Prompt-Distiller: Few-Shot Knowledge Distillation for Prompt-Based Language Learners with Dual Contrastive Learning.

Boyu Hou, Chengyu Wang, Xiaoqing Chen, Minghui Qiu, Liang Feng, Jun Huang

Browse the full ICASSP paper archive.