Publications

Lei Li, Yankai Lin, Shuhuai Ren, Peng Li, Jie Zhou, Xu Sun (2021). Dynamic Knowledge Distillation for Pre-trained Language Models. Main Conference, EMNLP 2021.

PDF Code

Lei Li, Yankai Lin, Deli Chen, Shuhuai Ren, Peng Li, Jie Zhou, Xu Sun (2021). CascadeBERT: Accelerating Inference of Pre-trained Language Models via Calibrated Complete Models Cascade. Findings of EMNLP 2021.

PDF Code

Hua Zheng*, Lei Li* (Equal Contribution), Damai Dai, Deli Chen, Tianyu Liu, Xu Sun, Yang Liu (2021). Leveraging Word-Formation Knowledge for Chinese Word Sense Disambiguation. Findings of EMNLP 2021.

Code

Shuhuai Ren, Jinchao Zhang, Lei Li, Xu Sun, Jie Zhou (2021). Text AutoAugment: Learning Compositional Augmentation Policy for Text Classification. EMNLP 2021.

PDF Code

Yi Zhang*, Lei Li* (Equal Contribution), Yunfang Wu, Qi Su, Xu Sun (2021). Alleviating the Knowledge-Language Inconsistency: A Study for Deep Commonsense Knowledge. Preprint.

PDF

Wenkai Yang, Lei Li, Zhiyuan Zhang, Xuancheng Ren, Xu Sun, Bin He (2021). Be Careful about Poisoned Word Embeddings: Exploring the Vulnerability of the Embedding Layers in NLP Models. NAACL-HLT 2021.

PDF Code

Hua Zheng, Damai Dai, Lei Li, Tianyu Liu, Zhifang Sui, Baobao Chang, Yang Liu (2021). Decompose, Fuse and Generate: A Formation-Informed Method for Chinese Definition Generation. NAACL-HLT 2021.

Pengcheng Yang*, Lei Li* (Equal Contribution), Fuli Luo, Tianyu Liu, Xu Sun (2019). Enhancing Topic-to-Essay Generation with External Commonsense Knowledge. ACL 2019.

PDF Code