Publications

Lei Li, Yankai Lin, Xuancheng Ren, Guangxiang Zhao, Peng Li, Jie Zhou, Xu Sun (2022). Model Uncertainty-Aware Knowledge Amalgamation for Pre-Trained Language Models. Arixv.

PDF

Shuhuai Ren, Lei Li, Xuancheng Ren, Guangxiang Zhao, Xu Sun (2022). Rethinking the Openness of CLIP. Arxiv.

PDF

Lei Li, Yankai Lin, Shuhuai Ren, Peng Li, Jie Zhou, Xu Sun (2021). Dynamic Knowledge Distillation for Pre-trained Language Models. Main Conference, EMNLP 2021.

PDF Code

Lei Li, Yankai Lin, Deli Chen, Shuhuai Ren, Peng Li, Jie Zhou, Xu Sun (2021). CascadeBERT: Accelerating Inference of Pre-trained Language Models via Calibrated Complete Models Cascade. Findings of EMNLP 2021.

PDF Code

Hua Zheng, Lei Li, Damai Dai, Deli Chen, Tianyu Liu, Xu Sun, Yang Liu (2021). Leveraging Word-Formation Knowledge for Chinese Word Sense Disambiguation. Findings of EMNLP 2021.

PDF Code

Shuhuai Ren, Jinchao Zhang, Lei Li, Xu Sun, Jie Zhou (2021). Text AutoAugment: Learning Compositional Augmentation Policy for Text Classification. EMNLP 2021.

PDF Code

Yi Zhang, Lei Li, Yunfang Wu, Qi Su, Xu Sun (2021). Alleviating the Knowledge-Language Inconsistency: A Study for Deep Commonsense Knowledge. TASLP.

PDF DOI

Wenkai Yang, Lei Li, Zhiyuan Zhang, Xuancheng Ren, Xu Sun, Bin He (2021). Be Careful about Poisoned Word Embeddings: Exploring the Vulnerability of the Embedding Layers in NLP Models. NAACL-HLT 2021.

PDF Code

Hua Zheng, Damai Dai, Lei Li, Tianyu Liu, Zhifang Sui, Baobao Chang, Yang Liu (2021). Decompose, Fuse and Generate: A Formation-Informed Method for Chinese Definition Generation. NAACL-HLT 2021.

Pengcheng Yang*, Lei Li*, Fuli Luo, Tianyu Liu, Xu Sun (2019). Enhancing Topic-to-Essay Generation with External Commonsense Knowledge. ACL 2019.

PDF Code