Avatar

Lei Li

Master Student

Peking University

About

Hi, I am a second-year master student at School of EECS, Peking University.

Currently, I am a member of Language Computing and Machine Learning Group (LANCO), advised by Prof. Xu Sun.

I am enthusiastic about Natural Lanuge Processing (NLP). My research focuses on applying machine learning techniques for improving the efficiency of pre-trained language models.

Interests

  • Efficient Methods for NLP
  • Knowledgeable NLP

Education

  • MSc in Computer Science, 2020 - 2023 (Expected)

    Peking University

  • BE in Software Engineering, 2016 - 2020

    Xidian University

Publications

Model Uncertainty-Aware Knowledge Amalgamation for Pre-Trained Language Models

As many fine-tuned pre-trained language models~(PLMs) with promising performance are generously released, investigating better ways to …

Rethinking the Openness of CLIP

Contrastive Language-Image Pre-training (CLIP) has demonstrated great potential in realizing open-vocabulary image classification in a …

Dynamic Knowledge Distillation for Pre-trained Language Models

Leveraging Word-Formation Knowledge for Chinese Word Sense Disambiguation