Visible to the public A Survey on Few-Shot Learning in Natural Language Processing

TitleA Survey on Few-Shot Learning in Natural Language Processing
Publication TypeConference Paper
Year of Publication2021
AuthorsYang, Mengde
Conference Name2021 International Conference on Artificial Intelligence and Electromechanical Automation (AIEA)
KeywordsAutomation, Computer vision, Costs, distant supervision, Few-shot learning, Human Behavior, learning (artificial intelligence), Meta Learning, natural language processing, pubcrawl, resilience, Resiliency, Scalability, Systematics, transfer learning
AbstractThe annotated dataset is the foundation for Supervised Natural Language Processing. However, the cost of obtaining dataset is high. In recent years, the Few-Shot Learning has gradually attracted the attention of researchers. From the definition, in this paper, we conclude the difference in Few-Shot Learning between Natural Language Processing and Computer Vision. On that basis, the current Few-Shot Learning on Natural Language Processing is summarized, including Transfer Learning, Meta Learning and Knowledge Distillation. Furthermore, we conclude the solutions to Few-Shot Learning in Natural Language Processing, such as the method based on Distant Supervision, Meta Learning and Knowledge Distillation. Finally, we present the challenges facing Few-Shot Learning in Natural Language Processing.
DOI10.1109/AIEA53260.2021.00069
Citation Keyyang_survey_2021