Recent Advances in Natural Language Processing via Large Pre-trained Language Models: A Survey

Keyphrases

• Recent Advances 100%
• Natural Language Processing 100%
• Pre-trained Language Model 100%
• Large-scale Pre-trained Model 100%
• Generic Tasks 50%
• Processing Task 50%
• Task-based Approach 25%
• Extensive Training 25%
• Text Generation 25%
• Latent Representation 25%
• Art Performance 25%
• Model Driven Architecture 25%
• Language Modeling 25%
• Natural Language Processing Techniques 25%
• Generation Approach 25%
• Model Limitations 25%

Computer Science

• Natural Language Processing 100%
• Pre-Trained Language Models 100%
• Processing Task 33%
• Art Performance 16%
• Model Architecture 16%
• Fundamental Concept 16%
• Language Modeling 16%
• Bidirectional Encoder Representations From Transformers 16%
• Extensive Training 16%