Frustratingly Easy Performance Improvements for Low-resource Setups: A Tale on BERT and Segment Embeddings

Keyphrases

• Performance Improvement 100%
• Low-resource 100%
• Segment Embeddings 100%
• BERT Embeddings 100%
• Word Embedding 33%
• Position Embedding 33%
• Training Tasks 16%
• Treebank 16%
• Dependency Parsing 16%
• Performance Prediction 16%
• Subword 16%
• Word-level 16%
• Multilingual BERT 16%
• Classification Task 16%
• Prediction Task 16%
• Lexical Words 16%
• Input Representation 16%
• Default Settings 16%
• Sentence Prediction 16%
• Lexical Information 16%
• Embedding Position 16%

Computer Science

• Bidirectional Encoder Representations From Transformers 100%
• Performance Improvement 100%
• Word Embedding 50%
• Syntactics 25%
• dependency parse 25%
• Classification Task 25%
• Prediction Performance 25%
• Lexical Information 25%
• Embedding Position 25%

Social Sciences

• Bidirectional Encoder Representations From Transformers 100%
• Parsing 25%
• Word Embedding 25%
• Syntax 25%