Subspace Chronicles: How Linguistic Information Emerges, Shifts and Interacts during Language Model Training

Computer Science

• Domain Knowledge 50%
• Interpretability 50%
• Language Modeling 100%
• Learning Phase 50%
• Multitask Learning 50%
• Natural Language Processing 50%
• Performance Improvement 50%
• Reasoning Task 50%
• Share Information 100%
• Syntactics 50%
• Task Performance 50%

Keyphrases

• Critical Learning 50%
• Full Training 50%
• Learning Phase 50%
• Open-domain 50%
• Reasoning Tasks 50%
• Representational Space 50%
• Semantic Tasks 50%
• Syntactic Knowledge 50%

Psychology

• Domain Knowledge 100%
• Performance Task 100%
• Representational Space 100%