Revealing the Dark Secrets of BERT

Keyphrases

• Attention Patterns 100%
• Handcrafted Features 50%
• Performance Improvement 50%
• Impact Performance 50%
• Art Performance 50%
• Self-attention 50%
• Fine-tuned BERT Model 50%
• Overparametrization 50%
• NLP Tasks 50%

Computer Science

• Bidirectional Encoder Representations From Transformers 100%
• Art Performance 20%
• Performance Improvement 20%

Psychology

• Performance Art 100%