Understanding Transformer Memorization Recall Through Idioms

Keyphrases

• Transformer 100%
• Memorization 100%
• Memory Recall 50%
• Transformer-based Language Models 50%
• Behavioral Model 25%
• Probability Distribution 25%
• Upper Layer 25%
• Prediction Accuracy 25%
• Methodological Framework 25%
• Methodological Basis 25%
• Token 25%
• English Use 25%
• Step Processes 25%
• Output Distribution 25%
• Language Model 25%
• Model Size 25%
• Model Driven Architecture 25%
• Gradual Refinement 25%
• Construction Process 25%
• Hidden Representation 25%
• Model Confidence 25%
• Internal Prediction 25%
• English Idioms 25%
• Distribution Layer 25%

Computer Science

• Transformer Language Model 100%
• Behavior Model 50%
• Output Probability 50%
• Language Modeling 50%
• Construction Process 50%

Psychology

• Probability Distribution 100%