Dissecting Recall of Factual Associations in Auto-Regressive Language Models

Keyphrases

• Subject Position 100%
• Language Model 100%
• Information Flow 50%
• Enrichment Method 50%
• Factual Knowledge 50%
• Process-based 50%
• Internal Mechanism 50%
• Transformer-based Language Models 50%
• Subject Relations 50%
• Attribute Mapping 50%
• Knowledge Localization 50%
• Attribute Extraction 50%

Computer Science

• Language Modeling 100%
• Subject Position 66%
• Related Attribute 33%
• Critical Point 33%
• Aggregate Model 33%
• Factual Knowledge 33%
• Attribute Mapping 33%