Emergent linguistic structure in artificial neural networks trained by self-supervision

Keyphrases

• Approximate Reconstruction 33%
• Artificial Neural Network 100%
• Contextual Language Models 33%
• Coreference 33%
• Engineering Work 33%
• Hierarchical Structure 66%
• Human Language 66%
• Language Acquisition 33%
• Language Communication 33%
• Language Comprehension 66%
• Latent Structure 33%
• Linear Transformation 33%
• Linguistic Structure 100%
• Linguists 33%
• Parse Tree 33%
• Self-supervision 100%
• Supervised Learning 33%
• Tree Distance 33%
• Tree Structure 33%
• Treebank 33%

Computer Science

• Artificial Neural Network 100%
• Engineering Work 33%
• Human Language 66%
• Language Modeling 33%
• Language Understanding 66%
• Latent Structure 33%
• Linear Transformation 33%
• Parse Tree 33%
• Supervised Learning 33%
• Syntactics 33%

Psychology

• Neural Network 100%