Convolutional neural networks uncover the dynamics of human visual memory representations over time

Eden Zohar, Stas Kozak, Dekel Abeles, Moni Shahar, Nitzan Censor*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

The ability to accurately retrieve visual details of past events is a fundamental cognitive function relevant for daily life. While a visual stimulus contains an abundance of information, only some of it is later encoded into long-term memory representations. However, an ongoing challenge has been to isolate memory representations that integrate various visual features and uncover their dynamics over time. To address this question, we leveraged a novel combination of empirical and computational frameworks based on the hierarchal structure of convolutional neural networks and their correspondence to human visual processing. This enabled to reveal the contribution of different levels of visual representations to memory strength and their dynamics over time. Visual memory strength was measured with distractors selected based on their shared similarity to the target memory along low or high layers of the convolutional neural network hierarchy. The results show that visual working memory relies similarly on low and high-level visual representations. However, already after a few minutes and on to the next day, visual memory relies more strongly on high-level visual representations. These findings suggest that visual representations transform from a distributed to a stronger high-level conceptual representation, providing novel insights into the dynamics of visual memory over time.

Original languageEnglish
Article number447
JournalCerebral Cortex
Volume34
Issue number11
DOIs
StatePublished - 1 Nov 2024

Keywords

  • consolidation
  • convolutional neural networks (CNNs)
  • long-term memory
  • visual memory
  • working memory

Fingerprint

Dive into the research topics of 'Convolutional neural networks uncover the dynamics of human visual memory representations over time'. Together they form a unique fingerprint.

Cite this