TY - JOUR
T1 - Neurofeedback through the lens of reinforcement learning
AU - Lubianiker, Nitzan
AU - Paret, Christian
AU - Dayan, Peter
AU - Hendler, Talma
N1 - Publisher Copyright:
© 2022 Elsevier Ltd
PY - 2022/8
Y1 - 2022/8
N2 - Despite decades of experimental and clinical practice, the neuropsychological mechanisms underlying neurofeedback (NF) training remain obscure. NF is a unique form of reinforcement learning (RL) task, during which participants are provided with rewarding feedback regarding desired changes in neural patterns. However, key RL considerations – including choices during practice, prediction errors, credit-assignment problems, or the exploration–exploitation tradeoff – have infrequently been considered in the context of NF. We offer an RL-based framework for NF, describing different internal states, actions, and rewards in common NF protocols, thus fashioning new proposals for characterizing, predicting, and hastening the course of learning. In this way we hope to advance current understanding of neural regulation via NF, and ultimately to promote its effectiveness, personalization, and clinical utility.
AB - Despite decades of experimental and clinical practice, the neuropsychological mechanisms underlying neurofeedback (NF) training remain obscure. NF is a unique form of reinforcement learning (RL) task, during which participants are provided with rewarding feedback regarding desired changes in neural patterns. However, key RL considerations – including choices during practice, prediction errors, credit-assignment problems, or the exploration–exploitation tradeoff – have infrequently been considered in the context of NF. We offer an RL-based framework for NF, describing different internal states, actions, and rewards in common NF protocols, thus fashioning new proposals for characterizing, predicting, and hastening the course of learning. In this way we hope to advance current understanding of neural regulation via NF, and ultimately to promote its effectiveness, personalization, and clinical utility.
KW - BCI
KW - biofeedback
KW - computational psychology
KW - imagery
KW - metacognition
KW - neuromodulation
UR - https://www.scopus.com/pages/publications/85130010323
U2 - 10.1016/j.tins.2022.03.008
DO - 10.1016/j.tins.2022.03.008
M3 - ???researchoutput.researchoutputtypes.contributiontojournal.systematicreview???
C2 - 35550813
AN - SCOPUS:85130010323
SN - 0166-2236
VL - 45
SP - 579
EP - 593
JO - Trends in Neurosciences
JF - Trends in Neurosciences
IS - 8
ER -