TY - JOUR
T1 - Responsible Design, Integration, and Use of Generative AI in Mental Health
AU - Asman, Oren
AU - Torous, John
AU - Tal, Amir
N1 - Publisher Copyright:
© Oren Asman, John Torous, Amir Tal.
PY - 2025
Y1 - 2025
N2 - Generative artificial intelligence (GenAI) shows potential for personalized care, psychoeducation, and even crisis prediction in mental health, yet responsible use requires ethical consideration and deliberation and perhaps even governance. This is the first published theme issue focused on responsible GenAI in mental health. It brings together evidence and insights on GenAI’s capabilities, such as emotion recognition, therapy-session summarization, and risk assessment, while highlighting the sensitive nature of mental health data and the need for rigorous validation. Contributors discuss how bias, alignment with human values, transparency, and empathy must be carefully addressed to ensure ethically grounded, artificial intelligence–assisted care. By proposing conceptual frameworks; best practices; and regulatory approaches, including ethics of care and the preservation of socially important humanistic elements, this theme issue underscores that GenAI can complement, rather than replace, the vital role of human empathy in clinical settings. To achieve this, an ongoing collaboration between researchers, clinicians, policy makers, and technologists is essential.
AB - Generative artificial intelligence (GenAI) shows potential for personalized care, psychoeducation, and even crisis prediction in mental health, yet responsible use requires ethical consideration and deliberation and perhaps even governance. This is the first published theme issue focused on responsible GenAI in mental health. It brings together evidence and insights on GenAI’s capabilities, such as emotion recognition, therapy-session summarization, and risk assessment, while highlighting the sensitive nature of mental health data and the need for rigorous validation. Contributors discuss how bias, alignment with human values, transparency, and empathy must be carefully addressed to ensure ethically grounded, artificial intelligence–assisted care. By proposing conceptual frameworks; best practices; and regulatory approaches, including ethics of care and the preservation of socially important humanistic elements, this theme issue underscores that GenAI can complement, rather than replace, the vital role of human empathy in clinical settings. To achieve this, an ongoing collaboration between researchers, clinicians, policy makers, and technologists is essential.
KW - AI ethics
KW - artificial intelligence
KW - digital mental health ethics
KW - large language model
KW - model alignment
KW - responsible AI in medicine
UR - http://www.scopus.com/inward/record.url?scp=85217656940&partnerID=8YFLogxK
U2 - 10.2196/70439
DO - 10.2196/70439
M3 - ???researchoutput.researchoutputtypes.contributiontojournal.systematicreview???
C2 - 39864170
AN - SCOPUS:85217656940
SN - 2368-7959
VL - 12
JO - JMIR Mental Health
JF - JMIR Mental Health
M1 - e70439
ER -