Skip to main navigation Skip to search Skip to main content

The Role of AI-Generated Clinical Image Descriptions in Enhancing Teledermatology Diagnosis: A Cross-Sectional Exploratory Study

  • Jonathan Shapiro*
  • , Binyamin Greenfield
  • , Itay Cohen
  • , Roni P. Dodiuk-Gad
  • , Yuliya Valdman-Grinshpoun
  • , Tamar Freud
  • , Anna Lyakhovitsky
  • , Ziad Khamaysi
  • , Emily Avitan-Hersh
  • *Corresponding author for this work
  • Maccabi Healthcare Services
  • Department of Dermatology
  • Rambam Health Care Campus Israel
  • Rutgers - The State University of New Jersey, New Brunswick
  • Technion-Israel Institute of Technology
  • Department of Dermatology
  • Emek Medical Center
  • University of Toronto
  • Department of Dermatology
  • Soroka Medical Center
  • Department of Family Medicine
  • The Haim Doron Division of Community Health
  • Sheba Medical Center at Tel Hashomer
  • Ben-Gurion University of the Negev

Research output: Contribution to journal › Article › peer-review

1 Scopus citations

Abstract

Background/Objectives: AI models such as ChatGPT-4 have shown strong performance in dermatology; however, the diagnostic value of AI-generated clinical image descriptions remains underexplored. This study assesses whether ChatGPT-4’s image descriptions can support accurate dermatologic diagnosis and evaluates their potential integration into the Electronic Medical Record (EMR) system. Materials & Methods: In this Exploratory cross-sectional study, we analyzed images and descriptions from teledermatology consultations conducted between December 2023 and February 2024. ChatGPT-4 generated clinical descriptions for each image, which two senior dermatologists then used to formulate differential diagnoses. Diagnoses based on ChatGPT-4’s output were compared to those derived from the original clinical notes written by teledermatologists. Concordance was categorized as Top1 (exact match), Top3 (correct within top three), Partial, or No match. Results: The study included 154 image descriptions from 67 male and 87 female patients, aged 0 to 93 years. ChatGPT-4 descriptions averaged 74.3 ± 33.1 words, compared to 7.9 ± 3.0 words for teledermatologists. At least one of the two dermatologists achieved a Top 3 concordance rate of 82.5% using ChatGPT-4’s descriptions and 85.3% with teledermatologist descriptions. Conclusions: Preliminary findings highlight the potential integration of ChatGPT-4-generated descriptions into EMRs to enhance documentation. Although AI descriptions were longer, they did not enhance diagnostic accuracy, and expert validation remained essential.

Original languageEnglish
Article number384
JournalDiagnostics
Volume16
Issue number3
DOIs
StatePublished - Feb 2026

Keywords

  • ChatGPT
  • Large Multimodal Models (LMMs)
  • artificial intelligence in medicine
  • automated clinical documentation
  • diagnostic concordance
  • generative AI
  • image description
  • teledermatology

Fingerprint

Dive into the research topics of 'The Role of AI-Generated Clinical Image Descriptions in Enhancing Teledermatology Diagnosis: A Cross-Sectional Exploratory Study'. Together they form a unique fingerprint.

Cite this