Ran Gu, Benjamin Hou, Mélanie Hébert, Asmita Indurkar, Yifan Yang, Emily Y Chew, Tiarnán D L Keenan, Zhiyong Lu
OcularChat gives the potential to support clinician-supervised, interpretable AMD image review, research annotation, and education, requiring prospective validation before clinical deployment.
PURPOSE: To evaluate OcularChat, an age-related macular degeneration (AMD)-specific multimodal large language model for interpreting color fundus photographs.
METHODS: A general-purpose multimodal large language model was fine-tuned using 705,850 simulated patient-physician dialogues paired with 46,167 AREDS images, then tested on separate AREDS and AREDS2 datasets.
RESULTS: In AREDS, OcularChat correctly classified advanced AMD, pigmentary abnormalities, and drusen size in 95.4%, 84.9%, and 67.8% of images, respectively. Retina specialists rated its responses more highly than those of the same model without fine-tuning.
CONCLUSIONS: OcularChat gives the potential to support clinician-supervised, interpretable AMD image review, research annotation, and education, requiring prospective validation before clinical deployment.