What is the accuracy of a popular online symptom checker for ophthalmic diagnoses?
In this vignette-based, cross-sectional study, the top 3 diagnoses generated by the online symptom checker included the correct diagnoses in 16 of 42 (38%) cases. A substantial number of diagnoses may not be captured.
This finding suggests that patients should exercise caution if depending on online symptom checkers to self-diagnosis ophthalmic conditions.
Because more patients are presenting with self-guided research of symptoms, it is important to assess the capabilities and limitations of these available health information tools.
To determine the accuracy of the most popular online symptom checker for ophthalmic diagnoses.
Design, Setting, and Participants
In a cross-sectional study, 42 validated clinical vignettes of ophthalmic symptoms were generated and distilled to their core presenting symptoms. Cases were entered into WebMD symptom checker by both medically trained and nonmedically trained personnel blinded to the diagnosis. Output from the symptom checker, including the number of symptoms, ranking and list of diagnoses, and triage urgency were recorded. The study was conducted on October 13, 2017. Analysis was performed between October 15, 2017, and April 30, 2018.
Main Outcomes and Measures
Accuracy of the top 3 diagnoses generated by the online symptom checker.
The mean (SD) number of symptoms entered was 3.6 (1.6) (range, 1-8). The median (SD) number of diagnoses generated by the symptom checker was 26.8 (21.8) (range, 1-99). The primary diagnosis by the symptom checker was correct in 11 of 42 (26%; 95% CI, 12%-40%) cases. The correct diagnosis was included in the online symptom checker's top 3 diagnoses in 16 of 42 (38%; 95% CI, 25%-56%) cases. The correct diagnosis was not included in the symptom checker's list in 18 of 42 (43%; 95% CI, 32%-63%) cases. Triage urgency based on the top diagnosis was appropriate in 7 of 18 (39%; 95% CI, 14%-64%) emergent cases and 21 of 24 (88%; 95% CI, 73%-100%) nonemergent cases. Interuser variability for the correct diagnosis being in the top 3 listed was at least moderate (Cohen κ = 0.74; 95% CI, 0.54-0.95).
Conclusions and Relevance
The most popular online symptom checker may arrive at the correct clinical diagnosis for ophthalmic conditions, but a substantial proportion of diagnoses may not be captured. These findings suggest that further research to reflect the real-life application of internet diagnostic resources is required.
Shen C, Nguyen M, Gregor A, Isaza G, Beattie A. Accuracy of a Popular Online Symptom Checker for Ophthalmic Diagnoses. JAMA Ophthalmol. Published online April 11, 2019137(6):690–692. doi:10.1001/jamaophthalmol.2019.0571
Browse and subscribe to JAMA Network podcasts!
Customize your JAMA Network experience by selecting one or more topics from the list below.
Create a personal account or sign in to: