[Skip to Content]
Access to paid content on this site is currently suspended due to excessive activity being detected from your IP address 18.206.12.79. Please contact the publisher to request reinstatement.
[Skip to Content Landing]
Users' Guides to the Medical Literature
November 12, 2019

How to Read Articles That Use Machine Learning: Users’ Guides to the Medical Literature

Author Affiliations
  • 1Google Health, Palo Alto, California
JAMA. 2019;322(18):1806-1816. doi:10.1001/jama.2019.16489
Abstract

In recent years, many new clinical diagnostic tools have been developed using complicated machine learning methods. Irrespective of how a diagnostic tool is derived, it must be evaluated using a 3-step process of deriving, validating, and establishing the clinical effectiveness of the tool. Machine learning–based tools should also be assessed for the type of machine learning model used and its appropriateness for the input data type and data set size. Machine learning models also generally have additional prespecified settings called hyperparameters, which must be tuned on a data set independent of the validation set. On the validation set, the outcome against which the model is evaluated is termed the reference standard. The rigor of the reference standard must be assessed, such as against a universally accepted gold standard or expert grading.

×