Prognostication is an important aspect of clinical decision-making, but it is often challenging. Previous studies show that both patients and physicians tend to overestimate survival chances. Prediction models may assist in estimating and quantifying prognosis. However, insufficient understanding of the development, possibilities, and limitations of such models can lead to misinterpretations. Although many excellent books and comprehensive methodological articles on prognostic model research are published, they may not be accessible enough for the clinical audience. Our aim is to provide an overview on the main issues regarding prediction research for health care professionals to achieve better interpretation and increase the use of prognostic models in daily clinical practice.
The first steps of model development include coding of predictors, model specification, and estimation. Next, we discuss the assessment of the performance of a prediction model, including discrimination and calibration aspects, followed by approaches to internal and external validation and updating. Finally, model reporting, presentation, and steps toward clinical implementation are presented.
Conclusions and Relevance
After thorough consideration of the research question, data inspection, and coding of predictors, one can start with the specification of a prediction model. The number of candidate predictors should be kept limited, in view of the number of events in the data, to prevent overfitting. Calibration and discrimination are 2 aspects of model performance that complement each other and should be assessed preferably at external validation. Model development should be accompanied by qualitative research among patients and physicians to facilitate the development of a valuable tool and maximize possibilities for successful implementation. After model presentation is optimized, impact studies are required to assess the clinical value of a prediction model.
Identify all potential conflicts of interest that might be relevant to your comment.
Conflicts of interest comprise financial interests, activities, and relationships within the past 3 years including but not limited to employment, affiliation, grants or funding, consultancies, honoraria or payment, speaker's bureaus, stock ownership or options, expert testimony, royalties, donation of medical equipment, or patents planned, pending, or issued.
Err on the side of full disclosure.
If you have no conflicts of interest, check "No potential conflicts of interest" in the box below. The information will be posted with your response.
Not all submitted comments are published. Please see our commenting policy for details.
Hoesseini A, van Leeuwen N, Sewnaik A, et al. Key Aspects of Prognostic Model Development and Interpretation From a Clinical Perspective. JAMA Otolaryngol Head Neck Surg. Published online December 09, 2021. doi:10.1001/jamaoto.2021.3505
Coronavirus Resource Center
Customize your JAMA Network experience by selecting one or more topics from the list below.