Key PointsQuestion
Is the intensity of the diagnostic evaluation of incidentally detected lung nodules associated with patient outcomes and health expenditures?
Findings
In this comparative effectiveness research study of 5057 individuals with an incidentally detected lung nodule, evidence of an association between evaluation intensity and lung cancer stage distribution was inconclusive. Compared with guideline-concordant evaluations, less intensive evaluations were associated with less radiation exposure, fewer procedure-related adverse events, and lower health expenditures, whereas more intensive evaluations were associated with greater radiation exposure, more procedure-related adverse events, and higher health expenditures.
Meaning
Findings from this study underscore the need to increase the level of evidence that supports current guideline recommendations and to decrease unnecessarily intensive diagnostic evaluations of lung nodules.
Importance
Whether guideline-concordant lung nodule evaluations lead to better outcomes remains unknown.
Objective
To examine the association between the intensity of lung nodule diagnostic evaluations and outcomes, safety, and health expenditures.
Design, Setting, and Participants
This comparative effectiveness research study analyzed health plan enrollees at Kaiser Permanente Washington in Seattle, Washington, and Marshfield Clinic in Marshfield, Wisconsin, with an incidental lung nodule detected between January 1, 2005, and December 31, 2015. Included patients were 35 years or older, had no high suspicion of infection, had no history of malignant neoplasm, and had no evidence of advanced lung cancer on nodule detection. Data analysis was conducted from January 7 to August 19, 2020.
Exposures
With the 2005 Fleischner Society guidelines (selected for their applicability to the time frame under investigation) as the comparator, 2 other intensities of lung nodule evaluation were defined. Guideline-concordant evaluation followed the guidelines. Less intensive evaluation was the absence of recommended testing, longer-than-recommended surveillance intervals, or less invasive testing than recommended. More intensive evaluation consisted of testing when the guidelines recommended no further testing, shorter-than-recommended surveillance intervals, or more invasive testing than recommended.
Main Outcomes and Measures
The main outcome was the proportion of patients with lung cancer who had stage III or IV disease, radiation exposure, procedure-related adverse events, and health expenditures 2 years after nodule detection.
Results
Among the 5057 individuals included in this comparative effectiveness research study, 1925 (38%) received guideline-concordant, 1863 (37%) less intensive, and 1269 (25%) more intensive diagnostic evaluations. The entire cohort comprised 2786 female patients (55%), and the mean (SD) age was 67 (13) years. Adjusted analyses showed that compared with guideline-concordant evaluations, less intensive evaluations were associated with fewer procedure-related adverse events (risk difference [RD], −5.9%; 95% CI, −7.2% to −4.6%), lower mean radiation exposure (−9.5 milliSieverts [mSv]; 95% CI, −10.3 mSv to −8.7 mSv), and lower mean health expenditures (−$10 916; 95% CI, −$16 112 to −$5719); no difference in stage III or IV disease was found among patients diagnosed with lung cancer (RD, 4.6%; 95% CI, −22% to +31%). More intensive evaluations were associated with more procedure-related adverse events (RD, +8.1%; 95% CI, +5.6% to +11%), higher mean radiation exposure (+6.8 mSv; 95% CI, +5.8 mSv to +7.8 mSv), and higher mean health expenditures ($20 132; 95% CI, +$14 398 to +$25 868); no difference in stage III or IV disease was observed (RD, −0.5%; 95% CI, −28% to +27%).
Conclusions and Relevance
This study found inconclusive evidence of an association between less intensive diagnostic evaluations and more advanced stage at lung cancer diagnosis compared with guideline-concordant care; higher intensities of diagnostic evaluations were associated with greater procedural complications, radiation exposure, and expenditures. These findings underscore the need for more evidence on better ways to evaluate lung nodules and to avoid unnecessarily intensive diagnostic evaluations of lung nodules.
Each year in the United States, the incidental detection of a lung nodule by computed tomography (CT) occurs in approximately 1.6 million people.1 Lung cancer is the main concern in such detections,2,3 but only 5% to 10% of individuals with nodules have cancer.1,4 Clinicians must balance the benefits of prompt lung cancer identification with the risks and costs of diagnostic testing.
Practice guidelines recommend using varying intensities of diagnostic evaluation for lung nodules that are based on an individual’s underlying lung cancer risk factors (eg, smoking) and nodule characteristics (eg, size).5,6 Rates of guideline-concordant evaluations vary from 39% to 67% across different practice environments.4,7,8 Barriers to adopting guideline-concordant nodule care exist at the patient, clinician, and health system levels, leading to calls for multilevel interventions that increase guideline-concordant practices.2,4,9-12 The benefits of such interventions are unclear because of the low levels of evidence supporting guideline recommendations and because the association between guideline-concordant care and outcomes has not been demonstrated.5,6,10
In this comparative effectiveness research study, we examined the observed patterns of care that reflect the association between the intensity of lung nodule diagnostic evaluations and outcomes, safety, and health expenditures. We hypothesized that, compared with guideline-concordant care, (1) less intensive evaluations would be associated with a higher risk of stage III or IV disease among patients with lung cancer and higher health expenditures (because costs are higher in advanced-stage cancers13,14) and (2) more intensive evaluations would be associated with greater radiation exposure, more procedure-related adverse events (AEs), and higher health expenditures without a difference in stage III or IV disease.
We conducted a retrospective comparative effectiveness research study of health plan enrollees at Kaiser Permanente Washington in Seattle, Washington, and Marshfield Clinic in Marshfield, Wisconsin, who had an incidentally detected lung nodule between January 1, 2005, and December 31, 2015. Institutional review boards at the collaborating institutions ceded oversight to Kaiser Permanente Washington, which approved the study and waived individual informed consent. We followed the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) reporting guidelines (eTable 2 in the Supplement).15
To be included in the study, individuals needed to be enrolled in the health plan for at least 2 years after nodule detection or enrolled until death, whichever occurred first. The data source was a collaborative model implemented in health systems across the United States that provides harmonized information on demographic characteristics, smoking status, health care utilization, cancer characteristics, enrollment status, and vital status as well as access to an electronic health record.16 To identify individuals with a lung nodule, we used (1) International Classification of Diseases, Ninth Revision (ICD-9), International Statistical Classification of Diseases and Related Health Problems, Tenth Revision (ICD-10), and Current Procedural Terminology (CPT) codes to ascertain which individuals underwent chest CT; (2) natural language processing to find individuals whose incidentally detected lung nodule was documented in free-text radiology reports1,17; and (3) trained medical record abstractors to confirm the documentation of the nodule in the free-text radiology report.18
We used the 2005 Fleischner Society guidelines for managing small pulmonary nodules that were detected on CT scans5 to define guideline concordance because these guidelines were applicable to the time frame under investigation in this study. These 2005 guidelines recommended up to 2 years of periodic follow-up for individuals who were 35 years or older, had no high suspicion of infection, had no history of malignant neoplasm, and had no evidence of advanced lung cancer on nodule detection (exclusions are shown in eTable 1 in the Supplement).5
Intensity of Nodule Evaluation and Lung Cancer Diagnosis
We defined the intensities of nodule diagnostic evaluation using the first diagnostic step recommended by the 2005 Fleischner Society guidelines5 (eTable 3 in the Supplement) as the comparator. Such guidelines stratify individuals on the basis of nodule size and smoking history followed by strata-specific diagnostic recommendations, including no further follow-up, chest CT at established time intervals, positron emission tomography (PET), or biopsy. We defined less intensive evaluation as the absence of recommended testing, a longer-than-recommended surveillance interval (delays in testing), or less invasive testing than recommended (use of chest CT instead of PET or biopsy). More intensive evaluation was defined as testing when the guidelines recommended no further testing, a shorter-than-recommended surveillance interval for chest CT, or more invasive testing than recommended (use of PET or biopsy instead of CT) (eMethods in the Supplement). To provide some allowance for scheduling preferences, we considered deviations from recommended testing intervals of up to 1 month to be guideline concordant.
To identify individuals who were diagnosed with lung cancer within 2 years after nodule detection, we used validated tumor registry data (eMethods in the Supplement). Because cancer registries assign a diagnosis date on the basis of first evidence of disease, which in some cases could be the lung nodule detection date, we used the date of pathological confirmation in the medical records to ensure a consistent date of diagnosis across patients, sites, and time. For cases without pathological specimens, we reviewed the electronic health record to establish the first date that a clinician documented findings suspicious for lung cancer with associated recommendations for treatment or best supportive care. Because more intensive evaluations may lead to overdiagnosis, we examined the associations between the intensity of nodule evaluation and the proportion of patients with lung cancer who had stage III or IV disease at diagnosis.
Radiation Exposure, Procedure-Related AEs, and Health Expenditures
We used ICD-9, ICD-10, and CPT codes to ascertain the use of CT and PET after nodule detection through the end of follow-up or until lung cancer diagnosis, whichever occurred first and independent of the evaluation intensity. We estimated radiation exposure for each patient by multiplying the number of CTs and PETs within the 2 years after nodule detection by modality-specific mean doses for these examinations (eTable 5 in the Supplement).19
We used ICD-9, ICD-10, and CPT codes to identify procedure-related AEs after nodule detection and through the end of follow-up or until lung cancer diagnosis, whichever occurred first and independent of the evaluation intensity. Because lung cancer guidelines recommend investigation of nonpulmonary findings suspicious for cancer spread (eg, nodal, pericardial, pleural, or extrathoracic metastases) before lung biopsy when possible,20-23 we used a broad set of percutaneous, endoscopic, and surgical procedures to define biopsies (eMethods in the Supplement). We measured procedure-related AEs against previously reported definitions.24-30
With a payer perspective, we estimated total health expenditures for each individual using a previously validated algorithm that measured health care utilization.31 The time horizon was 2 years or until death regardless of lung cancer diagnosis. We adjusted expenditures for inflation using the Consumer Price Index for medical care in 2017.32,33
We selected, a priori, 13 potential confounders on the basis of their known or suspected associations with the intensity of nodule evaluation and/or outcomes.4,34 Information was readily available on age, sex, race and ethnicity, smoking status, health system, and nodule detection year. Enrollees self-reported their race using a minimum of 5 categories and their ethnicity using at least 2 categories, as recommended by the National Institutes of Health. These variables were included in the risk-adjustment model to account for the potential confounding effects of racial and ethnic inequality in the United States. We used information during the year before nodule detection to calculate the Klabunde-modified comorbidity index.35 In addition, we used information 6 months before nodule detection to measure the probability of frailty with a validated algorithm, and we dichotomized the variable using a previously defined threshold probability.36,37 Trained medical record abstractors recorded the size of the dominant nodule, number of nodules, and whether the radiologist suspected an infectious cause or recommended follow-up as documented in the free-text radiology reports.
We described patient characteristics and outcomes using univariate descriptive statistics that estimated 95% CIs with the Wald method in R package DescTools, MultinomCI function (R Foundation for Statistical Computing). Next, anticipating few events relative to the number of covariates, we performed propensity score–adjusted regression analyses to address confounding.38 We developed 2 propensity score models using all 13 potential confounders, with 1 model estimating less intensive vs guideline-concordant nodule evaluations and the other estimating more intensive vs guideline-concordant nodule evaluations. We created outcome-specific regression models with 2 classes of independent variables: (1) an indicator for the intensity of nodule evaluation and (2) the fitted propensity score using a natural spline with knots identified by observed quartiles. This approach results in a desirable balance between low bias and power.39 We used logistic regression for comparisons of cancer stage and procedure-related AEs. To obtain adjusted risk-differences (RDs) for binary outcomes, we used marginal standardization.40 The primary analysis that compared cancer stage across exposure groups was restricted to patients diagnosed with lung cancer.
Recognizing that individuals with lung nodules can experience several different outcomes after nodule detection, we conducted a planned sensitivity analysis using multinomial regression for the entire cohort. We used linear regression for radiation exposure and health expenditures.41 Analyses were case complete because of the low frequency of missing data (3.4% for covariates, 0.1% for exposure, and 0% for outcomes and costs). The sample size was fixed as a consequence of the study design.
We used R statistical software, version 3.5.0 (R Foundation for Statistical Computing) for all analyses.42 Data analysis was conducted from January 7 to August 19, 2020.
Among 5057 individuals with an incidentally detected lung nodule, 1925 (38%) received guideline-concordant, 1863 (37%) received less intensive, and 1269 (25%) received more intensive diagnostic evaluations. Overall, the entire cohort comprised 2786 female (55%) and 2271 male (45%) patients, with a mean (SD) age of 67 (13) years (Table 1). Baseline characteristics varied across groups, although absolute differences tended to be less than 5% for most variables (Table 1). The less intensive evaluation group had the highest frequency of individuals who were 85 years or older (n = 201 [11%]), frail (n = 393 [21%]), or smokers (n = 1254 [67%]). Mean (SD) use of imaging (0.5 [0.9] vs 2.0 [1.5]) and invasive diagnostic procedures (0.03 [0.3] vs 0.4 [1.6]) was lowest for the less intensive evaluation group and was highest for the more intensive evaluation group (eTable 4 in the Supplement).
The proportion of individuals diagnosed with lung cancer according to the intensity of diagnostic evaluation was 8% (95% CI, 7%-9%) for the guideline-concordant, 1% (95% CI, 1%-1%) for the less intensive evaluation, and 2% (95% CI, 1%-3%) for the more intensive evaluation groups (Table 2). Median time to diagnosis of lung cancer by intensity of diagnostic evaluation was 1.3 months for the guideline-concordant, 12 months for the less intensive evaluation, and 2.3 months for the more intensive evaluation groups (Figure, A and eTable 6 in the Supplement). Time-to-diagnosis patterns were similar in subgroups defined by lung cancer stage (Figure, B and C), with a longer time to diagnosis among patients with less intensive evaluations.
Among patients with lung cancer, the frequency of stage III or IV disease by intensity of diagnostic evaluation was 42% (95% CI, 34%-50%; n = 63) for guideline-concordant, 47% (95% CI, 23%-71%; n = 8) for less intensive evaluation, and 43% (95% CI, 25%-61%; n = 12) for more intensive evaluation groups. The adjusted absolute difference in stage III or IV disease between the less intensive evaluation and guideline-concordant groups was not statistically significant (RD, 4.6%; 95% CI, −22% to +31%) (Table 3). No meaningful differences in the risk of stage III or IV disease were observed between the more intensive evaluation and guideline-concordant groups (RD, −0.5%; 95% CI, −28% to +27%). A sensitivity analysis using propensity score–adjusted multinomial models that accounted for all possible outcomes experienced by the entire cohort (with stage I or II lung cancer, with stage III or IV lung cancer, without lung cancer at 2 years, or died within 2 years without lung cancer) revealed no statistically significant difference in the relative risk (RR) of stage III or IV vs stage I or II disease in the comparison between the less intensive and guideline-concordant groups (RR, 1.21; 95% CI, 0.44-3.34) or between the more intensive evaluation and guideline-concordant groups (RR, 1.01; 95% CI, 0.40-2.52).
Unadjusted radiation exposure, rates of procedure-related AEs, and health care expenditures are shown in Table 2 by intensity of diagnostic evaluation. After adjustment (Table 3 and Table 4) and compared with guideline-concordant evaluation, less intensive evaluations were associated with significantly fewer procedure-related AEs (RD, −5.9%; 95% CI, −7.2% to −4.6%), lower mean radiation exposure (−9.5 milliSieverts [mSv]; 95% CI, −10.3 mSv to −8.7 mSv), and lower mean health expenditures (−$10 916; 95% CI, −$16 112 to −$5719). Meanwhile, more intensive evaluations were associated with more procedure-related AEs (RD, +8.1%; 95% CI, +5.6% to +11%), higher mean radiation exposure (+6.8 mSv; 95% CI, +5.8 mSv to +7.8 mSv), and higher mean health expenditures ($20 132; 95% CI, +$14 398 to +$25 868). A post hoc analysis of patients who experienced procedure-related AEs revealed that most patients (72%; 95% CI, 67%-77%) did not have a lung cancer diagnosis 2 years after nodule detection (eTable 7 in the Supplement).
We assessed the association between varying intensities of diagnostic evaluations and 2-year patient outcomes and health expenditures for patients with incidentally detected lung nodules. We found inconclusive evidence of an association between the intensity of diagnostic evaluations and advanced stage of lung cancer at diagnosis. Higher-intensity diagnostic evaluations were associated with greater radiation exposure, more procedure-related AEs, and higher health care expenditures.
We designed this comparative effectiveness research study under the assumption that the proportion of lung cancer diagnoses would be largely invariant across different groups of diagnostic evaluation intensity. The reason for this assumption was that the intensity of nodule evaluation generally impacts the cancer stage at diagnosis but not the frequency of lung cancer diagnoses. Unlike after screening, at the time of nodule detection the patient either has or does not have lung cancer (ie, the nodule represents cancer or a benign condition). To the extent that overdiagnoses occur, we recognized the likelihood of an excess of stage I lung cancers in the guideline-concordant and more intensive evaluation groups. For this reason, we compared the proportion of stage III or IV lung cancers across intensity groups. However, we unexpectedly observed a substantially higher proportion of lung cancer diagnoses in the guideline-concordant group than in the less intensive evaluation and more intensive evaluation groups—a pattern that was highly suggestive of confounding. A recently published study showed a similar pattern of variation in the proportion of lung cancer diagnoses by diagnostic evaluation intensity (0 for less intensive evaluation, 42% for guideline-concordant, and 15% for more intensive evaluation groups).8 That previous study showed that specialists deviated from guidelines if they thought the probability of lung cancer was low on the basis of radiographic characteristics (eg, edge characteristics or density), the patient had an indolent form of lung cancer on the basis of radiographic features of the nodule (eg, ground-glass opacity), and/or the patient had an equal or more likely alternative diagnosis for the nodule (eg, sarcoid).8 Although we were able to adjust for factors, such as age, comorbidity, frailty, smoking status, and nodule size, that might have changed the intensity of nodule evaluation, we were unable to measure other factors that may have altered clinicians’ estimate of the probability of lung cancer (eg, nodule density). We believe that confounding by indication likely explains the variable proportion of lung cancer diagnoses across intensity groups.
To address this confounding, we restricted the primary analysis to the subgroup of patients with lung cancer. As a consequence of a substantially smaller sample size, we likely had insufficient power to detect small but clinically important differences in the frequency of stage III or IV lung cancer across intensity groups. Despite these null results, we observed a median time to diagnosis of 12 months among patients in the less intensive evaluation group who were ultimately diagnosed with stage III or IV disease. This finding, along with a modestly higher proportion of stage III or IV lung cancer diagnoses in the less intensive evaluation group (if not owing to chance), supported the hypothesis that less intensive evaluations would be associated with delays in diagnoses and thus a higher stage of disease at the time of diagnosis.
We found relatively higher-intensity diagnostic evaluations to be associated with clinically meaningful differences in safety and health expenditures. The magnitude of differences in mean radiation exposure over 2 years for both comparisons in this study was on par with the mean radiation dose for 1 diagnostic chest CT (approximately 8 mSv). This amount of radiation was expected to lead to approximately 1 radiation-related cancer diagnosis for every 1500 persons who had imaging.43 Although any decrease in procedure-related AEs is clinically important from a patient perspective, the differences in procedure-related AEs across groups were arguably large. The magnitude of differences in procedure-related AEs for both comparisons was similar to the overall rate of procedure-related AEs for the entire cohort (approximately 6%). Similarly, the magnitude of differences in health care expenditures (approximately $11 000 for the less intensive evaluation group vs approximately $20 000 for the more intensive evaluation group) represent approximately 20% to 40% of the overall mean 2-year health expenditures for this cohort. We may have overestimated the differences in safety and expenditures because we were unable to attribute subsequent testing to lung nodule evaluation. Adjustments for patient demographic characteristics, comorbidity, and frailty may have decreased the misattribution errors across groups. We also may have overestimated the risk of procedure-related AEs because of the inaccuracies of administrative diagnostic codes (ICD-9 and ICD-10) in characterizing postprocedural complications,44-46 although we have no reason to believe that these errors were distributed unequally across groups defined by diagnostic intensity.
We believe that the findings in this study will complement the forthcoming results of the noninferiority Watch the Spot Trial.47,48 The Watch the Spot Trial compares 2 different guideline-concordant nodule evaluation strategies, whereas the present study compared more extreme deviations from guideline-concordant care that can only be observed in actual clinical practice. This study also underscored the need for more evidence on better ways to evaluate lung nodules, and its findings will have implications for future investigations and quality improvement efforts. In addition, we believe that the magnitude of harm associated with more intensive nodule evaluations demonstrated in this study will motivate and justify quality improvement initiatives that curb unnecessarily intensive diagnostic evaluations. For instance, efforts to decrease radiation exposure by approximately 8 milliSieverts may prevent more than 267 radiation-related cancers among the estimated 400 000 people with an incidentally detected lung nodule each year who received more intensive nodule evaluations.1,43
This study has several limitations. First, the proportion of lung cancer in this cohort was more than 50% lower than we had anticipated owing to a 2014 study of US veterans with incidental nodules who had a 9% prevalence of lung cancer.4 This finding limited our ability to detect small but potentially clinically important differences in stage III or IV lung cancer diagnoses across exposure groups. Since the publication of that 2014 veteran study, a large population-based study from Kaiser Permanente Southern California reported a 5.2% prevalence of lung cancer.1 These past findings suggested that we inadvertently underpowered the present study and that its results might be more generalizable than those of the study in the Veterans Affairs population. Second, the intensity of nodule evaluation was potentially misclassified because the approach that we used to categorize this variable was based on the first diagnostic step recommended by the 2005 Fleischner Society guidelines. We took this approach to avoid misattributing subsequent testing performed for other reasons (eg, dyspnea) as part of the nodule evaluation. Consequently, however, we may have misclassified patients as having received a guideline-concordant evaluation if they received only the first and not the subsequent diagnostic tests as recommended by guidelines. However, we believe the impact of such bias was small because most lung cancer diagnoses occurred within 4 months of nodule detection. Third, the 2005 Fleischner Society guidelines are no longer applicable to contemporary practice (new guidelines were issued in 201749); however, there remains an opportunity to gain knowledge about the implications (if any) of guideline deviations for patients and health systems.
This comparative effectiveness research study found inconclusive evidence of an association between evaluation intensity and lung cancer stage distribution. Compared with guideline-concordant evaluations, less intensive evaluations were associated with less radiation exposure, fewer procedure-related adverse events, and lower health expenditures, whereas more intensive evaluations were associated with greater radiation exposure, more procedure-related adverse events, and higher health expenditures. Findings from this study underscore the need to increase the level of evidence that supports current guideline recommendations and to decrease unnecessarily intensive diagnostic evaluations of lung nodules.
Accepted for Publication: November 15, 2020.
Published Online: January 19, 2021. doi:10.1001/jamainternmed.2020.8250
Corresponding Author: Farhood Farjah, MD, MPH, Department of Surgery, University of Washington, 1959 NE Pacific St, PO Box 356310, Seattle, WA 98195 (ffarjah@uw.edu).
Author Contributions: Dr Farjah had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis. Drs Buist and Greenlee are co–senior authors.
Concept and design: Farjah, Monsell, Gould, Banegas, Greenlee, Buist.
Acquisition, analysis, or interpretation of data: All authors.
Drafting of the manuscript: Farjah, Monsell, Smith-Bindman, Banegas.
Critical revision of the manuscript for important intellectual content: Farjah, Monsell, Gould, Banegas, Heagerty, Keast, Ramaprasan, Schoen, Brewer, Greenlee, Buist.
Statistical analysis: Farjah, Monsell, Heagerty, Keast, Ramaprasan.
Obtained funding: Farjah, Buist.
Administrative, technical, or material support: Farjah, Schoen, Brewer, Buist.
Supervision: Farjah.
Conflict of Interest Disclosures: Dr Farjah reported receiving grants from the National Cancer Institute (NCI) of the National Institutes of Health (NIH) during the conduct of the study. Ms Monsell reported receiving grants from the NCI of the NIH during the conduct of the study. Dr Gould reported receiving grants through his institution from the NCI of the NIH during the conduct of the study, grants through his institution from the Patient-Centered Outcomes Research Institute for serving as the principal investigator for a trial of pulmonary nodule evaluation strategies, personal fees from UpToDate Royalties for being a co-author of publications on lung cancer diagnosis and staging, and grants through his institution from Medial EarlySign for helping develop computer models of lung cancer risk outside the submitted work. Dr Smith-Bindman reported receiving consultant fees from the University of Washington; receiving a consultant fee from the NIH during the conduct of the study; and being the founder of Alara Imaging, which reports on quality measures for radiology, including computed tomography. Dr Banegas reported receiving grants from AstraZeneca outside the submitted work. Ms Brewer reported receiving grants from the NCI of the NIH during the conduct of the study. Dr Greenlee reported receiving grants from the University of Washington during the conduct of the study. Dr Buist reported receiving grants from the NCI of the NIH during the conduct of the study. No other disclosures were reported.
Funding/Support: This research was supported by grant R01CA207375 from the NCI of the NIH.
Role of the Funder/Sponsor: The funder had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.
Disclaimer: The views expressed herein are those of the authors and do not reflect the official policy or position of the NIH.
2.Wiener
RS, Gould
MK, Woloshin
S, Schwartz
LM, Clark
JA. What do you mean, a spot?: a qualitative analysis of patients’ reactions to discussions with their physicians about pulmonary nodules.
Chest. 2013;143(3):672-677. doi:
10.1378/chest.12-1095
PubMedGoogle ScholarCrossref 6.Gould
MK, Donington
J, Lynch
WR,
et al. Evaluation of individuals with pulmonary nodules: when is it lung cancer? diagnosis and management of lung cancer, 3rd ed: American College of Chest Physicians evidence-based clinical practice guidelines.
Chest. 2013;143(5 suppl):e93S-e120S. doi:
10.1378/chest.12-2351
PubMedGoogle ScholarCrossref 9.Wiener
RS, Slatore
CG, Gillespie
C, Clark
JA. Pulmonologists’ reported use of guidelines and shared decision-making in evaluation of pulmonary nodules: a qualitative study.
Chest. 2015;148(6):1415-1421. doi:
10.1378/chest.14-2941
PubMedGoogle ScholarCrossref 10.Slatore
CG, Horeweg
N, Jett
JR,
et al; ATS Ad Hoc Committee on Setting a Research Framework for Pulmonary Nodule Evaluation. An official American Thoracic Society research statement: a research framework for pulmonary nodule evaluation and management.
Am J Respir Crit Care Med. 2015;192(4):500-514. doi:
10.1164/rccm.201506-1082ST
PubMedGoogle ScholarCrossref 12.Golden
SE, Wiener
RS, Sullivan
D, Ganzini
L, Slatore
CG. Primary care providers and a system problem: a qualitative study of clinicians caring for patients with incidental pulmonary nodules.
Chest. 2015;148(6):1422-1429. doi:
10.1378/chest.14-2938
PubMedGoogle ScholarCrossref 15.von Elm
E, Altman
DG, Egger
M, Pocock
SJ, Gøtzsche
PC, Vandenbroucke
JP; STROBE Initiative. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies.
PLoS Med. 2007;4(10):e296. doi:
10.1371/journal.pmed.0040296
PubMedGoogle Scholar 17.Danforth
KN, Early
MI, Ngan
S, Kosco
AE, Zheng
C, Gould
MK. Automated identification of patients with pulmonary nodules in an integrated health system using administrative health plan data, radiology reports, and natural language processing.
J Thorac Oncol. 2012;7(8):1257-1262. doi:
10.1097/JTO.0b013e31825bd9f5
PubMedGoogle ScholarCrossref 18.Farjah
F, Halgrim
S, Buist
DS,
et al. An automated method for identifying individuals with a lung nodule can be feasibly implemented across health systems.
EGEMS (Wash DC). 2016;4(1):1254. doi:
10.13063/2327-9214.1254
PubMedGoogle Scholar 19.Smith-Bindman
R, Miglioretti
DL, Johnson
E,
et al. Use of diagnostic imaging studies and associated radiation exposure for patients enrolled in large integrated health care systems, 1996-2010.
JAMA. 2012;307(22):2400-2409. doi:
10.1001/jama.2012.5960
PubMedGoogle ScholarCrossref 20.Silvestri
GA, Gould
MK, Margolis
ML,
et al; American College of Chest Physicians. Noninvasive staging of non-small cell lung cancer: ACCP evidenced-based clinical practice guidelines (2nd edition).
Chest. 2007;132(3 suppl):178S-201S. doi:
10.1378/chest.07-1360
PubMedGoogle ScholarCrossref 21.Detterbeck
FC, Jantz
MA, Wallace
M, Vansteenkiste
J, Silvestri
GA; American College of Chest Physicians. Invasive mediastinal staging of lung cancer: ACCP evidence-based clinical practice guidelines (2nd edition).
Chest. 2007;132(3 suppl):202S-220S. doi:
10.1378/chest.07-1362
PubMedGoogle ScholarCrossref 22.Silvestri
GA, Gonzalez
AV, Jantz
MA,
et al. Methods for staging non-small cell lung cancer: diagnosis and management of lung cancer, 3rd ed: American College of Chest Physicians evidence-based clinical practice guidelines.
Chest. 2013;143(5 suppl):e211S-e250S. doi:
10.1378/chest.12-2355
PubMedGoogle ScholarCrossref 30.Francis
DO, Pearce
EC, Ni
S, Garrett
CG, Penson
DF. Epidemiology of vocal fold paralyses after total thyroidectomy for well-differentiated thyroid cancer in a Medicare population.
Otolaryngol Head Neck Surg. 2014;150(4):548-557. doi:
10.1177/0194599814521381
PubMedGoogle ScholarCrossref 36.Segal
JB, Huang
J, Roth
DL, Varadhan
R. External validation of the claims-based frailty index in the National Health And Aging Trends Study cohort.
Am J Epidemiol. 2017;186(6):745-747. doi:
10.1093/aje/kwx257
PubMedGoogle ScholarCrossref 39.Shi
X, Wellman
R, Heagerty
PJ, Nelson
JC, Cook
AJ. Safety surveillance and the estimation of risk in select populations: flexible methods to control for confounding while targeting marginal comparisons via standardization.
Stat Med. 2020;39(4):369-386. doi:
10.1002/sim.8410
PubMedGoogle ScholarCrossref 47.Gould
MK, Smith-Bindman
R, Kelly
K,
et al. Methods for the Watch the Spot Trial: a pragmatic trial of more - versus less - intensive strategies for active surveillance of small pulmonary nodules.
Ann Am Thorac Soc. 2019;16(12):1567-1576. doi:
10.1513/AnnalsATS.201903-268SD
PubMedGoogle ScholarCrossref