[Skip to Navigation]
Sign In
Figure 1.  Example of the Web-Based Tool Interface for a Patient With a T2aN2 Tumor Resected With Negative Margins
Example of the Web-Based Tool Interface for a Patient With a T2aN2 Tumor Resected With Negative Margins

The patient (or research coordinator) inputs clinical variables in the left panel. Based on that information, treatment options consistent with National Comprehensive Cancer Center (NCCN) guidelines and the timeline representation of the overall treatment course are generated. UCSF indicates University of California, San Francisco.

Figure 2.  Waterfall Plot Showing Changes in Decisional Conflict Scale (DCS) Scores
Waterfall Plot Showing Changes in Decisional Conflict Scale (DCS) Scores

A negative change suggests decreased decisional conflict. Seven patients experienced an increase in their DCS score after consultation with the web-based tool, while 3 patients experienced no change in DCS score.

Table 1.  Patient and Treatment Characteristics of Trial vs Retrospective Cohorts
Patient and Treatment Characteristics of Trial vs Retrospective Cohorts
Table 2.  Survey Results Before Consultation in Patients With Non–Small Cell Lung Cancer
Survey Results Before Consultation in Patients With Non–Small Cell Lung Cancer
Table 3.  Changes in Decisional Conflict Scale Scores After Consultation Incorporating Web-Based Access to Non–Small Cell Lung Cancer Guidelines
Changes in Decisional Conflict Scale Scores After Consultation Incorporating Web-Based Access to Non–Small Cell Lung Cancer Guidelines
1.
Schmidt  K, Damm  K, Prenzler  A, Golpon  H, Welte  T.  Preferences of lung cancer patients for treatment and decision-making: a systematic literature review.   Eur J Cancer Care (Engl). 2016;25(4):580-591. doi:10.1111/ecc.12425 PubMedGoogle ScholarCrossref
2.
Knops  AM, Goossens  A, Ubbink  DT, Legemate  DA, Stalpers  LJ, Bossuyt  PM.  Interpreting patient decisional conflict scores: behavior and emotions in decisions about treatment.   Med Decis Making. 2013;33(1):78-84. doi:10.1177/0272989X12453500 PubMedGoogle ScholarCrossref
3.
Hacking  B, Wallace  L, Scott  S, Kosmala-Anderson  J, Belkora  J, McNeill  A.  Testing the feasibility, acceptability and effectiveness of a ‘decision navigation’ intervention for early stage prostate cancer patients in Scotland–a randomised controlled trial.   Psychooncology. 2013;22(5):1017-1024. doi:10.1002/pon.3093 PubMedGoogle ScholarCrossref
4.
Sun  Q.  Predicting Downstream Effects of High Decisional Conflict: Meta-analyses of the Decisional Conflict Scale. University of Ottawa; 2005.
5.
Auvinen  A, Hakama  M, Ala-Opas  M,  et al.  A randomized trial of choice of treatment in prostate cancer: the effect of intervention on the treatment chosen.   BJU Int. 2004;93(1):52-56. doi:10.1111/j.1464-410X.2004.04554.x PubMedGoogle ScholarCrossref
6.
Whelan  T, Sawka  C, Levine  M,  et al.  Helping patients make informed choices: a randomized trial of a decision aid for adjuvant chemotherapy in lymph node–negative breast cancer.   J Natl Cancer Inst. 2003;95(8):581-587. doi:10.1093/jnci/95.8.581 PubMedGoogle ScholarCrossref
7.
Whelan  T, Levine  M, Willan  A,  et al.  Effect of a decision aid on knowledge and treatment decision making for breast cancer surgery: a randomized trial.   JAMA. 2004;292(4):435-441. doi:10.1001/jama.292.4.435 PubMedGoogle ScholarCrossref
8.
Leighl  NB, Shepherd  FA, Zawisza  D,  et al.  Enhancing treatment decision-making: pilot study of a treatment decision aid in stage IV non–small cell lung cancer.   Br J Cancer. 2008;98(11):1769-1773. doi:10.1038/sj.bjc.6604395 PubMedGoogle ScholarCrossref
9.
O’Brien  MA, Whelan  TJ, Villasis-Keever  M,  et al.  Are cancer-related decision aids effective? a systematic review and meta-analysis.   J Clin Oncol. 2009;27(6):974-985. doi:10.1200/JCO.2007.16.0101 PubMedGoogle ScholarCrossref
10.
Révész  D, Engelhardt  EG, Tamminga  JJ,  et al.  Decision support systems for incurable non-small cell lung cancer: a systematic review.   BMC Med Inform Decis Mak. 2017;17(1):144. doi:10.1186/s12911-017-0542-1 PubMedGoogle ScholarCrossref
11.
National Comprehensive Cancer Network. NCCN guidelines for treatment of cancer by site: non-small cell lung cancer, version 1.2014. Published February 21, 2014. Accessed August 25, 2020. https://web.archive.org/web/20140126050219/http://www.nccn.org/professionals/physician_gls/f_guidelines.asp#nscl
12.
O’Connor  AM.  Validation of a decisional conflict scale.   Med Decis Making. 1995;15(1):25-30. doi:10.1177/0272989X9501500105 PubMedGoogle ScholarCrossref
13.
Bruera  E, Sweeney  C, Calder  K, Palmer  L, Benisch-Tolley  S.  Patient preferences versus physician perceptions of treatment decisions in cancer care.   J Clin Oncol. 2001;19(11):2883-2885. doi:10.1200/JCO.2001.19.11.2883 PubMedGoogle ScholarCrossref
14.
Degner  LF, Sloan  JA.  Decision making during serious illness: what role do patients really want to play?   J Clin Epidemiol. 1992;45(9):941-950. doi:10.1016/0895-4356(92)90110-9 PubMedGoogle ScholarCrossref
15.
Cella  DF, Bonomi  AE, Lloyd  SR, Tulsky  DS, Kaplan  E, Bonomi  P.  Reliability and validity of the Functional Assessment of Cancer Therapy–Lung (FACT-L) quality of life instrument.   Lung Cancer. 1995;12(3):199-220. doi:10.1016/0169-5002(95)00450-F PubMedGoogle ScholarCrossref
16.
Holmes-Rovner  M, Kroll  J, Schmitt  N,  et al.  Patient satisfaction with health care decisions: the Satisfaction With Decision scale.   Med Decis Making. 1996;16(1):58-64. doi:10.1177/0272989X9601600114PubMedGoogle ScholarCrossref
17.
He  Y, Zaslavsky  AM, Landrum  MB, Harrington  DP, Catalano  P.  Multiple imputation in a large-scale complex survey: a practical guide.   Stat Methods Med Res. 2010;19(6):653-670. doi:10.1177/0962280208101273 PubMedGoogle ScholarCrossref
18.
Harel  O, Zhou  X-H.  Multiple imputation: review of theory, implementation and software.   Stat Med. 2007;26(16):3057-3077. doi:10.1002/sim.2787 PubMedGoogle ScholarCrossref
19.
Nadpara  PA, Madhavan  SS, Tworek  C.  Disparities in lung cancer care and outcomes among elderly in a medically underserved state population—a cancer registry–linked database study.   Popul Health Manag. 2016;19(2):109-119. doi:10.1089/pop.2015.0027 PubMedGoogle ScholarCrossref
20.
Ahmed  HZ, Liu  Y, O’Connell  K,  et al.  Guideline-concordant care improves overall survival for locally advanced non–small-cell lung carcinoma patients: a national cancer database analysis.   Clin Lung Cancer. 2017;18(6):706-718. doi:10.1016/j.cllc.2017.04.009 PubMedGoogle ScholarCrossref
21.
Potosky  AL, Saxman  S, Wallace  RB, Lynch  CF.  Population variations in the initial treatment of non–small-cell lung cancer.   J Clin Oncol. 2004;22(16):3261-3268. doi:10.1200/JCO.2004.02.051 PubMedGoogle ScholarCrossref
22.
Fang  P, He  W, Gomez  DR,  et al.  Influence of age on guideline-concordant cancer care for elderly patients in the United States.   Int J Radiat Oncol Biol Phys. 2017;98(4):748-757. doi:10.1016/j.ijrobp.2017.01.228 PubMedGoogle ScholarCrossref
23.
Wang  F, Mishina  S, Takai  S,  et al.  Systemic treatment patterns with advanced or recurrent non–small cell lung cancer in Japan: a retrospective hospital administrative database study.   Clin Ther. 2017;39(6):1146-1160. doi:10.1016/j.clinthera.2017.04.010 PubMedGoogle Scholar
24.
Javid  SH, Varghese  TK, Morris  AM,  et al; Collaborative to Improve Native Cancer Outcomes (CINCO).  Guideline-concordant cancer care and survival among American Indian/Alaskan Native patients.   Cancer. 2014;120(14):2183-2190. doi:10.1002/cncr.28683 PubMedGoogle Scholar
25.
Salloum  RG, Smith  TJ, Jensen  GA, Lafata  JE.  Factors associated with adherence to chemotherapy guidelines in patients with non–small cell lung cancer.   Lung Cancer. 2012;75(2):255-260. doi:10.1016/j.lungcan.2011.07.005 PubMedGoogle Scholar
26.
Vinod  SK, Sidhom  MA, Delaney  GP.  Do multidisciplinary meetings follow guideline-based care?   J Oncol Pract. 2010;6(6):276-281. doi:10.1200/JOP.2010.000019 PubMedGoogle Scholar
27.
Arriagada  R, Auperin  A, Burdett  S,  et al; NSCLC Meta-analyses Collaborative Group.  Adjuvant chemotherapy, with or without postoperative radiotherapy, in operable non–small-cell lung cancer: two meta-analyses of individual patient data.   Lancet. 2010;375(9722):1267-1277. doi:10.1016/S0140-6736(10)60059-1 PubMedGoogle Scholar
28.
Pignon  J-P, Tribodet  H, Scagliotti  GV,  et al; LACE Collaborative Group.  Lung adjuvant cisplatin evaluation: a pooled analysis by the LACE Collaborative Group.   J Clin Oncol. 2008;26(21):3552-3559. doi:10.1200/JCO.2007.13.9030 PubMedGoogle Scholar
29.
Strauss  GM, Herndon  JE  II, Maddaus  MA,  et al.  Adjuvant paclitaxel plus carboplatin compared with observation in stage IB non–small-cell lung cancer: CALGB 9633 with the Cancer and Leukemia Group B, Radiation Therapy Oncology Group, and North Central Cancer Treatment Group Study Groups.   J Clin Oncol. 2008;26(31):5043-5051. doi:10.1200/JCO.2008.16.4855 PubMedGoogle Scholar
30.
Winton  T, Livingston  R, Johnson  D,  et al; National Cancer Institute of Canada Clinical Trials Group; National Cancer Institute of the United States Intergroup JBR.10 Trial Investigators.  Vinorelbine plus cisplatin vs observation in resected non–small-cell lung cancer.   N Engl J Med. 2005;352(25):2589-2597. doi:10.1056/NEJMoa043623 PubMedGoogle Scholar
31.
National Comprehensive Cancer Network. NCCN guidelines for treatment of cancer by site: non–small cell lung cancer, version 2.2013. Accessed August 25, 2020. https://web.archive.org/
32.
National Comprehensive Cancer Network. NCCN guidelines for treatment of cancer by site: non–small cell lung cancer, version 2.2018. Accessed August 25, 2020. https://web.archive.org/
33.
Peele  PB, Siminoff  LA, Xu  Y, Ravdin  PM.  Decreased use of adjuvant breast cancer therapy in a randomized controlled trial of a decision aid with individualized risk information.   Med Decis Making. 2005;25(3):301-307. doi:10.1177/0272989X05276851 PubMedGoogle Scholar
34.
Fiset  V, O’Connor  AM, Evans  W, Graham  I, Degrasse  C, Logan  J.  Development and evaluation of a decision aid for patients with stage IV non-small cell lung cancer.   Health Expect. 2000;3(2):125-136. doi:10.1046/j.1369-6513.2000.00067.x PubMedGoogle Scholar
35.
Brundage  MD, Feldman-Stewart  D, Cosby  R,  et al; Journal of Clinical Oncology.  Phase I study of a decision aid for patients with locally advanced non–small-cell lung cancer.   J Clin Oncol. 2001;19(5):1326-1335. doi:10.1200/JCO.2001.19.5.1326 PubMedGoogle Scholar
36.
Stacey  D, Légaré  F, Lewis  K,  et al.  Decision aids for people facing health treatment or screening decisions.   Cochrane Database Syst Rev. 2017;4(4):CD001431. doi:10.1002/14651858.CD001431.pub5 PubMedGoogle Scholar
37.
Spiegle  G, Al-Sukhni  E, Schmocker  S,  et al.  Patient decision aids for cancer treatment: are there any alternatives?   Cancer. 2013;119(1):189-200. doi:10.1002/cncr.27641 PubMedGoogle Scholar
38.
Gaston  CM, Mitchell  G.  Information giving and decision-making in patients with advanced cancer: a systematic review.   Soc Sci Med. 2005;61(10):2252-2264. doi:10.1016/j.socscimed.2005.04.015 PubMedGoogle Scholar
39.
Brundage  MD, Feldman-Stewart  D, Dixon  P,  et al.  A treatment trade-off based decision aid for patients with locally advanced non-small cell lung cancer.   Health Expect. 2000;3(1):55-68. doi:10.1046/j.1369-6513.2000.00083.x PubMedGoogle Scholar
40.
Janis  IL, Mann  L.  Decision Making: A Psychological Analysis of Conflict, Choice, and Commitment. The Free Press; 1977.
41.
Street  RL  Jr, Voigt  B, Geyer  C  Jr, Manning  T, Swanson  GP.  Increasing patient involvement in choosing treatment for early breast cancer.   Cancer. 1995;76(11):2275-2285. doi:10.1002/1097-0142(19951201)76:11<2275::AID-CNCR2820761115>3.0.CO;2-S PubMedGoogle Scholar
42.
Goel  V, Sawka  CA, Thiel  EC, Gort  EH, O’Connor  AM.  Randomized trial of a patient decision aid for choice of surgical treatment for breast cancer.   Med Decis Making. 2001;21(1):1-6. doi:10.1177/0272989X0102100101 PubMedGoogle Scholar
43.
Cuypers  M, Lamers  RED, Kil  PJM, van de Poll-Franse  LV, de Vries  M.  Impact of a web-based prostate cancer treatment decision aid on patient-reported decision process parameters: results from the Prostate Cancer Patient Centered Care trial.   Support Care Cancer. 2018;26(11):3739-3748. doi:10.1007/s00520-018-4236-8 PubMedGoogle Scholar
44.
Joseph-Williams  N, Newcombe  R, Politi  M,  et al.  Toward minimum standards for certifying patient decision aids: a modified Delphi consensus process.   Med Decis Making. 2014;34(6):699-710. doi:10.1177/0272989X13501721 PubMedGoogle Scholar
Original Investigation
Oncology
September 30, 2020

Evaluation of a National Comprehensive Cancer Network Guidelines–Based Decision Support Tool in Patients With Non–Small Cell Lung Cancer: A Nonrandomized Clinical Trial

Author Affiliations
  • 1Department of Radiation Oncology, University of California, San Francisco
  • 2Department of Epidemiology and Biostatistics, University of California, San Francisco
  • 3Division of Hematology/Oncology, Department of Medicine, University of California, San Francisco
  • 4Department of Surgery, University of California, San Francisco
  • 5PatientsWithPower Inc, Santa Clara, California
  • 6Philip R. Lee Institute for Health Policy Studies, University of California, San Francisco
JAMA Netw Open. 2020;3(9):e209750. doi:10.1001/jamanetworkopen.2020.9750
Key Points

Question  Is exposure to the National Comprehensive Cancer Center guidelines associated with decreased decisional conflict and increased rates of guideline-concordant care in patients with non–small cell lung cancer?

Findings  In this nonrandomized clinical trial, exposure to the National Comprehensive Cancer Center guidelines in 76 patients with non–small cell lung cancer was associated with increased smoking cessation counseling and decreased use of adjuvant chemotherapy after resection of early-stage disease. Use of the tool during consultation was also associated with decreased decisional conflict and greater satisfaction with their decision by the patients.

Meaning  The findings of this study suggest that use of cancer treatment guidelines is not in conflict with shared decision-making; increasing patients’ access to guidelines appears to improve the quality of oncologic care.

Abstract

Importance  The association of guideline-based decision support with the quality of care in patients with non–small cell lung cancer (NSCLC) is not known.

Objective  To evaluate the association of exposure to the National Comprehensive Cancer Center (NCCN) guidelines with guideline-concordant care and patients’ decisional conflict.

Design, Setting, and Participants  A nonrandomized clinical trial, conducted at a tertiary care academic institution, enrolled patients from February 23, 2015, to September 28, 2017. Data analysis was conducted from July 19, 2019, to April 22, 2020. A cohort of 76 patients with NSCLC seen at diagnosis or disease progression and a retrospective cohort of 157 patients treated before the trial were included. Adherence to 6 NCCN recommendations were evaluated: (1) smoking cessation counseling, (2) adjuvant chemotherapy for patients with stage IB to IIB NSCLC after surgery, (3) pathologic mediastinal staging in patients with stage III NSCLC before surgery, (4) pathologic mediastinal staging in patients with stage III NSCLC before nonsurgical treatment, (5) definitive chemoradiotherapy for patients with stage III NSCLC not having surgery, and (6) molecular testing for epidermal growth factor receptor and anaplastic lymphoma kinase alterations for patients with stage IV NSCLC. Subgroup analysis was conducted to compare the rates of guideline concordance between the prospective and retrospective cohorts. Secondary end points included decisional conflict and satisfaction.

Interventions  An online tool customizing the NCCN guidelines to patients’ clinical and pathologic features was used during consultation, facilitated by a trained coordinator.

Main Outcomes and Measures  Concordance of practice with 6 NCCN treatment recommendations on NSCLC and patients’ decisional conflict.

Results  Of the 76 patients with NSCLC, 44 were men (57.9%), median age at diagnosis was 68 years (interquartile range [IQR], 41-87 years), and 59 patients (77.6%) had adenocarcinoma. In the retrospective cohort, 91 of 157 patients (58.0%) were men, median age at diagnosis was 66 years (IQR, 61-65 years), and 105 patients (66.9%) had adenocarcinoma. After the intervention, patients received more smoking cessation counseling (4 of 5 [80.0%] vs 1 of 24 [4.2%], P < .001) and less adjuvant chemotherapy (0 of 7 vs 7 of 11 [63.6%]; P = .012). There was no significant change in mutation testing of non–squamous cell stage IV disease (20 of 20 [100%] vs 48 of 57 [84.2%]; P = .10). There was no significant change in pathologic mediastinal staging or initial chemoradiotherapy for patients with stage III disease. After consultation with the tool, decisional conflict scores improved by a median of 20 points (IQR, 3-34; P < .001).

Conclusions and Relevance  The findings of this study suggest that exposure to the NCCN guidelines is associated with increased guideline-concordant care for 2 of 6 preselected recommendations and improvement in decisional conflict.

Trial Registration  ClinicalTrials.gov Identifier: NCT03982459

Introduction

Patients with non–small cell lung cancer (NSCLC) navigate a complicated sequence of diagnostic tests and choices of treatment and are often faced with a complex decision-making framework that evolves substantially through the course of their workup. National treatment guidelines are not easily accessible for these patients, whose treatment preferences may change based on upstaging, individual factors, or personal circumstances.1

This burden of decision-making is stressful. Decisional conflict is associated with delays in decision-making, vacillation between treatment options, and regret.2-4 Decision support tools can improve patient knowledge regarding options, prognosis, and selection of treatment that best balances their goals of care,5,6 but most tools have been developed for patients with breast6,7 and prostate cancer or advanced/metastatic cancer.8-10 Furthermore, to our knowledge, there have been no studies demonstrating changes in practice patterns based on enhanced decision support in patients with NSCLC.

The aim of this clinical trial was to evaluate an interactive web-based tool that allows patients to explore individually tailored decision trees derived from the National Comprehensive Cancer Center (NCCN) guidelines. The primary end point was the association with predetermined benchmarks of guideline-concordant quality care. Changes in decisional conflict, satisfaction with decisions, and other metrics of patient experience were also assessed.

Methods
Patient Selection

Physicians in the multidisciplinary lung cancer practice identified eligible patients scheduled for consultation. Trained research coordinators then screened these patients, identifying 84 eligible patients, of whom 76 were enrolled (90% enrollment). Patients were older than 18 years; able to use an English-language, web-based interface; and had NSCLC that was either newly diagnosed and treatment naive or newly recurrent or progressive, requiring a change in therapy. Eligible histologic types included adenocarcinoma, squamous cell, large cell, and adenosquamous carcinoma; patients with radiographically diagnosed NSCLC who were unable to undergo biopsy were also eligible. Clinical data, including staging, treatments received, and demographic information, were abstracted from the medical record. Enrolled patients retained access to the web-based tool until trial closure and consented to have their use monitored for 1 year.

This trial was approved by the institutional review board of the University of California, San Francisco, and participants in the prospective cohort provided written informed consent; aside from access to the web-based tool, there were no incentives to participate. Consent for retrospective data collection was waived by the institutional review board. The retrospective data set comprised patients who had consultations with the same group of physicians within the 8 months preceding the trial and met the same eligibility criteria. The NCCN guidelines v1.2014 were used to program the web-based tool and evaluate guideline concordance in the retrospective study cohort.11 The trial protocol is available in Supplement 1. This study followed the Transparent Reporting of Evaluations With Nonrandomized Designs (TREND) reporting guideline for nonrandomized clinical trials.

Guideline Tool and Assessments

An interactive web-based interface allowed patients, with assistance from a trained research coordinator, to enter their individual clinical, radiographic, and pathologic characteristics and then explore, in a structured manner, treatment combinations and sequences based on the NCCN guidelines (Figure 1). The decision tree created an interactive calendar-like timeline that allowed patients to map out their sequence of treatments over time.

We established 6 benchmarks of quality care derived from the guidelines that were evaluated in a binary manner: (1) documented smoking cessation counseling in active smokers, (2) adjuvant chemotherapy for patients with stage IB to IIB NSCLC after surgery, (3) pathologic mediastinal staging in patients with stage III NSCLC before surgery, (4) pathologic mediastinal staging in patients with stage III NSCLC before nonsurgical management, (5) definitive chemoradiotherapy for patients with stage III NSCLC not undergoing surgery, and (6) molecular testing for epidermal growth factor receptor and anaplastic lymphoma kinase alterations for patients with stage IV NSCLC. We performed a retrospective review of 157 consecutive patients meeting enrollment criteria and seen by the group in the 8 months before the trial to determine baseline levels of guideline concordance. Two independent reviewers (S.Y.W. and S.S.Y.) compared the rates of guideline concordance in the retrospective cohort vs the trial patients.

Six patient-reported instruments were used to evaluate decisional conflict, decision-making preferences, quality of life, and satisfaction with decisions. The Decisional Conflict Scale (DCS)12 consists of 5 subscales evaluating whether a patient feels informed, supported, uncertain, effective in decision-making, and clear regarding their values on a scale of 0 to 100, with higher values representing the most positive levels. The Decision Making Preference Questionnaire13,14 asks patients to identify their preferred level of decision-making responsibility, ranging from “the doctor should make the decisions” to “I should make the decisions.” The Functional Assessment of Cancer Therapy–Lung (FACT-L) assesses lung cancer–specific quality of life.15 The Satisfaction With Decision is a 6-item questionnaire measuring satisfaction on a scale of 1 (lowest) to 5 (highest).16 Patients also completed a postconsultation questionnaire querying proposed treatments, satisfaction, understanding, and expectation of tolerating treatment (eAppendix in Supplement 2).

Following consent and before consultation, patients completed a baseline Decision Making Preference Questionnaire, DCS, and FACT-L and were guided through the web-based tool by a trained research coordinator (T.L.D.), who helped enter clinical information to create the decision tree. The research coordinator then attended the visit, with the tool displayed on a laptop for reference during the consultation. Following consultation, patients completed the DCS, Satisfaction With Decision, and postconsultation questionnaires. The preconsultation questionnaires took 20 to 30 minutes to complete, training with the tool took approximately 15 minutes, and the postconsultation questionnaires required 10 to 20 minutes. All interventions were completed on the day of consultation.

Statistical Analysis

The Fisher exact test and the Cochrane-Armitage trend test for ordered factors were used to compare clinical variables and guideline benchmarks between the 2 cohorts. The Wilcoxon signed rank test was used to compare DCS scores before and after consultation with the web-based tool. There were 9 participants with missing survey results preventing calculation of the change in DCS score (9/76 [12%]) and 3 with missing FACT-L subscores (3/76 [4%]). Multiple imputation by chained equations using 20 imputation data sets was performed as a sensitivity analysis17,18 (eTable 1 in Supplement 2). Multivariable regression linear (for continuous outcomes) and logistic (for dichotomous outcomes) analysis was performed to evaluate the association between outcomes and clinical variables. Use of the web-based tool was log transformed (log 10 + 1) since the fit of the model was better based on the residual plot, and we exponentiated the results. For ease of interpretation, we also dichotomized patient satisfaction with decision as satisfied or neutral/unsatisfied. We evaluated each variable in a separate model as a potential confounder, and we did not identify confounders requiring adjustment based on a P value <.05. We forced potential confounders into the multivariable model: age or age as quadratic, race/ethnicity, and cancer stage. The magnitude of the association after adjusting for clinical variables is presented as an adjusted estimate for age, race/ethnicity, and stage with the associated 95% CI.

Analysis of guideline concordance was matched based on clinical criteria appropriate for the benchmark (ie, stage IB-IIB disease for guideline 2). Because of the limited numbers of patients, further matching or inverse probability weighting via propensity score to reduce potential differences between groups was not possible owing to low event rates (<10 events), particularly for benchmarks 1, 2, and 3. Analyses were performed using SPSS, version 25 (IBM Corp) and SAS, version 9.4 (SAS Institute Inc). Two-sided P values <.05 were considered statistically significant except for benchmark comparisons of quality care where a 2-sided P value <.017 was used based on the Bonferroni correction for multiple testing.

The sample size calculation is described in the protocol (Supplement 1). We expected that the clinical volume of 30 patients per month for 12 months would yield a potential enrollment pool of 360 patients. Anticipating a 30% decline, dropout, or ineligibility rate at the time of potential enrollment, at least 250 patients would be evaluable. Data analysis was conducted from July 19, 2019, to April 22, 2020.

Results

Between February 23, 2015, and September 28, 2017, 76 patients with NSCLC were prospectively enrolled. The median age was 68 years (interquartile range [IQR], 41-87 years) and 44 were men (57.9%); most of the 76 patients had adenocarcinoma (59 [77.6%]) or squamous cell carcinoma (14 [18.4%]) and stage I (28 [36.8%]) or stage IV (23 [30.3%]) disease. In the comparator cohort of 157 patients, the median age was 66 years (IQR, 61-65 years), 91 patients (58.0%) were men, most had adenocarcinoma (105 [66.9%]) or squamous cell carcinoma (28 [17.8%]) and stage I (35 [22.3%]) or stage IV (64 [40.8%]) disease. Other characteristics of the 2 cohorts are presented in Table 1, and their treatments are reported in eTable 3 in Supplement 2. Enrollment into the trial was slow, with 5 to 6 patients accrued per month during peak enrollment in 2015. We closed the trial in September 2017.

Rates of guideline-concordant treatment in the cohorts are reported in Table 1; these cohorts are shown by ethnicity in eTable 5 in Supplement 2. Among self-declared active smokers in the trial, 80.0% (4 of 5) had documented smoking cessation counseling compared with 4.2% (1 of 24) of patients in the retrospective cohort (P < .001). The trial cohort also received less adjuvant chemotherapy after surgery among patients with stage IB to IIB disease (0 of 7 vs 63.6% [7 of 11]; P = .012). In post hoc subanalysis, this difference seemed primarily driven by patients who underwent surgery with negative margins (0 of 7) in the trial cohort compared with 4 of 6 patients (66.7%) in the comparator cohort (P = .02). While there was no overall difference in the rates of molecular testing for epidermal growth factor receptor and anaplastic lymphoma kinase alterations in those with stage IV disease (21 of 23 [91.3%] vs 49 of 60 [81.7%]; P = .50), and among those with non–squamous cell histologic characteristics, the change in rates of testing was not significant (20 of 20 [100%] vs 48 of 57 [84.2%]; P = .10). There was no significant change in the trial vs retrospective cohort in the rate of pathologic mediastinal staging in patients with stage III NSCLC undergoing surgery (50.0% [1 of 2] vs 35.7% [5 of 14]; P > .99) or nonoperative management (28.6% [4 of 14] vs 35.3% [12 of 34]; P = .75) and no significant difference in the rate of upfront chemoradiotherapy for those with stage III NSCLC not undergoing surgery (64.3% [9 of 14] vs 64.7% [22 of 34]; P > .99).

Half (51.3%) of the trial patients expressed on the Decision Making Preference Questionnaire that they and their physician should take equal part in the decision-making process (Table 2). The median FACT-L total score was 67 (IQR, 61-75). Based on the FACT-L, trial patients generally felt supported by their families and friends (median subscore, 20; IQR, 9) and believed that their diagnosis had a moderate association with their functional well-being (median subscore, 14; IQR, 8-17) (Table 2).

Following a guidelines-enhanced consultation, patients’ total DCS scores improved by a median decrease of 20 points (IQR, 3-34; P < .001) (Table 3). Significant decreases were seen across all subscales, with the largest decreases in the domains of feeling informed, clarity about personal values, and uncertainty (each with a median improvement of 25 points). Although most patients had a decrease in their DCS score, 7 patients’ (9.2%) scores increased and 3 scores (4.0%) were unchanged (Figure 2). The sensitivity analysis showed similar results (eTable 2 in Supplement 2).

Patients satisfied with their decision (53 of 68 [77.9%]) had significant improvement in their DCS score after consultation compared with those who were not satisfied (adjusted odds ratio, 0.80; 95% CI, 0.71-0.91; P < .001). Sixty-four patients (84.2%) accessed the web-based tool a median of 3 times following their initial consultation (range, 0-20). On multivariable analysis, for a 10-unit improvement in DCS score, we expected a 6% increase in use of the tool following consultation while controlling for age, race/ethnicity, and stage (95% CI, 2%-9%; P = .002).

Discussion

The findings of this study suggest feasibility and efficacy of a web-based, customizable decision support tool facilitating direct access to the NCCN guidelines. Exposure to the guidelines during consultation was associated with improvements in 2 indices of guideline-concordant care. Exposure was also associated with decreased decisional conflict and increased satisfaction with decision-making. In turn, decreased decisional conflict was associated with increased patient satisfaction with decisions. Patients with greater reductions in decisional conflict accessed the guidelines at a higher frequency after consultation.

Receipt of guideline-concordant care for lung cancer has been shown to improve median overall survival,19,20 but registry data suggest that only 20% to 50% of patients with NSCLC receive recommended therapy.20,21 There are many complex factors that may mediate delivery of guideline-concordant care,22 such as sex,23 race,24 ethnicity,21 insurance coverage,25 socioeconomic status,25 performance status,26 and patient preferences. Given our limited sample size, we could not explore these variables further.

Patients with stage IB to IIB cancer in our 2 cohorts were treated with the same standard of care, but the role of adjuvant chemotherapy following surgery for early-stage NSCLC remains controversial. According to 2 meta-analyses, the 5-year overall survival benefits may be on the order of 4% to 5%,27,28 but both of these studies included patients with stage I to stage III disease. However, mature results of the Cancer and Leukemia Group B (CALGB) 9633 trial demonstrated no survival benefit for patients with T2N0 NSCLC,29 and the JBR.10 trial, which stratified patients by nodal status at enrollment, found that adjuvant treatment with cisplatin plus vinorelbine did not improve overall survival in patients with stage IB cancer.30 Therefore, the NCCN guidelines for adjuvant therapy (consistent from v2.201331 through v2.201832) have recommended that, for stage IB-IIA (T2N0) cancers resected with negative margins, adjuvant chemotherapy should be considered for high-risk features, such as poorly differentiated tumors, vascular invasion, wedge resection, size greater than 4 cm, visceral pleural involvement, and unknown lymph node status. For patients with T2N0 cancers resected with a positive margin, further resection with or without chemotherapy or radiotherapy with or without chemotherapy (but with chemotherapy for patients with IIA disease) is recommended. In patients with N1 disease, adjuvant chemotherapy is recommended alone for negative margins or in conjunction with further resection or radiotherapy for microscopic or macroscopic residual tumor. In our study, in keeping with similar findings in low-risk breast cancer, patients’ exposure to a decision-support tool that recommends adjuvant treatment only for specific high-risk situations (in which the benefit of additional therapy is estimated to be low) was associated with a decision-making process that led to decreased use of the adjuvant therapy.33

The impact of patient-directed support tools has primarily been studied in patients with prostate or breast cancer5,33 or metastatic34 and locally advanced35 NSCLC; these tools have been shown to improve knowledge and decrease decisional conflict,7 and in patients with prostate and endometrial cancer considering adjuvant radiotherapy, higher DCS scores are associated with a likelihood of postponing decisions.2 Although a meta-analysis suggests that decision aids may not change a patient’s ultimate decision,36 use of the tools may improve the timeliness of decision-making, which impacts oncologic outcomes. In this trial, we found that the greatest decreases in decisional conflict were in the domains of feeling informed, clarity about personal values, and uncertainty, suggesting that patients gained knowledge about treatment options within the context of personal preferences and felt less uncertain about their decisions. A smaller reduction was seen in the domain of feeling supported owing to lower baseline scores before consultation (Table 3) and consistent with the FACT-L findings that most trial patients already felt supported by friends and family.

Although most randomized trials suggest that decision tools are not associated with increased anxiety for most patients,9,36-38 7 patients (9.2%) in our trial reported increased decisional conflict after consultation. This finding is consistent with the work of Brundage et al,39 who found that 1 of 12 patients (8.3%) with stage III NSCLC experienced an increase in DCS scores after decision support. Increased decisional conflict may be an appropriately vigilant response to the presentation of information that challenges patients’ preconceptions.40 It is beyond this study’s scope to analyze patient or disease factors that might estimate increased conflict.

Limitations

The primary limitation of this study is its small sample size due to unexpectedly slow accrual. This limitation was multifactorial but primarily owing to repeated changes in coordinators, resulting in 2 prolonged enrollment pauses that accounted for 17 of the 31 months that the trial was open. Another factor limiting enrollment was reliance on attending oncologists to screen eligible patients before consultation; the physicians insisted on performing this initial screening, which reduced eligibility. As such, the study was underpowered for the primary end point, although significant differences were still found.

This study was conducted at a tertiary academic medical center and may not be representative of the population at large. Decreased use of adjuvant chemotherapy may have been due to advanced-level discussions of toxic effects, options, and recurrence risk, but we cannot analyze this outcome further. Another potential confounder was the emergence of gene expression profiling of these patients with early-stage disease. However, molecular risk stratification was performed in only 3 patients in the trial cohort (2 by Encore Clinical, Brisbane, California, and 1 by VariStrat, Boulder, Colorado) and 7 patients in the retrospective cohort (6 by Pervenio Lung, Life Technologies Clinical Services Lat, West Sacramento, California, and 1 by Encore Clinical). Given these low numbers and the different assays used, we were unable to draw further conclusions regarding their impact.

The baseline rate of smoking cessation counseling in the retrospective cohort was low (4%). It is possible that some of the improvement seen during the trial was due to improved documentation by physicians (Hawthorne effect) or unquantified institutional factors, such as changes to the intake process. In addition, only 5 of 76 patients (6.6%) in the trial cohort identified as current smokers compared with 24 of 157 patients (15.3%) in the retrospective cohort, and it is possible that the rate of smoking was overestimated at baseline. It is difficult to identify how or why this overestimate may have occurred. In contrast, major management, such as pathologic mediastinal staging, and chemoradiotherapy for stage III patients did not change, reflecting a greater fixity and lack of efficacy of this tool in these areas.

One practical consideration is the resource-intensive nature of decision support. Data suggest that when patients self-administer decision support tools, there is limited improvement in knowledge41 or decisional conflict,42,43 suggesting that assistance resources are necessary. Also of concern is the effect of these tools on consultation time, although one Cochrane review suggested that the median consultation time was just 2.6 minutes longer with use of a decision aid.36 Then there is the burden of development, implementation, and maintenance of the tool to consider. Adjustments to this process would be needed to increase guideline access on a larger scale. During and after implementation of this study, some of our clinicians began drawing out diagrams or writing out the NCCN guidelines on paper during consultations. It may be that the online interactivity, further personalization, and real-time calendaring provided by our tool was less necessary than the basic guideline content. Nonguideline-based support could include providing a written summary or audio recording of patients’ consultations.43,44

As this trial was not randomized, it is not clear whether reductions in decisional conflict would have been seen after consultation alone. However, randomized trials have addressed this question and demonstrated decreased decisional conflict with the use of decision aids.7 Ours was a practical implementation study aimed at quality improvement rather than reestablishing the ethicality and validity of decision support. The magnitude and similar directionality of multiple reinforcing metrics testifies to the power of this intervention. While the tool in this study did not meet criteria for a decision aid,44 meta-analysis suggests that decision support has the ability to improve patient knowledge and decisional conflict at a level similar to that of decision aids.37 By using a standard national guideline in a supportive rather than directive manner, our intervention was acceptable to our clinicians.

Further research is needed to explore how best to implement decision support in routine clinical practice. Allocating limited clinic resources requires commitment, and a direct translation to cost savings or quantifiable improvement in quality is difficult to establish. Nonetheless, our study reinforces that there is a potential positive association with the patient’s experience and delivery of high-quality care.

Conclusions

To our knowledge, this is the first study in patients with NSCLC that has suggested an association with guideline-concordant care using a patient-empowering educational approach. Patient exposure to the NCCN guidelines appears to be associated with increases in smoking cessation counseling and decreased use of adjuvant chemotherapy in patients with resected early-stage disease. Patients exposed to the tool appeared to have decreased decisional conflict and greater satisfaction with their decision. Despite the limitations of this study, these findings suggest that evidence-based decision and communication tools have potential to improve the quality of cancer care delivered.

Back to top
Article Information

Accepted for Publication: April 27, 2020.

Published: September 30, 2020. doi:10.1001/jamanetworkopen.2020.9750

Open Access: This is an open access article distributed under the terms of the CC-BY License. © 2020 Wu SY et al. JAMA Network Open.

Corresponding Author: Sue S. Yom, MD, PhD, MAS, Department of Radiation Oncology, University of California, San Francisco, 1600 Divisadero St, Ste H-1031, San Francisco, CA 94115 (sue.yom@ucsf.edu).

Author Contributions: Drs Wu and Yom had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.

Concept and design: Wu, Jablons, Dunbar, Guthrie, Belkora, Yom.

Acquisition, analysis, or interpretation of data: Wu, Lazar, Gubens, Blakely, Gottschalk, Jahan, Wang, Wong, Chan, Guthrie, Belkora, Yom.

Drafting of the manuscript: Wu, Chan, Belkora, Yom.

Critical revision of the manuscript for important intellectual content: All authors.

Statistical analysis: Wu, Lazar, Yom.

Obtained funding: Yom.

Administrative, technical, or material support: Gubens, Jahan, Wang, Dunbar, Guthrie, Belkora, Yom.

Supervision: Jablons, Jahan, Yom.

Conflict of Interest Disclosures: Dr Gubens reported receiving personal fees from Novartis, AstraZeneca, Mersana, Genentech/Roche, Bristol-Myers Squibb, Heron, Boehringer Ingelheim, Takeda, BeyondSpring, and Inivata outside the submitted work. Dr Blakely reported receiving grants from Novartis, AstraZeneca, Mirati, Ignyta, MedImmune, Takeda, Spectrum, and Roche and personal fees from Revolution Medicines, Amgen, and Foundation Medicine outside the submitted work. Dr Jablons reported having a patent to Multigene Assay for Lung Cancer pending, licensed, and with royalties paid. Dr Jahan reported receiving grants from AstraZeneca, Aduro Pharmaceuticals, Bristol-Myers Squibb, Bayer, Alerta Pharmaceuticals, Eli Lilly and Company, Epizyme Pharmaceuticals, Kadmon Pharmaceuticals, Polaris Pharmaceuticals, Springworks Therapeutics, and Trizell Ltd outside the submitted work. Dr Wang reported grants from the US Department of Defense, Damon Runyon Foundation, Conquer Cancer Foundation, and Lung Cancer Research Foundation outside the submitted work. Ms Dunbar reported employment at Gilead Sciences Inc. Dr Wong reported receiving research support from Genentech/Roche outside the submitted work. Dr Yom reported receiving grants from Genentech, Merck, Bristol-Myers Squibb, and BioMimetix outside the submitted work and royalties for book chapters from UpToDate and Springer. No other disclosures were reported.

Funding/Support: This research was funded by a Young Investigator Award from the National Comprehensive Cancer Center Foundation (Dr Yom).

Role of the Funder/Sponsor: The National Comprehensive Cancer Center Foundation had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

Meeting Presentations: This work was presented in part at the 60th Annual Meeting of the American Society for Radiation Oncology; October 21-24, 2018; San Antonio, Texas; and at the Multidisciplinary Thoracic Cancers Symposium; March 14-16, 2019; San Diego, California.

Additional Information: Technical support was provided by PatientsWithPower Inc.

References
1.
Schmidt  K, Damm  K, Prenzler  A, Golpon  H, Welte  T.  Preferences of lung cancer patients for treatment and decision-making: a systematic literature review.   Eur J Cancer Care (Engl). 2016;25(4):580-591. doi:10.1111/ecc.12425 PubMedGoogle ScholarCrossref
2.
Knops  AM, Goossens  A, Ubbink  DT, Legemate  DA, Stalpers  LJ, Bossuyt  PM.  Interpreting patient decisional conflict scores: behavior and emotions in decisions about treatment.   Med Decis Making. 2013;33(1):78-84. doi:10.1177/0272989X12453500 PubMedGoogle ScholarCrossref
3.
Hacking  B, Wallace  L, Scott  S, Kosmala-Anderson  J, Belkora  J, McNeill  A.  Testing the feasibility, acceptability and effectiveness of a ‘decision navigation’ intervention for early stage prostate cancer patients in Scotland–a randomised controlled trial.   Psychooncology. 2013;22(5):1017-1024. doi:10.1002/pon.3093 PubMedGoogle ScholarCrossref
4.
Sun  Q.  Predicting Downstream Effects of High Decisional Conflict: Meta-analyses of the Decisional Conflict Scale. University of Ottawa; 2005.
5.
Auvinen  A, Hakama  M, Ala-Opas  M,  et al.  A randomized trial of choice of treatment in prostate cancer: the effect of intervention on the treatment chosen.   BJU Int. 2004;93(1):52-56. doi:10.1111/j.1464-410X.2004.04554.x PubMedGoogle ScholarCrossref
6.
Whelan  T, Sawka  C, Levine  M,  et al.  Helping patients make informed choices: a randomized trial of a decision aid for adjuvant chemotherapy in lymph node–negative breast cancer.   J Natl Cancer Inst. 2003;95(8):581-587. doi:10.1093/jnci/95.8.581 PubMedGoogle ScholarCrossref
7.
Whelan  T, Levine  M, Willan  A,  et al.  Effect of a decision aid on knowledge and treatment decision making for breast cancer surgery: a randomized trial.   JAMA. 2004;292(4):435-441. doi:10.1001/jama.292.4.435 PubMedGoogle ScholarCrossref
8.
Leighl  NB, Shepherd  FA, Zawisza  D,  et al.  Enhancing treatment decision-making: pilot study of a treatment decision aid in stage IV non–small cell lung cancer.   Br J Cancer. 2008;98(11):1769-1773. doi:10.1038/sj.bjc.6604395 PubMedGoogle ScholarCrossref
9.
O’Brien  MA, Whelan  TJ, Villasis-Keever  M,  et al.  Are cancer-related decision aids effective? a systematic review and meta-analysis.   J Clin Oncol. 2009;27(6):974-985. doi:10.1200/JCO.2007.16.0101 PubMedGoogle ScholarCrossref
10.
Révész  D, Engelhardt  EG, Tamminga  JJ,  et al.  Decision support systems for incurable non-small cell lung cancer: a systematic review.   BMC Med Inform Decis Mak. 2017;17(1):144. doi:10.1186/s12911-017-0542-1 PubMedGoogle ScholarCrossref
11.
National Comprehensive Cancer Network. NCCN guidelines for treatment of cancer by site: non-small cell lung cancer, version 1.2014. Published February 21, 2014. Accessed August 25, 2020. https://web.archive.org/web/20140126050219/http://www.nccn.org/professionals/physician_gls/f_guidelines.asp#nscl
12.
O’Connor  AM.  Validation of a decisional conflict scale.   Med Decis Making. 1995;15(1):25-30. doi:10.1177/0272989X9501500105 PubMedGoogle ScholarCrossref
13.
Bruera  E, Sweeney  C, Calder  K, Palmer  L, Benisch-Tolley  S.  Patient preferences versus physician perceptions of treatment decisions in cancer care.   J Clin Oncol. 2001;19(11):2883-2885. doi:10.1200/JCO.2001.19.11.2883 PubMedGoogle ScholarCrossref
14.
Degner  LF, Sloan  JA.  Decision making during serious illness: what role do patients really want to play?   J Clin Epidemiol. 1992;45(9):941-950. doi:10.1016/0895-4356(92)90110-9 PubMedGoogle ScholarCrossref
15.
Cella  DF, Bonomi  AE, Lloyd  SR, Tulsky  DS, Kaplan  E, Bonomi  P.  Reliability and validity of the Functional Assessment of Cancer Therapy–Lung (FACT-L) quality of life instrument.   Lung Cancer. 1995;12(3):199-220. doi:10.1016/0169-5002(95)00450-F PubMedGoogle ScholarCrossref
16.
Holmes-Rovner  M, Kroll  J, Schmitt  N,  et al.  Patient satisfaction with health care decisions: the Satisfaction With Decision scale.   Med Decis Making. 1996;16(1):58-64. doi:10.1177/0272989X9601600114PubMedGoogle ScholarCrossref
17.
He  Y, Zaslavsky  AM, Landrum  MB, Harrington  DP, Catalano  P.  Multiple imputation in a large-scale complex survey: a practical guide.   Stat Methods Med Res. 2010;19(6):653-670. doi:10.1177/0962280208101273 PubMedGoogle ScholarCrossref
18.
Harel  O, Zhou  X-H.  Multiple imputation: review of theory, implementation and software.   Stat Med. 2007;26(16):3057-3077. doi:10.1002/sim.2787 PubMedGoogle ScholarCrossref
19.
Nadpara  PA, Madhavan  SS, Tworek  C.  Disparities in lung cancer care and outcomes among elderly in a medically underserved state population—a cancer registry–linked database study.   Popul Health Manag. 2016;19(2):109-119. doi:10.1089/pop.2015.0027 PubMedGoogle ScholarCrossref
20.
Ahmed  HZ, Liu  Y, O’Connell  K,  et al.  Guideline-concordant care improves overall survival for locally advanced non–small-cell lung carcinoma patients: a national cancer database analysis.   Clin Lung Cancer. 2017;18(6):706-718. doi:10.1016/j.cllc.2017.04.009 PubMedGoogle ScholarCrossref
21.
Potosky  AL, Saxman  S, Wallace  RB, Lynch  CF.  Population variations in the initial treatment of non–small-cell lung cancer.   J Clin Oncol. 2004;22(16):3261-3268. doi:10.1200/JCO.2004.02.051 PubMedGoogle ScholarCrossref
22.
Fang  P, He  W, Gomez  DR,  et al.  Influence of age on guideline-concordant cancer care for elderly patients in the United States.   Int J Radiat Oncol Biol Phys. 2017;98(4):748-757. doi:10.1016/j.ijrobp.2017.01.228 PubMedGoogle ScholarCrossref
23.
Wang  F, Mishina  S, Takai  S,  et al.  Systemic treatment patterns with advanced or recurrent non–small cell lung cancer in Japan: a retrospective hospital administrative database study.   Clin Ther. 2017;39(6):1146-1160. doi:10.1016/j.clinthera.2017.04.010 PubMedGoogle Scholar
24.
Javid  SH, Varghese  TK, Morris  AM,  et al; Collaborative to Improve Native Cancer Outcomes (CINCO).  Guideline-concordant cancer care and survival among American Indian/Alaskan Native patients.   Cancer. 2014;120(14):2183-2190. doi:10.1002/cncr.28683 PubMedGoogle Scholar
25.
Salloum  RG, Smith  TJ, Jensen  GA, Lafata  JE.  Factors associated with adherence to chemotherapy guidelines in patients with non–small cell lung cancer.   Lung Cancer. 2012;75(2):255-260. doi:10.1016/j.lungcan.2011.07.005 PubMedGoogle Scholar
26.
Vinod  SK, Sidhom  MA, Delaney  GP.  Do multidisciplinary meetings follow guideline-based care?   J Oncol Pract. 2010;6(6):276-281. doi:10.1200/JOP.2010.000019 PubMedGoogle Scholar
27.
Arriagada  R, Auperin  A, Burdett  S,  et al; NSCLC Meta-analyses Collaborative Group.  Adjuvant chemotherapy, with or without postoperative radiotherapy, in operable non–small-cell lung cancer: two meta-analyses of individual patient data.   Lancet. 2010;375(9722):1267-1277. doi:10.1016/S0140-6736(10)60059-1 PubMedGoogle Scholar
28.
Pignon  J-P, Tribodet  H, Scagliotti  GV,  et al; LACE Collaborative Group.  Lung adjuvant cisplatin evaluation: a pooled analysis by the LACE Collaborative Group.   J Clin Oncol. 2008;26(21):3552-3559. doi:10.1200/JCO.2007.13.9030 PubMedGoogle Scholar
29.
Strauss  GM, Herndon  JE  II, Maddaus  MA,  et al.  Adjuvant paclitaxel plus carboplatin compared with observation in stage IB non–small-cell lung cancer: CALGB 9633 with the Cancer and Leukemia Group B, Radiation Therapy Oncology Group, and North Central Cancer Treatment Group Study Groups.   J Clin Oncol. 2008;26(31):5043-5051. doi:10.1200/JCO.2008.16.4855 PubMedGoogle Scholar
30.
Winton  T, Livingston  R, Johnson  D,  et al; National Cancer Institute of Canada Clinical Trials Group; National Cancer Institute of the United States Intergroup JBR.10 Trial Investigators.  Vinorelbine plus cisplatin vs observation in resected non–small-cell lung cancer.   N Engl J Med. 2005;352(25):2589-2597. doi:10.1056/NEJMoa043623 PubMedGoogle Scholar
31.
National Comprehensive Cancer Network. NCCN guidelines for treatment of cancer by site: non–small cell lung cancer, version 2.2013. Accessed August 25, 2020. https://web.archive.org/
32.
National Comprehensive Cancer Network. NCCN guidelines for treatment of cancer by site: non–small cell lung cancer, version 2.2018. Accessed August 25, 2020. https://web.archive.org/
33.
Peele  PB, Siminoff  LA, Xu  Y, Ravdin  PM.  Decreased use of adjuvant breast cancer therapy in a randomized controlled trial of a decision aid with individualized risk information.   Med Decis Making. 2005;25(3):301-307. doi:10.1177/0272989X05276851 PubMedGoogle Scholar
34.
Fiset  V, O’Connor  AM, Evans  W, Graham  I, Degrasse  C, Logan  J.  Development and evaluation of a decision aid for patients with stage IV non-small cell lung cancer.   Health Expect. 2000;3(2):125-136. doi:10.1046/j.1369-6513.2000.00067.x PubMedGoogle Scholar
35.
Brundage  MD, Feldman-Stewart  D, Cosby  R,  et al; Journal of Clinical Oncology.  Phase I study of a decision aid for patients with locally advanced non–small-cell lung cancer.   J Clin Oncol. 2001;19(5):1326-1335. doi:10.1200/JCO.2001.19.5.1326 PubMedGoogle Scholar
36.
Stacey  D, Légaré  F, Lewis  K,  et al.  Decision aids for people facing health treatment or screening decisions.   Cochrane Database Syst Rev. 2017;4(4):CD001431. doi:10.1002/14651858.CD001431.pub5 PubMedGoogle Scholar
37.
Spiegle  G, Al-Sukhni  E, Schmocker  S,  et al.  Patient decision aids for cancer treatment: are there any alternatives?   Cancer. 2013;119(1):189-200. doi:10.1002/cncr.27641 PubMedGoogle Scholar
38.
Gaston  CM, Mitchell  G.  Information giving and decision-making in patients with advanced cancer: a systematic review.   Soc Sci Med. 2005;61(10):2252-2264. doi:10.1016/j.socscimed.2005.04.015 PubMedGoogle Scholar
39.
Brundage  MD, Feldman-Stewart  D, Dixon  P,  et al.  A treatment trade-off based decision aid for patients with locally advanced non-small cell lung cancer.   Health Expect. 2000;3(1):55-68. doi:10.1046/j.1369-6513.2000.00083.x PubMedGoogle Scholar
40.
Janis  IL, Mann  L.  Decision Making: A Psychological Analysis of Conflict, Choice, and Commitment. The Free Press; 1977.
41.
Street  RL  Jr, Voigt  B, Geyer  C  Jr, Manning  T, Swanson  GP.  Increasing patient involvement in choosing treatment for early breast cancer.   Cancer. 1995;76(11):2275-2285. doi:10.1002/1097-0142(19951201)76:11<2275::AID-CNCR2820761115>3.0.CO;2-S PubMedGoogle Scholar
42.
Goel  V, Sawka  CA, Thiel  EC, Gort  EH, O’Connor  AM.  Randomized trial of a patient decision aid for choice of surgical treatment for breast cancer.   Med Decis Making. 2001;21(1):1-6. doi:10.1177/0272989X0102100101 PubMedGoogle Scholar
43.
Cuypers  M, Lamers  RED, Kil  PJM, van de Poll-Franse  LV, de Vries  M.  Impact of a web-based prostate cancer treatment decision aid on patient-reported decision process parameters: results from the Prostate Cancer Patient Centered Care trial.   Support Care Cancer. 2018;26(11):3739-3748. doi:10.1007/s00520-018-4236-8 PubMedGoogle Scholar
44.
Joseph-Williams  N, Newcombe  R, Politi  M,  et al.  Toward minimum standards for certifying patient decision aids: a modified Delphi consensus process.   Med Decis Making. 2014;34(6):699-710. doi:10.1177/0272989X13501721 PubMedGoogle Scholar
×