M/NI represents Medicaid or no insurance.
Forest plot showing the hazard ratio (HR) of death for patients receiving standard arm vs experimental arm therapies. Boxes represent HRs; horizontal lines, 95% CIs; diamonds, overall average HR across subgroups; and diamond size, 95% CI. The vertical line is the line of equal hazard (ie, neither an increased or decreased benefit of experimental therapy). Results for each sociodemographic variable level are derived from a single-adjusted model controlling for the covariates specified in the Methods.
The regression coefficient (A), χ2 statistic (B), and attributable variation (C) for the interaction between insurance status and treatment depending on the amount of follow-up are shown. The strength of the interaction of treatment and insurance status was insensitive to the designated amount of follow-up time if specified annually, with interaction P values for the association with overall survival (OS) and with progression- or relapse-free survival (PFS) shown (B). M/NI represents Medicaid or no insurance.
eTable 1. SWOG Studies With Statistically Significant Benefit of Experimental Therapy on Overall Survival
eTable 2. Characteristics of the Study Sample
eFigure 1. Study Level Estimates of the Interaction Between Treatment and Sociodemographic Variables With Respect to Overall Survival
eTable 3. Association Between Treatment and Socioeconomic Variables With Respect to Overall Survival
eTable 4. Association Between Treatment and Socioeconomic Variables With Respect to Progression-Free Survival
eFigure 2. Interaction P Values By Factor; Results Excluding Single Studies
Customize your JAMA Network experience by selecting one or more topics from the list below.
Identify all potential conflicts of interest that might be relevant to your comment.
Conflicts of interest comprise financial interests, activities, and relationships within the past 3 years including but not limited to employment, affiliation, grants or funding, consultancies, honoraria or payment, speaker's bureaus, stock ownership or options, expert testimony, royalties, donation of medical equipment, or patents planned, pending, or issued.
Err on the side of full disclosure.
If you have no conflicts of interest, check "No potential conflicts of interest" in the box below. The information will be posted with your response.
Not all submitted comments are published. Please see our commenting policy for details.
Unger JM, Blanke CD, LeBlanc M, et al. Association of Patient Demographic Characteristics and Insurance Status With Survival in Cancer Randomized Clinical Trials With Positive Findings. JAMA Netw Open. 2020;3(4):e203842. doi:10.1001/jamanetworkopen.2020.3842
Do positive treatment effects from cancer clinical trials apply to all sociodemographic groups?
In this cohort study using patient-level data recorded for 10 804 patients who participated in cancer randomized clinical trials with positive findings, the receipt of experimental treatment vs standard treatment was associated with improved overall survival among patients 65 years or older compared with patients younger than 65 years. No significant added benefit of experimental treatment was observed among patients having Medicaid or no insurance compared with those with private insurance.
Patients with Medicaid or no insurance may have smaller added benefits from experimental therapies in clinical trials.
Few new treatments tested in phase 3 cancer randomized clinical trials show an overall survival benefit. Although understanding whether the benefits are consistent among all patient groups is critical for informing guideline care, individual trials are designed to assess the benefits of experimental treatments among all patients and are too small to reliably determine whether treatment benefits apply to demographic or insurance subgroups.
To systematically examine whether positive treatment effects in cancer randomized clinical trials apply to specific demographic or insurance subgroups.
Design, Setting, and Participants
Cohort study of pooled patient-level data from 10 804 patients in SWOG Cancer Research Network clinical treatment trials reported from 1985 onward with superior overall survival for those receiving experimental treatment. Patients were enrolled from 1984 to 2012. Maximum follow-up was 5 years.
Main Outcomes and Measures
Interaction tests were used to assess whether hazard ratios (HRs) for death comparing standard group vs experimental group treatments were associated with age (≥65 vs <65 years), race/ethnicity (minority vs nonminority populations), sex, or insurance status among patients younger than 65 years (Medicaid or no insurance vs private insurance) in multivariable Cox regression frailty models. Progression- or relapse-free survival was also examined. Data analyses were conducted from August 2019 to February 2020.
In total, 19 trials including 10 804 patients were identified that reported superior overall survival for patients randomized to experimental treatment. Patients were predominantly younger than 65 years (67.3%) and female (66.3%); 11.4% were black patients, and 5.7% were Hispanic patients. There was evidence of added survival benefits associated with receipt of experimental therapy for all groups except for patients with Medicaid or no insurance (HR, 1.23; 95% CI, 0.97-1.56; P = .09) compared with those with private insurance (HR, 1.66; 95% CI, 1.44-1.92; P < .001; P = .03 for interaction). Receipt of experimental treatment was associated with reduced added overall survival benefits in patients 65 years or older (HR, 1.21; 95% CI, 1.11-1.32; P < .001) compared with patients younger than 65 years (HR, 1.41; 95% CI, 1.30-1.53; P < .001; P = .01 for interaction), although both older and younger patients appeared to strongly benefit from receipt of experimental treatment. The progression- or relapse-free survival HRs did not differ by age, sex, or race/ethnicity but differed between patients with Medicaid or no insurance (HR, 1.32; 95% CI, 1.06-1.64; P = .01) vs private insurance (HR, 1.74; 95% CI, 1.54-1.97; P < .001; P = .03 for interaction).
Conclusions and Relevance
Patients with Medicaid or no insurance may have smaller added benefits from experimental therapies compared with standard treatments in clinical trials. A better understanding of the quality of survivorship care that patients with suboptimal insurance receive, including supportive care and posttreatment care, could help establish how external factors may affect outcomes for these patients.
Phase 3 trials are designed to evaluate the efficacy of new treatments or interventions. Trials with positive results—especially those with a survival end point—often establish new standards of care.1 However, phase 3 trials are typically designed to examine their primary end point for all patients combined and lack statistical power to show that the benefit of the experimental treatment consistently applies to major demographic, socioeconomic, and clinical subgroups.2,3 In oncology, this is critical to determine because treatment benefits could be smaller in disadvantaged groups at potentially higher risk of noncancer-related deaths and with more limited access to health care resources. Numerous prior studies have described the reduced health care utilization rates and cancer outcomes for racial/ethnic minority populations and for patients with Medicaid or no insurance (M/NI).4-11 In addition, differences in survival by age and sex for many cancers have been clearly characterized.12 Yet the generalizability of the treatment effects to these subgroups is often assumed, and few, if any, distinctions within demographic or socioeconomic subgroups are made in cancer treatment guidelines.
Approximately 1 in 4 phase 3 cancer clinical trials shows a benefit, and fewer show improved overall survival (OS).13,14 Using more than 3 decades of clinical trials conducted in the SWOG Cancer Research Network,15 we systematically examined whether the treatment effects for trials with positive findings applied to important demographic and insurance subgroups.
Clinical trials are conducted by SWOG for patients with a broad range of cancer types. In the present cohort study, we identified SWOG phase 3 clinical treatment trials, completed in 1985 or later, for which a significant benefit for OS in favor of the new experimental therapy was reported in the primary published article (eTable 1 in the Supplement). Patient-level data from these positive trials were pooled. Patients were enrolled from 1984 to 2012. The present study followed the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) reporting guideline.16 Each trial in this secondary analysis was previously approved by an institutional review board; written informed consent was previously obtained from all patients. No one received compensation or was offered any incentive for participating in this study.
Patients with missing age, sex, race, or performance status were excluded. Ethnicity data were routinely collected in SWOG trials beginning in 1991, and insurance status in 1992. By design, the analysis examining the association of sex with treatment outcomes was restricted to non–sex-specific cancers, the analysis by minority racial/ethnic populations restricted to patients with complete data on race and ethnicity, and the analysis by insurance type restricted to patients younger than 65 years because patients 65 years of age or older are covered by Medicare.
We defined key independent variables of interest, including age (≥65 vs <65 years), sex, and any minority racial/ethnic population (black, Hispanic, Asian, Native American, or Pacific Islander vs white; by self-report). Insurance status was categorized as private vs M/NI based on prior studies.6,7
To account for differences in clinical risk that may be associated with survival across a diverse set of cancers, a baseline clinical health status variable was used based on performance status, which has been strongly associated with cancer outcomes and was available for all studies.17 Performance status was dichotomized as 0 (no functional limitation) vs 1 or higher (some functional limitation) because few patients (7%) had a performance status of 2 or higher and several studies excluded such patients (eTable 1 in the Supplement). In addition, a global (study-level) disease stage variable was created, which was defined as advanced or poor prognosis or locally advanced disease vs other (eTable 1 in the Supplement).
We also examined the extent to which insurance status was associated with the effect of treatment on both OS and progression- or relapse-free survival (PFS) over time by iteratively truncating follow-up at 0.1-year intervals through 7.5 years. The robustness of the interaction analyses for all variables was examined by iteratively excluding each individual study and evaluating the statistical strength of the association among remaining studies by using the regression model Wald χ2 statistic.
The primary end point was OS given the clinical relevance and a definition consistent across different cancer and treatment settings. It was defined as the time from randomization until death due to any cause. Patients known to be alive at the last contact date were censored. Progression- or relapse-free survival was also examined with cancer-specific definitions.
To emphasize the association of cancer treatment with outcomes, the primary analyses for each factor used survival within the first 5 years after randomization. We used interaction tests to examine whether the association of treatment with survival differed by demographic and insurance status variables. Multivariable Cox regression frailty models were used with each individual study considered a random effect to account for heterogeneity in design, assessment intervals, follow-up duration, and prognosis.18,19 We included covariate adjustment for age, sex, minority status, period of registration (during or before 2000 vs after 2000), clinical risk using performance status, and the study-level disease stage variable.
Statistical tests were from Wald χ2 test statistics derived from multivariable Cox regression frailty models. Analyses were conducted from August 2019 to February 2020 using SAS, version 9.4 (SAS Institute Inc) and R, version 3.4.1 (R Foundation for Statistical Computing). All tests were 2-sided, and P < .05 was considered statistically significant.
Nineteen phase 3 treatment trials showing an overall survival benefit were identified across a diverse range of cancers (eTable 1 in the Supplement).20-38 In all cases, the experimental therapy was compared with an existing standard of care that included active treatment. Of 11 026 eligible patients, 38 had missing data on age or race, and 184 had missing data on performance status, leaving 10 804 patients (98.0%) with complete data on age, sex, race, and performance status (Figure 1). The age analysis was conducted for the entire cohort of 10 804 patients. Eight trials with 6858 patients with sex-specific cancers were excluded from the analysis by sex, leaving 3946 patients. Overall, 3611 patients were enrolled prior to 1991, leaving 7193 patients with race/ethnicity data potentially analyzable for the race/ethnicity analysis; of these patients, 203 (2.8%) had missing data on ethnicity, leaving 6990 patients. Overall, 5792 patients were enrolled in 1992 or after, among whom 2095 were 65 years or older, leaving 3597 patients with potentially analyzable insurance data; of these, 902 patients (25.1%) had missing insurance data, leaving 2695 patients. The insurance analysis was conducted in 2255 patients with private insurance or M/NI and included 16 trials with at least partial insurance data and 10 trials with nearly complete (>85%) insurance data (eTable 1 in the Supplement).
The patients were predominantly younger than 65 years (67.3%), 66.3% were female, and 35.7% had a performance status of 1 or higher (eTable 2 in the Supplement). In the non–sex-specific cancer trials only, 37.6% were female, consistent with the US cancer population.39 Of the patients with complete data on race/ethnicity, 20.5% were in a minority population, including 11.4% black and 5.7% Hispanic patients. Of the patients included in the insurance analysis, 24.8% had M/NI.
In the age analysis, older patients were less likely to be in a minority population or be fully active (Table 1). In the sex analysis, female patients were less likely to have advanced disease. In the race/ethnicity analysis, minority patients were less likely to be older than 65 years or to be fully active. In the insurance analysis, patients with M/NI were more commonly minority patients and less likely to be fully active. There was no evidence that the association between age, sex, race/ethnicity, or insurance status and demographic or clinical status variables differed between those assigned to standard and those assigned experimental therapy.
Study-level estimates of the interaction between treatment and sociodemographic variables are shown in eFigure 1 in the Supplement. For the age analysis, receipt of experimental treatment was associated with reduced added OS benefits in patients 65 years or older (hazard ratio [HR], 1.21; 95% CI, 1.11-1.32; P < .001) compared with patients younger than 65 (HR, 1.41; 95% CI, 1.30-1.53; P < .001; P = .01 for interaction), although the receipt of experimental therapy was strongly associated with added OS benefits for both age groups (Figure 2; eTable 3 in the Supplement).
Among patients in trials for non–sex-specific cancers, there was no evidence that the HR for standard to experimental therapy differed for female (HR, 1.40; 95% CI, 1.21-1.60; P < .001) vs male (HR, 1.39; 95% CI, 1.25-1.54; P < .001) patients (P = .97 for interaction). Among patients in the race/ethnicity analysis, receipt of experimental therapy appeared to be associated with increased added OS benefits in minority patients (HR, 1.39; 95% CI, 1.19-1.62; P < .001) compared with nonminority patients (HR, 1.34; 95% CI, 1.23-1.45; P < .001), although the difference between groups was small and not statistically significant (P = .68 for interaction).
For patients with M/NI, there was no statistically significant added benefit associated with receipt of experimental treatment (HR, 1.23; 95% CI, 0.97-1.56; P = .09) compared with patients with private insurance (HR, 1.66; 95% CI, 1.44-1.92; P < .001; P = .03 for interaction). Alternatively, although there was no difference in risk of death between patients with M/NI and privately insured patients treated with standard therapies (HR, 1.03; 95% CI, 0.84-1.27; P = .77), among patients receiving experimental therapies, those with M/NI had a greater risk of death; in other words, they did not have the same added benefits of experimental therapy (HR, 1.40; 95% CI, 1.14-1.71; P = .001) (eTable 3 in the Supplement).
There was no evidence that patterns of association of treatment with PFS differed among subgroups by age, sex, or race/ethnicity (Table 2; eTable 4 in the Supplement). Among patients with private insurance, there was an observed greater benefit associated with receipt of experimental therapy (HR, 1.74; 95% CI, 1.54-1.97; P < .001) compared with patients with M/NI (HR, 1.32; 95% CI, 1.06-1.64; P = .01; P = .03 for interaction).
The magnitude of the model coefficient value for the interaction of treatment and insurance status was approximately constant for both OS and PFS from 1 year after randomization onward (Figure 3A). Furthermore, the strength of the interaction for both OS and PFS reached statistical significance by 1 year and was insensitive to the designated amount of follow-up time when specified annually (Figure 3B). When considering only the model effect of treatment, insurance, and the interaction between insurance and treatment, nearly one-third of the variation in OS (31.1%)—but only 9.3% of the variation in PFS—was attributable to insurance status and its interaction with treatment (Figure 3C). This finding suggested that, even though insurance status was associated with both cancer and noncancer outcomes, its association with noncancer outcomes was notably greater. These results indicated a marked association of insurance status with both cancer and especially noncancer outcomes manifesting early in the course of treatment and remaining approximately constant through 7.5 years.
The findings were largely robust to the exclusion of individual studies (eFigure 2 in the Supplement). The χ2 statistic remained statistically significant in 15 of 19 cases (78.9%) for the interaction of age and treatment and in 12 of 16 cases (75.0%) for the interaction of insurance and treatment. The interaction tests were not statistically significant for the sex and race/ethnicity analyses in all cases.
In this pooled analysis of phase 3 studies positive for OS, receipt of experimental treatment was not associated with added OS benefits among patients with M/NI, in an adjusted model compared with privately insured patients. Furthermore, an association of insurance status with both PFS and OS was observed within 1 year after initiation of treatment and was sustained through 7.5 years. By contrast, significant added OS benefits from receipt of experimental therapies were observed for female patients, male patients, minority patients, nonminority patients, and privately insured patients. The magnitude of the added survival benefit associated with receiving experimental therapies was significantly greater for patients younger than 65 years based on the interaction analysis; however, receipt of experimental therapy was strongly associated with added OS benefits for both age groups, suggesting a quantitative rather than qualitative interaction, with more limited clinical or policy implications.40 Finally, the findings by insurance status, age, sex, and race/ethnicity were generally not influenced by the inclusion of any single trial, suggesting that these findings were internally robust.
Ayanian et al41 was among the first to identify that patients with M/NI had worse survival outcomes than other patients and concluded that differences in access to care, staging, and treatments played a role. Noncancer-related factors also likely play a role.42 Our study differs from prior studies in 2 key aspects. First, prior studies focused on differences between those with suboptimal insurance compared with those with private insurance overall, irrespective of the nature of the treatment (eg, newly proven treatment vs standard treatment).42-46 Second, in contrast to prior studies that relied on cancer population data, patients in clinical trials are uniformly staged according to eligibility criteria, a principal advantage of using trial data to examine outcomes by demographic and insurance factors. This uniform staging limits the potential for differences between patient groups in baseline health status (eg, differences in patterns of concurrent illnesses) to bias the association with outcomes. In addition, we adjusted for important baseline factors, including performance status, a key measure of health status and a potential confounder. Nonetheless, residual differences in health status and health behaviors between certain groups may remain, especially for disadvantaged groups. In addition, once enrolled, trial patients all have access to protocol-guided therapy representing either standard treatment or an experimental alternative thought to be approximately as good or better than standard of care. Thus, patients in clinical trials start with the same treatments, are healthy enough to participate in trials, and typically have similar initial cancer risk profiles, although differences in comorbid conditions not ruled out by protocol eligibility criteria may still exist.
An individual’s health care insurance facilitates their access to health care services; insurance status also reflects socioeconomic status.47,48 These 2 constructs are related because insurance coverage is associated with income.47 Medicaid eligibility is largely limited to children, parents of dependent children, pregnant women, disabled persons, and elderly persons and is primarily determined by income level; in this context, it can be considered a surrogate for poverty or low income, even as the program provides needed access to health care services.48,49 Importantly, the present study did not indicate that patients with M/NI did not benefit from cancer therapy. Rather, it showed that the added benefits associated with experimental therapies in clinical trials on OS were much smaller for patients with M/NI compared with privately insured patients. Indeed, within the group of patients with M/NI, the CI did not preclude some modest positive association with OS. The patients with M/NI did have improved PFS, suggesting that receipt of experimental therapies was associated with benefits for cancer-specific outcomes despite these benefits being much lower compared with privately insured patients.
The reasons for these findings are likely multifactorial. The observation that patients with M/NI had limited benefits associated with receipt of experimental therapies that were otherwise beneficial for all demographic patient groups is consistent with the idea that lower socioeconomic status has a constant, negative influence on health through the mechanism of long-term, sustained lack of access to resources.50 This could dampen the benefits of experimental treatments in trials for patients with suboptimal insurance if receipt of experimental therapy typically requires more supportive services or is more difficult to adhere to than standard care. Alternatively, access to postprotocol therapy may differ for those receiving experimental vs standard therapy. Under these scenarios, the added benefits of new experimental therapies may be short-lived. In fact, further detailed analyses in the present study showed that the association of insurance status with outcomes began within 1 year after treatment initiation, illustrating how the benefits of equal access to initial treatment quickly waned for patients with M/NI. Other reasons for the observed findings may include that patients with suboptimal insurance are likely at increased risk of noncancer deaths, which can reduce the ability to detect the benefits of experimental treatments in trials. This factor may also explain the more limited benefits of the experimental therapies observed among older patients because the burden of other (comorbid) diseases increases markedly with age.51
Legislation sponsored by the American Society of Clinical Oncology and currently before Congress seeks to require state Medicaid programs to cover routine patient costs for items and services that are provided in connection with a qualifying clinical trial regarding cancer or other life-threatening conditions.52 This legislation could help resolve the disparity in experimental treatment benefits by insurance status within clinical trials; however, this legislation would only improve the applicability of trial results if Medicaid patients receiving cancer treatment outside of trials also have adequate access to cancer care. Yet state-level Medicaid programs vary widely in their coverage and reimbursement policies, which may affect both the consistency and the adequacy of care for patients.53,54 One study highlighted how Medicaid coverage for hematopoietic cell transplant to treat patients with hematologic cancers varied substantially by state, with no states providing full recommended coverage.55 Variations in state Medicaid policies may be associated with time to receipt of surgery for breast cancer.56 Studies have shown underuse of screening, genetic testing and counseling, adjuvant therapy, surgery, and radiation therapy for patients on Medicaid.57-62 Furthermore, not all physicians accept Medicaid patients given the relatively low reimbursement rates, presenting additional hurdles to access to care for these patients.63 In general, our findings highlight the importance of coverage expansion policies for those with suboptimal insurance and underline the importance of improved coverage provisions for those with existing Medicaid insurance.
To our knowledge, this is first study to examine whether treatment effects from cancer randomized clinical trials with positive findings were associated with major demographic or insurance status subgroups. This analysis required the unique combination of a large clinical trial database with patient-level data from multiple trials positive for OS conducted over a long period, with insurance status data collected for the same trials. Despite its uniqueness, the study also has limitations. Although performance status is strongly associated with outcomes irrespective of cancer type,64 its use as a covariate may not adequately reflect baseline health status. Insurance status data were not available for older trials. In addition, most of the trials were completed before the implementation of the insurance exchanges and the Medicaid expansion through the Affordable Care Act; thus, the potential influence of this legislation on the present findings could not be established. Given no known prior systematic examinations about how treatment effects may differ by sociodemographic variables, we reported P < .05 as statistically significant with no adjustment for multiple comparisons. Thus, confirmatory analyses in independent studies may provide important insights about the observed associations in this study.
The magnitude of added treatment benefits associated with receipt of experimental therapies may not be uniform for patients with Medicaid or without insurance. Future work into the potential causes of this phenomenon is warranted. A better understanding of the quality of survivorship care that patients with suboptimal insurance receive, including supportive care and posttreatment care, could help establish how external factors may affect outcomes for these patients.
Accepted for Publication: March 2, 2020.
Published: April 30, 2020. doi:10.1001/jamanetworkopen.2020.3842
Open Access: This is an open access article distributed under the terms of the CC-BY License. © 2020 Unger JM et al. JAMA Network Open.
Corresponding Author: Joseph M. Unger, PhD, SWOG Statistics and Data Management Center, Fred Hutchinson Cancer Research Center, 1100 Fairview Avenue N, M3-C102, PO Box 19024, Seattle, WA 98109-1024 (firstname.lastname@example.org).
Author Contributions: Dr Unger had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.
Concept and design: Unger, Ramsey, Hershman.
Acquisition, analysis, or interpretation of data: Unger, Blanke, LeBlanc, Barlow, Vaidya, Hershman.
Drafting of the manuscript: Unger, Blanke, Hershman.
Critical revision of the manuscript for important intellectual content: All authors.
Statistical analysis: Unger, LeBlanc.
Obtained funding: Unger, Blanke.
Supervision: Unger, Ramsey.
Conflict of Interest Disclosures: Dr Ramsey reported receiving personal consulting fees from Bayer, Bristol-Myers Squibb, Genentech, Kite Pharma, and Seattle Genetics; research funding from Bayer and from Bristol-Myers Squibb; and travel funding from Bayer Schering Pharma AG, Bristol-Myers Squibb, and Flatiron Health. No other disclosures were reported.
Funding/Support: Research reported in this publication was supported in part by grant 5UG1CA189974 from the Division of Cancer Prevention, National Cancer Institute, National Institutes of Health under (Dr Hershman); in part by The Hope Foundation for Cancer Research in support of infrastructure, data analysis, and trial design within the SWOG Cancer Research Network, at the SWOG Statistics and Data Management Center (Dr Unger); and by the Dr Charles A. Coltman, Jr, Fellowship Program of The Hope Foundation For Cancer Research (Dr Unger).
Role of the Funder/Sponsor: The funding sources had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.
Disclaimer: The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.