For each treatment arm (atezolizumab plus bevacizumab and sorafenib) and each end point (overall survival and progression-free survival), event time distributions were estimated using a mixed model with a Kaplan-Meier survival estimator up to the last follow-up and Weibull distribution for the tail after the last follow-up. The IMbrave150 trial only reported survival data within 17 months; thus, the numbers of individuals at risk were not available beyond this period.
The 10 most influential variables are presented. The dotted line in the middle represents the incremental cost-effectiveness ratio (ICER) of $322 500 per quality-adjusted life-year (QALY) from the base case results. The left and right dotted lines represent the 5th ($149 364 per QALY) and 95th ($683 744 per QALY) per percentiles of ICER, respectively, from the results of probabilistic sensitivity analysis.
The curves show the probabilities of being cost-effective at different willingness-to-pay thresholds for atezolizumab plus bevacizumab and sorafenib. QALY, quality-adjusted life-year.
eTable 1. Model Parameters: Baseline Values, Ranges, and Distributions for Sensitivity Analyses
eTable 2. Results for Subgroup Analyses
eFigure. Scatter Plot of Probabilistic Sensitivity Analysis
Customize your JAMA Network experience by selecting one or more topics from the list below.
Identify all potential conflicts of interest that might be relevant to your comment.
Conflicts of interest comprise financial interests, activities, and relationships within the past 3 years including but not limited to employment, affiliation, grants or funding, consultancies, honoraria or payment, speaker's bureaus, stock ownership or options, expert testimony, royalties, donation of medical equipment, or patents planned, pending, or issued.
Err on the side of full disclosure.
If you have no conflicts of interest, check "No potential conflicts of interest" in the box below. The information will be posted with your response.
Not all submitted comments are published. Please see our commenting policy for details.
Zhang X, Wang J, Shi J, Jia X, Dang S, Wang W. Cost-effectiveness of Atezolizumab Plus Bevacizumab vs Sorafenib for Patients With Unresectable or Metastatic Hepatocellular Carcinoma. JAMA Netw Open. 2021;4(4):e214846. doi:10.1001/jamanetworkopen.2021.4846
Is atezolizumab plus bevacizumab a cost-effective first-line treatment compared with sorafenib for unresectable or metastatic hepatocellular carcinoma from a US payer perspective?
In this economic evaluation of data from a hypothetical sample of 424 patients, compared with the standard sorafenib therapy, atezolizumab plus bevacizumab was associated with an incremental increase in quality-adjusted life-years per patient, with an incremental cost of $156 210 and an incremental cost-effectiveness ratio of $322 500 per quality-adjusted life-year.
In this study, atezolizumab plus bevacizumab was associated with clinical benefit but was not cost-effective compared with sorafenib for first-line treatment of unresectable or metastatic hepatocellular carcinoma from a US payer perspective.
Atezolizumab plus bevacizumab as a first-line therapy for patients with unresectable or metastatic hepatocellular carcinoma has been shown to improve overall and progression-free survival compared with standard sorafenib treatment. However, because of the high cost of atezolizumab plus bevacizumab, assessment of its value by considering both efficacy and cost is needed.
To evaluate the cost-effectiveness of atezolizumab plus bevacizumab vs sorafenib for patients with unresectable or metastatic hepatocellular carcinoma from a US payer perspective.
Design, Setting, and Participants
This economic evaluation was performed from June through September 2020, with a 6-year investment time period. Hypothetical patients were male and female adults 18 years or older who had a diagnosis of locally advanced metastatic or unresectable hepatocellular carcinoma confirmed by histologic or clinical features.
Main Outcomes and Measures
Health care costs (adjusted to 2020 US dollars), life-years, quality-adjusted life-years (QALYs), and incremental cost-effectiveness ratio (ICER) of atezolizumab plus bevacizumab vs sorafenib were examined using a partitioned survival model. One-way deterministic and probabilistic sensitivity analyses were used to examine model uncertainty. The model was also used to estimate price reductions of atezolizumab plus bevacizumab that would achieve more favorable cost-effectiveness.
In the base case analysis of a hypothetical sample of 424 patients, atezolizumab plus bevacizumab was associated with an increase of 0.623 life-years (1.840 vs 1.218 life-years) and 0.484 QALYs (1.412 vs 0.928 QALYs) and with an incremental cost of $156 210 per patient compared with sorafenib. The ICER was $322 500 per QALY (5th to 95th percentile, $149 364-$683 744 per QALY), with 0.6% and 5.1% chance of being cost-effective at willingness-to-pay thresholds of $100 000 and $150 000 per QALY, respectively. The ICER never decreased below $150 000 per QALY in the 1-way sensitivity analyses. To achieve more favorable cost-effectiveness under the thresholds of $150 000 to $100 000 per QALY, the prices of atezolizumab and bevacizumab would need to be reduced by 37% to 47%.
Conclusions and Relevance
In this economic evaluation, atezolizumab plus bevacizumab was associated with clinical benefit but was not cost-effective compared with sorafenib for first-line treatment of unresectable or metastatic hepatocellular carcinoma from a US payer perspective. A substantial reduction in price for atezolizumab plus bevacizumab would be needed to achieve favorable cost-effectiveness for this new therapy.
Hepatocellular carcinoma (HCC) is the most common type of liver cancer, accounting for more than 840 000 diagnosed cases and 780 000 deaths worldwide each year.1 Although early-stage disease may be cured by means of treatments such as resection, ablation, or liver transplantation, most patients present with unresectable disease at diagnosis and have a poor prognosis.2 According to the American Cancer Society, liver cancer incidence rates have more than tripled and the death rates have more than doubled since 1980, making it the fastest increasing cause of deaths due to cancer in the US.3
Sorafenib, an oral multikinase inhibitor, was the first approved systemic regimen for unresectable HCC based on results of a phase 3 trial showing a survival advantage over placebo.4 Until recently, no regimens have been demonstrated to be superior to sorafenib in phase 3 trials.5 However, the prognosis with sorafenib is only modestly improved, with a median duration of survival of 6.5 to 14.7 months.4,6-13
Atezolizumab is a fully humanized monoclonal antibody that selectively targets the protein programmed cell death ligand 1 (PD-L1) and restores T-cell immune activity.14 Bevacizumab is a fully humanized monoclonal antibody that targets vascular endothelial growth factor (VEGF),15 which plays important roles in tumor vascularization.16 In addition, anti-VEGF therapies may also enhance anti-programmed death 1 and anti–PD-L1 efficacy by reducing VEGF-mediated immunosuppression within the tumor microenvironment and promoting T-cell infiltration in tumors.17,18
Recently, the IMbrave150 phase 3 randomized clinical trial13 demonstrated a significant improvement in survival with use of atezolizumab plus bevacizumab compared with use of sorafenib in patients with unresectable or metastatic HCC who had not previously received systemic therapy (hazard ratio [HR], 0.58; 95% CI, 0.42-0.79).13 Until now, the combination is the only regimen demonstrated to be superior to the standard sorafenib in phase 3 trials. The overall incidence rates of grade 3 or 4 adverse events were similar in the 2 treatment groups (56.5% for atezolizumab plus bevacizumab vs 55.1% for sorafenib).13 Atezolizumab plus bevacizumab was subsequently approved by the US Food and Drug Administration in May 2020 and has become a new first-line standard of care.19 The objective of this study was to evaluate the cost-effectiveness of atezolizumab plus bevacizumab vs sorafenib as the first-line treatment for patients with unresectable or metastatic HCC from a US payer perspective.
This economic evaluation was performed at Xi’an Jiaotong University in Xi’an, China, from June through September 2020. The study was deemed exempt from institutional review board approval by the Second Affiliated Hospital of Xi’an Jiaotong University because it did not involve human participants. This study followed the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) reporting guideline.20
The target patient population was the same as that from the IMbrave150 trial.13 Included patients were adults (aged ≥18 years) who had locally advanced metastatic or unresectable HCC or both, with diagnosis confirmed by histologic or clinical features.21 Other inclusion criteria were no history of systemic therapy, a performance status of 0 or 1 on the Eastern Cooperative Group scale, and adequate hematologic and organ function.
Included patients received either first-line atezolizumab-bevacizumab (atezolizumab, 1200 mg, plus bevacizumab, 15 mg per kilogram of body weight, intravenously every 3 weeks) or first-line sorafenib (400 mg orally twice daily). When disease progressed or unacceptable adverse events occurred, the first-line treatments were discontinued and patients in both arms of the study could receive second-line treatments until death. In the IMbrave150 trial,13 69 of 266 patients (25.9%) in the atezolizumab plus bevacizumab arm and 73 of 158 patients (46.2%) in the sorafenib arm received second-line treatment. Tyrosine kinase inhibitors (including regorafenib and cabozantinib) were the second-line options for both arms.13 In addition, the patients in the sorafenib arm could receive immunotherapy as second-line treatment.13
A partitioned survival model was developed to compare health care costs and clinical outcomes associated with atezolizumab plus bevacizumab vs sorafenib for treatment of patients with unresectable or metastatic HCC. The model is frequently used in late-stage oncology modeling.22 The time horizon was 6 years, and more than 98.5% patients died in both treatment arms (Figure 1). The cycle length was 1 month (30 days). The analysis was conducted from a US payer perspective. The primary outputs of the model were cost, life-years, quality-adjusted life-years (QALYs), and incremental cost-effectiveness ratio (ICER). Both costs and clinical outcomes were discounted by 3% annually.23 A willingness-to-pay threshold of $100 000 or $150 000 per QALY gained was used to determine cost efficacy.24,25 The model was constructed using TreeAge Pro 2020 (TreeAge Software).
Probabilities of overall survival (OS) and progression-free survival (PFS) for atezolizumab plus bevacizumab and sorafenib were extracted from Kaplan-Meier curves in the IMbrave150 trial13 using GetData Graph Digitizer.26 For each treatment arm (atezolizumab plus bevacizumab and sorafenib) and each end point (OS and PFS), event time distributions were estimated using a mixed model, with a Kaplan-Meier survival estimator up to the last follow-up visit and Weibull distribution for the tail after the last follow-up visit. Weibull distributions were generated on the basis of extracted data from Kaplan-Meier curves in IMbrave150 using the methods described by Hoyle and Henley.27 The Weibull distribution was selected because it seemed more biologically and clinically plausible than logarithmic models.28 Fitted mixed models are shown in Figure 1.
Only direct medical costs were considered, including costs for drugs, drug administration, follow-up visits, management of adverse events, and end-of-life care. Atezolizumab and bevacizumab costs were obtained from the Centers for Medicare & Medicaid Services.29 Body weight was not reported in the IMbrave150 trial. A mean body weight of 73 kg, adopted from an HCC cohort, was used for dose calculation of bevacizumab.30 Sorafenib cost was obtained from Micromedex Redbook Online.31,32 Dose intensity was assumed to be 95% for atezolizumab, 93% for bevacizumab, and 84% for sorafenib, as observed in the IMbrave150 trial.13 Thus, the cost of sorafenib per month would be $14 767.65 ($586.018 per day × 30 days × 0.84 for 400 mg orally twice daily). Regorafenib and cabozantinib costs were also obtained from Micromedex Redbook,31 and dose reduction was based on results of previous studies32-38 (eTable 1 in the Supplement). Administration costs were obtained from the Medicare physician fee schedule for 2020.39
Patients in both arms of the study were assumed to be routinely followed up until death. The follow-up costs included physician visits, laboratory tests, and imaging (eTable 1 in the Supplement). Patients who experienced disease progression had greater follow-up costs than those who entered the study before disease progression occurred. End-of-life cost was allocated when a patient died, and cost was assumed to be equivalent in both arms.
Grade 3 to 4 adverse events that occurred in 2% or more of the patients in the IMbrave150 trial were included in the model. The related costs were derived from previously published studies32-38 (eTable 1 in the Supplement). All costs were converted to 2020 US dollars using the medical component of the Consumer Price Index.40
Utility values were not reported in the IMbrave150 trial. Kobayashi et al41 calculated utility values by analyzing patient-level data on health-related quality of life in the REFLECT trial, a noninferiority trial in which lenvatinib was compared with sorafenib.11 In this trial, health-related quality of life was assessed using the 3-level version of the European Quality of Life 5-Dimension questionnaire.11 According to Kobayashi et al,41 the utility values were 0.837 for a progression-free patient with sorafenib treatment after subtracting adverse event disutilities and 0.714 for a patient with disease progression. In the base case of the present analysis, these utility values were used for patients receiving sorafenib treatment because the characteristics of patients in the IMbrave150 and REFLECT trials were similar. Data were not available to calculate utility values for atezolizumab-bevacizumab treatment. They were assumed to be the same as those for sorafenib.41
A series of sensitivity analyses were performed to assess the robustness of the model and to address the uncertainty in estimates of variables. Hazard ratios, incidences of adverse events, rates of treatment discontinuation, and second-line treatment proportions were varied over their 95% CIs. A wide range of utility values was derived from previous studies32-38 (eTable 1 in the Supplement). Cost ranges were derived from previously published studies41-43 if available; otherwise, a variance of 25% from base case values was assumed. In 1-way sensitivity analyses, the association of each aforementioned parameter with ICERs was examined over its defined range. The ranges of model inputs for sensitivity analyses are listed in eTable 1 in the Supplement. In addition, we estimated price reductions for atezolizumab plus bevacizumab that would achieve more favorable cost-effectiveness under the thresholds of $150 000 to $100 000 per QALY.
A probabilistic sensitivity analysis was performed using 10 000 Monte Carlo simulations; random sampling from the distributions of all parameters was done each time. Distributions were assumed based on parameter types: gamma distribution for costs and body weight; log-normal distribution for HRs; and β distribution for utility, incidences of adverse events, rates of treatment discontinuation, and second-line treatment proportions (eTable 1 in the Supplement).
In the subgroup analyses, the ICER was calculated for each subgroup using the subgroup-specific HRs for OS and PFS obtained from the IMbrave150 trial (eTable 2 in the Supplement). Because of the lack of sufficient data, the same data were assumed for all subgroups except for the subgroup-specific HRs for OS and PFS.
The base case analysis assessed a hypothetical sample of 424 patients. Results of the base case cost-effectiveness analysis are shown in the Table. Atezolizumab plus bevacizumab treatment was associated with significantly higher health care costs per patient compared with standard treatment with sorafenib ($313 193 vs $156 984), with an incremental cost of $156 210. Of this incremental cost, drug cost accounted for $145 217 and nondrug cost accounted for $10 993. Atezolizumab plus bevacizumab treatment was associated with an improvement of 0.623 life-years (1.840 vs 1.218 life-years) and 0.484 QALY (1.412 vs 0.928 QALYs) per patient compared with standard treatment with sorafenib. The ICER for atezolizumab plus bevacizumab vs sorafenib was estimated to be $322 500 per QALY.
The results of 1-way sensitivity analyses are shown in Figure 2. The HR for OS had the greatest influence on the ICER, followed by patient weight, HR for PFS, cost of atezolizumab, utility of progression-free state, cost of bevacizumab, cost of sorafenib, and utility of postprogression state. The associations of other variables with the ICER were negligible. Across a broad variation in the ranges for each variable, the ICER remained greater than $150 000 per QALY. To achieve more-favorable cost-effectiveness under the thresholds of $150 000 to $100 000 per QALY, the price of atezolizumab plus bevacizumab combination treatment would need to be reduced by 37% to 47%.
In a probabilistic sensitivity analysis of 10 000 simulations, the 5th to 95th percentile range for the ICER was estimated to be $149 364 per QALY to $683 744 per QALY. The cost-effectiveness acceptability curves suggested that the probability of atezolizumab plus bevacizumab being cost-effective compared with sorafenib was 0.6% and 5.1% at willingness-to-pay thresholds of $100 000 and $150 000 per QALY, respectively (Figure 3). A scatterplot showing the 10 000 simulations is presented in the eFigure in the Supplement. The results of subgroup analyses showed that the ICER for atezolizumab plus bevacizumab vs sorafenib was greater than $150 000 per QALY for all patients in clinically relevant subgroups (eTable 2 in the Supplement).
To date, atezolizumab plus bevacizumab is currently the first and only treatment superior to sorafenib, the standard of care for unresectable or metastatic HCC.13 Thus, the drug was approved as a new first-line therapy for patients with this disease. However, based on our model, the cost of the new treatment doubled because of higher drug costs. Atezolizumab plus bevacizumab cost $322 500 per additional QALY gained compared with sorafenib from a US payer perspective. The probabilistic sensitivity analysis revealed that the probability of atezolizumab plus bevacizumab being cost-effective was 0.6% and 5.1% at willingness-to-pay thresholds of $100 000 and $150 000 per QALY, respectively. The uncertainty analysis suggests a high likelihood that atezolizumab plus bevacizumab exceeds the usually accepted values for cost-effective incremental costs of care.25
In the 1-way sensitivity analyses, HRs for OS and PFS, drug costs, and health utilities were the most influential parameters. However, across a wide range of each of these parameters, atezolizumab plus bevacizumab was still not cost-effective compared with sorafenib at the willingness-to-pay threshold of $150 000 per QALY. Studies of other malignant neoplasms have suggested improved cost-effectiveness of immunotherapy in certain subgroups of patients.44-46 In the present study regarding unresectable or metastatic HCC, an association between treatment and cost-effectiveness was not found in any subgroup, but the results should be interpreted with caution because of the small sample size for each group and the exploratory nature of subgroup analyses.
The willingness-to-pay threshold can substantially affect the cost-effectiveness of a therapy. Drugs used to treat cancer often have higher ICERs than other drugs, and a value of $100 000 or $150 000 per QALY has been suggested as the willingness-to-pay threshold in the US.24,25 Nevertheless, the US Food and Drug Administration approves new drugs used in cancer treatment based on their efficacy and safety. Many of these drugs are used despite an ICER greater than $100 000 or $150 000 per QALY. The present study showed an ICER of $322 500 per QALY for atezolizumab plus bevacizumab vs sorafenib, which is higher than those thresholds. This finding does not suggest opposition to the use of atezolizumab plus bevacizumab for patients with late-stage HCC but rather suggests that policy makers spend more resources on more cost-effective interventions (eg, HCC screening for patients with cirrhosis47) so that they can maximize health gains with a fixed budget by choosing interventions with ICERs from the lowest to highest until the available resources are consumed.25
Recently, a study showed a similar cost-effectiveness balance in China; even in comparison with the present study, atezolizumab plus bevacizumab was reported with more QALYs gained (0.811 QALY) and a substantial reduction in incremental cost ($49 994) because of drug donation programs.48 But the study reported a markedly long OS of 1.736 years (20.832 months) associated with sorafenib compared with results of published phase 3 trials of treatment for unresectable or metastatic HCC.4,6-13 To our knowledge, no other cost-effectiveness analyses of immune checkpoint inhibitors for HCC have been published. Previously, these drugs were evaluated for treatment of other recurrent or metastatic malignant neoplasms, such as head and neck cancers, non–small cell lung cancer, renal cell cancer, and melanoma.49 Because development costs are high, the prices of immune checkpoint inhibitors are often high.50 Thus, it is not uncommon to see an immune checkpoint inhibitor that is not cost-effective mentioned in published economic evaluations. In the present analysis, the addition of bevacizumab (an anti–vascular endothelial growth factor agent) to the immune checkpoint inhibitor atezolizumab made the combination more expensive. If generics or biosimilars can be generated in the future and if government negotiation with pharmaceutical companies is successful, drug prices may decrease so that atezolizumab plus bevacizumab can be affordable.50 As the present analysis has shown, reduction of ICERs to more widely acceptable values requires a substantial price reduction for the combination of atezolizumab plus bevacizumab (37% to 47%).
This study has limitations. First, the long-term efficacy of atezolizumab plus bevacizumab for the treatment of unresectable or metastatic HCC remains a question. In long-term follow-up for patients with other malignant neoplasms who received immunotherapy, a plateau appeared on the tail of the survival curve.51,52 The possibility of long-term survival with atezolizumab plus bevacizumab would alter the effectiveness implemented in the model, but it also raises the question of when to stop immunotherapy in a responding patient. In addition, responding patients, although only accounting for a small proportion, may have the opportunity to undergo surgical resection; however, the long-term benefit is unknown, and resection may increase the cost of treatment.
Second, to our knowledge, the IMbrave150 trial13 is the only phase 3 randomized clinical trial in which atezolizumab plus bevacizumab was compared with sorafenib for the treatment of unresectable or metastatic HCC. Parameters of efficacy and safety in the model essentially relied on results of this trial. Any biases within the trial may have affected the cost and effectiveness. For example, the patients enrolled in IMbrave150 were healthier than the general population of patients with unresectable or metastatic HCC, and patients participating in clinical trials often have better adherence to treatment than do those in real-world practice.53
Third, the utility values in the model were not estimated from the IMbrave150 study but from the REFLECT study, in which lenvatinib was compared with sorafenib.12,41 In the present study, the value was directly used for the sorafenib treatment arm because the target patients and adverse events with sorafenib treatment were comparable between the 2 studies.11,13 The IMbrave150 trial showed that atezolizumab plus bevacizumab significantly delayed the decline in quality of life and functioning, even in patients with disease progression.13 Thus, the assumption of the same utility value in both arms in the base case may have underestimated the effectiveness of atezolizumab plus bevacizumab. However, the underestimation would not have changed the cost-effectiveness balance. Even if no utility reduction occurred after disease progression during treatment with atezolizumab plus bevacizumab, an ICER of $255 058 per QALY would still be higher than the willingness-to-pay thresholds.
The present study did not include evaluation of lenvatinib, which is another first-line treatment approved for unresectable or metastatic HCC in the US. Because of similar clinical effectiveness and lower cost compared with sorafenib,11 atezolizumab plus bevacizumab would not be cost-effective compared with lenvatinib.
The findings of this economic evaluation suggest that from the perspective of US payers, atezolizumab plus bevacizumab is unlikely to be cost-effective under current drug pricing at willingness-to-pay thresholds of $100 000 to $150 000 per QALY compared with sorafenib for patients with unresectable or metastatic HCC who have not received systemic therapy. A substantial price reduction for the combination of atezolizumab plus bevacizumab would be needed to achieve favorable cost-effectiveness for this new therapy.
Accepted for Publication: February 8, 2021.
Published: April 7, 2021. doi:10.1001/jamanetworkopen.2021.4846
Open Access: This is an open access article distributed under the terms of the CC-BY-NC-ND License. © 2021 Zhang X et al. JAMA Network Open.
Corresponding Author: Wenjun Wang, MD, Department of Hepatology and Infectious Diseases, Second Affiliated Hospital of Xi’an Jiaotong University, 157 Xiwu Rd, Xi’an 710004, China (firstname.lastname@example.org).
Author Contributions: Drs Zhang and J. Wang served as co–first authors and contributed equally to this work. Dr W. Wang had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.
Concept and design: Zhang, W. Wang.
Acquisition, analysis, or interpretation of data: All authors.
Drafting of the manuscript: Zhang, J. Wang, W. Wang.
Critical revision of the manuscript for important intellectual content: All authors.
Statistical analysis: Zhang, J. Wang, Shi, W. Wang.
Administrative, technical, or material support: Jia, W. Wang.
Conflict of Interest Disclosures: None reported.
Funding/Support: This work was supported by grant TQGB20180175 (W. Wang) from the Chinese Foundation for Hepatitis Prevention and Control: TianQing Liver Disease Research Fund.
Role of the Funder/Sponsor: The Chinese Foundation for Hepatitis Prevention and Control had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.
Create a personal account or sign in to: