The 2-part model included a short-term decision tree and a long-term Markov model. CAR-T indicates chimeric antigen receptor T-cell therapies; SCT, stem cell transplantation.
aPatients who discontinue owing to manufacturing failure will transition to the active comparator. Patients who discontinue owing to adverse event will receive no further antileukemic or antilymphomic therapy and will enter the semi-Markov partitioned survival model at M2.
bPatients who transition from M1 to M2 will receive palliative therapy.
The incremental cost-effectiveness ratio fell below $150 000 per QALY gained when the model time horizon was 7 years or longer. LY indicates life-year and QALY, quality-adjusted life-year. Cost-effectiveness was in 2017 US dollars.
eAppendix. Detailed Methods
eTable 1. Rationale for Model Assumptions
eTable 2. Population Characteristics for the Intervention and Comparator Group
eTable 3. Treatment Regimens
eTable 4. Response to Treatment
eTable 5. Source of Kaplan-Meier Curves to Calculate Transition Probabilities
eTable 6. Survival Curve Fit, Shape, and Scale Parameters for Final Model
eTable 7. Proportion of the Cohort in Each Health State
eTable 8. Receipt of Stem Cell Transplantation
eTable 9. Included Adverse Event Rates
eTable 10. Model Health State Utilities
eTable 11. Treatment-Related Disutilities
eTable 12. Treatment Acquisition Costs
eTable 13. Unit Costs for Healthcare Utilization
eTable 14. Administration and Monitoring
Customize your JAMA Network experience by selecting one or more topics from the list below.
Whittington MD, McQueen RB, Ollendorf DA, et al. Long-term Survival and Value of Chimeric Antigen Receptor T-Cell Therapy for Pediatric Patients With Relapsed or Refractory Leukemia. JAMA Pediatr. 2018;172(12):1161–1168. doi:10.1001/jamapediatrics.2018.2530
What is the long-term survival and value of tisagenlecleucel for pediatric patients with relapsed or refractory leukemia?
In this decision-analytic modeling study using deidentified data, cost-effectiveness analysis generated an incremental cost-effectiveness ratio between $37 000 and $78 000 per quality-adjusted life-year gained over a patient lifetime horizon, with more than 40% of those initiating tisagenlecleucel treatment becoming long-term survivors.
Tisagenlecleucel seems to be priced in alignment with its clinical benefits, although its value depends on assumptions around long-term survival.
Among children and young adults with relapsed or refractory B-cell acute lymphoblastic leukemia, the rate of 5-year disease-free survival is 10% to 20%. Approval of tisagenlecleucel, a chimeric antigen receptor T-cell therapy, represents a new and potentially curative treatment option. However, tisagenlecleucel is expensive, with a current list price of $475 000 per one-time administration.
To estimate the long-term survival and value of tisagenlecleucel for children and young adults with B-cell acute lymphoblastic leukemia.
Design, Setting, and Participants
In this cost-effectiveness analysis, a decision analytic model was designed to extrapolate trial evidence to a patient lifetime horizon. The survival evidence for the model was extracted from 3 studies: B2202 (enrolled patients from April 8, 2015, to November 23, 2016), B2205J (enrolled patients from August 14, 2014, to February 1, 2016), and B2101J (enrolled patients from March 15, 2012, to November 30, 2015). Long-term survival and outcomes of patients younger than 25 years with B-cell acute lymphoblastic leukemia that is refractory or in second or later relapse were derived using flexible parametric modeling from the direct extrapolation of event-free survival and overall survival curves. The published Kaplan-Meier curves were digitized from November 1, 2017, to November 30, 2017, using an algorithm to impute patient-level time-to-event data. Sensitivity and scenario analyses assessed uncertainty in the evidence and model assumptions to further bound the range of cost-effectiveness. Data were analyzed from December 1, 2017, to March 31, 2018.
The primary intervention of interest was tisagenlecleucel. The comparator of interest was the chemoimmunotherapeutic agent clofarabine.
Main Outcomes and Measures
Model outcomes included life-years gained, quality-adjusted life-years (QALYs) gained, and incremental costs per life-year and QALY gained.
Forty percent of patients initiating treatment with tisagenlecleucel are expected to be long-term survivors, or alive and responding to treatment after 5 years. Tisagenlecleucel had a total discounted cost of $667 000, with discounted life-years gained of 10.34 years and 9.28 QALYs gained. The clofarabine comparator had a total discounted cost of approximately $337 000, with discounted life-years gained of 2.43 years and 2.10 QALYs gained. This difference resulted in an incremental cost-effectiveness ratio of approximately $42 000 per life-year gained and approximately $46 000 per QALY gained for tisagenlecleucel vs clofarabine. These results were robust to probabilistic sensitivity analyses. Across scenario analyses that included more conservative assumptions regarding long-term relapse and survival, the incremental cost-effectiveness ratio ranged from $37 000 to $78 000 per QALY gained.
Conclusions and Relevance
Tisagenlecleucel likely provides gains in survival and seems to be priced in alignment with these benefits. This study suggests that payers and innovators should develop novel payment models that reduce the risk and uncertainty around long-term value and provide safeguards to ensure high-value care.
B-cell acute lymphoblastic leukemia (B-ALL) is the most common malignant neoplasm diagnosed in children, accounting for 20% to 30% of the overall incidence of childhood cancer.1,2 Owing to its presentation as a systemic disease, treatment for B-ALL has been based primarily on chemotherapy.3 However, among patients with relapsed or refractory B-ALL, rates of 5-year disease-free survival are only 10% to 20%.4-6 The recent approval of chimeric antigen receptor T-cell (CAR-T) therapies represents a new and potentially curative treatment option for B-ALL.7 Tisagenlecleucel, the first CAR-T therapy approved, is indicated for use in pediatric patients with relapsed or refractory B-ALL.7 Evidence for tisagenlecleucel demonstrated higher rates of response, event-free survival, and overall survival than other therapies used in pediatric patients with B-ALL who were heavily pretreated.8 However, follow-up for patients receiving tisagenlecleucel is limited, with a maximum duration of less than 4 years; therefore, uncertainty remains around its long-term benefit.
Tisagenlecleucel is expensive, currently listed at $475 000 per a one-time administration.9 Although the manufacturer has discussed an outcomes-based payment agreement, in which only patients who respond to treatment will be required to pay,10 the list price and payment agreement do not include additional costs, such as hospital markup or health care use for preparation, administration, management, or adverse events. The objective of this analysis was to estimate the long-term survival and value of tisagenlecleucel for pediatric patients with B-ALL.
Because this study model uses already available evidence from studies, the Colorado Multiple Institutional Review Board waived approval for this study and for patient consents. A decision analytic model extrapolated trial evidence from 3 studies11 (B2202, enrolled patients from April 8, 2015, to November 23, 2016; B2205J, enrolled patients from August 14, 2014, to February 1, 2016; and B2101J, enrolled patients from March 15, 2012, to November 30, 2015) and aggregated all costs and outcomes expected from tisagenlecleucel. The analysis was from a payer perspective and estimated outcomes over a patient lifetime horizon. Data were analyzed from December 1, 2017, to March 31, 2018. The decision analytic model included a short-term decision tree and a long-term semi-Markov partitioned survival model (Figure 1). The decision tree tracked a patient from initiation of treatment through assessment of response. Initiation of treatment was to undergo leukapheresis in preparation for tisagenlecleucel infusion. At the first decision tree event node, patients had the following 3 options: continue with the tisagenlecleucel infusion after undergoing leukapheresis, discontinue before infusion because of adverse events (AEs) or manufacturing failure, or die before receiving the infusion. Those who discontinued the CAR-T arm owing to AEs were assumed to not be able to tolerate other active therapies and therefore transitioned to receive no further antileukemic therapy (ie, palliative care only). Those who discontinued the CAR-T arm owing to manufacturing failure were assumed to receive clofarabine. The second event node of the decision tree assessed a patient’s response to treatment, which had the 3 following options: alive and responding to treatment, alive and not responding to treatment, or dead before assessment of response. The model allowed for patients to receive or not receive stem cell transplantation (third event node of the decision tree) after assessment of response.
After the decision tree, patients moved to the semi-Markov partitioned survival model, where they transitioned between the following 3 health states: alive and responding to treatment, alive and not responding to treatment, and dead. Patient movement through each of the health states was estimated from the direct extrapolation of event-free survival and overall survival curves. The published Kaplan-Meier curves were digitized from November 1, 2017, to November 30, 2017, using the algorithm by Guyot and colleagues12 to impute patient-level time-to-event data. The fitted model curves included the distributional forms of Weibull, exponential, log-normal, log-logistic, and Gompertz. The base-case distributional form was analyzed between December 1, 2017, and December 31, 2017, and was selected separately for each curve based on best model fit using Akaike information criterion values, visual comparison with Kaplan-Meier curves, and plausibility of long-term extrapolation. The eAppendix in the Supplement provides more details regarding the study design.
Flattening in the tail of the survival curves was observed for both tisagenlecleucel and clofarabine. Standard parametric models likely underestimate survival when flattening in the tail exists; therefore, we used a flexible parametric model to account for this flattening.13 We first fit a parametric curve function to the portion of the curve that was downward sloping. After the fitted curve intersected the flat portion (ie, slope of 0) of the Kaplan-Meier curve, a knot was introduced. After the knot, mortality occurred only owing to all-cause mortality. This flexible parametric approach extrapolated the published survival curves to 5 years, after which patients who were alive and responding to treatment were considered to be long-term survivors and effectively cured.14 Accordingly, patients who were alive and not responding to treatment died within 5 years of treatment completion. Mortality after 5 years was based on the age- and sex-adjusted all-cause risks of mortality.14 Modifications for excess disease-related mortality for long-term survivors was modeled by applying a standardized mortality ratio of 9.1 to the mortality risk.15 Model outcomes included patient survival, quality-adjusted survival, and health care costs. A full description of model assumptions, along with their rationale, can be found in eTable 1 in the Supplement.
The modeled cohort included patients younger than 25 years with B-ALL that was refractory or in second or later relapse. The intervention of interest was tisagenlecleucel. Evidence for tisagenlecleucel was abstracted from single-arm trials, which resulted in challenges selecting the most appropriate comparator therapy. Because a matching-adjusted indirect comparison was not possible owing to the lack of patient-level data and the available aggregated evidence being from single-arm trials,16 we chose the comparator with evidence from the most similar patient population. We engaged stakeholders and clinical experts in relapsed or refractory leukemia to inform our decision and considered various comparisons, including clofarabine monotherapy, clofarabine combination therapy, and blinatumomab. Clofarabine monotherapy was chosen as the comparator because the trial populations for both tisagenlecleucel and clofarabine monotherapy were most similar in relation to demographics and disease severity. eTable 2 in the Supplement describes the population characteristics for those receiving tisagenlecleucel and clofarabine. eTable 3 in the Supplement details the treatment regimen for the intervention and comparator. Furthermore, both clofarabine and tisagenlecleucel are indicated by the US Food and Drug Administration for relapsed or refractory acute lymphoblastic leukemia after at least 2 prior regimens. Blinatumomab was not selected as the comparator owing to the heterogeneity in the patient populations (eg, age, bone marrow blast level, and prior lines of therapy) in the evidence for tisagenlecleucel and blinatumomab.
Clinical inputs included survival, AEs, and quality of life. The clinical inputs that informed the model are detailed in Table 1.8,14,17-24 Further detail on clinical model inputs can be found in eTables 4-11 in the Supplement. Economic inputs included the treatment acquisition cost, potential hospital markup, and health care use. Payment for tisagenlecleucel was assumed only for responders at 1 month, based on expected agreements between the manufacturer and payers. Both the tisagenlecleucel and clofarabine treatment arms assumed inpatient administration and were thus subject to potential hospital markup. Because the contracts between hospitals and payers related to hospital markup are still being developed for tisagenlecleucel and are confidential, we engaged stakeholders and CAR-T experts to inform the hospital markup for tisagenlecleucel. The assumed markup was capped at $100 000 based on comments from stakeholders and CAR-T experts that some facilities may not negotiate a markup while other facilities may charge a markup. Costs associated with health care use resulting from administration and monitoring were included in the model. The cost of a hospitalization for treatment administration was estimated using a fee-for-service approach, which included a per diem cost for hospital days and added costs of therapies administered during the hospitalization. Additional costs were included for AEs that were expected to prolong hospitalization (cytokine release syndrome) or extend beyond discharge (ie, B-cell aplasia). Future related and unrelated medical costs were included for long-term survivors. All costs were adjusted to 2017 US dollars. A full description of the economic inputs that informed the model can be found in eTables 12-14 in the Supplement.
A probabilistic sensitivity analysis was conducted to assess variation in all model inputs simultaneously. Five thousand iterations were run and the percentage of all iterations that fell beneath common value thresholds of $50 000, $100 000, and $150 000 per quality-adjusted life-year (QALY) gained were computed.
Previous literature has noted unique characteristics of decision analytic modeling for potentially curative therapies in the pediatric population, such as the discount rate, duration of benefit observed in trials, point of treatment initiation, and inclusion of future health care costs.25 For each of these characteristics, we conducted a scenario analysis. The resulting values from these scenario analyses served to bound the range of cost-effectiveness.
In the United Kingdom, the National Institute for Health and Care Excellence recommends a discount rate of 1.5%, compared with the typical 3.5% discount rate, when an intervention is expected to result in substantial improvement in health over a long period of time.26 In the United States, there has been no recommendation on differential discounting for therapies with long-term and significant health improvement. In our base-case analysis, we used a discount rate of 3%, based on recommendations from the Second Panel on Cost-Effectiveness in Health and Medicine.27 However, in this scenario analysis, we used a discount rate of 1.5% for both costs and outcomes.
When tisagenlecleucel was approved by the US Food and Drug Administration, the median follow-up of Study B2101J, the trial with the longest duration, was only 18.6 months.11 Therefore, our decision analytic model required extrapolation of trial results. We tested the assumptions made through extrapolation in 2 scenario analyses. First, we estimated the number of years the benefit observed in the trial would need to continue to produce an incremental cost-effectiveness ratio beneath commonly cited value thresholds. Second, instead of using a flexible parametric model that accounted for the flattening observed in the Kaplan-Meier curves, we used standard parametric modeling to serve as a lower bound of survival and a conservative estimate of the long-term value.
With tisagenlecleucel, patients initiate treatment by undergoing leukapheresis. However, patients who undergo leukapheresis may never receive the infusion owing to AEs, manufacturing failures, or death. In our base-case analysis, we started our model at leukapheresis; this approach is similar to an intent-to-treat analysis for a randomized clinical trial. In this scenario analysis, we started the model at infusion instead.
Criticism of models that include future unrelated health care costs is common, despite recommendations by the Second Panel on Cost-Effectiveness in Health and Medicine to include both future related and unrelated health care costs.27 Our base-case analysis included future related and unrelated health care costs for long-term survivors; however, in this scenario analysis, these future health care costs were excluded.
The total discounted costs over the patient lifetime horizon as well as the total undiscounted and discounted life-years (LYs) and QALYs are detailed in Table 2. Tisagenlecleucel had a total discounted cost of approximately $667 000, with discounted LYs gained of 10.34 years and 9.28 QALYs gained. A total of 42.6% of patients who underwent leukapheresis were considered to be long-term survivors. Clofarabine had a total discounted cost of approximately $337 000, with discounted life-years gained of 2.43 years and 2.10 QALYs gained. A total of 10.8% of patients receiving clofarabine treatment were considered to be long-term survivors. The incremental cost-effectiveness ratio between tisagenlecleucel and clofarabine was approximately $46 000 per QALY gained.
The mean incremental cost-effectiveness ratio from the probabilistic sensitivity analysis was $43 416 per QALY gained. All iterations were below a threshold of $100 000 per QALY gained; however, these sensitivity analyses did not account for uncertainty around survival curve parameters.
Table 3 presents the results of each scenario analysis as compared with the base-case estimates. The cost-effectiveness estimates ranged from $37 000 to $77 500 per QALY gained across the scenario analyses.
From the base-case analysis, the costs did not change, but the LYs and QALYs increased owing to the smaller discount rate. This change increased the incremental difference in health outcomes and resulted in a more favorable cost-effectiveness ratio of $37 000 per QALY gained (Table 3).
The trial-specific benefit would need to continue for at least 7 years after infusion to produce an incremental cost-effectiveness ratio less than $150 000 per QALY gained, for 12 years to be less than $100 000 per QALY gained, and for 36 years to be less than $50 000 per QALY gained. Figure 2 shows the cost-effectiveness estimate over all time horizons, from 1 year to lifetime. Furthermore, using standard parametric modeling, the LY for tisagenlecleucel decreased to 5.15 years and the QALYs for tisagenlecleucel decreased to 4.49 years. For clofarabine, the LYs decreased to 0.66 years and the QALYs decreased to 0.49 years. This change increased the incremental cost-effectiveness ratio to $77 500 per QALY gained (Table 3).
When the model started at treatment infusion, the incremental cost-effectiveness ratio slightly increased. Starting at leukapheresis, the incremental costs were $329 498 and incremental QALYs were 7.2 years. This change resulted in an incremental cost-effectiveness ratio of $45 871. When the model started at infusion, the incremental costs increased to $454 892 and incremental QALYs increased to 9.1 years. This change slightly increased the incremental cost-effectiveness ratio to $50 000 per QALY gained (Table 3).
In the final scenario analysis, we removed future related and unrelated medical costs. This resulted in a more favorable cost-effectiveness estimate of $40 700 per QALY gained (Table 3).
Our base-case findings suggest that tisagenlecleucel in pediatric patients with B-ALL provides clinical benefits in quality-adjusted and overall survival compared with clofarabine. This result translates into cost-effectiveness estimates that meet commonly cited value thresholds under current model assumptions. The results were robust through sensitivity analyses, with no resulting incremental cost-effectiveness ratio extending beyond $100 000 per QALY gained. Owing to the unique characteristics of modeling potentially curative therapies in the pediatric population, multiple scenario analyses were conducted to test model assumptions. From these scenario analyses, the lowest cost-effectiveness estimate of approximately $37 000 resulted when the discount rate was reduced to 1.5%. The highest cost-effectiveness estimate of approximately $78 000 resulted when standard parametric modeling was used to estimate long-term survival from these therapies. We acknowledge that considerable uncertainty remains around the long-term benefit of tisagenlecleucel owing to limited available evidence; however, with current evidence and assumptions, tisagenlecleucel meets commonly cited value thresholds over a patient lifetime horizon, assuming payment for treatment acquisition for responders at 1 month.
With evidence for tisagenlecleucel coming from single-arm trials, comparator selection was challenging. We chose the comparator with the most similar baseline population characteristics, but also acknowledge that blinatumomab is frequently used to treat this patient population. We suspect that tisagenlecleucel would remain cost-effective compared with blinatumomab. A study conducted by other researchers found the incremental cost-effectiveness ratio of tisagenlecleucel vs blinatumomab was similar to the incremental cost-effectiveness ratio of tisagenlecleucel vs clofarabine (ie, $3000 more per QALY).28 Selection of the comparator is important in cost-effectiveness estimates; however, tisagenlecleucel for pediatric B-ALL likely remains below commonly cited value thresholds despite the chosen comparator.29
This analysis is limited primarily by the lack of comparative evidence between the intervention and comparator; this lack complicates the calculation of the incremental difference in outcomes (denominator of the incremental cost-effectiveness ratio) between tisagenlecleucel and clofarabine. First, cross-trial differences in the population between tisagenlecleucel and clofarabine, and not necessarily the different treatments, may contribute to the differences in health outcomes observed between trials. This lack of comparative evidence also prohibits the ability to account for uncertainty about survival curve parameters in sensitivity analyses; therefore, the sensitivity analyses likely underestimate the uncertainty in this evidence. Second, follow-up on event-free survival and overall survival is limited for tisagenlecleucel, which required assumptions regarding long-term results and defining when a patient is effectively cured. A 5-year cure point was used based on evidence from clinical15 and economic14 literature. The cure point was established to determine at what point after trial follow-up patients who were alive but not responding to treatment would die. A later cure point (after 5 years) would result in slightly more favorable cost-effectiveness estimates. Similarly, an earlier cure point (shorter than 5 years) would result in slightly less favorable cost-effectiveness estimates. Uncertainty in long-term survival was partially accounted for in scenario analyses that evaluated different modeling assumptions and time horizons. Although scenario analysis results represent a reasonable lower bound on effectiveness based on current data, it is always possible that a worst-case scenario might present itself (eg, development of neutralizing antibodies with high rates of subsequent relapse). Value should therefore be reassessed once data with longer follow-up are available. Third, mechanisms for payment of tisagenlecleucel are still largely unknown (eg, bundled payment vs fee-for-service, amount of hospital markup, and outcomes-based pricing), necessitating assumptions around costs and payment of these therapies. Clinical experts and other key stakeholders were engaged to inform our assumptions, but value should also be reassessed once more information on payment for this novel therapy is available. Finally, because there is some expectation that tisagenlecleucel might be curative, we considered using a mixture cure model. However, without access to patient-level data, we elected to use a flexible parametric model with an assumed cure-point to approximate the aggregated data with fewer assumptions.
After extrapolating trial results over a patient lifetime horizon, we estimated that more than 40% of pediatric patients who undergo leukapheresis in preparation for tisagenlecleucel therapy will be considered long-term survivors, compared with approximately 10% of pediatric patients considered long-term survivors after receiving comparator therapy. With the evidence available at this time, tisagenlecleucel seems to be priced in alignment with benefits observed over a patient lifetime horizon. The findings are sensitive to the long-term benefit forecasting, but based on currently available evidence and extrapolation assumptions, the cost-effectiveness likely is between $37 000 and $78 000 over a patient lifetime horizon. As payers are negotiating their coverage and reimbursement of tisagenlecleucel, they should consider the uncertainties in the evidence and the assumptions made in this analysis. Novel payment models consistent with the present evidence may reduce the risk and uncertainty in long-term value and be more closely aligned with ensuring high-value care.30,31 Financing cures in the United States is challenging owing to the high up-front price, rapid uptake, and uncertainty in long-term outcomes31,32; however, innovative payment models are an opportunity to address some of these challenges and to promote patient access to novel and promising therapies.
Accepted for Publication: June 13, 2018.
Corresponding Author: Melanie D. Whittington, PhD, Department of Clinical Pharmacy, University of Colorado Anschutz Medical Campus, 12850 E Montview Blvd, V20-1206, Aurora, CO 80045 (email@example.com).
Published Online: October 8, 2018. doi:10.1001/jamapediatrics.2018.2530
Author Contributions: Dr Whittington had full access to all the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.
Concept and design: Whittington, McQueen, Ollendorf, Chapman, Tice, Pearson, Campbell.
Acquisition, analysis, or interpretation of data: Whittington, McQueen, Ollendorf, Kumar, Chapman, Tice, Campbell.
Drafting of the manuscript: Whittington.
Critical revision of the manuscript for important intellectual content: All authors.
Statistical analysis: Whittington, McQueen, Kumar.
Obtained funding: Ollendorf, Campbell.
Administrative, technical, or material support: McQueen, Ollendorf, Kumar, Chapman, Tice.
Supervision: Ollendorf, Pearson, Campbell.
Conflict of Interest Disclosures: Drs Ollendorf, Kumar, Chapman, and Pearson report being employees of the Institute for Clinical and Economic Review, an independent organization that evaluates the evidence on the value of health care interventions, which is funded by grants from the Laura and John Arnold Foundation, Blue Shield of California Foundation, and the California HealthCare Foundation. The organization’s annual policy summit is supported by dues from Aetna, AHIP, Anthem, Blue Shield of California, CVS Caremark, Express Scripts, Harvard Pilgrim Health Care, Omeda Rx, United Healthcare, Kaiser Permanente, Premera Blue Cross, AstraZeneca, Genentech, GlaxoSmithKline, Johnson & Johnson, Merck, National Pharmaceutical Council, Takeda, Pfizer, Novartis, Lilly, and Humana. No other disclosures were reported.
Funding/Support: This work was funded by the Institute for Clinical and Economic Review.
Role of the Funder/Sponsor: The Institute for Clinical and Economic Review was involved in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.
Additional Contributions: Samuel McGuffin, MHP, University of Colorado, provided editorial support and Chong Kim, MPH, and Mausam Patidar, MS, University of Colorado, provided the survival curve digitization. They were not compensated for their contributions.
Create a personal account or sign in to: