Results are shown as a cost-effectiveness acceptability curve. The y-axis shows the likelihood that strategies would be considered cost-effective for a given cost-effectiveness willingness to pay (or acceptability) threshold. PCV13 indicates 13-valent pneumococcal conjugate vaccination; PPSV, 23-valent pneumococcal polysaccharide vaccine; QALY, quality-adjusted life-year.
Customize your JAMA Network experience by selecting one or more topics from the list below.
Smith KJ, Wateska AR, Nowalk MP, Raymund M, Nuorti JP, Zimmerman RK. Cost-effectiveness of Adult Vaccination Strategies Using Pneumococcal Conjugate Vaccine Compared With Pneumococcal Polysaccharide Vaccine. JAMA. 2012;307(8):804–812. doi:10.1001/jama.2012.169
Author Affiliations: University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania (Drs Smith, Nowalk, Raymund, and Zimmerman and Ms Wateska); and National Center for Immunization and Respiratory Diseases, Centers for Disease Control and Prevention, Atlanta, Georgia (Dr Nuorti). Dr Nuorti is currently with the School of Health Sciences, University of Tampere, Tampere, Finland.
Context The cost-effectiveness of 13-valent pneumococcal conjugate vaccine (PCV13) compared with 23-valent pneumococcal polysaccharide vaccine (PPSV23) among US adults is unclear.
Objective To estimate the cost-effectiveness of PCV13 vaccination strategies in adults.
Design, Setting, and Participants A Markov state-transition model, lifetime time horizon, societal perspective. Simulations were performed in hypothetical cohorts of US 50-year-olds. Vaccination strategies and effectiveness estimates were developed by a Delphi expert panel; indirect (herd immunity) effects resulting from childhood PCV13 vaccination were extrapolated based on observed PCV7 effects. Data sources for model parameters included Centers for Disease Control and Prevention Active Bacterial Core surveillance, National Hospital Discharge Survey and Nationwide Inpatient Sample data, and the National Health Interview Survey.
Main Outcome Measures Pneumococcal disease cases prevented and incremental costs per quality-adjusted life-year (QALY) gained.
Results In the base case scenario, administration of PCV13 as a substitute for PPSV23 in current recommendations (ie, vaccination at age 65 years and at younger ages if comorbidities are present) cost $28 900 per QALY gained compared with no vaccination and was more cost-effective than the currently recommended PPSV23 strategy. Routine PCV13 at ages 50 and 65 years cost $45 100 per QALY compared with PCV13 substituted in current recommendations. Adding PPSV23 at age 75 years to PCV13 at ages 50 and 65 years gained 0.00002 QALYs, costing $496 000 per QALY gained. Results were robust in sensitivity analyses and alternative scenarios, except when low PCV13 effectiveness against nonbacteremic pneumococcal pneumonia was assumed or when greater childhood vaccination indirect effects were modeled. In these cases, PPSV23 as currently recommended was favored.
Conclusion Overall, PCV13 vaccination was favored compared with PPSV23, but the analysis was sensitive to assumptions about PCV13 effectiveness against nonbacteremic pneumococcal pneumonia and the magnitude of potential indirect effects from childhood PCV13 on pneumococcal serotype distribution.
The 23-valent pneumococcal polysaccharide vaccine (PPSV23) has been recommended for prevention of invasive pneumococcal disease (IPD) in adults since 1983.1 Most studies show that PPSV23 provides some protection against IPD, but studies have reached contradictory conclusions about its ability to prevent nonbacteremic pneumococcal pneumonia (NPP),1,2 which causes several hundred thousand illnesses annually in the United States.3
Large randomized controlled trials of PPSV23 conducted in developed countries have not found evidence of efficacy against NPP among community-dwelling older adults or among younger adults with chronic illness.1,4,5 Routine childhood vaccination with the 7-valent pneumococcal conjugate vaccine (PCV7) has substantially decreased both IPD and NPP in children through both direct and indirect (herd immunity) vaccine effects6,7 and reduced adult pneumococcal disease through indirect effects.6-9 The introduction of a pediatric conjugate vaccine containing 6 additional serotypes (PCV13) is expected to further reduce pneumococcal disease in children and adults.10,11
Prior analyses suggest that adult pneumococcal conjugate vaccination could prevent more disease than PPSV23 because of its potential effectiveness against both NPP and IPD.12 Although PCV7 has been shown to prevent NPP in children,13 PCV13 effectiveness in preventing NPP in adults is currently unknown and the subject of an ongoing clinical trial.14 In addition, routine childhood vaccination with PCV13 will likely result in further indirect effects in adults,10 perhaps limiting the potential benefits of adult vaccination.
As PCV13 has recently been approved by the Food and Drug Administration for use among adults aged 50 years and older,15 decisions about vaccination policy must weigh trade-offs between the possibility of decreased NPP vs fewer serotypes covered by PCV13, on a background of childhood vaccination-related changes in pneumococcal epidemiology and suboptimal adult vaccination uptake.16 To address these issues, we used decision modeling techniques to estimate the effectiveness and cost-effectiveness of pneumococcal vaccination strategies among adult cohorts 50 years of age and older.
Using a Markov state-transition model with a 1-year cycle length (eFigure 1 and eFigure 2), we examined 6 pneumococcal vaccination strategies developed by a Delphi expert panel process: (1) no vaccination, (2) the present US Advisory Committee on Immunization Practices (ACIP) adult recommendations (vaccinate all persons with PPSV23 at age 65 years; those who received PPSV23 before age 65 years for a comorbid condition are recommended to receive another dose at 65 years or older if at least 5 years have passed since the previous dose),1 (3) substituting PCV13 for PPSV23 in current ACIP recommendations, (4) PCV13 at age 50 years and PPSV23 at age 65 years, (5) PCV13 at ages 50 and 65 years, and (6) PCV13 at ages 50 and 65 years and then PPSV23 at age 75 years.
Strategies were compared using identical hypothetical cohorts of 50-year-old US adults, with cohorts tracked as they aged. We used a lifetime time horizon, a societal perspective, and a 3% discount rate for costs and benefits, converting costs to 2006 US dollars.17 Quality of life was modeled using health state utility weights, with 0 equaling death and 1 denoting perfect health; quality-adjusted life-years (QALYs) are the product of the health state utility and the length of time in that state.
The Markov model tracked cohorts yearly until death. Pneumococcal disease was assumed to occur as in the Box, where the risk of infection is modified by the likelihood and effectiveness of vaccination and by projected herd immunity effects from childhood PCV13. In the model, these factors varied by age and presence or absence of comorbidity. In the base case scenario, PPSV23 was assumed to have no effect on NPP4 while PCV13 was assumed to protect against NPP; these assumptions were modified in sensitivity analyses. Individuals could be in health states where pneumococcal disease risk was average or high, and within high-risk health states, persons with immunocompromising conditions were considered separately from those with other comorbid conditions. Persons at average risk could transition to the high-risk group because of development of a comorbid condition. We assumed no transitions from high risk to average risk. Patients could become disabled or die from pneumococcal infection or recover.
Baseline probability of infection (prechildhood 13-valent pneumococcal conjugate vaccine [PCV13])
Projected relative likelihood of infection (indirect effect, after vs before PCV13)
Relative likelihood of infection from a vaccine serotype (before PCV13)
Projected change in infection serotype likelihood (indirect effect)
Probability of being vaccinated
Probability of vaccine effectiveness
We used 2006 National Health Interview Survey data to segment cohorts into comorbid illness groups to model differential vaccine effectiveness and pneumococcal disease rates based on age and comorbidity, using Centers for Disease Control and Prevention (CDC) definitions for immunocompromising and other comorbid conditions.18 Asthma and cigarette smoking were recently added as pneumococcal vaccination indications.1 In the model, asthma was included as a comorbid condition; smoking was not, because of difficulties in capturing reliable smoking information in CDC data. We also used Framingham Study19-22 and SEER23 data to model age-related risk of comorbid conditions in the oldest age groups. Patients with both immunocompromising and other comorbid conditions were included in the immunocompromised group; persons with human immunodeficiency virus infection were also assumed to be included in the immunocompromised group. Transitions from other comorbid conditions to immunocompromised were based on SEER age-specific cancer incidence rates.23
Data from the CDC Active Bacterial Core surveillance (ABCs) from 2007-2008 were used to model IPD rates and age-specific likelihood of illness from vaccine-contained serotypes (eTable 1). We used previously published methods12 to derive hypothetical “no vaccine” IPD rates. Deaths were modeled using US mortality tables.24 For hospitalized NPP rates, we extrapolated from all-cause pneumonia hospitalization rates (eTable 2), estimating that pneumococcal pneumonia accounts for 30% of all-cause pneumonia hospitalizations.3,12,25 We used National Hospital Discharge Survey data26 for our base case analysis, with Nationwide Inpatient Sample data6 used in sensitivity analyses. We assumed that the relative likelihood of hospitalized NPP among age- and comorbidity-specific groups was similar to that observed for IPD and used rate ratios to model this assumption. Age- and comorbidity-specific rate ratios for IPD, from ABCs data, were applied to NPP rates to calculate age- and comorbidity-specific hospitalized NPP rates (eTable 3). We also assumed that the serotype distributions were similar for hospitalized NPP and IPD. Because of uncertainty regarding the age- and comorbidity-specific frequency and serotype distribution of outpatient NPP and its lower cost,27,28 we limited our analysis to hospitalized NPP.
As described previously,29 an expert panel, using the modified Delphi technique,30 estimated PPSV23 effectiveness against IPD (eTable 4). A second Delphi panel, comprising ACIP Pneumococcal Vaccines Working Group members, estimated PCV13 effectiveness against vaccine serotypes causing IPD and NPP (eTable 5) and selected the vaccination strategies to be modeled. Relative effectiveness of PCV13 against NPP was estimated to be 18% lower than for IPD (range, 10%-60%) in healthy 50-year-olds, 25% lower (range, 10%-60%) in healthy 65-year-olds, and 30% lower (range, 10%-60%) in persons with immunocompromising conditions, other comorbid conditions, or both; these calculations' results are shown in eTable 6.
Disability after IPD was modeled using meningitis as a proxy, understanding that not all meningitis is disabling but other IPD syndromes can be. For disability after NPP,31 we used 50% of the IPD value and varied it from 0% to 100% in sensitivity analyses. Vaccination adverse event data and quality-of-life utilities were literature-based.32-34 Vaccine,35 administration,36 and average adverse event costs ($0.03 per dose34) came from published sources. Hospitalization costs for IPD and NPP were obtained from 2006 Healthcare Cost and Utilization Project data.37
Potential indirect effects from childhood PCV13 were modeled in 2 steps. First, changes in adult IPD rates were extrapolated from indirect effects seen after PCV7.9 We assumed that age-specific decreases in IPD would occur in commonly carried serotypes (3, 6A, 7F, and 19A) added to PCV13, as was observed for colonizing PCV7 serotypes,9 and increases would occur in non-PCV13 serotype IPD. No herd effects were assumed for serotypes 1 and 5, which are considered uncommon colonizers.11,38 Next, age-specific changes in vaccine serotype distributions were modeled, based on observed changes after PCV7 introduction,8 leading to a diminished relative likelihood of PCV13 serotype IPD in the first 1 to 5 years after PCV13 licensure. Longer-term effects were modeled based on observed age-related serotype distribution changes. Potential indirect PCV13 effects for NPP were modeled using point estimates for decreases observed after PCV7 introduction.6
In the base case scenario, we assumed 60.1% adherence to age-based vaccination recommendations and 33.9% adherence to comorbidity-based vaccination recommendations, based on observed PPSV23 uptake.16,39 In strategies modeling current vaccination recommendations, all persons with a comorbid condition diagnosed before age 50 years were vaccinated at age 50 years. Persons aged 50 to 64 years developing a comorbid condition were vaccinated that year and then revaccinated either at age 65 years or 5 years after the first vaccination, whichever came last.
Table 1 depicts model parameter values. Parameters were varied individually in 1-way sensitivity analyses and varied simultaneously in probabilistic sensitivity analyses, where random draws from distributions were performed and the effectiveness or cost-effectiveness of each strategy calculated 3000 times. Distributions were chosen based on parameter characteristics and level of certainty. Parameters whose distributions were least certain (eg, utility weights) were assigned uniform distributions, vaccine effectiveness estimates were assigned triangular distributions, and parameters whose distributions were most certain (ie, derived from clinical trial or epidemiologic data) were assigned distributions based on data characteristics and ability to account for distribution skewness. In separate analyses, we varied the relative likelihood of IPD or NPP due to vaccine serotypes from 90% to 110% of the baseline values and considered greater herd immunity effects. All analyses were performed using TreeAge Pro Suite 2009 (TreeAge Software) decision analysis software.
With no vaccination, the lifetime risk from age 50 years onward for hospitalized NPP was 9.3%, for IPD was 0.86%, and for death due to pneumococcal disease was 1.8%. Thus, among the cohort of approximately 4.3 million US 50-year-olds in 2006,40 the model estimated 396 087 NPP hospitalizations, 36 576 IPD cases, and 75 647 deaths due to pneumococcal disease over their lifetime. Table 2 summarizes the public health effect of different vaccination strategies. Strategies using PPSV23 prevented more IPD than strategies using only PCV13, while strategies using 2 scheduled PCV13 doses prevented more NPP.
In sensitivity analyses, results were most sensitive to variation in vaccine effectiveness estimates and magnitude of herd effects from childhood PCV13 vaccination on adult NPP. Using Nationwide Inpatient Sample data for all-cause pneumonia rates instead of the National Hospital Discharge Survey minimally affected results.
Because of the unknown effectiveness of adult PCV13 against NPP, we also performed a worst-case NPP scenario (Table 2), where PCV13 effectiveness against NPP was set at the low range of estimates (eTable 6) and base case IPD effectiveness estimates for both vaccines were used. Even with worst-case assumptions, more total pneumococcal disease cases and deaths were prevented by strategies containing PCV13 compared with the current PPSV23 recommendation strategy.
Incremental cost-effectiveness analysis results under base case assumptions are shown in Table 3. In accordance with guidelines,17 we present results as incremental cost-effectiveness ratios, ordering strategies by cost and eliminating strategies that are strictly dominated (more costly and less effective) or extended dominated (having higher incremental cost-effectiveness ratios than more effective strategies).41
With no vaccination, the total per-person cost of IPD and hospitalized NPP from age 50 years onward was $1047. Compared with no vaccination, current PPSV23 recommendations (vaccination at age 65 years and at younger ages if comorbidities are present) cost $34 600 per QALY gained. However, this strategy is eliminated because of extended dominance, because its cost-effectiveness ratio is greater than that of the more effective PCV13 substituted in current recommendations strategy, which cost $28 900 per QALY gained. With routine vaccine administration at ages 50 and 65 years, PCV13 costs $45 100 per QALY compared with PCV13 substituted in current recommendations. Administration of PCV13 at ages 50 and 65 years followed by PPSV23 at age 75 years gained 0.00002 more QALYs per person and cost $496 000 per QALY gained. There are no absolute criteria for cost-effectiveness, but in general, interventions costing less than $20 000 per QALY gained are felt to have strong evidence for adoption, interventions costing $20 000 to $100 000 per QALY have moderate evidence, and those costing more than $100 000 per QALY have weaker evidence for adoption.42,43
When PCV13 effectiveness against NPP is set at low-range estimates (Table 3), current PPSV23 recommendations were favored, costing $34 600 per QALY gained. Substituting PCV13 in current recommendations cost $131 000 per QALY gained; other strategies had prohibitive cost-effectiveness ratios. If, in this scenario, PPSV23 effectiveness against IPD is also at the low estimates, the current PPSV23 recommendation strategy cost $60 200 per QALY and PCV13 substituted in current recommendations cost $93 000 per QALY gained.
The analysis was also sensitive to vaccine costs. Substituting PCV13 into current recommendations cost more than $100 000 per QALY when PCV13 vaccination cost was more than $237 (base case estimate = $128). The analysis was sensitive to individual variation of other parameter values as shown in Table 4.
A probabilistic sensitivity analysis of base case results is shown as a cost-effectiveness acceptability curve (Figure), showing the proportion of cost-effectiveness calculations that would be considered acceptable from a societal standpoint for various willingness-to-pay thresholds. In this analysis, which includes the likelihood of worst-case scenario for effectiveness against NPP, PCV13 given routinely at ages 50 and 65 years would be favored if willingness-to-pay (or acceptability) thresholds were greater than $50 000 per QALY (eFigure 3). Changing vaccine effectiveness distributions from triangular to uniform or beta distributions left results essentially unchanged.
In a series of separate sensitivity analyses on the base case model, we relaxed modeling assumptions to test model robustness. If PCV13 had no direct effects on adult nonbacteremic pneumonia, the current PPSV23 policy cost $34 600 per QALY and all PCV13 strategies were strictly dominated (ie, more costly and less effective). If greater herd immunity effects on pneumococcal disease rates (leading to fewer IPD and NPP cases) were modeled, current recommendations using PCV13 cost $38 400 per QALY and PCV13 at ages 50 and 65 years cost $51 000 per QALY gained. Modeling greater decreases in disease likelihood from a vaccine serotype (declining with age from a 16% relative likelihood of disease from PCV13 serotypes compared with nonvaccine serotypes at age 50 years, rather than from 24% in the base case) led to the current recommendations using PCV13 strategy being dominated, current recommendations using PPSV23 costing $38 900 per QALY gained, and PCV13 at ages 50 and 65 years costing $106 000 per QALY. In the base case analysis, we assumed that 30% of hospitalized all-cause pneumonia was NPP. If NPP accounted for 20% of pneumonia hospitalizations, current PPSV23 recommendations cost $34 400 per QALY, PCV13 in current recommendations cost $59 100 per QALY, and PCV13 at ages 50 and 65 years cost $74 200 per QALY.
We also examined scenarios in which PPSV23 was effective against NPP. Administration of PCV13 at ages 50 and 65 years would continue to be favored (at a $100 000/QALY criterion) if PPSV23 effectiveness against NPP was less than 44% at age 50 years and less than 38% at age 65 years. At higher effectiveness levels, the currently recommended PPSV23 strategy was favored.
Our analysis favors vaccinating adults with PCV13 instead of PPSV23 and suggests that PCV13 administered either as a substitute for PPSV23 in current recommendations or routinely at ages 50 and 65 years might reduce pneumococcal disease burden in an economically reasonable fashion. A 2-dose PCV13 strategy at ages 50 and 65 years, although having a higher cost-effectiveness ratio, addresses the complexity of risk-based recommendations and is consistent with moves away from comorbidity-based strategies, exemplified by recent changes in influenza vaccination recommendations.44
However, results favoring PCV13 were sensitive to assumptions regarding PCV13 effectiveness against NPP. If effectiveness against NPP is low, then current PPSV23 recommendations are favored, but if, in addition, PPSV23 effectiveness against IPD is at the experts' low-range estimate, PCV13 substituted into current recommendations again becomes economically reasonable. This analysis highlights the trade-offs that policy makers must consider when choosing among adult pneumococcal vaccination strategies. PPSV23 covers 23 serotypes and could prevent more IPD than PCV13 but, based on US and western European studies, has no consistent effect on NPP.4,5 Based on experience with the PCV7 program,6,7 PCV13 is likely to prevent NPP. Since NPP is much more common than IPD, PCV13, despite its narrower serotype coverage, should prevent more pneumococcal disease than PPSV23. However, when modeling the possibility of PPSV23 preventing NPP, PPSV23 could be favored, but only if its effectiveness against NPP is higher than would be expected based on trial results.4,5 At present, PCV13 effectiveness against pneumonia in adults is unknown. However, PCV7 was consistently effective against pediatric pneumonia in randomized clinical trials.13,45-47
Results were also sensitive to the magnitude of indirect effects from childhood PCV13. Herd immunity from the added 6 serotypes will likely reduce disease rates in adults. Indirect effects of childhood PCV7 on carriage and IPD rates among adults have been documented.8,9,48 Decreases in all-cause pneumonia hospitalizations in adults 50 years and older were observed following PCV7 introduction; these reductions were not statistically significant in one study6 but were significant in another.7 However, given documented decreases in IPD rates due to indirect effects, we modeled decreases in adult NPP rates based on published point estimates, which could bias the analysis against PCV13. In any case, larger than expected indirect effects from childhood PCV13 would reduce the value of adult PCV13 strategies.
Several limitations should be considered in interpreting our findings. The analysis is limited by the lack of data on PCV13 effectiveness. A randomized trial of PCV13 among 85 000 adults 65 years and older is currently under way in the Netherlands; data collection was scheduled to end December 2011, but results will not be available until 2013.14 The magnitude of herd effects and changes in serotype distribution resulting from childhood PCV13 are also unknown. We modeled these based on data from the PCV7 experience. We excluded outpatient pneumonia because of difficulties in accurate estimation of disease rates and characteristics and the relatively minor role of outpatient costs, again possibly biasing against PCV13. Other studies estimated that outpatient NPP accounted for 5% or less of adult pneumococcal disease costs.28,49 Our model is based on 50-year-old cohorts tracked over their lifetime; this analysis does not consider cohorts of differing ages or other issues germane to ensuring population immunity, such as catch-up vaccination. In addition, because infrastructure and resources to support adult vaccination are limited, achieving sufficient coverage with PCV13 is uncertain.39
In conclusion, our analysis suggests that PCV13 might prevent more pneumococcal disease compared with current PPSV23 vaccination recommendations while remaining economically reasonable. However, these conclusions are sensitive to assumptions regarding PCV13 effectiveness against NPP, PPSV23 effectiveness against IPD and NPP, and herd immunity effects. Model estimates of the effect of adult PCV13 would be strengthened by evidence of PCV13 effectiveness against NPP from ongoing clinical trials and availability of data on the indirect effects of childhood PCV13 on adult pneumococcal disease rates.
Corresponding Author: Kenneth J. Smith, MD, MS, Section of Decision Sciences and Clinical Systems Management, University of Pittsburgh School of Medicine, 200 Meyran Ave, Ste 200, Pittsburgh, PA 15213 (email@example.com).
Author Contributions: Dr Smith had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.
Study concept and design: Smith, Nuorti, Zimmerman.
Acquisition of data: Smith, Wateska, Nowalk, Raymund, Zimmerman.
Analysis and interpretation of data: Smith, Wateska, Nowalk, Nuorti, Zimmerman.
Drafting of the manuscript: Smith, Wateska.
Critical revision of the manuscript for important intellectual content: Smith, Nowalk, Raymund, Nuorti, Zimmerman.
Statistical analysis: Smith, Wateska.
Obtained funding: Smith.
Administrative, technical, or material support: Smith, Nowalk, Raymund, Nuorti, Zimmerman.
Study supervision: Smith.
Conflict of Interest Disclosures: All authors have completed and submitted the ICMJE Form for Disclosure of Potential Conflicts of Interest. Drs Zimmerman and Nowalk reported having a research grant from Merck on HPV vaccine. No other disclosures were reported.
Funding/Support: This study was supported by the National Institute of Allergy and Infectious Diseases (R01 AI076256).
Role of the Sponsor: The funding agency had no role in the design and conduct of the study; in the collection, analysis, and interpretation of the data; or in the preparation, review, or approval of the manuscript.
Disclaimer: The findings and conclusions in this report are those of the authors and do not necessarily represent the views of the Centers for Disease Control and Prevention.
Additional Contributions: We thank the Working Group on Pneumococcal Vaccines of the Advisory Committee on Immunization Practices for providing their expert opinion of pneumococcal vaccine efficacy estimates. We also thank Matthew R. Moore, MD, MPH, and Ruth Link-Gelles, MPH, Respiratory Diseases Branch, Centers for Disease Control and Prevention, for data from the Active Bacterial Core surveillance. None received compensation for the contributions.
Create a personal account or sign in to: