Screening strategy A (conventional cytologic testing followed by additional cytologic testing for atypical squamous cells of undetermined significance [ASC-US]) and the follow-up actions subsequent to all possible test results. The strategy assumes standard guidelines for follow-up and management of abnormal results.16,17 ASC-H indicates atypical squamous cells that cannot exclude high-grade squamous intraepithelial lesions (HSIL); CIN, cervical intraepithelial neoplasia; LSIL, low-grade squamous intraepithelial lesions.
Screening strategy B (liquid-based cytologic testing followed by human papillomavirus [HPV] triage testing for ASC-US) and the follow-up actions subsequent to all possible test results. The strategy assumes standard guidelines for follow-up and management of abnormal results.16,17 Other abbreviations are explained in the legend to Figure 1.
Screening strategy C (liquid-based cytologic testing and human papillomavirus [HPV] DNA testing in combination) and the follow-up actions subsequent to all possible test results. The strategy assumes standard guidelines for follow-up and management of abnormal results.16,17 Other abbreviations are explained in the legend to Figure 1.
Screening strategy D (human papillomavirus [HPV] DNA testing followed by cytologic triage testing) and the follow-up actions subsequent to all possible test results. The strategy assumes standard guidelines for follow-up and management of abnormal results.16,17 Other abbreviations are explained in the legend to Figure 1.
Expected screening outcomes and lifetime risk. Expected number of colposcopies and diagnoses of cervical intraepithelial neoplasia (CIN) types 1 and 2 or 3 among 1000 patients who undergo triennial screening for 10 years compared with the lifetime risk of invasive cervical cancer. On the left axis, the height of the bar shows the total number of colposcopies; the shaded portion is the number resulting in a diagnosis of CIN 1. The expected diagnoses of CIN 2 or 3, the solid black portion at the top of each bar, represent a small proportion of all colposcopic results (range, 6-7 for 20-year-old and 7-8 for 40-year-old women under all strategies). On the right axis, circles denote the lifetime risk of cervical cancer associated with each screening strategy. For comparison, current US screening patterns18 resulted in a lifetime risk of cervical cancer ranging from 0.47% to 0.69%. These results represent the population perspective but may be less useful for an individual woman because the outcomes are for a population of women participating in screening at different frequencies. HPV indicates human papillomavirus.
Customize your JAMA Network experience by selecting one or more topics from the list below.
Stout NK, Goldhaber-Fiebert JD, Ortendahl JD, Goldie SJ. Trade-offs in Cervical Cancer Prevention: Balancing Benefits and Risks. Arch Intern Med. 2008;168(17):1881–1889. doi:10.1001/archinte.168.17.1881
New screening and vaccination technologies will provide women with more options for cervical cancer prevention. Because the risk of cervical cancer diminishes with effective routine screening, women may wish to consider additional attributes, such as the likelihood of false-positive results and diagnostic procedures for mild abnormalities likely to resolve without intervention in their screening choices.
We used an empirically calibrated simulation model of cervical cancer in the United States to assess the benefits and potential risks associated with prevention strategies differing by primary screening test, triage test for abnormal results (cytologic testing, human papillomavirus [HPV] DNA test), and screening frequency. Outcomes included colposcopy referrals, cervical intraepithelial neoplasia (CIN) types 1 and 2 or 3, lifetime cancer risk, and quality-adjusted life expectancy.
Across strategies, colposcopy referrals and diagnostic workups varied 3-fold, although diagnostic rates of CIN 2 or 3 were similar and 95% of positive screening test results were for mild abnormalities likely to resolve on their own. For a representative group of a thousand 20-year-old women undergoing triennial screening for 10 years, we expect 1038 colposcopy referrals (7 CIN 2 or 3 diagnoses) from combined cytologic and HPV DNA testing and fewer than 200 referrals (6-7 CIN 2 or 3 diagnoses) for strategies that use triage testing. Similarly, for a thousand 40-year-old women, combined cytologic and HPV DNA testing led to 489 referrals (9 CIN 2 or 3), whereas alternative strategies resulted in fewer than 150 referrals (7-8 CIN 2 or 3). Using cytologic testing followed by triage testing in younger women minimizes both diagnostic workups and positive HPV test results, whereas in older women diagnostic workups are minimized with HPV DNA testing followed by cytologic triage testing.
Clinically relevant information highlighting trade-offs among cervical cancer prevention strategies allows for inclusion of personal preferences into women's decision making about screening and provides additional dimensions to the construction of clinical guidelines.
Routine screening with cervical cytologic testing is widely credited with reducing cervical cancer incidence through the early detection and treatment of high-grade cervical intraepithelial neoplasia (CIN). The long duration between initial infection with human papillomavirus (HPV), development of low-grade cervical abnormalities, and progression to high-grade disease allows for effective prevention of invasive cancer. Today, women in the United States have an average lifetime risk of 0.7%.1 Guidelines have recommended using cytologic testing as the primary screening test at annual to triennial intervals, with HPV DNA testing (Hybrid Capture II; Digene, Gaithersburg, Maryland) as an option for triage of equivocal cytologic test results.2-5 More recently, the combination of HPV DNA testing as a primary screening test with cytologic testing has been suggested as a reasonable alternative for primary screening in women older than 30 years.3,4 As evidence of the improved sensitivity of HPV DNA testing for detecting high-grade CIN accumulates, recommendations for its use in screening are likely to further evolve. For example, primary screening using HPV DNA testing followed by cytologic testing in women who are HPV positive is currently being evaluated in trials.6 How best to capitalize on the enhanced sensitivity of HPV DNA testing while minimizing false-positive results from its lower specificity is an important question to be addressed in upcoming screening guidelines.
In addition to new screening diagnostics, 2 prophylactic vaccines against HPV types 16 and 18, responsible for approximately 70% of cervical cancer, appear highly efficacious.7,8 Current US recommendations for routine vaccination are for young adolescent girls who stand to receive the most benefit, with temporary catch-up programs up to the age of 26 years.9,10 Although important discussions have ensued regarding screening for vaccinated girls, most women today will not directly benefit from vaccination but have the opportunity to benefit from new technology and improved screening strategies.
For clinical decision making, these women and their primary care physicians have a number of relevant considerations when choosing a screening strategy. Although protection from cervical cancer is the primary goal, as this risk becomes smaller, other attributes may become more important, such as potential anxiety associated with positive test results and diagnostic workup protocols.11 Consideration of these attributes becomes even more compelling given that many diagnostic workups are in response to mild cervical abnormalities likely to regress without intervention or false-positive results. Furthermore, HPV positivity may affect a woman's quality of life because she may feel stigmatized owing to the diagnosis of a sexually transmitted infection.12,13
Although numerous cost-effectiveness analyses have been conducted comparing different screening approaches,14 less attention has been paid to enumerating the more difficult to monetize trade-offs faced by individual women undergoing screening. To inform clinical decision making in the context of current and emerging screening guidelines, we assessed health-related benefits and potential harms across a spectrum of cervical cancer screening strategies using cytologic testing and HPV DNA testing. We specifically considered strategies that have been either recommended or deemed acceptable options in current US guidelines, have been used in clinical practice, or are under evaluation in clinical studies.
We used an empirically calibrated microsimulation model of the natural history of cervical cancer to simulate alternative cervical cancer screening strategies in a representative cohort of US women.15 Strategies differed by primary screening test, triage test for abnormal results, and screening frequency. One million women were simulated individually, with a tally maintained of clinical outcomes across their lifetimes. Outcomes included number of referrals for colposcopy and detection rates of CIN 2 or 3 and cancer reported as age-specific expected outcomes from a 10-year period of screening. For descriptive purposes, we refer to colposcopies performed on women with no cervical abnormalities or with CIN 1 as “excessive.” Long-term outcomes included lifetime cancer risk, life expectancy, and quality-adjusted life expectancy (QALE).
The model, described elsewhere,15 represents the natural history of disease as a sequence of monthly transitions between mutually exclusive health states, which include HPV infection, grade of CIN (1 and 2 or 3), and stage of cancer. The model distinguishes among HPV type 16, HPV type 18, other high-risk types, and low-risk types. The time horizon incorporates a woman's lifetime beginning at the age of 11 years before sexual debut. Transitions among health states depend on HPV type, age, history of prior HPV infection, type-specific natural immunity, previously treated CIN, and screening patterns. Women infected with HPV can develop transient CIN 1, progress to CIN 2 or 3, and regress without intervention. Women with persistent high-grade CIN may progress to invasive cancer, and those with invasive cancer can develop symptoms or progress to the next stage. Women diagnosed as having cancer receive stage-specific treatment and are subject to stage-specific survival rates. All women face competing mortality risks from all other causes.
Details of the model, calibration to epidemiologic data, and validation have been previously published.15 Briefly, 1 million unique sets of natural history inputs were generated by sampling values from predefined ranges derived from the published literature for each model input. Simulated model outcomes produced from each set of sampled model input values were scored according to their fit with calibration targets, such as age- and type-specific HPV prevalence and age-specific cancer incidence. A subset of these sets of model inputs was selected as “good fitting” according to a likelihood-based criterion. By conducting analyses with a random sample of 25 good-fitting sets of model inputs and reporting outcomes using the mean and standard deviation, our results reflect the effect of uncertainty in model inputs.
We sought to provide comparative information on the risks and benefits of strategies recommended or deemed acceptable in US guidelines, used in clinical practice, or under evaluation in clinical studies. On the basis of these considerations, we include 4 general testing approaches that highlight important differences in the use of new technologies: conventional cytologic testing with additional cytologic testing for women with atypical squamous cells of undetermined significance (conventional cytologic testing), liquid-based cytologic testing with HPV DNA testing for women with atypical squamous cells of undetermined significance (cytologic testing followed by HPV triage testing), liquid-based cytologic testing and HPV DNA testing in combination (combined cytologic and HPV testing), and HPV DNA testing with cytologic testing for women who test positive for HPV (HPV testing followed by cytologic triage testing) (Figures 1, 2, 3, and 4 and Table 1). We assume the average age of screening initiation is 18 years, screening intervals vary from 1 to 5 years, and testing approaches may vary depending on age. For example, a representative age-based strategy is cytologic testing followed by HPV triage testing for younger women and then switching to combined cytologic and HPV testing for women older than 30 years. For comparative purposes, we simulate a status quo scenario, assuming a distribution of screening frequencies in accordance with observational data.18
Screening test characteristics and plausible ranges used for sensitivity analyses were based on published literature.19,20 For both conventional and liquid-based cytologic testing, we assumed a sensitivity of 70% for CIN 1 (range, 40%-75%) and 80% for CIN 2 or 3 or worse (range, 50%-85%). We assumed a specificity of 95% (range, 90%-98%). On the basis of recent data, we also assumed a higher likelihood of a false-positive result with liquid-based cytologic testing compared with conventional cytologic testing and in particular among women with results indicating atypical squamous cells of undetermined significance.21,22 The probability of detecting high-risk HPV types given that they are truly present and detectable is assumed to be 100%. The clinically relevant definition of the sensitivity of an HPV DNA test is the probability of detecting high-risk types of HPV given CIN 2 or 3. This is a model output and ranges from 80% to 90%, whereas specificity ranges from 87% to 92%. We conservatively assumed that diagnostic workup in response to abnormal screening test results identifies all high-grade disease and that, although it begins with colposcopy and biopsy, it may include additional procedures and subsequent screening and follow-up. We conducted a sensitivity analysis on our screening test characteristic assumptions.
We used age-specific utility weights derived from population-based data to reflect general quality of life in US females with adjustment for invasive cervical cancer.15 To explore the potential effect on a woman's quality of life (eg, anxiety and psychosocial effects) associated with an abnormal cytologic test result, a positive HPV test result, or a diagnostic workup, we allowed for small short-term negative consequences.11 Because the magnitude of these potential effects is uncertain, we varied them in sensitivity analyses.
Table 2 gives the outcomes by screening frequency for the 4 general testing approaches using conventional cytologic testing, cytologic testing followed by HPV triage testing, combined cytologic and HPV testing, and HPV testing followed by cytologic triage testing. Table 2 also gives the outcomes for women undergoing triennial screening with cytologic testing followed by HPV triage testing before the age of 30 years who switch to HPV testing followed by cytologic triage testing at the age of 30 years to illustrate a strategy that changes the screening approach on the basis of age. Outcomes are reported as the age-specific average for a screening strategy for 1000 women participating in a 10-year period of screening. For illustrative purposes, we chose to present outcomes for 20- and 40-year-old women. Model results for all screening scenarios and ages are available from the authors by request.
Across strategies, referrals to colposcopy and further diagnostic workups a woman may expect from 10 years of screening varied 3-fold, although diagnostic rates of CIN 2 or 3 were similar. Screening with combined cytologic and HPV testing led to the most referrals, whereas HPV testing followed by cytologic triage testing led to the fewest. For example, for a representative group of a thousand 20-year-old women undergoing annual screening for 10 years, we expect 1795 referrals from combined cytologic and HPV testing (1788 excessive), 403 referrals from cytologic testing with HPV triage testing (396 excessive), 333 from conventional cytologic testing (326 excessive), and 223 referrals from HPV testing followed by cytologic triage testing (216 excessive).
Less frequent screening results in lower overall referral rates but comparable trends across strategies. For the same group of 1000 women undergoing triennial screening for 10 years, we expect 1038 referrals from combined cytologic and HPV testing (1031 excessive), whereas the 3 other strategies have fewer than 200. Although the strategy of HPV testing followed by cytologic triage testing has the lowest colposcopy referrals, there is a greater likelihood of an initially positive screening test result. This finding reflects the high likelihood of HPV infection in young women because the probability of a positive test result is a function of both test sensitivity and underlying disease prevalence.
Although the likelihood of a CIN 2 or 3 diagnosis increases with age, most women do not have CIN 2 or 3 at the time of screening, and little variation was seen in expected diagnoses across strategies. Increasing the screening frequency from every 5 years to annually resulted in an increase of 1 to 2 more expected diagnoses of CIN 2 or 3 for a representative group of 1000 women aged 20 years undergoing 10 years of screening. For older women, the effect of screening frequency was only slightly greater.
More than 95% of referrals to colposcopy for diagnostic workup are false positive and/or potentially excessive in that they are performed on healthy women or women who have CIN 1. Screening with combined cytologic and HPV testing, regardless of patient age, leads to the highest number of excessive colposcopic referrals. For a representative group of 1000 women aged 40 years undergoing 10 years of combination screening, we expect 892, 480, and 283 excessive referrals for colposcopy and diagnostic workup from every 1-, 3-, and 5-year screening, respectively. Of these, only 139, 91, and 58, respectively, would be for CIN 1 and the remainder conducted for women with no histologic abnormalities. Excessive referrals were reduced notably in the strategies that used triage testing.
Reductions in screening test sensitivity, whether cytologic testing or HPV DNA testing, have minimal effect on relative outcomes for strategies with frequent screening. In contrast, changes in test specificity lead to large changes in referral rates. For example, a 40-year-old woman can expect a nearly 50% increase in colposcopy referral rates if the specificity of HPV DNA testing is 10% lower than assumed in our main analysis.
Figure 5 illustrates the trade-off between a measure of benefit (lifetime cancer risk) and risk (referral to colposcopy for 10 years of triennial screening) for the 4 main approaches. Differences in lifetime risk of cervical cancer among the strategies are small and translate to even smaller life expectancy differences because survival is high for cervical cancer detected at early stages as is the case for most screen-detected cancer.1 In contrast, the colposcopy referral rate was 5-fold higher for combination cytologic and HPV testing compared with HPV testing followed by cytologic triage testing.
Table 3 gives the reductions in QALE from small disutilities associated with screening and diagnostic workup. These reductions are on the order of days and months, similar in magnitude to differences in QALE across screening frequencies and among strategies for other preventive services.23 Considering the potential disutility from a positive screening test result, the reduction in QALE with primary HPV testing is greater than with primary cytologic test–based strategies; in contrast, the potential disutility from colposcopy has a greater effect on cytologic test–based strategies, reflecting the lower likelihood for colposcopy using primary HPV testing with cytologic triage testing. In comparing all screening frequencies and ages, the combination of cytologic and HPV testing is the least attractive because the disutility outweighs the small incremental reduction in lifetime risk of cancer.
To aid decision making by women and their primary care physicians, we enumerated health-related benefits and potential harms for 4 main screening strategies using cytologic and HPV DNA testing. These strategies pose trade-offs between minimizing cancer risk (already small with regular screening) and minimizing the risk of false-positive test results and excessive diagnostic procedures. Because women vary in the relative values they place on these trade-offs, providing comparative information for women and their physicians may help them choose among several screening strategies. Although no strategy will eliminate false-positive results and excessive colposcopy referrals, the risk is greater for some strategies than for others.
Although differences in a woman's lifetime cancer risk associated with alternative screening approaches are small, the difference in colposcopy referrals is 3-fold. Combined screening with 2 tests, cytologic testing and HPV DNA testing, leads to the highest number of false-positive results and excessive referrals across all screening frequencies, even when restricted to women older than 30 years. Although the sensitivity of combined cytologic and HPV testing is highest, expected CIN 2 or 3 diagnoses are similar for all 4 strategies. Combined cytologic and HPV testing also resulted in high numbers of CIN 1 diagnoses. For younger women, nearly half of all colposcopies resulted in a CIN 1 diagnosis regardless of strategy. Because most CIN 1 is likely to regress, this potential overdiagnosis may also be of particular concern, especially if conservative management guidelines are not followed and overtreatment occurs and/or if a woman's quality of life is compromised by the need for repeated visits and more frequent follow-up screening.
For women who experience short-term anxiety around screening and diagnostic workup, quality of life could be an important criterion for decision making if several screening options associated with similar cancer risk reduction are available. Although HPV testing followed by cytologic triage testing is less likely to result in a colposcopy referral than cytologic testing followed by HPV triage testing, there is a greater likelihood of an initially positive screening test result, especially in younger women, reflecting the significant prevalence of high-risk HPV infection in the second and third decades of life. Using cytologic test–based strategies in younger women minimizes the rate of both excessive diagnostic workups and HPV positive results on the initial screening test. This finding may be particularly important for women who experience additional disutility from the diagnosis of a sexually transmitted disease compared with an abnormal cytologic test result.
We purposefully focused on clinical outcomes and did not consider costs in this analysis. Cost-effectiveness analyses, which include the strategies examined herein, have been conducted with the goal of ascertaining comparative “value for resources” at a population level.14 Our objective is different. Women are generally faced with multiple options deemed acceptable in clinical guidelines and may in fact make choices that differ from those strategies found to be most cost-effective.24 We sought to provide comparative information on a broader range of attributes to allow women and their primary care physicians to select a screening approach reflective of individual preferences (Table 4). To make our results most useful in a real-world context, which includes decision makers who consider cost-effectiveness an important criterion or those developing prevention guidelines, we selected strategies that reflect current US practice and recommendations, have been found to be cost-effective, and/or are being evaluated in clinical studies.
Despite our focus on the individual, this analysis has implications at the population level. It has been estimated that 65 million cytologic screening tests are performed in the United States annually.27 Considering the United States as a whole, our analysis shows that, if all women 18 to 70 years old were screened triennially using cytologic testing followed by HPV triage testing per current guidelines, more than 1 million excessive colposcopies would be performed annually. For a strategy of HPV testing followed by cytologic triage testing, 0.7 million excessive colposcopies would be expected; in sharp contrast, with a strategy of combined cytologic and HPV testing, this figure increased to 4 million. Nearly 1.5 million of these excessive diagnostic procedures could be eliminated by substituting a cytologic test–based strategy for women younger than 30 years, emphasizing why the combination strategy is not part of the recommended screening guidelines for this age group. Even for women older than 30 years, combined use of cytologic and HPV testing is associated with nearly 3 times more excessive colposcopies compared with cytologic test–based strategies and more than 5 times more than HPV followed by cytologic triage testing. Because the implications for resource utilization could be substantial, this information might be useful to other decision makers, such as health care organizations responsible for providing care to their insured populations.
For our analysis we used a modeling approach and, as such, formidable limitations are related to the data and assumptions necessary for the model. The natural history of HPV infection and cervical cancer is unobservable. As with any model, unobservable variables were constrained by structural assumptions and fit to epidemiologic data. Our model is biologically plausible and produces results consistent with observational data.15 To establish an upper bound on both the risks and benefits achievable, we assumed 100% adherence to the screening protocol for each strategy. One can infer by the results for other screening frequencies what outcomes would be if women participated less regularly. Finally, we did not address qualitative aspects that affect women's decision making regarding screening participation (eg, preferences for screening frequency, presentation of numerical results, or peace of mind from diagnostic resolution).
The newly available HPV 16 and 18 vaccine will pose additional challenges to the evaluation of screening policies. If long-term performance of the HPV vaccines is as promising as the short-term performance,7,8 the marginal health benefit from screening will be even smaller, potentially accentuating trade-offs in risks among strategies for some women. Although the effect of widespread use of the vaccine on HPV infection dynamics is as yet unknown and will not be known for several years, the relative performance of cytologic and HPV DNA testing will likely be affected.28 Undoubtedly, in vaccinated women, the ratio of false-positive to true-positive screening test results will increase if screening strategies remain the same. Although we chose to focus on providing information to women making decisions about screening today, these issues will be critical to explore in terms of both empirical data analysis and cost-effectiveness analysis.
There is great promise in the availability of accurate HPV diagnostics, new screening technology, and HPV vaccination for successful cervical cancer prevention in the United States. From both an individual and population perspective, the range of new options for prevention will ideally be assembled in such a way as to improve cancer outcomes, reduce disparities, and minimize the risk of overdetection of abnormalities likely to resolve on their own. As the risk of cervical cancer becomes small, in part owing to an already successful secondary prevention program and the availability of new technologies, women and their primary care physicians may wish to consider their choices in the context of a more fully descriptive range of screening strategy attributes. Existing information, however, about cervical cancer prevention directed toward the lay public has not always presented the benefits and risks from screening in a manner that illustrates all potential consequences.29 We sought to provide insight into the trade-offs associated with a range of cervical cancer screening policies. These results provide an initial step toward a comprehensive set of clinically relevant information highlighting trade-offs among screening policies to ultimately better inform women's decisions and provide additional dimensions for the construction of clinical guidelines.
Correspondence: Natasha K. Stout, PhD, Program in Health Decision Science, Department of Health Policy and Management, Harvard School of Public Health, 718 Huntington Ave, Second Floor, Boston, MA 02115 (firstname.lastname@example.org).
Accepted for Publication: March 26, 2008.
Author Contributions:Study concept and design: Stout, Goldhaber-Fiebert, Ortendahl, and Goldie. Acquisition of data: Stout and Goldie. Analysis and interpretation of data: Stout, Goldhaber-Fiebert, Ortendahl, and Goldie. Drafting of the manuscript: Stout. Critical revision of the manuscript for important intellectual content: Stout, Goldhaber-Fiebert, Ortendahl, and Goldie. Statistical analysis: Stout and Goldhaber-Fiebert. Obtained funding: Goldie. Administrative, technical, and material support: Stout, Ortendahl, and Goldie.
Financial Disclosure: None reported.
Funding/Support: This work was supported in part by the Harvard Center for Risk Analysis (Dr Stout), the National Science Foundation's Graduate Research Fellowship (Dr Goldhaber-Fiebert), National Cancer Institute grant R01 CA093435 (Dr Goldie), and the American Cancer Society (Dr Goldie).
Role of the Sponsor: The funding agreements ensured the authors' independence in designing the study, in interpreting the data, and in writing and publishing the report.
Additional Contributions: We gratefully acknowledge the contributions of the entire cervical cancer prevention team at the Program in Health Decision Science (Harvard School of Public Health).