Author Affiliations: Division of Infectious Diseases (Drs Nolan, Zaoutis, and Coffin and Ms Prasad), Department of Pediatrics (Dr Fiks), The Children's Hospital of Philadelphia; and Department of Biostatistics, University of Pennsylvania School of Medicine (Dr TenHave), Philadelphia, Pennsylvania.
Objectives To measure the effect of rotavirus vaccine (RVV) on acute gastroenteritis (AGE) managed by primary care physicians in the first 2 rotatvirus seasons following the introduction of RVV.
Design Retrospective cohort study.
Setting Practice-based network composed of 33 ambulatory pediatric practices in Philadelphia, Pennsylvania.
Participants All children born from February 22, 2006 (date of RVV licensure), through February 29, 2008, and who received care at any network site.
Main Exposure Receipt of RVV.
Outcome Measures The primary outcomes were AGE-related office visits, telephone calls, and episodes (composite outcome consisting of all visits and calls within a 10-day period).
Results Rates of AGE visits in the 2 rotavirus seasons following the introduction of RVV steadily decreased from 3.0 AGE visits per 100 total office visits in the 2005 season to 1.8 in the 2008 season. In 2007, vaccinations were administered to 9351 of 13 951 vaccine-eligible children (67.0%), and in 2008, they were administered to 9958 of 10 728 (92.8%). Among RVV-immunized children in 2007, AGE calls and episodes were significantly reduced with vaccine effectiveness of 53% and 46%, respectively. No significant difference was seen between RVV-immunized and RVV-nonimmunized children for any outcome in 2008.
Conclusions Rotavirus vaccine was associated with a significant reduction in outpatient AGE calls and episodes among immunized children in our network in 2007. Despite a reduction in winter AGE rates in the network, no difference was detected between RVV-immunized and RVV-nonimmunized children for any outcome in 2008. Further study is needed to understand the lack of vaccine effect in 2008.
Before the introduction of rotavirus (RV) vaccine (RVV) in 2006, RV was the most common cause of serious gastroenteritis among young children in the United States,1,2 causing approximately 55 000 to 70 000 hospitalizations annually, 200 000 emergency department visits, and 400 000 outpatient visits among children younger than 5 years.3
Prelicensure clinical trials demonstrated that the 3-dose regimen of the pentavalent RVV prevented 94.5% of RV-associated emergency department visits and hospitalizations and 86% of RV-associated outpatient clinic visits.4,5 Recent data from the National Respiratory and Enteric Virus Surveillance System6 demonstrated a greater than 50% reduction in RV disease activity for the 2007-2008 winter season compared with the previous 15 years; however, most of these specimens were obtained from children who either sought care in an emergency department or required hospitalization. Only a few studies have examined the effect of RVV on mild acute gastroenteritis (AGE) in the setting of the primary care practice. A cohort study by Wang et al7 demonstrated 27% vaccine effectiveness (VE) in preventing outpatient AGE visits in RVV-immunized vs RVV-nonimmunized patients. Studying AGE office visit rates, Bégué and Perrin8 and Cortese et al9 reported 23% and 32% to 62% reductions, respectively, in rates during the 2008 RV season.
Reductions in the burden of mild AGE are most likely underestimated by these studies because not all children will require an outpatient office visit for an AGE episode.2 A large proportion of children will require only home care or a telephone call(s) to their primary care physician for AGE, making it difficult to gauge the full effect of RVV on less severe manifestations of AGE in young children. However, systematic capture of AGE-related telephone calls as well as AGE-related office visits will provide a more accurate assessment of the effect of RVV on the burden of AGE managed by primary care physicians. Using data from a large pediatric health care network, we measured the effect of RVV on the incidence of outpatient AGE outcomes, including office visits, telephone calls, and a composite variable, episodes, among children in the first 2 RV seasons following the introduction of RVV.
We performed a retrospective cohort study to evaluate the effectiveness of RVV in preventing primary care AGE office visits, telephone calls, and episodes (all AGE-related visits and calls that occurred within 10 days of each other) during the first 2 full RV seasons after the introduction of RVV. The study was approved by The Children's Hospital of Philadelphia (CHOP) Institutional Review Board.
The CHOP pediatric health care network includes 33 ambulatory pediatric practices (5 inner-city and 28 suburban). These ambulatory practices constitute the CHOP Pediatric Research Consortium (PeRC), a practice-based research network that has nearly 200 000 active patients, 60% of whom are younger than 5 years. Practices within PeRC use an electronic health record (EHR; EpicCare) and since December 2006 have shared a centralized after-hours nursing telephone call center. The triage nurses use the algorithm-driven Barton Schmitt outpatient telephone triage protocols,10 and contents of calls are recorded in a standardized and templated report that becomes part of the patient's EHR.
The EHR used by PeRC was designed to facilitate research efforts in the ambulatory setting. The data procured have been validated in multiple studies. In particular, the immunization database within the EHR provides a comprehensive record of all vaccines received by a patient and is the sole immunization record used at all study practices. It has been used as the source of vaccine information in several studies11- 14 and, in a study15 of vaccine registries in Philadelphia, was found to have the most complete information. Also, a recent infectious disease study16 in our network validated the use of International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM) codes from PeRC's EHR. The ICD-9 codes agreed with the documentation in the clinician's note with 95% sensitivity and specificity.
The study population included any child born from February 22, 2006 (date of RVV licensure), through February 29, 2008, who had at least 1 office visit at a PeRC site before 2 months of age. To evaluate protection in the second season following immunization, children were divided into 2 cohorts: (1) the 2007 cohort included those children who were eligible for AGE outcomes in both the 2007 and the 2008 seasons, and (2) the 2008 cohort included children eligible for AGE outcomes in the 2008 season only (Figure 1). The cohorts were mutually exclusive. The 2007 season was from December 1, 2006, through May 31, 2007, and the 2008 season was from January 1, 2008, through June 30, 2008. Dates for AGE observations were selected to capture all seasonal RV activity on the basis of data from the CHOP Clinical Virology Laboratory. The AGE observation period began on the first day of the month with positive RV samples for 3 consecutive weeks and ended on the last day of the month in which there were 2 consecutive weeks without positive RV samples.
Figure 1. Primary study design for cohort selection and outpatient acute gastroenteritis outcomes. Children were selected from the Pediatric Research Consortium, which is The Children's Hospital of Philadelphia's network of affiliated pediatric primary care practices. RVV indicates rotavirus vaccine.
The primary exposure of interest was receipt of RVV (RotaTeq [Merck], the only RVV available during the study period). Exposed children received 1, 2, or 3 doses of RVV. Unexposed children received 0 doses of RVV.
The primary outcomes were AGE-related visits, calls, and episodes. Visits were defined as any office visits in the patient's EHR with a primary diagnosis code for a diarrheal illness using the AGE ICD-9-CM codes (001-005, 006-007, 008-008.5, 008.6, 008.61, 008.8, 009-009.3, 558.9, 787-787.03, and 787.91).17Calls were defined as all AGE-related after-hours telephone triage calls identified in the EHR by the use of standard protocols for vomiting, diarrhea, and dehydration.10 Because of inconsistencies in the way practice sites entered calls into the EHR during daytime office hours, we limited our data to calls made to the centralized triage center during night and weekend hours. Episodes were defined as all AGE-related visits and calls that occurred within 10 days of each other. The episode outcome was created to yield the best estimate of discrete diarrheal illnesses that each patient had during a season. This outcome accounts for variations in health care use and reduces the potential for bias if children had more than 1 visit and/or call for a single illness. Individual outcomes were not assessed until the child was at least 6 weeks of age (the earliest age at which RVV administration is recommended).
As a secondary outcome to contextualize our results, we determined the rates of AGE in the network during the period before and after the introduction of RVV (January 1, 2005, through December 31, 2008) by dividing the total number of monthly AGE visits (based on aforementioned ICD-9-CM codes) by the total number of monthly office visits for children 24 months or younger.
The EHR was retrospectively queried to identify all primary and secondary exposures and outcomes (number of RVV doses and number of AGE visits and calls) for children eligible for inclusion in the cohort. Data regarding demographic characteristics, other immunizations received, complex chronic conditions,18 number of sick and preventative care visits, and total numbers of calls were also abstracted.
We first characterized cohort subjects by all potential risk factors for AGE, including age (calculated as the age [in days] on the first day of their eligibility for an outcome in the first season in which they participated), demographic variables, and complex chronic conditions. Categorical variables, such as sex and race, were summarized by frequencies, whereas continuous variables, such as age, were summarized by mean (SD) or median (range). To compare demographic variables and characteristics of health care use between RVV-immunized and RVV-nonimmunized groups, χ2 analysis was used for categorical variables and the t test or Wilcoxon rank sum test for continuous variables. Bivariable analysis was conducted using Poisson regression to determine the association between potential risk factors and each outcome.
For the multivariable analysis, Poisson regression was used to determine the association between exposure to RVV and the outcomes for each season. Receipt of RVV (exposure) was modeled as a binary variable, and each outcome was modeled as a count (total numbers of AGE visits, calls, and episodes per season). The total number of days the child was eligible for an outcome per season was calculated and included as the time variable in the regression. All variables with P < .20 on bivariable analysis were included in the multivariable model. Confounders and clinically relevant risk factors were also considered for inclusion in the multivariable model. Stratified analysis to assess effect modification was performed. Additional analyses were conducted to determine the association between receipt of RVV and VE after receipt of 1, 2, or 3 doses of vaccine and protection in the second season after vaccination.
Vaccine effectiveness in preventing AGE outcomes was calculated using a standard approach applied in other retrospective studies,7,9,19 with the formula VE = (1 − incident rate ratio [IRR]) × 100, where the IRR is the adjusted ratio for each AGE outcome among vaccinated vs unvaccinated study subjects.20
Monthly AGE office visit rates were calculated for all children 24 months or younger who were in the PeRC network to describe the context of our cohort findings. Before the introduction of RVV, the peak monthly AGE rate was 3.0 per 100 total office visits for 2005 and 2.7 for 2006 (Figure 2). For the 2007 and 2008 seasons, the peak monthly rates of AGE visits per 100 total visits were 2.4 and 1.8, respectively. The mean monthly winter AGE visit rate was significantly lower in 2007 and 2008 compared with those in 2005 and 2006 (P < .001). The mean summer baseline AGE rate (mean monthly rate of AGE visits for June through December 2005 through 2008) was 1.4 per 100 total visits.
Figure 2. Rates of acute gastroenteritis (AGE) office visits per 100 total office visits in the Pediatric Research Consortium network by month for children 24 months or younger during rotavirus seasons from 2005 through 2008. The dashed line represents the summer baseline comparison AGE rate and is the mean monthly rate of AGE office visits per total office visits for June through December 2005 through 2008.
The study population included a total of 24 679 children with a high rate of RVV vaccination; 78.2% of the cohort received at least 1 dose of RVV and 65.0% of the cohort was fully vaccinated with 3 doses of RVV. The study population comprised 2 cohorts: 13 951 children in the 2007 cohort and an additional 10 728 children in the 2008 cohort.
The rate of vaccination increased by nearly 50% between the 2007 and the 2008 cohorts. Among the 2007 cohort, 67.0% received at least 1 dose of RVV and 54.8% were fully vaccinated with RVV. For the 2008 cohort, 92.8% received at least 1 dose and 78.3% received 3 doses. The demographic characteristics of children in the cohorts were similar. In both cohorts, RVV-nonimmunized children were more likely to be black and to receive care at an urban pediatric practice than were children who had received 1 or more doses of RVV (Table 1). Children not immunized with RVV had lower rates of health care use than their immunized peers; this disparity was more pronounced in the 2008 cohort compared with the 2007 cohort (Table 2).
Unadjusted rates of AGE visits, calls, and episodes per 10 000 cohort days for RVV-immunized children remained constant across both cohorts for the 2007 and 2008 seasons (Figure 3). However, among RVV-nonimmunized children, rates for all outcomes dropped nearly 3-fold from 2007 to 2008. We calculated the IRR for each AGE outcome using Poisson regression. Adjusted models revealed that during the 2007 season, RVV-immunized children had significantly fewer AGE calls and episodes compared with RVV-nonimmunized children, with IRRs of 0.47 (95% CI, 0.33-0.65) and 0.54 (0.40-0.74), respectively. However, receipt of RVV was not associated with a significant reduction in either AGE calls or episodes for either cohort during the 2008 winter season (Table 3). Immunization with RVV was associated with a statistically nonsignificant reduction in AGE visits for the 2007 cohort in both seasons and for the 2008 cohort during the 2008 season (Table 3). The calculated VE was 53% for calls and 46% for episodes in the 2007 season.
Figure 3. Median numbers of acute gastroenteritis (AGE) outcomes per 10 000 cohort days for the 2007 and 2008 cohorts. These numbers are adjusted for each child's time in the cohort for each season. This graph demonstrates the decrease in numbers of AGE outcomes among rotavirus (RV) vaccine (RVV)–nonimmunized children from 2007 to 2008 and the lack of change in AGE outcomes between the 2 RV seasons among RVV-immunized children.
A stratified analysis was performed to determine the effectiveness of RVV among different age groups. On the basis of the distribution of age at study entry, the cohorts were divided into quartiles. On stratified analysis, there was no difference between the second and third quartiles; therefore, those age groups were combined, resulting in the 3 reported age groups: 6 weeks, 7 to 24 weeks, and 25 to 40 weeks. During the 2007 season, RVV was most effective in preventing AGE outcomes in the youngest age group (Figure 4A); this differential effect was seen for both cohorts in the 2008 season (Figure 4B and C) but was statistically nonsignificant. A subanalysis was performed for each age group to determine differences in protection from AGE on the basis of the number of RVV doses received. We found no significant difference in protection regardless of the number of doses of RVV received for AGE visits, calls, or episodes.
Figure 4. Incidence rate ratios for all acute gastroenteritis outcomes for the 2007 and 2008 cohorts by age group and rotavirus (RV) season. Error bars indicate 95% CIs. A, 2007 cohort in RV season 2007. B, 2007 cohort in RV season 2008. C, 2008 cohort in RV season 2008.
Although much attention has been focused on inpatient RV disease, this study instead examined AGE and its effect on disease managed by the primary care physician. In this cohort study within a large outpatient pediatric practice–based research network, we found a significant reduction in AGE outcomes for RVV-immunized children. This study determined that children immunized with RVV had a reduced risk of AGE calls (VE of 53%) and episodes (VE of 46%) in 2007. We demonstrated a 3-fold reduction in rates of AGE visits, calls, and episodes among RVV-nonimmunized children in the cohort from the 2007 season to the 2008 season. Also, in our secondary analysis, we showed a significant reduction in winter AGE visit rates among children in our network in the 2 RV seasons following the introduction of RVV compared with the 2 RV seasons preceding RVV.
Our findings demonstrated a significant reduction in the IRR for AGE calls and episodes in 2007 for children immunized with 1 or more doses of RVV. By including calls and creating a composite episode variable, we demonstrated a more significant reduction in AGE-related outpatient outcomes among RVV-immunized children in the 2007 RV season than did Wang et al,7 with nearly half of AGE episodes reduced among RVV-immunized children in our network. Because RV has been estimated to cause more than 40% of outpatient AGE during the RV season,21 the AGE reductions found in our study correspond with expected reductions in RV-specific disease due to RVV. Although the IRR for visits alone did not reach the level of statistical significance, the trend we detected was similar to that reported by other investigators7,13 who demonstrated VE of 25% to 27%. The inability to achieve a statistically significant difference for the visit outcome is unclear but may be due to fewer numbers of visits than calls or fewer RVV-nonimmunized children in the 2008 cohort.
We found children's age on entry into the 2007 season influenced the effectiveness of RVV. Stratified analysis demonstrated that RVV was most effective in preventing calls and episodes in the youngest age group. The reason for these results is unclear. We suspect that RVV is effective in preventing RV infection in children of all ages equally, but as children grow older, they are more likely to be exposed to non-RV AGE pathogens or their parents are less likely to call or to bring the children in for evaluation. Despite clear evidence in prelicensure studies for a dose-dependent response,4 we were unable to detect a difference based on number of doses in either cohort. This finding might be explained by a smaller sample size in each stratum that limited our ability to detect a statistically significant difference. Decreasing overall rates of disease may also have limited our ability to detect a difference on the basis of the number of doses received.
In 2008, essentially no vaccine effect was seen for AGE calls and episodes, despite a robust decrease in both of these outcomes among RVV-immunized patients in the 2007 season. These unexpected results contradicted our 2007 findings and the results from other studies.7,9,22- 24 We suspect that indirect protection through herd immunity might have led to our inability to detect a difference between RVV-immunized and RVV-nonimmunized children in the 2008 season. High rates of vaccination in our cohort and the decrease in peak winter AGE rates in our network from the 2 RV seasons before the introduction of RVV to near-summer baseline levels by 2008 (after the introduction of RVV) support the possibility of indirect protection for RVV-nonimmunized children in the 2008 season. Other possible explanations for our inability to detect a difference between RVV-immunized and RVV-nonimmunized children in 2008 include limited RV disease activity, an increase in AGE caused by another pathogen, waning or short-lived immunity, or failure of the vaccine to protect against mild RV disease.
There were several limitations of this study. By using AGE as an outcome, we measured the AGE burden managed by primary care physicians, but we cannot truly assess the reduction in RV disease due to RVV. Testing for viral stool pathogens is uncommon in outpatient settings, so we could not capture RV-specific disease as a retrospective outcome. To perform this study prospectively and to collect stool to test for RV during every AGE episode for more than 24 000 patients would have been costly and inefficient. Despite previous validation, the use of ICD-9-CM codes to identify AGE outcomes introduces the potential for error in both the physician diagnosis and the recorded codes. Also, we used retrospective data and captured only office visits and telephone calls within the PeRC network. If parents sought care for their children outside of the network, our data capture may be incomplete. Despite including 3 distinct factors in the models to account for variability in patterns of both well-child and sick-child primary care use, perhaps we did not adequately control for changes in health care use patterns in 2008 or other unmeasured factors, which could also explain the lack of a statistically significant difference between RVV-immunized and RVV-nonimmunized children in 2008.
In conclusion, our study demonstrates 46% VE against AGE episodes managed by primary care physicians in our cohort in the 2007 season. No difference was detected between RVV-immunized and RVV-nonimmunized children in 2008. Further studies are needed to determine whether the lack of VE seen in the 2008 season was the result of low RV disease activity, waning immunity, herd immunity, or other factors. Further study is also warranted to evaluate whether RVV is more effective in preventing disease among young infants compared with older infants and toddlers.
Correspondence: Sheila M. Nolan, MD, MSCE, Division of Infectious Diseases, The Children's Hospital of Philadelphia, 34th St and Civic Center Blvd, Philadelphia, PA 19104 (firstname.lastname@example.org).
Accepted for Publication: August 3, 2011.
Author Contributions: Dr Coffin received no commercial funding for this project, had full access to all the data in the study, and takes responsibility for the integrity of the data and the accuracy of the data analysis. Study concept and design: Nolan, Fiks, Zaoutis, TenHave, and Coffin. Acquisition of data: Nolan, Prasad, Fiks, and Coffin. Analysis and interpretation of data: Nolan, Prasad, Fiks, Zaoutis, TenHave, and Coffin. Drafting of the manuscript: Nolan, Prasad, Fiks, and Coffin. Critical revision of the manuscript for important intellectual content: Nolan, Fiks, Zaoutis, TenHave, and Coffin. Statistical analysis: Nolan, Prasad, Fiks, TenHave, and Coffin. Obtained funding: Nolan. Administrative, technical, and material support: Nolan. Study supervision: Fiks, Zaoutis, and Coffin.
Financial Disclosure: Dr Nolan reports that she has received grants from the Eunice Kennedy Shriver National Institute of Child Health and Human Development and the Merck Investigator-Initiated Studies Program for this project. Funding from Merck has been in the form of salary support only. Design and conduct of the study was performed solely by the authors. Per the stipulations of the grant contract, the findings of the study were submitted to Merck for review but do not require company approval for publication. Dr Fiks reports that he has received $250 for help in preparing a grant on shared decision making in pediatric diabetes; is the lead investigator on a contract from the Agency for Healthcare Research and Quality to CHOP to develop a multipart intervention to improve vaccination rates for adolescents (contract HHSA290200710013); received a $500 honorarium for a publication titled “Designing Computerized Decision Support That Works for Clinicians and Families”; and is the co-inventor of a piece of software (the “Care Assistant”) that provides decision support within EHRs. Dr Zaoutis reports that he has received research funding from Merck, Enzon, Schering-Plough, AstraZeneca, and Wyeth-Ayerst Laboratories and has received speaking honoraria from Cephalon. None of this funding is directly related to this project.
Funding/Support: The project described was supported by award F32HD062184 from the Eunice Kennedy Shriver National Institute of Child Health & Human Development. This work was also supported in part by a research grant from the Merck Investigator-Initiated Studies Program of Merck Sharp & Dohme.
Role of the Sponsor: The content is solely the responsibility of the authors and does not necessarily represent the official views of the Eunice Kennedy Shriver National Institute of Child Health & Human Development or the National Institutes of Health.
Disclaimer: The opinions expressed herein are those of the authors and do not necessarily represent those of Merck Sharp & Dohme.
Additional Contributions: We thank the network of primary care physicians, the patients, and the families for their contribution to clinical research through the PeRC at CHOP. We thank Jonathan Crossette and Svetlana Ostapenko from the CHOP Center for Biomedical Informatics for their assistance with data abstraction for this study.
Nolan SM, Prasad P, Fiks AG, Zaoutis T, TenHave TR, Coffin SE. Effect of Rotavirus Vaccine on Reducing Acute Gastroenteritis in a Large Outpatient Pediatric Network. Arch Pediatr Adolesc Med. 2012;166(3):232-239. doi:10.1001/archpediatrics.2011.628