Sign In
Individual Sign In
Create an Account
Institutional Sign In
OpenAthens Shibboleth
July 1999

Impact of North Carolina's Universal Vaccine Purchase Program by Children's Insurance Status

Author Affiliations

From the Division of General Pediatrics, University of Michigan, Ann Arbor (Dr Freed and Ms Clark), and Cecil G. Sheps Center for Health Services Research, University of North Carolina at Chapel Hill (Dr Pathman and Mss Schectman and Serling).


Copyright 1999 American Medical Association. All Rights Reserved. Applicable FARS/DFARS Restrictions Apply to Government Use.1999

Arch Pediatr Adolesc Med. 1999;153(7):748-754. doi:10.1001/archpedi.153.7.748

Objective  To examine the impact of a new universal purchase vaccine program on immunization rates of children with different types of insurance.

Design  Ecologic study using parent telephone interviews, medical chart abstraction in sites of outpatient care, and insurance verification with Medicaid and private insurers.

Setting  State of North Carolina.

Participants  Of a random birth certificate sample of 4385 children born in North Carolina during 1994 and 1995, 507 were excluded. A total of 2767 children had completed parent interviews; 95% of those had medical chart abstraction and insurance data.

Main Outcome Measures  Immunization rates at each month during the first 2 years of age, site of delivery for immunizations and well-child visits, and insurance status.

Results  In month-by-month comparisons, children born in 1995 had immunization rates 4% to 10% higher than their 1994 counterparts. By 24 months of age, 84% of the 1995 cohort had completed the primary immunization series, compared with 79% of the 1994 cohort (P<.001). In all insurance subgroups, 1995 immunization rates were higher than 1994 rates. The largest increases occurred among privately insured children with no well-child coverage, children who had periods of being uninsured, and children enrolled in Medicaid exclusively or with private insurance. More children in the 1995 cohort received immunizations in the private sector.

Conclusions  Implementation of North Carolina's universal purchase program was associated with improved immunization rates, especially for children with inadequate insurance for well-child care. However, insurance status still influences the ability of children to receive immunizations on schedule.

DESPITE THE availability of effective vaccines, the annual incidences of several vaccine-preventable diseases continue to be higher than the targets outlined in the Healthy People 2000 report.1,2 Inadequate immunization has been linked to most cases of vaccine-preventable diseases.3,4

There have been many attempts to determine the reasons some children do not receive recommended immunizations on schedule.5 Affordability of immunizations has been the focus of much recent research; private-sector charges for the primary immunization series have increased markedly over the past decade, and are thought to contribute to low immunization rates and the referral of patients from private offices to health departments for immunizations.6,7

Children's insurance status has an impact on preventive care delivery, immunization status, and the site of immunization provision (health department vs private office).8 Physicians have reported that they do not immunize uninsured and underinsured children (those whose private insurance does not fully cover preventive services) as frequently as insured children, opting instead to refer them to public clinics.9 Federal or state programs designed to reduce or eliminate the cost of immunization for those groups aim to increase immunization rates and to decrease the number of children referred from private providers to health departments. Evaluation of such programs, therefore, must examine these outcomes for the target groups of children.

In the early 1990s, the state of North Carolina sought to improve its childhood immunization rate by addressing financial barriers to vaccines and limiting the referral of children to health departments for immunizations. To accomplish these goals, the state established a universal purchase (UP) vaccine program, under which the state purchases vaccine for all children and distributes it free to all participating providers. Providers are not allowed to charge for the vaccine itself but are permitted to charge a state-determined administration fee. The UP program was publicized and administered solely to providers, not the general public. Implementation began officially on January 1, 1994; however, start-up tasks and processes (eg, enrolling providers, depleting existing private vaccine supplies) consumed much of the first year. By late 1994, the program was fully operational.

Although UP programs are in place in North Carolina and 14 other states, none had been evaluated to determine whether program goals were being achieved, particularly among the target groups of uninsured and underinsured children. In 1996, our research team was asked to conduct an evaluation of the North Carolina UP program. This report describes the results of an ecologic study that examined the impact of the UP program on immunization rates and site of immunization for children with various types of health insurance.


The study compared 2 cohorts: children born in January or February 1994 and children born in January or February 1995. Although both cohorts had the potential to receive all of their immunizations under North Carolina's UP program, the process of enrolling private providers and integrating the program into the private-sector immunization delivery system took several months. As such, data from the 1995 cohort represent the impact of a fully operational program, while data from the 1994 cohort serve as provisional information about the program in its formative stages. While this study design does not provide a true "before-and-after" comparison, the use of a birth cohort from 1993 or earlier would have greatly impeded the task of locating parents and obtaining medical and insurance records, leading to a biased respondent pool. Thus, a comparison of the 1994 and 1995 co-horts was used to reflect changes associated with im-plementation of the UP program, although the magnitude of effect is likely greater than these data demonstrate.


In the summer of 1996, the North Carolina Office of Vital Records provided birth certificate information for a random sample of 2 cohorts: children born in January or February 1994 (N=2196), and children born in January or February 1995 (N=2189). Research staff then used a variety of sources (eg, commercial databases, local telephone directories, Internet public access files, directory assistance, US Postal Service records, state health department records) to locate addresses and telephone numbers of parents of these children.

Phase 1: Parent Interviews

Parent telephone interviews were conducted from July through December 1996. Parents were mailed an introductory letter explaining the study and how their child was selected for participation. Trained interviewers then called parents to obtain consent to participate and complete the interview. Interviewers asked to speak with the parent who usually took the child to the doctor. In a few instances where parents were unavailable, grandmothers completed the telephone interview. A written version of the interview form was received from 143 families who had no telephone, an unlisted telephone number, or who so requested. Spanish-speaking interviewers completed interviews upon request.

Parents gave specific information about all sites of medical care for the child since birth and the type of care provided at each site. Parents also were asked, for each site, whether an immunization had ever been administered there. Interviewers then asked about the child's health insurance history from birth to present, including name of carrier, employer, group or subscriber numbers, and coverage dates. Several family demographic questions were asked, including ages of siblings, number of adults living in the home, and household income.

Phase 2: Medical Record Review

To obtain specific information on children's medical history, chart abstractions were conducted from February through June 1997 in each practice and health department where parents reported their children received outpatient care. The only sites not included in chart abstraction were emergency departments and subspecialty clinics (most commonly, allergy or ear-nose-throat clinics); not one parent reported that an immunization was administered at one of these excluded sites, nor was there any such indication in children's primary care records.

Chart abstractions were performed by trained and certified medical record abstractors. Medical records were abstracted to obtain (1) dates of all vaccines administered in the practice, (2) dates of all office visits and type of visits (eg, well-child care, acute care, follow-up), (3) dates and type of visits to other providers during which vaccines were administered, and (4) information regarding patient transfer to other practices and names of the patient's other providers. Other sites of care obtained via chart abstraction were compared with parent-reported sites; additional chart abstractions were ordered if a site was missing from parental report. This occurred infrequently, and was not more common in one cohort over the other.

A total of 643 sites of medical care participated in the chart abstraction (500 private practices, 24 community health centers, 16 hospital-affiliated clinics, and 103 local health departments). At the time of chart abstraction, 91% of private practice and 100% of health departments were participating in the state UP program. Only 24 private practices refused to consent to chart abstraction; in addition, 3 solo physicians had retired by the time of the study and could not make their records available.

Phase 3: Insurance Status Verification

The final aspect of data collection was to verify children's health insurance history and identify insurance benefits for immunizations and well-child visits. Research staff contacted insurance companies and employers identified in the parent interviews to verify coverage for individual children. More than 150 different insurance companies and more than 200 employers provided historical information on children's dates of enrollment and benefit coverage for immunizations and well-child visits. Information about Medicaid participation was provided by the North Carolina Division of Medical Assistance. For each child, a chronology of insurance coverage was constructed with each policy classified into 1 of 6 categories: (1) Full coverage—a private policy providing full coverage for immunizations and well-child visits with no deductible, but usually requiring a copayment ($5 to $20) for each office visit. (2) Partial coverage—a private policy with coverage for all well-child care, but subject to a deductible and/or a fixed coinsurance rate (eg, 80/20 indemnity plan), or a private policy with coverage for well-child visits or immunizations but not both. (3) Medicaid—enrolled in Medicaid program. (4) Underinsured—a private policy with no coverage for well-child visits or immunizations (eg, acute and curative care only). (5) Uninsured—not covered under any health insurance. (6) Unknown—coverage could not be determined or verified.

There was no assessment of children's Medicaid eligibility separate from enrollment.


Initial analysis of data involved demographic assessment of the sample. Next, immunization data from all sources of chart review were synthesized to create a complete immunization history for each child. Discrepancies in vaccine type or administration date were resolved by the project coordinator based on primary vs secondary source, corresponding office visit dates, and other available information.

Each child's immunization status then was determined at each month of age based on the then-current combined immunization schedule.10 A 1-month grace period was allowed with each immunization required; for example, immunizations recommended at 6 months of age were required for up-to-date designation beginning at 7 months. Additionally, we required only 3 doses of Haemophilus influenzae type b (Hib) vaccine by 24 months because chart abstraction protocols did not allow specification of whether a 3-dose or 4-dose type of Hib vaccine was administered. The specific criteria used to evaluate immunization status from 7 to 24 months of age are shown below.

Finally, immunization status was merged with each child's insurance chronology. A χ2 analysis was used to examine the immunization status of children with different types of insurance and by year of birth.

This study was approved by the Committee for the Protection of Human Subjects at the University of North Carolina at Chapel Hill.


Of the original sample of 4385 children, 507 were declared ineligible because they had either moved from the state (n=298), had obtained medical care at military bases or at sites outside North Carolina and thus were not eligible for the UP program (n=202), were adopted or placed in the custody of the courts (n=6), or had incomplete birth certificate information (n=1). Of the remaining 3878 children, 2767 (71%) had completed parent interviews (1241 children in the 1994 cohort and 1526 in the 1995 cohort). Written surveys were received from 143 parents; the other respondents participated in telephone interviews. Of those who did have completed interviews, 64 parents declined participation, and the remaining parents could not be contacted.

Of the 2767 children with completed parent interviews, 84 had no chart data collected because their site of care refused participation or their chart could not be located, and 41 other children had missing immunization data from 1 or more sites. Thus, 2642 (95%) of the children with parent interviews had complete immunization information. Complete insurance information was collected for 2695 (97%) of the 2767 children with completed parent interviews.

Demographic characteristics of the sample are presented in Table 1, comparing mothers of children with completed parent interviews (respondents) with nonrespondents and with those declared ineligible. Nonrespondent mothers were more likely to be younger, black, not married, and less educated compared with respondent and ineligible mothers.

Table 1. 
Image not available
Demographic Characteristics of Sample*

Among respondents, maternal characteristics of the 1995 birth cohort differed from those of the 1994 cohort. Mothers in the 1995 respondent group were more likely than the 1994 group to be teenagers (17% vs 14%; P<.01), to be black (28% vs 25%; P<.01), to be unmarried (32% vs 28%; P<.01), and to have not graduated from high school (22% vs 17%; P<.01). Since these characteristics were associated with lower immunization rates both in this study and in previous reports,11 the 1995 cohort would be expected to have lower immunization rates than the 1994 cohort.

Figure 1 demonstrates, however, that in month-by-month comparisons, children born in 1995 had immunization rates 4% to 10% higher than children born in 1994. From a longitudinal perspective, a given percentage of the 1995 cohort consistently became up-to-date earlier than the 1994 cohort. For example, the 1995 cohort had achieved the targeted 90% immunization rate for their first 3 vaccine series at 10 months of age, while the 1994 cohort did not reach this marker until 14 months of age. From a cross-sectional view, by 15 months of age, 95% of children in the 1995 cohort had received their first 3 series of immunizations vs 90% of the 1994 cohort (P<.001). By 24 months of age, 84% of the 1995 cohort had completed the primary immunization series, compared with 79% of the 1994 cohort (P<.001).

Image not available

Immunization status of North Carolina children by age. In this study, up-to-date immunization status was defined as follows: 7 to 15 months: 3 diphtheria and tetanus toxoids and pertussis (DTP), 2 Haemophilus influenzae type b (Hib), 2 oral poliovirus (OPV), 2 hepatitis B virus (HBV); 16 to 17 months: 3 DTP, 3 Hib, 2 OPV, 2 HBV, 1 measles-mumps-rubella (MMR); 18 to 24 months: 4 DTP, 3 Hib, 3 OPV, 3 HBV, 1 MMR.

A composite of children's insurance coverage during the first 2 years of life is presented in Table 2. The largest group included children who were enrolled in Medicaid, either exclusively or in combination with private insurance that covered well-child care, through the first 2 years of life. The next largest group was those who were uninsured for some period of time during their first 2 years of life; more than half of the children in this category were enrolled in Medicaid at some time.

Table 2. 
Image not available
Composite Insurance Status Through 24 Months

The relationship between immunization rates and insurance status is presented in Table 3. Up-to-date rates are shown for children at 12 months and 24 months of age. In all insurance subgroups, 1995 immunization rates were higher than 1994 rates (differences shown in the table). Although immunization rates were higher among insured children, the subgroup difference between the highest and lowest rate was significantly smaller in the 1995 cohort. At both 12 and 24 months of age, the largest increases from 1994 to 1995 were seen among children who had periods of being uninsured and those continuously enrolled in Medicaid or a combination of Medicaid and private insurance. Substantial 1994-to-1995 increases also were seen at 12 and 24 months of age among children who had periods of being underinsured and with partial coverage for well-child care.

Table 3. 
Image not available
Percentage of Children Up-to-date* for Immunizations at 12 and 24 Months of Age Stratified by Insurance Status

Utilization of public health departments for immunization decreased from 1994 to 1995. For the 1994 cohort, 63% of vaccines were administered in private practices, and 37% in public health departments, compared with 68% in private practices and 32% in health departments for the 1995 cohort (P<.001). Across all insurance subgroups, the proportion of vaccines administered at public health departments was significantly less in the 1995 cohort ( Table 4).

Table 4. 
Image not available
Percentage of Immunizations Given at Public Health Departments for Children With Different Types of Insurance*

Results of this study demonstrate an association between North Carolina's UP program and increased immunization rates. Immunization rates improved for all groups of children, especially those with inadequate or no insurance for preventive care. However, for both the 1994 and 1995 cohorts, insurance status still appeared to play a key role in the ability of children to receive immunizations on schedule.


Findings from this study demonstrate that the groups achieving the greatest rise in immunization rates during the initial years of North Carolina's UP program were those who, theoretically, should have gained the most: the uninsured and the underinsured. These populations historically have had difficulty with access to preventive care and with fragmentation of care,6,7,12 often obtaining well-child visits from private physicians but receiving immunizations at public health departments.13,14 Data from this study demonstrate that for uninsured and underinsured children, immunization rates increased substantially and receipt of vaccines at public clinics decreased. The UP program appears to have had success in alleviating financial barriers and expanding continuity of care for these at-risk populations.

Children enrolled in Medicaid also demonstrated improvements in immunization rates associated with the UP program. Although these children may not have been expected to experience financial barriers, previous reports have indicated that many physicians refer Medicaid children to health departments for immunization.6,7 As such, the UP program took steps focusing on Medicaid children, in cooperation with the Division of Medical Assistance and other state agencies. A major effort was to increase provider reimbursement for immunizations administered under the UP program; in fact, Medicaid reimbursement was established at the same amount a provider was allowed to charge a private patient under the UP program. Further, provider reimbursement for privately purchased vaccines was no longer accepted. These developments likely prompted many physicians to immunize Medicaid patients in the private practice, rather than refer them to health departments.

Finally, children with full insurance coverage for preventive care showed increased immunization rates associated with the UP program, although the increases were much smaller than those seen in other subgroups. This is somewhat surprising, as fully insured children would have no financial barrier to immunization and thus would not have been expected to benefit from the program.15 However, it seems plausible that the UP program engendered broad improvements in overall immunization delivery, allowing participating physicians to immunize all children in the same manner without referrals to public clinics.


One of the main goals of the UP program was to decrease referrals to health departments for immunization and keep children in their medical home. Our data indicate limited progress in this area. Importantly, this trend has implications beyond immunization rates. Previous studies have shown that interventions that help to keep children in their medical home also improve other measurable aspects of primary care, such as screening for specific diseases and attendance for preventive care visits.16

However, the UP program did not—and cannot—solve the issue of access to private-sector care for the uninsured and underinsured populations. Half of all uninsured children continue to receive immunizations at health departments. It is important to remember that immunizations are only one component of the package of preventive care that should be provided to young children. Programs aimed at expanding children's insurance coverage, such as the State Child Health Insurance Program (CHIP), are expected to make further progress in this area.


The North Carolina UP program is not without its critics. Concerns regarding UP programs generally fall into 3 areas. First, some contend that taxpayer money should not be spent to provide free vaccines for children whose insurance would otherwise pay for it. Second, vaccine manufacturers claim that UP programs unfairly provide for the purchase of all vaccines at lower government contract prices, thus eliminating the private market for vaccines and decreasing revenue. Third, although immunization charges to patients are reduced under UP programs, patients still pay for the vaccine administration fee and for the accompanying well-child visit; totally free immunizations are offered only at public health departments, as they were prior to the institution of UP.

Advocates of UP programs counter that their greatest advantage is the simplicity for providers. Many government programs have difficulty achieving high rates of provider participation because of the extra (uncompensated) effort required of them. Prior to adopting the UP program, the state conducted discussions, in which one of us (G.L.F.) participated, with North Carolina physicians, who insisted that they would not participate in any vaccine program that required office-based eligibility checks. The universal aspect of UP minimizes physicians' administrative burden and ensures high participation rates.

Through this study we discovered another issue related to UP. It appears that the UP program has created a perverse incentive for insurance companies to include immunization fees—but not the cost of vaccine—as part of a preventive care package in employer-sponsored health plans.17 Providers who use state-supplied free vaccines to immunize all children are unable to bill insurers for the cost of vaccine. Since the initiation of UP in North Carolina, most insurance plans that covered immunizations ceased to include vaccine as a reimbursable expense; instead they reimburse only the state-determined administration fee. Also, many other private insurance plans have added coverage for immunizations, quite possibly because the insurer can cover this preventive service at a relatively low cost (ie, not paying for the vaccine). As a result, the government is performing a de facto subsidization of private insurers who need no longer to cover the cost of vaccines for their insured patients. State policy makers have begun looking at this issue. An option adopted by some UP states is mandating that insurance companies contribute to a trust fund to help finance the UP system, based on their savings on vaccines.


This ecologic study took advantage of a new phenomenon, the initiation of a UP program in North Carolina, to examine changes in immunization delivery to children. A unique strength of this study was the method of verification of the information provided by parents or guardians of subjects regarding site of preventive care provision and insurance coverage. This information was verified by chart review of all sources of care and direct contact with insurance companies and/or employers. To our knowledge, this is the most accurate information ever available on immunizations and insurance status for a sample of children of this size.

There are several limitations of the study that mitigate the ability to definitely demonstrate the impact of the UP program. First, as with any ecologic study, there were influences on immunization delivery beyond the new UP program. For example, local vaccine campaigns, sponsored by service groups or county government agencies, were conducted. Although there was no direct publicity of the UP program, there may have been other media coverage of vaccines or vaccine-preventable illnesses.

Second, as explained in the "Subjects and Methods" section, the study compared children born in 1994 with those born in 1995. However, the UP program was in place for the entire life span of both cohorts. As such, changes from 1994 to 1995 represent the impact of a program as it matured, rather than a true "before-and-after" comparison.

Another limitation of the study is that 32% of the 1994 cohort and 18% of the 1995 cohort were not able to be contacted for participation in this study. The nonrespondent mothers of these children were more likely to be black, not married, younger, and less educated—factors associated with low immunization rates. This potential response bias would not account for the increase in immunization rates observed between the 2 cohorts because 1995 respondents had a slightly greater proportion of these same characteristics than the 1994 respondents. However, the response bias may impact the ability of this study to be generalized to specific populations.


Our data indicate that the UP program was associated with increased immunization rates for children in North Carolina. Further, while certain groups of children (uninsured, Medicaid) continue to have lower immunization rates, the gap between these groups and children who are fully insured has closed. Additional efforts, reaching beyond economic issues, are required to bring age-appropriate immunization rates above 90% for all groups of children. Future efforts should focus on follow-up and tracking systems.

Other studies of UP in North Carolina have shown that the cost of obtaining immunizations in the private sector is not limited to vaccine charges.17 While the UP program reduces one component of vaccine charges to parents, it does not provide access to the private sector for all those without insurance and unable to pay for well-child care. If policy goals are directed toward providing children with a medical home for all preventive care, UP programs can only be viewed as one step in that process. First-dollar insurance coverage for preventive services will be required to bring this level of care to all children in the United States.

Back to top
Article Information

Accepted for publication November 11, 1998.

Funding for this study was provided by the North Carolina Department of Health and Human Services and the Centers for Disease Control and Prevention, Atlanta, Ga.

We thank staff of the North Carolina Immunization Section, the Division of Medical Assistance, and the Department of Insurance, for their assistance.

Reprints: Gary L. Freed, MD, MPH, Division of General Pediatrics, University of Michigan, D3202 Medical Professional Building, 1500 E Medical Center Dr, Ann Arbor MI 48109-0718 (e-mail:

Editor's Note: Provide it (free) and they will come—unless, of course, they must pay to access the "freebie."—Catherine D. DeAngelis, MD

Centers for Disease Control and Prevention, Status report on the Childhood Immunization Initiative: reported cases of selected vaccine-preventable diseases—United States, 1996. MMWR Morb Mortal Wkly Rep. 1997;46665- 710
US Department of Health and Human Services, Healthy People 2000: National Health Promotion and Disease Prevention Objectives.  Washington, DC US Government Printing Office1990;
National Vaccine Advisory Committee, The measles epidemic: the problems, barriers, and recommendations. JAMA. 1991;2661547- 1552Article
Goldstein  KPPhilipson  TJJoo  HDaum  RS The effect of epidemic measles on immunization rates. JAMA. 1996;27656- 58Article
Freed  GLBordley  WCDeFriese  GH Childhood immunization programs: an analysis of policy issues. Milbank Q. 1993;7165- 96Article
Bordley  WCFreed  GLGarrett  JMByrd  CAMeriwether  R Factors responsible for immunization referrals to health departments in North Carolina. Pediatrics. 1994;94376- 380
Ruch-Ross  HSO'Conner  KG Immunization referral practices of pediatricians in the US. Pediatrics. 1994;94508- 513
Stoddard  JJSt. Peter  RFNewacheck  PW Health insurance status and ambulatory care for children. N Engl J Med. 1994;3301421- 1425Article
Arnold  PJSchlenker  TL The impact of health care financing on childhood immunization practices. AJDC. 1992;146728- 732
American Academy of Pediatrics, Recommended childhood immunization schedule. Pediatrics. 1996;97143
Mustin  HDHolt  VLConnell  FA Adequacy of well-child care and immunizations in US infants born in 1988. JAMA. 1994;2721111- 1115Article
Wood  DLCorey  CFreeman  HEShapiro  MF Are poor families satisfied with the medical care their children receive? Pediatrics. 1992;9066- 70
St. Peter  RFNewacheck  PWHalfon  N Access to care for poor children. JAMA. 1992;2672760- 2764Article
Schulte  JMBrown  GRZetzman  MR  et al.  Changing immunization referral patterns among pediatricians and family practice physicians, Dallas County, Texas, 1988. Pediatrics. 1991;87204- 207
Taylor  JADarden  PMSlora  EHasemeier  CMAsmussen  LWasserman  R The influence of provider behavior, parental characteristics, and a public policy initiative on the immunization status of children followed by private pediatricians: a study from PROS. Pediatrics. 1997;99209- 215Article
Freed  GLKatz  SL The Comprehensive Childhood Immunization Act of 1993. N Engl J Med. 1993;3291957- 1960Article
Freed  GLClark  SJPathman  DEKonrad  TRBiddle  AKSchectman  RM Impact of a new universal purchase vaccine program in North Carolina. Arch Pediatr Adolesc Med. 1997;1511117- 1124Article