Customize your JAMA Network experience by selecting one or more topics from the list below.
To examine the effect of open access scheduling (OA) on infant well-child care (WCC).
Cluster randomization of 2 methods of OA compared with a baseline group (prior to OA).
Community health center pediatric clinic, August 1, 2003, to January 31, 2004.
Ten providers (pediatricians and physician assistants) and 878 infants; 2-, 4-, and 6-month WCC visits were scheduled.
Two scheduling methods were compared under the OA model: the OA future visit group scheduled their infant's next WCC visit when leaving the visit, and the OA same day group called for a same-day appointment.
Main Outcome Measures
Missed appointment rates, on-time immunization rates, and continuity of care.
Missed appointment rates decreased from 21% in the baseline group to 14% and 9% in the OA future visit and OA same day groups, respectively (P<.02). For 630 infants older than 5 months at study end, on-time immunization rates were 59% in the baseline group and 74% in both OA groups (P<.006). Of 412 infants with 2 or more WCC visits, 75% in the OA future visit group and 60% in the OA same day group saw the same provider for all visits (P = .001). This difference was due to differences among providers, not to the different scheduling methods.
Open access scheduling decreases missed appointments for infant WCC visits and appears to increase on-time immunizations.
Open access scheduling (OA) is an appointment scheduling system that attempts to provide access to care at the time it is needed.1,2 In OA, when a parent calls to schedule a well-child care (WCC) visit, the patient receives an appointment within 1 to 2 days. When OA is not used, the next available WCC visit appointment is often in 4 to 6 weeks. In OA, since more than 50% of appointments are available for the same day, ill children can receive a same-day appointment without overbooking. Overbooking usually results in long wait times. Without overbooking, doctors' time may not be filled because of cancellations or missed appointments. Open access scheduling was developed in the early 1990s to address these issues.1-3 Open access scheduling systems have decreased missed appointment rates, improved continuity of care, and improved patient satisfaction.2,4-6 We found no published data on the effect of OA on infant WCC visits.
Immunization rates, a marker of effective pediatric care, remain lower than the Healthy People 2010 goal of 90% of all children aged 19 to 35 months having received 4 diphtheria and tetanus toxoids and acellular pertussis vaccines; 3 inactivated poliovirus vaccines; 1 measles, mumps, and rubella vaccine; 3 Haemophilus influenzae type b vaccines; 3 hepatitis B vaccines; and 1 varicella vaccine (4:3:1:3:3:1). Despite use of immunization registries,7 improved insurance coverage,8 and reminder recall systems for parents and health care professionals,9-13 only 76% of 19- to 35-month-old children had completed the 4:3:1:3:3:1 series in 2004.14 Parents report that inability to get timely appointments impedes their ability to get care.15,16 The National Vaccine Advisory Committee recommends minimizing delays in scheduling appointments to improve immunization rates.17 If OA improves access to care and decreases missed appointment rates, immunization rates should improve. If parents forget to call for an appointment in OA, immunization rates might decrease. We found no published data on the effect of OA on immunization rates or whether it is better to schedule infant WCC visits in advance compared with same-day scheduling.
The hypotheses for this project include: (1) The missed appointment rate for WCC visits will be reduced from the estimated baseline (non-OA) rate of 25% to 16% in OA. (2) There will be no difference in on-time immunizations in the baseline group compared with the OA group.
Study setting and population
This study was conducted in a pediatric clinic of a community health center, Westside Family Health Center (WFHC), that is part of Denver Health, an integrated health system. The system includes a safety-net hospital, 9 community health centers, and other entities. The WFHC clinic is staffed by pediatricians, physician assistants, residents, and support staff. More than 25 000 immunizations are administered annually at approximately 25 000 visits. About two thirds of the patients have Medicaid, one third are uninsured, and less than 5% have commercial insurance. The patients are largely of Mexican origin. Prior to the start of OA in October 2003, all infants were scheduled for the next 2-, 4-, or 6-month WCC visit at the end of the prior visit.
For the 2 months preceding the change to OA, missed appointments and immunizations were tracked for all infants scheduled for 2-, 4-, and 6-month WCC visits.
Open access period
Ten pediatricians and physician assistants caring for infants were divided into 4 groups of 2 or 4 providers each by sessions worked per week, Spanish-language fluency, and education (physician assistant or physician degree). Residents and pediatricians not working throughout the study period were excluded. Half of each group was randomized (by cluster) to the OA future visit group. Families needing a 2-, 4-, or 6-month WCC visit prescheduled their next appointment (same scheduling system as during baseline). The other half was randomized to the OA same day group, whose families called for an appointment the week it was needed. Informed consent was obtained from all providers.
The clinic began OA for all patients on October 1, 2003. Beginning at the 2-week WCC visit, providers in the OA future visit group gave parents an appointment slip for the clerk to schedule their next appointment prior to leaving the clinic. Providers in the OA same day group gave parents a reminder slip with their pediatrician’s or physician assistant's name and the proper week to call for their infant's next appointment. Under OA, 50% to 75% of appointments were available at the beginning of each day.
Standard procedures for infant WCC visits included the following:
Standardized forms were used to document WCC visits.
At all clinic visits, the Denver Health immunization registry was queried. Immunization history and recommended immunizations were printed for the provider to review.
The immunization registry printed recall postcards that were mailed monthly when infants were more than 30 days overdue for immunizations. Mailings were repeated every 3 months until the appropriate immunizations were recorded or the infant was inactivated from the registry.
When infants did not attend a WCC visit, the medical assistant made a telephone call or sent a postcard to remind parents to reschedule.
Standard immunizations for infants during the study included the administration of combined diphtheria and tetanus toxoids and acellular pertussis–inactivated poliovirus–hepatitis B vaccine, H influenzae type b vaccine, and 7-valent pneumococcal conjugate vaccine at 2-, 4-, and 6-month WCC visits.
Data were collected for all infants attending 2-, 4-, and 6-month WCC visits from August through September 2003 (baseline) and during the first 4 months of OA from October 1, 2003, through January 31, 2004 (Figure). All data were collected from computerized information systems. The clerks scheduling appointments noted which infants were scheduled for 2-, 4-, or 6-month WCC visits. On a biweekly basis during the study, 1 research assistant searched the daily schedule for each study provider. For any patient having a 2-, 4-, or 6-month WCC appointment, the medical record number, patient name, provider name, visit date, date the appointment was scheduled, and appointment attendance were recorded in a spreadsheet. The date of birth, sex, insurance, and race/ethnicity (by parental report) were collected from registration data. The immunization registry was checked for immunizations administered. Data were generally collected within 2 weeks of the visit date.
Timeline for open access study.
Any infant who had a 2-, 4-, or 6-month WCC visit scheduled with 1 of the study providers during the study period was included. Infants completed the study when they received their 6-month immunizations or on January 31, 2004, whichever came first. After January 31, 2004, the immunization registry was queried on all children whose immunizations were not up-to-date. Immunizations given at nonstudy visits or given elsewhere were included in the data collection and analysis. At the end of data collection, the patient name and hospital number were removed to deidentify the data.
Statistical analysis was performed using SPSS for Windows version 12.0 (SPSS Inc, Chicago, Ill) and SAS version 8.2 (SAS Institute Inc, Cary, NC).18 Categorical variables were compared by χ2 test, and nonnormally distributed continuous variables were compared by Kruskal-Wallis test.
Ethnic group was reported by families as Hispanic; however, it was transformed into Mexican American based on prior research at WFHC. Providers were identified as being fluent in Spanish or not. Insurance was dichotomized into having any insurance (Medicaid, State Children's Health Insurance Program, or private insurance) vs self-pay or being a Medicaid applicant. When insurance was used as a variable in the regression models for analysis of immunization rates and continuity of care, the insurance status at the last appointment was used.
Three outcomes were analyzed. The missed appointment status was tabulated for each scheduled visit. Repeated logistic regression was used to examine the effect of the risk variables, group (baseline, OA future visit, and OA same day), insurance status, and Spanish-speaking provider on the missed appointment status. Correlation due to the repeated measurements on the same subjects (possible 2-, 4-, and 6-month visits) was taken into account during modeling.19
On-time immunization rates based on all immunizations in the registry assessed the proportion of infants older than 153 days (5 months) at study completion who had received their most recent immunizations within 30 days of the recommended age for that immunization. The Luman definition of being younger than 153 days for the receipt of 4-month immunizations or younger than 214 days for the receipt of 6-month immunizations was used.20 Infants were coded as being in the baseline, OA future visit, or OA same day group by the group they were in for the last study visit. Logistic regression was used to examine the effect of the risk variables, group (baseline, OA future visit, and OA same day), insurance status, and Spanish-speaking provider on the on-time immunization rate.
Continuity of care was assessed for all infants having 2 or more visits during the study. Infants were coded as having perfect continuity (being seen by the same provider for all visits) or not (being seen by > 1 provider). For the comparison of rates of perfect continuity between the 2 OA groups, the match effect for provider and cluster effect for patients nested within providers were taken into consideration during modeling. Logit link function and binomial distribution21 were applied to the outcome variable in the nonlinear effect model.
The project was approved by the Colorado Multiple Institutional Review Board and a Health Insurance Portability and Accountability Act of 1996 waiver was obtained.
Between August 1, 2003, and January 31, 2004, 1563 appointments for 2-, 4-, or 6-month WCC visits were scheduled for or attended by 878 infants. Table 1 compares the demographic information of the infants and the Spanish fluency of the providers among the 3 groups.
The 2 different methods of OA used in this study resulted in significant differences among the baseline and the 2 OA groups for the median number of days ahead that the appointments were scheduled and the number of appointments scheduled the same day and within 36 hours of the appointment. There were 228 missed appointments (15%). The missed appointment rate decreased by 30% in the OA future visit group and by more than 50% in the OA same day group (Table 2). Variables associated with the decreased missed appointment rate for 1539 visits included being in the OA future visit group vs the baseline group (adjusted odds ratio [OR], 0.58 [95% confidence interval (CI), 0.42-0.80]), being in the OA same day group vs the baseline group (adjusted OR, 0.38 [95% CI, 0.26-0.55]), being seen by a Spanish-speaking provider (adjusted OR, 0.58 [95% CI, 0.43-0.79]), and having insurance (adjusted OR, 0.57 [95% CI, 0.40-0.82]).
Of the 630 infants who were older than 5 months at study end, 59% of the baseline group and 74% of both OA groups had on-time immunizations (Table 2). Variables associated with on-time immunizations for 628 infants included being in the OA future visit group vs the baseline group (adjusted OR, 2.12 [95% CI, 1.34-3.36]), being in the OA same day group vs the baseline group (adjusted OR, 1.89 [95% CI, 1.22-2.93]), having insurance (adjusted OR, 2.95 [95% CI, 1.68-5.19]), and being seen by a Spanish-speaking provider (adjusted OR, 1.55 [95% CI, 1.06-2.26]).
Of the 412 infants having 2 or more WCC visits, 274 (67%) had perfect continuity. In the OA future visit group, 136 (75%) of 180 infants had perfect continuity compared with 138 (60%) of 232 infants in the OA same day group (P = .001). This difference in perfect continuity was not due to the difference between the OA methods (P = .90) but was due to variation among the providers.
Use of OA decreased missed appointment rates for WCC visits from 21% in the baseline period to 14% in the OA future visit group and to 9% in the OA same day group. The decrease in the missed appointment rate in the OA future visit group was unexpected. The OA future visit group had a significant increase in appointments scheduled within 36 hours of the visit compared with the baseline period (Table 2). Only 50 (8%) of the 584 appointments scheduled within 36 hours of the visit were missed, compared with 177 (18%) of 978 missed appointments scheduled more than 1 day in advance. Scheduling appointments within 36 hours of the visit was associated with decreased missed appointments.
High missed appointment rates affect patient flow, the availability of appointments, and productivity. Missed appointment rates of 8% to more than 50% have been found in patients insured by Medicaid.9,22-25 Belardi et al4 did not find a decrease in missed appointment rates after implementation of OA in a family practice clinic; however, their baseline missed appointment rate of 9% was much less than the baseline missed appointment rate of 21% for infants at WFHC. Bundy et al6 found that missed appointment rates decreased from 16% to 11% in 4 pediatric and family practice clinics after the introduction of OA. With the decreased missed appointment rate at WFHC, we have decreased the number of appointments scheduled and increased the number of patients seen in a session. This increases access to care.
Three factors were associated with decreased missed appointment rates: being in either of the OA groups, being seen by a Spanish-speaking provider (a proxy for our patients who are monolingual Spanish speakers), and having insurance. Monolingual Spanish-speaking families at WFHC are recent immigrants from Mexico and their infants, born in the United States, are eligible for Medicaid. Having health insurance is a marker of their ability to complete the Medicaid paperwork. Inability to complete the Medicaid paperwork may be associated with other problems in accessing care. Families without Medicaid may not have attended a visit for fear of getting a bill.
On-time immunizations improved by 25% between the baseline group and the 2 OA groups. The decreased missed appointment rates in the OA groups should increase immunization rates. Irigoyen et al9 found that children who attended their appointment after a reminder call were 2.3 times more likely to be up-to-date on immunizations than children who missed the visit. LeBaron et al10 improved immunization rates by 3% to 6% by using an automated appointment reminder/recall system; however, the major reason for delayed immunizations remained missed appointments. In OA, if an appointment is canceled or missed, it can be promptly rescheduled. Of 176 appointments in the OA future visit group that were scheduled within 36 hours of the visit, 42 (24%) were scheduled after a prior missed appointment. Before OA at WFHC, the next available WCC visit appointment would have been in 3 to 6 weeks.
Randolph et al2 hypothesized that OA should improve immunization rates by decreasing the time between scheduling the appointment and the appointment date. Lannon et al15 found that the long wait between scheduling an appointment and the appointment date impeded the ability of low-income mothers to get medical care for their children. Our results support the hypothesis of Randolph et al.
In addition to OA, having insurance and being seen by a Spanish-speaking provider were also associated with improved on-time immunization rates. Our results support the importance of insurance in improving immunization rates found by others.8,26 The variable “Spanish-speaking provider” is a marker for the importance of immunizations for families who have recently immigrated from Mexico. Anderson et al27 found that Latino children whose mothers were the least acculturated were 3 to 5 times more likely to be up-to-date on immunizations as Latino children whose mothers were more acculturated.
The Denver Health system, with its access to an organization-wide immunization registry, assessment of immunizations at each visit, printed provider reminders of immunizations needed, follow-up after missed appointments, and mailed parent recalls for delayed immunizations, has attempted to optimize immunization rates. Open access scheduling appears to improve immunization rates further.
Practices using OA for at least 6 to 12 months report increased continuity of care.4,5 We found less continuity of care in the infants seen in the OA same day group than in the OA future visit group. The reason for this was differences in continuity among providers, not differences between the OA groups. One provider on maternity leave during part of the study may have accounted for some of the difference among providers. Our study duration was only 4 months.
This study had several limitations. Because of time and financial constraints, we were unable to randomize the infants, so we used a cluster design with provider randomization. Since the baseline group had no cluster randomization and we compared the 3 groups for missed appointment rates and on-time immunizations, we could not include the cluster randomization in this data analysis. However, comparison of the missed appointment and on-time immunization rates between the 2 OA groups including the effect of the cluster randomization yielded similar results as the comparison of the 3 groups without the cluster randomization. With randomization of the providers, some patients crossed between the 2 OA groups. In the analysis of continuity and immunization rates, infants were grouped based on the group they were in at their last visit. We have no data that the crossing between the 2 OA groups occurred more 1 way than the other. The time frame of the study was short and results could have been affected by seasonal variations. However, quarterly monitoring of missed appointment and immunization rates of 1-year-old children has shown no seasonal variations.
The increased on-time immunization rates in the OA groups could be because of infants who never had an appointment scheduled, never got immunizations, and were not included in the study. Since the infants in the baseline and OA future visit groups had their appointments for WCC visits scheduled in the same manner, this was not a factor in the OA future visit group results. There was only a small number of infants who attended a 2-week visit, and who were not included in the study. There was no difference between the number of these infants who were not seen during the baseline period or during the OA period.
Our study population was low income and largely Mexican American. An evaluation of OA needs to be replicated in other ethnic and socioeconomic groups. Using a study design with complete cohorts seen in a non-OA and an OA system would give more robust data results for comparison of immunization rates.
Open access scheduling decreased the missed appointment rates for infant WCC visits. Scheduling 2-, 4-, and 6-month WCC visits 2 months ahead within an OA system allows the same improvement in on-time immunizations as scheduling same-day infant WCC. In a community health center that is part of a health care system that has attempted to optimize immunization rates, OA appears to have increased on-time immunization rates.
At WFHC, we have continued to offer future-visit appointments for 2-, 4-, and 6-month WCC visits in OA. This allows parents to schedule ahead or the same day, whichever they prefer. Open access scheduling has improved access to care.
Correspondence: Mary E. O’Connor, MD, MPH, Westside Family Health Center, 1100 Federal Blvd, Denver, CO 80204 (email@example.com).
Accepted for Publication: April 20, 2006.
Author Contributions: Dr O’Connor had full access to all the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis. Study concept and design: O’Connor and Matthews. Acquisition of data: O’Connor and Matthews. Analysis and interpretation of data: O’Connor and Gao. Drafting of the manuscript: O’Connor, Matthews, and Gao. Critical revision of the manuscript for important intellectual content: O’Connor, Matthews, and Gao. Statistical analysis: O’Connor and Gao.
Funding/Support: This study was funded in part by Health Resources and Services Administration grant 2D54HP0054-04-00 to the Primary Care Research Unit, University of Colorado Health Sciences Center.
Acknowledgment: Thanks go to Stephen Vogler, MD, for persistently asking the question “How will we know that our infants are coming for care?”; Pete Gutierrez, BA, and Jeff Brown, MD, MPH, for their support of this project; the providers, nursing staff, and especially to Celina Magallanes and Joann Rios for their ability to accurately schedule patients in the 2 different open access systems; and Simon Hambidge, MD, PhD, and the other reviewers for their suggestions.
O’Connor ME, Matthews BS, Gao D. Effect of Open Access Scheduling on Missed Appointments, Immunizations, and Continuity of Care for Infant Well-Child Care Visits. Arch Pediatr Adolesc Med. 2006;160(9):889–893. doi:10.1001/archpedi.160.9.889
Monkeypox Resource Center