To assess the use of Internet-based portals among families of children with chronic diseases and to describe characteristics of portal registrants and users.
Retrospective observational study.
Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio, using data from September 1, 2003, through February 29, 2008.
Parents of children with diabetes mellitus, juvenile idiopathic arthritis, or cystic fibrosis.
Parents of children with a chronic disease were given the opportunity to access health-related information for their children via an Internet-based portal.
Percentage of families who obtained a portal account (registered), used the portal for the first time within 3 months and again 3 to 6 months after registration, number of times logged in, and session length.
Of 1900 families, 27.9% obtained a portal account. Of those, 47.8% used the portal within 3 months of registration and 15.9% continued to use the portal 3 to 6 months after registration. Families of African American patients and of patients insured by Medicaid were less likely to obtain a portal account. More outpatient visits and having private health insurance coverage were associated with increased portal registration and use.
Understanding the feasibility of portal use by parents is an important first step to using portals for improving self-management, patient-provider interactions, and outcomes for children with chronic diseases. Subsequent studies should address parent perceptions of the value portals add to the management of the chronic disease of their child and ways to increase that value. Barriers to using portals among racial minorities and publicly insured families should also be studied to address disparities.
In 1998, JAMA published a consensus statement concerning the use of electronic technology by patients to obtain health-related information.1 Shortly thereafter, the US Department of Health and Human Services published the findings of a science panel that proposed strategies to achieve the following vision: “Interactive health communication will play an essential role in enhancing health, minimizing total burden of illness, and optimizing relationships between individuals and health professionals.”2(p3) Evidence that parents of children with a chronic disease will use such tools is limited.
Adult studies have explored the use of electronic tools for patients to inform themselves and to enhance their ability to manage their health care. Internet-based communication with health care providers among adults has been associated with perceptions of enhanced communication3,4 and being more informed regarding health care.5,6 Other studies have shown Internet-based coaching can benefit adults with chronic diseases. A randomized controlled trial7 showed Internet-based coaching improved satisfaction with care. Another randomized controlled trial of Internet use to promote self-management showed significant improvement in some health indicators.8 Ross and Lin9 published a review article that concluded that although patients would likely not be harmed by having access to their electronic health record (EHR), evidence has been inconsistent regarding the potential benefits of EHRs in relation to adherence, patient education, and patient empowerment. Finally, a number of large organizations such as Geisinger Health System, Group Health, and Beth Israel Deaconess Medical Center have demonstrated that Internet-based portals are used and liked by adult patients.7,10,11
Data from studies in pediatric settings are limited. Two studies in the pediatric literature tested the usability of an electronic pain diary for children with chronic diseases.12,13 Others tested the effectiveness of Internet-based self-management tools for adolescents with hemophilia14 and asthma.15 To our knowledge, the use of Internet-based patient portals that allow parents of children with chronic diseases to access the medical record of their child has not been studied.
In 2009, the American Academy of Pediatrics published a policy statement concerning the use of personal health records (PHRs) to improve the quality of health care for children. The policy statement recognized that although great potential exists for electronic PHRs to positively affect health care for children, many unknowns exist, along with a need for standards and incentives to use PHRs.16 The PHR has been defined by the Markle Foundation's Connecting for Health Collaborative as “an electronic application through which individuals can access, manage and share their information, and that of others for whom they are authorized in a private, secure and confidential environment.”17(p14) Although the PHR is typically perceived as consisting of information managed by the patient or individual, the information in the EHR is managed by health care professionals. The College of Medical Informatics of the American Medical Informatics Association concluded that the integration of PHRs and EHRs would be more relevant and beneficial to patients and thus should be the preferred model.18 This model is made available to patients through electronic gateways,17 which are also referred to as patient portals.
The objective of this study was to evaluate portal use among families of children with chronic diseases by describing registration in an Internet-based portal and characteristics of registrants and nonregistrants, retention of portal users, characteristics of portal users and nonusers, and frequency of portal use. Based on our early experience, we hypothesized that most families would obtain a portal account by the end of the study period and that significant disparities would be found with respect to race and health insurance status. This study is a first step toward determining both the role that patient portals potentially can have in improving interactions among parents of children with chronic diseases and the health care professionals who care for them, and, ultimately, the effect of those portals on health-related outcomes.
Ours was a retrospective observational study of portal registration and use incorporating data from September 1, 2003, through February 29, 2008. It was conducted at Cincinnati Children's Hospital Medical Center and was approved by the hospital's institutional review board. The focus of this study was parents of children with 1 or more of 3 chronic diseases: cystic fibrosis (CF), diabetes mellitus (DM), and juvenile idiopathic arthritis (JIA). These diseases were chosen because they are common, and the clinical teams treating individuals with those conditions were interested in collaborating in the portal development. The portals were developed in-house by the Department of Information Services of Cincinnati Children's Hospital Medical Center in response to the expressed desires of families and health care professionals for ready access to key portions of the EHRs of patients. The portals are secure Internet-based applications that provide access to laboratory results in tabular and graphical formats, secure messaging capabilities to health care providers, visit history, ability to upload documents to share with health care providers (eg, school-related forms), medication information, and reminders for laboratory tests and clinic visits.
Although the portals shared a common infrastructure and user interface, the content was customized for each disease so parents could easily locate the most critical information regarding the disease of their child. The portals were designed using family input and refined with formal usability methods.19 Parental awareness of the portals was developed, and portal registration was promoted with guidance from the marketing department of the Cincinnati Children's Hospital Medical Center. Each clinic worked with the marketing department to develop flyers and mailings. In addition, efforts to introduce the portals and register families during clinic visits were common to all 3 clinics. A timeline of the major marketing efforts by clinic appears in the eTable. Although teenagers could obtain a portal account with full access, parents were the focus of these efforts.
Patients were included in the study if they were recorded in at least 1 of the hospital's disease-based clinical registries for the 3 target diseases (CF, DM, and JIA), were younger than 18 years, and had a portal account opened by a parent by February 29, 2008. Patients are entered into the chronic disease–based registries by clinic personnel when diagnosed. Since reports for subsequent clinic visits are generated using the registries, any missed patients would be discovered and included at their next visit. Patients were excluded if they did not have at least 1 outpatient visit at 1 of the 3 disease-specific hospital-based clinics during the calendar year of 2007 or did not speak English, as identified by clinic personnel. Since portal usage data were associated with families and not patients, the unit of analysis was the family.
Measures of portal registration and use were developed from portal administrative records dated from September 1, 2003, through February 29, 2008. Registration was measured by the percentage of families who had obtained a portal account by February 29, 2008. Families were designated as initial users if they had used the portal at least once within 3 months after registration. They were designated as ongoing users if they had used the portal at least once within 3 months after registration and within 3 to 6 months after registration. Families were included in the analysis of portal use only if they had obtained accounts before September 1, 2007, in order to give them 6 entire months before the study end date to use the portal. Portal use was measured by the total number of times families had logged into the portal. Portal session time was defined as the amount of time that had elapsed between the time the parent logged in and the time of the last action of the session.
Measures of demographic characteristics and health care use were selected based on the literature pertaining to adults and were obtained from chronic disease registries and hospital administrative databases. The demographic characteristics were defined by using the data values at the time of the study end date and included insurance type; age, race, and sex of the patient; and area of family residence (large metropolitan area, small metropolitan area, or rural). Area of family residence was determined using zip codes and the 2003 Urban Influence Codes developed by the US Department of Agriculture.20 Health care use data included the number of hospitalizations and outpatient visits during the calendar year of 2007. For families with more than 1 child, patient-level demographic data were used from the child who had been diagnosed first. The number of outpatient visits and hospitalizations were summed across children.
Descriptive statistics and cross-tabulations were developed to describe demographic characteristics, health care use, portal registration, portal use within 3 months after registration, and portal use within 3 to 6 months after registration. Predictors of registration were identified using bivariate analysis and logistic regression. The dependent variable was whether the family had obtained (registered for) a portal account. The independent variables were the demographic and health care use variables described in the Outcome Measures subsection of the text. Since a large number of families had no hospitalizations, this variable was dichotomized. A bivariate analysis consisting of χ2 analyses for categorical variables and the nonparametric Kruskal-Wallis test for continuous variables was conducted to identify candidate variables with P values less than .10 for inclusion in the logistic regression model. The final model included only significant variables. Similarly, portal use data were analyzed to identify patient and family characteristics associated with initial and ongoing portal use. Using the method described herein, 2 models were developed for which the dependent variables were whether families had used the portal within the first 3 months after registration (initial users) and whether initial users continued to use the portal within the 3-month to 6-month time frame after registration (ongoing users). Finally, descriptive statistics were developed for the number of times families used the portal and the length of their portal sessions (in minutes). To account for the varying number of sessions across families, weighted averages were used to describe session length.
Inclusion and exclusion criteria resulted in 1960 eligible patients, which translated to 1900 families because 58 families had 2 or more eligible children. For families with 2 or more eligible children, patient-level demographic data from the oldest child was used for analysis purposes. Also, 21 patients had 2 diseases each, of which 1 was DM. These children all received the DM diagnosis after being diagnosed with CF or JIA. For the purposes of analysis, they were included in the disease category pertaining to their first diagnosis. This resulted in 19 patients with CF and DM being included in the CF category and 2 patients with JIA and DM being included in the JIA category. Of the 1900 families, 175 were included in the CF, 1336 in the DM, and 389 in the JIA categories.
Table 1 summarizes the demographic characteristics of the study population by disease, demonstrating that patients with CF had higher rates of health care use. Other notable differences were that a higher percentage of patients with CF were insured by Medicaid, a higher percentage of patients with DM and CF lived in large metropolitan areas, and a higher percentage of patients with JIA were girls.
Figure 1 illustrates the disposition of the families by registration and portal use. Of the 1900 families, 530 (27.9%) had opened a portal account (registered). Thirty-two families were excluded from further portal use analysis because their registration date did not allow them to use the portal for a full 6 months before the study ended. Of the 498 included families, 238 (47.8%) were initial users and only 79 (15.9%) were ongoing users. Figure 2 illustrates the cumulative percentage of families who registered over time, by disease.
The study population by portal registration and use.
Cumulative percentage of families obtaining a portal account, by disease. CF indicates cystic fibrosis; DM, diabetes mellitus; and JIA, juvenile idiopathic arthritis.
Table 2 describes the demographic characteristics of the study population, portal registrants, and users. Some noteworthy observations were that 23.1% of the total population was insured by Medicaid compared with only 9.2% of initial users and 3.8% of ongoing users. A similar pattern was seen among African Americans. Also, the mean number of outpatient visits for the total study population was 2.0 compared with 4.4 for ongoing portal users.
Tables 3, 4, and 5 summarize the predictors of portal registration and use. The odds ratios in Table 3 show that registration is associated with more outpatient visits. African Americans and those insured by Medicaid were less likely to register. Table 4 shows that among portal registrants, parents of patients insured by Medicaid were less likely to use the portal. Also, compared with parents of patients with CF, parents of patients with DM and JIA were less likely to be portal users. The number of outpatient visits trended toward significance (odds ratio [95% confidence interval], 1.12 [0.98-1.39]). Given that patients with CF had the highest average number of outpatient visits, it is difficult to discern whether the disease, health care use, or both function as predictors of initial portal use. Table 5 shows that among initial portal users, parents of patients insured by Medicaid were less likely to be ongoing users and that more outpatient visits were associated with ongoing portal use.
Table 6 summarizes descriptive statistics for the number of times portal users had accessed the portal and the length of their sessions. The mean number of times families used the portal was 4.5 within 3 months of registration and 7.2 times if they continued portal use 3 to 6 months after registration. These data are positively skewed, with the median number of times families accessed the portal equaling 2.0 for both time periods. The weighted mean session length was 5.0 and 6.1 minutes within 3 months and 3 to 6 months after registration, respectively.
In this population, 27.9% of families obtained a portal account. Although not completely comparable, Kaiser Permanente reported that member household ability to access electronic health services grew to 14% during a 3-year period.21 The population in that study consisted of adults, not all of whom had a chronic disease, and did not include access to an EHR. Group Health reported that 25% of its members had registered to access their shared medical record during a 3-year period.11 At Beth Israel Deaconess Medical Center, 11% of patients had registered for and used a portal at least once during a 4-year time period.22 Thus, although portal registration in our population was fewer than hypothesized, it exceeded that reported by other large organizations.
In our study, less than half of portal registrants used the portal within the first 3 months of registration and even fewer (15.9%) continued to use it (Figure 1). This magnitude of decline was seen in another study of primary care practices, which showed that during a 3-month time period, the percentage of portal registrants who logged in at least once declined from 76% to slightly more than one-third.22 One possible explanation for the decline in portal use in our study is that most test results are given to the parent at the time of the clinic visit.
Similar to other studies of adults, our study showed disparities in accessing electronic health data by race and insurance status. Hsu et al21 found that individuals of a race other than white and those living in neighborhoods of lower socioeconomic status were less likely to take advantage of Internet-based health services. Another study23 showed that secure electronic messaging between patients and health care professionals was less frequent among patients with Medicaid and older adults, and a study of community practices22 concluded that nonregistrants in a patient portal were more likely to be of a race other than white and to be insured by Medicaid. Finally, a study of the use of an electronic PHR in a large health network24 showed that users were more likely to be white.
Study results concerning the association of health care use with portal use have not been as consistent. In our study, health care use measured by the number of outpatient visits was positively associated with registration and portal use. Similarly, Miller et al24 concluded that sicker patients, as measured by the number of health problems and clinic visits, were more likely to be users of an electronic PHR. However, Weingart et al22 found that portal registration with access to the EHR of the patient was associated with fewer office visits.
The results from our study and others support the notion that incongruity exists among patients between reported interest in using EHRs and actual behavior. A survey by the Markle Foundation showed that 65% of US residents are interested in accessing their electronic PHR and that a relatively high level of interest exists regardless of age and race.25 Another large survey of adult patients resulted in 36% of respondents stating they were interested in reading their medical record. Health status, health care use, educational level, and income level were not related to interest level.26
Among our population of parents of children with a chronic disease, 27.9% had registered for portal use after marketing efforts were enacted by the clinics to build awareness and promote registration. Significant disparities by race and insurance status were found, indicating that barriers to adopting these tools may exist, especially among racial minorities and publicly insured families. Tang et al18 suggest a need exists to better understand how a PHR fits into the daily activities of an individual, which is especially important for parents of children with chronic diseases who require more time and family resources to manage the child's disease.
Our study population involves 3 diseases from 1 geographic area, which may limit generalizability to other settings and chronic diseases. Another limitation is that we do not have data concerning the various marketing efforts used and the ways health care providers engaged families in discussions regarding the portal. Thus, we cannot gauge the effect marketing efforts and provider communication had on portal registration and/or use, which could account for some of the variation in portal registration and use across outpatient clinics. Also, we collected data only from the parents of children with chronic diseases, not the patients themselves. Although 26 of the 530 families had multiple user names, we could not discern whether they belonged to parents and/or patients. It is also conceivable that families had multiple users for single user names, but we could not tell which family members had accessed the portal.
The first step toward understanding how portals can be used to improve self-management and patient-provider interactions, which could ultimately improve outcomes for children with chronic diseases, is to better understand the feasibility of portal use among the parents of patients. Subsequent studies should address the value, if any, that families perceive portals add to the management of the chronic disease of their child and should suggest ways to increase that value. It will be important to study ways that families might incorporate portals into the daily management of the disease of their child and potential incentives for families to access patient portals. An important next step will be to determine barriers to using portals among racial minority and publicly insured families so that disparities regarding access to such resources can be addressed and ultimately lessened or eliminated.
Correspondence: Terri L. Byczkowski, PhD, MBA, Division of Emergency Medicine, Cincinnati Children's Hospital Medical Center, University of Cincinnati College of Medicine, 3333 Burnet Ave, MLC 2008, Cincinnati, OH 45229-3039 (email@example.com).
Accepted for Publication: January 9, 2011.
Author Contributions: Drs Byczkowski and Britto had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. Study concept and design: Byczkowski and Britto. Acquisition of data: Munafo and Britto. Analysis and interpretation of data: Byczkowski, Munafo, and Britto. Drafting of the manuscript: Byczkowski. Critical revision of the manuscript for important intellectual content: Byczkowski, Munafo, and Britto. Statistical analysis: Byczkowski. Obtained funding: Britto. Administrative, technical, and material support: Byczkowski, Munafo, and Britto. Study supervision: Britto.
Financial Disclosure: None reported.
Funding/Support: The work was supported by a grant to Dr Britto from the Cincinnati Children's Hospital Medical Center's Place Outcomes Award.
Additional Contributions: We thank S. Andrew Spooner, MD, for his valuable advice, which greatly improved this manuscript, and Juli Bick, BA, for providing details regarding the marketing efforts for the portals.
Byczkowski TL, Munafo JK, Britto MT. Variation in Use of Internet-Based Patient Portals by Parents of Children With Chronic Disease. Arch Pediatr Adolesc Med. 2011;165(5):405–411. doi:10.1001/archpediatrics.2011.55
* * SCHEDULED MAINTENANCE * *
The JAMA Network Sites will be conducting routine maintenance from 10/20/2017 through 10/21/2017. During this window access to content and authentication may be intermittently available. The JAMA Store will be completely unavailable during the maintenance window.