To describe the magnitude of off-label drug use, to identify drugs most commonly used off-label, and to identify factors associated with off-label drug use in children hospitalized in the United States.
Retrospective cohort study.
Administrative database containing inpatient resource utilization data from January 1 to December 31, 2004, from 31 tertiary care pediatric hospitals in the United States.
Hospitalized patients 18 years or younger.
Institution and patient characteristics.
Main Outcome Measures
Off-label drug use was defined as use of a specific drug in a patient younger than the Food and Drug Administration–approved age range for any indication of that drug.
At least 1 drug was used off-label in 297 592 (78.7%) of 355 409 patients discharged during the study. Off-label use accounted for $270 275 849 (40.5%) of the total dollars spent on these medications. Medications classified as central or autonomic nervous system agents or as fluids or nutrients, or gastrointestinal tract agents were most commonly used off-label, whereas antineoplastic agents were rarely used off-label. Factors associated with off-label use in multivariate analysis were as follows: undergoing a surgical procedure, age older than 28 days, greater severity of illness, and all-cause in-hospital mortality.
Most patients hospitalized at tertiary care pediatric institutions receive at least 1 medication outside the terms of the Food and Drug Administration product license. Substantial variation in the frequency of off-label use was observed across diagnostic categories and drug classes. Despite the frequent off-label use of drugs, using an administrative database, we cannot determine which of these treatments are unsafe or ineffective and which treatments result in substantial benefit to the patient.
Many medications prescribed for children have not been formally studied in this population and most are not labeled for use in children.1 This scarcity of pediatric data can lead to the withholding of potentially beneficial treatments or to administration of potentially harmful treatments. Despite evidence that recent legislation in the United States has resulted in improved pediatric drug labeling,2 there is still little information about the extent of off-label drug use in hospitalized children, the types of drugs used most often off-label, and the characteristics of hospitalized patients receiving drugs off-label.
Current studies of off-label drug use in hospitalized children are limited by the few patients studied,3- 11 the focus on patients receiving subspecialty care,4,5,7,10 and the inclusion of patients treated in both the hospital and ambulatory settings.4,5 All of these studies have been conducted outside of the United States.3- 12 Inasmuch as the requirement for hospitalization may differ depending on culture, health system, and national resources, findings of studies conducted in other countries may not be generalizable to the United States. This study was designed to describe the magnitude of off-label drug use, to identify drugs most commonly used off-label, and to identify factors associated with off-label drug use in children hospitalized in the United States. Because most drugs are not labeled for use in children,13 we chose to focus on those drugs that were either administered frequently or recommended for further study in children by the Food and Drug Administration (FDA).
Data for this study were obtained from the Pediatric Health Information System (PHIS), an administrative database that contains inpatient data from 36 not-for-profit tertiary care pediatric hospitals in the United States. These hospitals are affiliated with the Child Health Corporation of America (Shawnee Mission, Kan), a business alliance of children's hospitals. Data quality and reliability are assured through a joint effort between the Child Health Corporation of America and participating hospitals. The data warehouse function for the PHIS database is managed by Solucient LLC (Evanston, Ill). For the purposes of external benchmarking, participating hospitals provide discharge data including demographic characteristics, diagnoses, and procedures. Thirty-one of these hospitals also submit resource utilization data (eg, pharmaceutical agents, radiologic imaging, and laboratory studies). Data are deidentified at the time of data submission and before data extraction and analysis and are subjected to a number of reliability and validity checks before being processed into data quality reports. Data are accepted into the database when classified errors occur less frequently than a criterion threshold of 2% of a hospital's quarterly data. If a hospital's quarterly data are unacceptable according to these limits, all of their quarterly data are rejected; however, these data can be resubmitted and reevaluated before inclusion in the database. During the study, 100% of drug use data from all 31 hospitals that submit resource utilization data was included in the data set.
Patients 18 years or younger at the time of hospital discharge from any of the 31 hospitals submitting resource utilization data to PHIS between January 1, 2004, and December 31, 2004, were eligible for inclusion. This study was approved by the Children's Hospital of Philadelphia Institutional Review Board.
Drug use, the dependent variable, was categorized as either appropriate for age or off-label. The term “off-label drug use” indicated the use of a specific drug in a patient who at the time of hospital discharge was younger than the FDA-approved age range for any indication of that drug. Drug use was considered appropriate for age if the patient met the age criteria approved by the FDA regardless of indication. While we did not attempt to determine the specific indication for which a drug was prescribed, major diagnostic categories were used to classify off-label drug use according to each patient's principal diagnosis. The major diagnostic categories form a broad classification system of related diseases and disorders that divide principal diagnoses into mutually exclusive categories. The major diagnostic categories encompass each of the all-patient refined diagnosis-related groups codeveloped by the National Association of Children's Hospitals and Related Institutions (Alexandria, Va) and 3M Health Information Systems (Murray, Utah).14 Each major diagnostic category corresponds to a single organ system rather than to an etiologic diagnosis.
Drugs specifically examined for off-label use were either used commonly (defined here as being administered in more than 2.99% of all hospital patients discharged during the study period) or included on the FDA list of medications that were recommended for further study in pediatric patients.15- 17 This list was mandated under the FDA Modernization Act and comprised recommendations from the American Academy of Pediatrics, the Pharmaceutical Research Manufacturers Association, the National Institutes of Health, the Pediatric Pharmacology Research Units Network, the National Pharmaceutical Alliance, the Generic Pharmaceutical Industry Association, the National Association of Pharmaceutical Manufacturers, and the United States Pharmacopeia.18 This resulted in a list of 90 drugs included in this study.
Variables for each institution included geographic location, average daily census, number of staffed beds, number of personnel, percentage of managed care penetration, and population served. Demographic variables for each patient discharged included age, sex, race (non-Hispanic white, non-Hispanic black, Hispanic, Asian, and other), and primary payer (private insurance, government insurance, or other). The category “Other insurance” included patients who were self-insured. Patient discharge disposition was also included, that is, discharged to home, died, or other (discharged to home with home health services, transferred to another facility, or left against medical advice). Resource use data included length of hospital stay (LOS) and case mix index (CMI), a widely used severity of illness and risk of mortality adjustment. The CMI of a patient population is an average of the patients' LOS weights. The LOS weight for each category in the All-Patient Refined–Diagnosis-Related Group Classification System, version 20, and severity level combination is computed as the ratio of the average LOS for patients in this group to the average LOS for all other patients.
Categorical variables were summarized using frequencies and percentages for all patients included in the study, patients receiving any of the included drugs off-label, and subpopulations receiving any drug within the drug categories off-label. For continuous variables such as CMI and LOS, we summarized the data using mean (± SD) values. Comparisons of the demographic characteristics between the patients receiving a drug within a category off-label and those not receiving a drug within a category off-label were made using generalized estimating equations to control for hospital clustering. To understand factors associated with receiving any drug under consideration off-label, we also created multivariate generalized estimating equation models adjusting for hospital clustering and potential confounders. From these models, we provide odds ratios with associated binomial exact 95% confidence intervals to evaluate the precision of the effect. All statistical analyses were performed using SAS statistical software (version 9.1; SAS Institute Inc, Cary, NC), and P <.001 was considered statistically significant because of large sample sizes.
At least 1 of 90 drugs was used off-label in 297 592 (78.7%) of 355 409 patients discharged during the study. The total charges for the 90 drugs in this study (Table 1) were $666 544 241, which represents 5.7% of total inpatient charges. Off-label use accounted for $270 275 849, or 40.5%, of the total dollars spent on these medications. This off-label expenditure represents 14.4% of all dollars spent on pharmaceutical agents and 2.3% of total inpatient charges. There was substantial variation in the frequency of off-label drug use, even within a drug category (Table 1). While some commonly used medications in a particular drug category were rarely used off-label (eg, acetaminophen), other commonly used medications in that category were almost always used off-label. For example, morphine was used in 27.8% of patients discharged; its use was considered off-label in 96.7% of these patients (Table 1) because there is no FDA indication for its administration in the pediatric population. The use of more recently approved medications such as azithromycin was also considered off-label in most instances.
Demographic characteristics of patients receiving drugs off-label are given in Table 2. For purposes of comparison, specific drugs were classified by therapeutic category. Male patients represented 54.8% of the population. The racial distribution included 51.3% non-Hispanic white patients, 21.4% non-Hispanic black patients, and 16.0% Hispanic patients. For patients of all ages and in all drug categories except antineoplastic drugs, there was a significant difference between the percentage of patients discharged who received off-label drugs and those who did not. Racial differences in the receipt of drugs off-label were noted in the endocrine and respiratory tract drug categories. Male patients were more likely than female patients to receive a drug off-label in the cardiac, endocrine, and respiratory tract categories. The overall mortality rate in patients discharged in 2004 was 1.07%. Most patients, regardless of whether they died or survived to hospital discharge, received at least 1 drug off-label (Table 2).
Substantial variation in the frequency of off-label use was observed across diagnostic categories and drug classes (Table 3). In every medical diagnostic category, at least 1 drug was used off-label in more than 50% of patients; off-label drug use occurred disproportionately in patients receiving central and autonomic nervous system agents. In all procedural or surgical categories, at least 1 drug was used off-label in more than 90% of patients; in each procedural category, off-label drug use occurred disproportionately with drugs in the central and autonomic nervous systems and in the fluids or nutrients, or gastrointestinal tract drug categories. There was a higher degree of illness among patients receiving a drug off-label (CMI, 1.83 ± 2.88) compared with those not receiving a drug off-label (CMI, 0.98 ± 0.97; P<.001). The mean CMI was significantly higher for patients who received an off-label drug compared with those who did not receive an off-label drug in every category except the antineoplastic or diagnostic drug category; the mean CMI in the diagnostic drug category was 1.40 for patients receiving drugs off-label compared with 1.67 (P = .34) for those not receiving drugs off-label. For patients receiving a drug off-label, the mean CMI ranged from 1.40 (antineoplastic drugs) to 4.73 (hematologic, biological, or immunologic agents). For patients who did not receive a drug off-label, the mean CMI ranged from 1.06 (fluids and nutrients, or gastrointestinal tract drugs) to 1.67 (antineoplastic drugs). The mean LOS was also longer for patients receiving a drug off-label compared with those not receiving a drug off-label (6.68 vs 2.79 days; P<.001). This difference was significant in every drug category except antineoplastic or diagnostic agents, with mean LOS of 5.60 days for those receiving antineoplastic drugs off-label compared with 5.95 days (P = .87) for those not receiving the drugs off-label. The longest LOS was for patients receiving other category drugs (19.58 days); hematologic, biological, or immunologic drugs (18.91 days); cardiac or adrenergic drugs (17.64 days); and anti-infective drugs (13.89 days) off-label.
Table 4 gives the unadjusted and adjusted results of a logistic regression model evaluating the odds of off-label drug use based on patient and hospital factors while adjusting for hospital clustering. Patient age greater than 28 days, severity of illness (as measured by the CMI), undergoing a surgical procedure, and all-cause in-hospital mortality were associated with off-label drug use. Differences in race, sex, payer, and hospital region were not associated with overall off-label drug use.
Our study of clinical prescribing practice in major children's hospitals in the United States demonstrates that most hospitalized children receive medications outside of the FDA product license. Substantial variation in the frequency of off-label drug use was observed across diagnostic categories and drug classes. Several factors, including age older than 28 days, greater severity of illness, undergoing a surgical procedure, and all-cause in-hospital mortality, were independently associated with off-label drug use. The licensing system is the main tool regulators have to protect public health by ensuring that only medications meeting strict criteria of quality, safety, and efficacy reach the market. However, despite several regulatory changes in the licensing process, we still have incomplete knowledge about the safety and efficacy of many medications commonly used to treat children across a range of drug classes and clinical diagnoses.
Our multicenter study of children hospitalized in the United States revealed a high frequency of off-label drug use during a sustained period. During 1 year, off-label use of 90 drugs at the 31 children's hospitals included in this study accounted for more than $250 million. We also identified specific drugs that were commonly used off-label that did not appear on the FDA list of medications requiring further study in children. Since we cannot know beforehand whether a drug administered in a particular situation will benefit or harm a patient, we believe that the frequency of administration should be considered when deciding which drugs warrant further study in children. Inasmuch as most drugs are not labeled for use in children, our results will assist in further prioritizing certain drugs for additional pediatric studies of safety and efficacy. To our knowledge, no previous studies of off-label drug use in hospitalized children have been performed in the United States. However, several smaller studies conducted in other countries have also reported a high frequency of off-label drug use in hospitalized children.3- 12 In patients followed up by subspecialty services, including pediatric oncologists,4 gastroenterologists,5 cardiologists,10 and pain management teams,9 off-label or unlicensed drug use ranged from 33% to 76%. Other single-center studies have included patients in general pediatric wards along with patients in either intensive care units6,7,11 or surgical wards19; in these studies, the off-label drug use ranged from 36% to 92%. Few multicenter studies of off-label drug use have been published. A multicenter study of children admitted to the general pediatrics wards of 9 hospitals in Italy found that 1182 (89%) of 1461 hospitalized children received at least 1 drug off-label.12 In a multicenter study of general pediatric wards in the United Kingdom, Sweden, Germany, Italy, and the Netherlands, 421 (67%) of 624 children received a drug off-label during a 4-week period; off-label or unlicensed use occurred in 46% of all drug prescriptions.3 Direct comparison of off-label drug use in children hospitalized in other countries may be confounded by differences in hospitalization practices among those countries.
In our study, the lowest off-label drug use occurred with antineoplastic agents. However, there were no significant differences in the variables evaluated in this study between patients who did and those who did not receive an antineoplastic agent off-label. The routine enrollment of children receiving antineoplastic agents in clinical trials may more consistently result in pediatric age-inclusive FDA approval of commonly used antineoplastic agents. Furthermore, the frequent participation of children receiving antineoplastic agents in clinical trials may minimize the differences between children receiving these agents off-label and those receiving these agents in accord with the FDA product label. Conroy et al4 examined inpatient and outpatient prescriptions in pediatric patients with cancer during a 4-week period; unlicensed or off-label use occurred in 45% of prescriptions. The different definitions of off-label drug use in our study compared with the study by Conroy and colleagues may explain the discrepant study results. In our study, drug use was considered off-label only if the patient was younger than the FDA-approved age range for any indication of that drug at the time of discharge. Many cases of off-label use identified by Conroy and colleagues were due to modifying cytotoxic preparations such as methotrexate and etoposide for oral administration. Such modifications were not identified as off-label use in our study.
Factors associated with off-label drug use are not well characterized. One previous study identified age younger than 6 months as a risk factor for off-label drug use at univariate analysis.6 However, the generalizability of that study is limited because patients in intensive care units accounted for more than 50% of the patient population.6 Turner et al8 did not find a significant difference in the frequency of off-label drug use in patients hospitalized in medical wards compared with those hospitalized in surgical wards; that study was limited to the experience of a single center during 13 weeks. In our multicenter study conducted during 1 year, off-label drug use was associated with patient age greater than 28 days, all-cause in-hospital mortality, procedural interventions, and greater severity of illness. Neonates were less likely to receive drugs off-label than were older children. In the case of neonates, we believe that a more conservative clinical approach is taken, in part because of the scarcity of reliable drug dosing information in this population, particularly in the context of clinically unstable children in the first few weeks of life and the known exaggerated differences in the metabolism of many other medications in neonates compared with older children. While we cannot determine causality in the association of greater severity of illness and off-label drug use, we suspect that in many cases drugs are prescribed off-label in children who are already critically ill because either they have failed approved therapy or there are few situation-specific FDA-approved options.
This study has several limitations. We defined off-label drug use based solely on age criteria. Use of these medications for reasons other than those stated on the product label also constitutes off-label use. Since the indications for prescribing a particular drug were not available and only 90 drugs were evaluated, the results of our study likely underestimate the magnitude of off-label drug use in children. Approximately 20% of tertiary care general children's hospitals participate in PHIS. Given the geographic heterogeneity of the participating hospitals and the racial and ethnic diversity of their patient populations, we believe these data can be generalized to other tertiary care children's hospitals. It is also possible that off-label drug use occurs more commonly in tertiary care hospitals than in community hospitals. Since this study included only tertiary care children's hospitals, the results may not accurately reflect practice in other settings. However, one study suggested that off-label drug use is greater in community settings than in academic settings.6 Therefore, it is unlikely that our data overstate the magnitude of off-label drug use in children.
Despite the frequent use of drugs off-label, using an administrative database, we cannot determine which of these treatments are unsafe or ineffective and which result in substantial benefit to the patient. Though off-label drug use also occurs in adults, the problem is substantially greater in children because many drugs have not been tested in any pediatric population for any indication. The use of medications inadequately studied in children has contributed to adverse outcomes,19- 21 underscoring the importance of comprehensive evaluation of these medications in children. Continued off-label use of drugs is not an acceptable alternative to documenting the safety and effectiveness of drugs used to treat infants and children. By describing the volume of off-label drug use, the number of children affected by the use of particular drugs off-label, and the costs associated with off-label use, we have provided insight into the magnitude of the problem. With greater cooperation between industry, academia, and government, the necessary studies could be carried out to ensure that the pediatric patient does not remain a “therapeutic orphan.”22
Correspondence: Samir S. Shah, MD, Division of Infectious Diseases, Children's Hospital of Philadelphia, Room 1526, North Campus, 34th St and Civic Center Blvd, Philadelphia, PA 19104 (email@example.com).
Accepted for Publication: October 13, 2006.
Author Contributions: Dr Hall had full access to all the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis. Study concept and design: Shah, Hall, Goodman, Feuer, Sharma, Fargason, Hyman, Jenkins, White, Levy, Levin, Bertoch, and Slonim. Acquisition of data: Hall and Bertoch. Analysis and interpretation of data: Shah, Hall, Goodman, Feuer, Hyman, Jenkins, White, Levy, Levin, and Slonim, Drafting of the manuscript: Shah, Hall, Feuer, Jenkins, White, Levy, Bertoch, and Slonim. Critical revision of the manuscript for important intellectual content: Shah, Hall, Goodman, Feuer, Sharma, Fargason, Hyman, White, Levy, Levin, Slonim. Statistical analysis: Shah, Hall, Goodman, Levin, and Slonim. Administrative, technical, and material support: Fargason, Bertoch, and Slonim. Study supervision: Shah, Sharma, Bertoch and Slonim.
Financial Disclosure: None reported.
Funding/Support: This study was supported in part by KO-8 HS14009-01 from the National Institutes of Health (Dr Slonim).
This article was corrected for error in data on 5/8/2007, prior to the publication of the correction in print.
Shah SS, Hall M, Goodman DM, Feuer P, Sharma V, Fargason C, Hyman D, Jenkins K, White ML, Levy FH, Levin JE, Bertoch D, Slonim AD. Off-label Drug Use in Hospitalized Children. Arch Pediatr Adolesc Med. 2007;161(3):282-290. doi:10.1001/archpedi.161.3.282