[Skip to Navigation]
Sign In
Visual Abstract. Efficacy of a Clinical Decision Rule to Enable Direct Oral Challenge in Patients With Low-Risk Penicillin Allergy
Efficacy of a Clinical Decision Rule to Enable Direct Oral Challenge in Patients With Low-Risk Penicillin Allergy
Figure.  CONSORT Diagram
CONSORT Diagram

aAny other illness that, in the investigator’s judgment, would substantially increase the risk associated with the patient’s participation in this study, including neurological or psychological conditions.

bPatients with a history of type A adverse drug reaction, drug-associated anaphylaxis, idiopathic urticaria/anaphylaxis, mastocytosis, serum sickness, blistering skin eruption, or acute interstitial nephritis.

Table 1.  Baseline Characteristics of the Intention-to-Treat Population
Baseline Characteristics of the Intention-to-Treat Population
Table 2.  Adverse Events Occurring Up to 5 Days After Oral Challenge
Adverse Events Occurring Up to 5 Days After Oral Challenge
1.
Trubiano  JA, Chen  C, Cheng  AC, Grayson  ML, Slavin  MA, Thursky  KA; National Antimicrobial Prescribing Survey (NAPS).  Antimicrobial allergy ‘labels’ drive inappropriate antimicrobial prescribing: lessons for stewardship.   J Antimicrob Chemother. 2016;71(6):1715-1722. doi:10.1093/jac/dkw008 PubMedGoogle ScholarCrossref
2.
MacFadden  DR, LaDelfa  A, Leen  J,  et al.  Impact of reported beta-lactam allergy on inpatient outcomes: a multicenter prospective cohort study.   Clin Infect Dis. 2016;63(7):904-910. doi:10.1093/cid/ciw462 PubMedGoogle ScholarCrossref
3.
Trubiano  JA, Pai Mangalore  R, Baey  YW,  et al.  Old but not forgotten: antibiotic allergies in general medicine (the AGM study).   Med J Aust. 2016;204(7):273. doi:10.5694/mja15.01329 PubMedGoogle ScholarCrossref
4.
Blumenthal  KG, Lu  N, Zhang  Y, Li  Y, Walensky  RP, Choi  HK.  Risk of meticillin resistant Staphylococcus aureus and Clostridium difficile in patients with a documented penicillin allergy: population based matched cohort study.   BMJ. 2018;361:k2400. doi:10.1136/bmj.k2400 PubMedGoogle ScholarCrossref
5.
Moran  R, Devchand  M, Smibert  O, Trubiano  JA.  Antibiotic allergy labels in hospitalized and critically ill adults: a review of current impacts of inaccurate labelling.   Br J Clin Pharmacol. 2019;85(3):492-500. doi:10.1111/bcp.13830 PubMedGoogle ScholarCrossref
6.
Blumenthal  KG, Peter  JG, Trubiano  JA, Phillips  EJ.  Antibiotic allergy.   Lancet. 2019;393(10167):183-198. doi:10.1016/S0140-6736(18)32218-9 PubMedGoogle ScholarCrossref
7.
Antimicrobial stewardship interventions: a practice guide. World Health Organization. 2021. Accessed June 10, 2023. https://apps.who.int/iris/bitstream/handle/10665/340709/9789289054980-eng.pdf
8.
Trubiano  J, Phillips  E.  Antimicrobial stewardship’s new weapon? a review of antibiotic allergy and pathways to ‘de-labeling’.   Curr Opin Infect Dis. 2013;26(6):526-537. doi:10.1097/QCO.0000000000000006 PubMedGoogle ScholarCrossref
9.
Rose  MT, Slavin  M, Trubiano  J.  The democratization of de-labeling: a review of direct oral challenge in adults with low-risk penicillin allergy.   Expert Rev Anti Infect Ther. 2020;18(11):1143-1153. doi:10.1080/14787210.2020.1792775 PubMedGoogle ScholarCrossref
10.
Khan  DA, Banerji  A, Blumenthal  KG,  et al; Chief Editor(s); Workgroup Contributors; Joint Task Force on Practice Parameters Reviewers.  Drug allergy: a 2022 practice parameter update.   J Allergy Clin Immunol. 2022;150(6):1333-1393. doi:10.1016/j.jaci.2022.08.028 PubMedGoogle ScholarCrossref
11.
Mustafa  SS, Conn  K, Ramsey  A.  Comparing direct challenge to penicillin skin testing for the outpatient evaluation of penicillin allergy: a randomized controlled trial.   J Allergy Clin Immunol Pract. 2019;7(7):2163-2170. doi:10.1016/j.jaip.2019.05.037 PubMedGoogle ScholarCrossref
12.
Chua  KYL, Vogrin  S, Bury  S,  et al.  The penicillin allergy delabeling program: a multicenter whole-of-hospital health services intervention and comparative effectiveness study.   Clin Infect Dis. 2021;73(3):487-496. doi:10.1093/cid/ciaa653 PubMedGoogle ScholarCrossref
13.
Trubiano  JA, Vogrin  S, Chua  KYL,  et al.  Development and validation of a penicillin allergy clinical decision rule.   JAMA Intern Med. 2020;180(5):745-752. doi:10.1001/jamainternmed.2020.0403 PubMedGoogle ScholarCrossref
14.
Piotin  A, Godet  J, Trubiano  JA,  et al.  Predictive factors of amoxicillin immediate hypersensitivity and validation of PEN-FAST clinical decision rule.   Ann Allergy Asthma Immunol. 2022;128(1):27-32. doi:10.1016/j.anai.2021.07.005 PubMedGoogle ScholarCrossref
15.
Copaescu  AM, James  F, Vogrin  S,  et al.  Use of a penicillin allergy clinical decision rule to enable direct oral penicillin provocation: an international multicentre randomised control trial in an adult population (PALACE): study protocol.   BMJ Open. 2022;12(8):e063784. doi:10.1136/bmjopen-2022-063784 PubMedGoogle ScholarCrossref
16.
Chan  IS, Zhang  Z.  Test-based exact confidence intervals for the difference of two binomial proportions.   Biometrics. 1999;55(4):1202-1209. doi:10.1111/j.0006-341X.1999.01202.x PubMedGoogle ScholarCrossref
17.
Charlson  ME, Pompei  P, Ales  KL, MacKenzie  CR.  A new method of classifying prognostic comorbidity in longitudinal studies: development and validation.   J Chronic Dis. 1987;40(5):373-383. doi:10.1016/0021-9681(87)90171-8 PubMedGoogle ScholarCrossref
18.
Mak  R, Yuan Zhang  B, Paquette  V,  et al.  Safety of direct oral challenge to amoxicillin in pregnant patients at a Canadian tertiary hospital.   J Allergy Clin Immunol Pract. 2022;10(7):1919-1921.e1. doi:10.1016/j.jaip.2022.03.025PubMedGoogle ScholarCrossref
19.
Castells  M, Khan  DA, Phillips  EJ.  Penicillin allergy.   N Engl J Med. 2019;381(24):2338-2351. doi:10.1056/NEJMra1807761 PubMedGoogle ScholarCrossref
20.
Trubiano  JA, Beekmann  SE, Worth  LJ,  et al.  Improving antimicrobial stewardship by antibiotic allergy delabeling: evaluation of knowledge, attitude, and practices throughout the Emerging Infections Network.   Open Forum Infect Dis. 2016;3(3):ofw153. doi:10.1093/ofid/ofw153 PubMedGoogle ScholarCrossref
21.
Day  C, Mendelson  M, Peter  J; ADvISE study group.  Low self-reported penicillin allergy in South Africa—implications for global public health response.   JAC Antimicrob Resist. 2023;5(1):dlad015. doi:10.1093/jacamr/dlad015 PubMedGoogle ScholarCrossref
22.
Antimicrobial stewardship programmes in health-care facilities in low- and middle-income countries: a WHO practical toolkit. World Health Organization. 2019. Accessed June 10, 2023. https://apps.who.int/iris/bitstream/handle/10665/329404/9789241515481-eng.pdf
23.
Barlam  TF, Cosgrove  SE, Abbo  LM,  et al.  Implementing an antibiotic stewardship program: guidelines by the Infectious Diseases Society of America and the Society for Healthcare Epidemiology of America.   Clin Infect Dis. 2016;62(10):e51-e77. doi:10.1093/cid/ciw118 PubMedGoogle ScholarCrossref
Original Investigation
July 17, 2023

Efficacy of a Clinical Decision Rule to Enable Direct Oral Challenge in Patients With Low-Risk Penicillin Allergy: The PALACE Randomized Clinical Trial

Author Affiliations
  • 1Centre for Antibiotic Allergy and Research, Department of Infectious Diseases, Austin Health, Heidelberg, Victoria, Australia
  • 2Division of Allergy and Clinical Immunology, Department of Medicine, McGill University Health Centre, McGill University, Montreal, Quebec, Canada
  • 3The Research Institute of the McGill University Health Centre, McGill University Health Centre, McGill University, Montreal, Quebec, Canada
  • 4Department of Medicine, Austin Health, The University of Melbourne, Melbourne, Victoria, Australia
  • 5Department of Medicine, St Vincent’s Hospital, The University of Melbourne, Melbourne, Victoria, Australia
  • 6The National Centre for Infections in Cancer, Peter MacCallum Cancer Centre, Melbourne, Victoria, Australia
  • 7Department of Clinical Immunology and Allergy, The Royal Melbourne Hospital, Melbourne, Victoria, Australia
  • 8Department of Infectious Diseases, Peter MacCallum Cancer Centre, Melbourne, Victoria, Australia
  • 9Division of Pulmonary, Allergy, and Critical Care Medicine, Department of Medicine, Duke University School of Medicine, Durham, North Carolina
  • 10Center for Drug Safety and Immunology, Vanderbilt University Medical Center, Nashville, Tennessee
  • 11Division of Allergy, Immunology and Dermatology, Montreal Children’s Hospital, McGill University Health Centre McGill University, Montreal, Quebec, Canada
  • 12Department of Infectious Diseases, Duke University Medical Center, Durham, North Carolina
  • 13Department of Infectious Diseases, The Peter Doherty Institute for Infection and Immunity, The University of Melbourne, Melbourne, Victoria, Australia
  • 14Institute for Immunology and Infectious Diseases, Murdoch University, Murdoch, Western Australia, Australia
JAMA Intern Med. 2023;183(9):944-952. doi:10.1001/jamainternmed.2023.2986
Key Points

Question  Is direct oral penicillin challenge in adults with a low-risk penicillin allergy, defined as a PEN-FAST score less than 3, safe and effective compared with the standard-of-care penicillin skin testing followed by an oral penicillin challenge?

Findings  In this randomized clinical trial of 382 patients across 6 centers in 3 countries, a positive penicillin oral challenge consistent with an immune-mediated reaction occurred in 0.5% of both the direct oral challenge intervention group and the control group, with an upper 1-sided confidence interval below the noninferiority margin of 5 percentage points.

Meaning  In adult patients with a low-risk penicillin allergy, direct oral penicillin challenge is a safe and effective procedure that may facilitate the removal of a larger number of penicillin allergy labels.

Abstract

Importance  Fewer than 5% of patients labeled with a penicillin allergy are truly allergic. The standard of care to remove the penicillin allergy label in adults is specialized testing involving prick and intradermal skin testing followed by an oral challenge with penicillin. Skin testing is resource intensive, limits practice to specialist-trained physicians, and restricts the global population who could undergo penicillin allergy delabeling.

Objective  To determine whether a direct oral penicillin challenge is noninferior to the standard of care of penicillin skin testing followed by an oral challenge in patients with a low-risk penicillin allergy.

Design, Setting, and Participants  This parallel, 2-arm, noninferiority, open-label, multicenter, international randomized clinical trial occurred in 6 specialized centers, 3 in North America (US and Canada) and 3 in Australia, from June 18, 2021, to December 2, 2022. Eligible adults had a PEN-FAST score lower than 3. PEN-FAST is a prospectively derived and internationally validated clinical decision rule that enables point-of-care risk assessment for adults reporting penicillin allergies.

Interventions  Patients were randomly assigned to either direct oral challenge with penicillin (intervention arm) or a standard-of-care arm of penicillin skin testing followed by oral challenge with penicillin (control arm).

Main Outcome and Measure  The primary outcome was a physician-verified positive immune-mediated oral penicillin challenge within 1 hour postintervention in the intention-to-treat population. Noninferiority was achieved if a 1-sided 95% CI of the risk difference (RD) did not exceed 5 percentage points (pp).

Results  A total of 382 adults were randomized, with 377 patients (median [IQR] age, 51 [35-65] years; 247 [65.5%] female) included in the analysis: 187 in the intervention group and 190 in the control group. Most patients had a PEN-FAST score of 0 or 1. The primary outcome occurred in 1 patient (0.5%) in the intervention group and 1 patient (0.5%) in the control group, with an RD of 0.0084 pp (90% CI, −1.22 to 1.24 pp). The 1-sided 95% CI was below the noninferiority margin of 5 pp. In the 5 days following the oral penicillin challenge, 9 immune-mediated adverse events were recorded in the intervention group and 10 in the control group (RD, −0.45 pp; 95% CI, −4.87 to 3.96 pp). No serious adverse events occurred.

Conclusions and Relevance  In this randomized clinical trial, direct oral penicillin challenge in patients with a low-risk penicillin allergy was noninferior compared with standard-of-care skin testing followed by oral challenge. In patients with a low-risk history, direct oral penicillin challenge is a safe procedure to facilitate the removal of a penicillin allergy label.

Trial Registration  ClinicalTrials.gov Identifier: NCT04454229

Introduction

Patient-reported penicillin allergies remain largely unquestioned. These unverified penicillin allergy labels have been associated with poor patient health outcomes, including increased outpatient mortality, longer hospital stay, inappropriate antibiotic prescribing, development of antibiotic-resistant infections, and excess health care costs.1-5 More than 95% of patients labeled as penicillin allergic will have negative penicillin allergy testing and tolerate subsequent exposure.6 Delabeling, or removing this penicillin allergy label, is increasingly recognized as an essential pillar of global antimicrobial stewardship.7,8

In the majority of countries, the current standard of care in adults to verify or disprove a penicillin allergy includes prick and intradermal skin testing, followed, if negative, by the oral challenge. Observational data support direct oral penicillin challenge without prior skin testing in children and lower-risk adults.9 Regardless of whether skin testing occurs first, oral challenge is considered the necessary final step and is the gold standard to remove the penicillin allergy label, as skin testing alone lacks 100% negative predictive value. However, currently, and to our knowledge, there are no adequately powered randomized controlled data to support direct penicillin challenge without preceding skin testing in adults. This is reflected in updated clinical practice guidelines where direct oral challenge only has conditional recommendations supported by low-quality evidence.10 A prospective, single-center randomized clinical trial in the US evaluated the safety of drug challenges in a low-risk penicillin allergy patient group, including children and adults.11 The investigators identified 3 of 79 patients (3.8%) with a positive challenge 2-step direct challenge (immediate skin manifestations treated with antihistamines and no epinephrine use).11 The safety of direct oral challenge was also demonstrated in a large prospective cohort study of hospitalized patients.12 However, safety and efficacy data in an adequately powered multicenter, international randomized clinical trial remain absent from the literature.

PEN-FAST is a prospectively derived and internationally validated clinical decision rule that enables point-of-care risk assessment for adults reporting penicillin allergies (eFigure 1 in Supplement 1).13,14 A PEN-FAST score lower than 3 can identify low-risk penicillin allergy in adults, with a negative predictive value of 96.3% (95% CI, 94.1%-97.8%).13 The aim of the Penicillin Allergy Clinical Decision Rule (PALACE) study was to evaluate whether risk-stratified direct oral challenge with penicillin was noninferior to penicillin prick and intradermal skin testing followed by an oral challenge in patients with low-risk penicillin allergy (PEN-FAST score <3).

Methods
Study Design

The PALACE study, a multicenter, parallel, 2-arm, noninferiority, international, open-label, randomized clinical trial, was conducted in outpatient clinics at 6 centers, 3 in North America (US [Vanderbilt University Medical Centre and Duke University Medical Center] and Canada [McGill University Health Centre]) and 3 in Australia (Austin Health, Peter MacCallum Cancer Centre, and The Royal Melbourne Hospital). The rationale and design of the PALACE study have been published previously.15 The study was designed and overseen by a Trial Management Group (eMethods in Supplement 1). Study administration, data management, and statistical analyses were performed at Austin Health in Melbourne, Victoria, Australia. To ensure the safety and well-being of patients throughout the study, adverse events were reviewed by an independent data and safety monitoring board every 2 months.

The trial protocol (Supplement 2) was approved by an institutional review board at Austin Health and subsequently by the independent institutional review board at each site. All participants provided written informed consent. This study followed the Consolidated Standards of Reporting Trials (CONSORT) reporting guideline.

Participants

Outpatient adults (18 years or older) labeled with a penicillin allergy referred to an allergy clinic with a calculated PEN-FAST score of less than 3 were eligible for enrollment (eMethods in Supplement 1). Key exclusion criteria included anaphylaxis associated with any drug and a known history of chronic spontaneous urticaria or mast cell disease. Patients with histories of non–IgE-mediated severe reactions such as severe delayed organ or skin reactions were also excluded. Patients with self-reported penicillin allergy were also not eligible if their reaction was inconsistent with an allergy and compatible with adverse effects such as nausea or headache. The full inclusion and exclusion criteria are provided in the protocol15 (Supplement 2) and the eMethods in Supplement 1. Racial classification was defined by the investigator following verbal confirmation from the participant. Site investigators confirmed eligibility before a participant underwent randomization.

Randomization and Masking

Participants were randomized in a 1:1 ratio to either the intervention group (direct oral penicillin challenge) or the control group (prick followed by intradermal testing followed by 1-step oral challenge with penicillin, if negative). Randomization was performed remotely using a centralized web-based REDCap (Vanderbilt University) by permuted block design (block sizes ranging from 4-14), stratified by hospital site. Group allocation was concealed until randomization, and blinding postrandomization was not possible. The sequence was computer generated by the trial statistician (S.V.). The trial investigators enrolled the patients and performed the randomization.

Procedures

Skin-testing reagents and interpretation of prick and intradermal testing used in the control arm were performed using standardized procedures (eTable 1 in Supplement 1). Open-label administration of the lowest available therapeutic dose at each site of oral penicillin (eg, amoxicillin, penicillin VK) was performed as per protocol (eTable 1 in Supplement 1). Participants were directly observed following the penicillin challenge with measurement of vital signs at baseline, on any associated symptoms as necessary, and at 60 minutes. Site investigators were responsible for safety evaluation. On day 5 following the oral challenge, study research personnel contacted participants to prompt them to report any delayed adverse events occurring after the period of in-clinic observation.

Outcomes

The primary outcome was a physician-verified positive oral penicillin challenge. Positive oral challenge reactions were defined as an immediate reaction occurring within the hour after ingestion of the penicillin that was consistent with an immune-mediated reaction, including diffuse erythema, rash or urticaria, angioedema, respiratory compromise (measured by a decrease in the baseline oxygen saturation level), and anaphylaxis (or unexplained cardiovascular collapse). Two independent investigators (1 infectious disease specialist [A.M.C.] and 1 allergist [J.A.T.]), unaware of study group allocations, judged these reactions retrospectively based on reviewing documentation of the reactions. In current clinical practice, skin testing is considered a safety measure to avoid an adverse reaction to oral challenge in those with an unverified penicillin allergy. Therefore, participants who had positive skin testing results were counted as not achieving the primary outcome. The primary outcome was to demonstrate that in those with low-risk allergy, a direct oral challenge without prior skin testing does not lead to an increased number of immediate allergic events. The secondary outcomes are detailed in the eMethods in Supplement 1 and include trial feasibility, efficacy, and safety.

Statistical Analysis

We calculated that we would need to enroll 380 patients (190 per group) to achieve a statistical power of 80%, assuming a conservative event rate in the control group of 4%,13 the type I error probability of 5% (1-sided), and noninferiority margin of 5 percentage points (pp). If the control group had a lower prevalence of the outcome (2%), the power of the study would be 95%. Had the estimated difference between the intervention and control group been larger than 0%, the power of the study would remain above 80% if the risk difference (RD) remained below 2.5 pp. Noninferiority design and a 1-sided confidence interval were chosen because we did not believe that the control group was superior to the intervention group. While a noninferiority margin of 5 pp allows for more than double the risk of outcome in the control group, this was chosen as a clinically relevant margin by consensus among investigators due to the rarity of the outcome, its relative nonseverity, benefits of removal of the penicillin allergy label, and cost, time, and resources required for skin testing (control arm). Due to the randomization, intervention, and the primary outcome being collected within the same visit, loss to follow-up was expected to be minimal.

The primary analysis was performed in the intention-to-treat population with any postrandomization exclusions due to ineligibility excluded from the analysis. A generalized linear model was used with binomial family and identity links to estimate the RD between intervention and control. Due to the low number of events, the clinical site was not included in the model. A 2-sided 90% CI was used to represent a single-sided 95% CI. The intervention arm was defined as noninferior if the upper limit of the confidence interval did not cross the noninferiority margin of 5 pp. Results were also presented using risk ratios with 2-sided 90% CIs, which were analyzed as previously described but using a log link. Due to the low number of events, each predefined subgroup was analyzed separately. Sensitivity analysis for the primary outcome and subgroup analysis included an exact 90% CI, as described by Chan and Zhang.16

Safety and other binary secondary outcomes were analyzed similarly to the primary outcome and presented with 95% CIs. Due to the highly skewed distribution of the continuous secondary outcome of time from challenge to delabeling, this was analyzed using the rank sum test. The median difference with a 95% CI is presented.

Missing data were present in fewer than 5% of cases. Therefore, no missing data imputation was performed, and the results of the complete case analysis are presented. Analyses were performed with Stata, version 16 (StataCorp). The detailed statistical analysis plan (Supplement 3) was prepared before the analysis and published on ClinicalTrials.gov.

Results
Study Population

From June 18, 2021, to December 2, 2022, 382 patients were enrolled from the 6 centers; 190 were randomly assigned to the intervention group and 192 to the control group (Figure). The 2 groups were balanced concerning their baseline characteristics (Table 117).

Primary Outcome

The primary outcome of a positive oral penicillin challenge consistent with an immune-mediated reaction occurred in 1 of 187 patients (0.5%) in the intervention group and 1 of 190 patients (0.5%) in the control group, with an RD of 0.0084 pp (90% CI, −1.22 to 1.24 pp). Because the upper limit of the 1-sided 95% CI is 1.24 pp, this is below the noninferiority margin of 5 pp. The risk ratio was 1.02 (90% CI, 0.10-10.34). Most of the patients in both groups (>84%) received a single-dose amoxicillin challenge (eTable 1 in Supplement 1). Both patients with positive challenges presented a mild cutaneous skin reaction that resolved following a single dose of antihistamines (eTable 2 in Supplement 1). The intervention had a similar effect when analyzing subgroups of interest; however, the small number of participants and events in each subgroup limited these conclusions (eMethods and eFigure 2 in Supplement 1). Per-protocol analysis of the proportion of positive oral challenges showed similar results (RD, −0.57 pp; 90% CI, −1.50 to 0.36 pp). Sensitivity analysis using exact methods for evaluating confidence intervals showed a similar result (eTable 3 in Supplement 1).

Secondary Outcomes
Feasibility

The study demonstrated feasibility, with 446 of 643 screened patients being eligible to participate (69%; 95% CI, 66%-73%) and 382 of 446 eligible patients being enrolled (86%; 95%, CI 82%-89%). The intervention-to-recruitment ratio is illustrated in the Figure.

Among the 382 randomized patients (190 in the intervention group and 192 in the control group), the intervention as per protocol was completed in 351 participants (92%; 95% CI, 87%-94%). A total of 5 patients were excluded from the analysis due to either missing outcome data or not meeting inclusion criteria.

Adverse Events

In the 5 days following the oral penicillin challenge, 22 cumulative adverse events were recorded in the intervention group (20 participants) and 24 events in the control group (21 participants), with an RD of −0.36 pp (95% CI, −6.64 to 5.93 pp) and a risk ratio of 0.97 (95% CI, 0.54-1.73). There were 9 immune-mediated adverse events recorded in the intervention group and 10 in the control group (RD, −0.45 pp; 95% CI, −4.87 to 3.96 pp). There was no difference between the groups (eTable 4 in Supplement 1).

The overall safety data are summarized in Table 2. The 5-day adverse events occurred after a median (IQR) of 4 (0.67-16.67) hours following the oral penicillin challenge in the intervention group and 6 (2.09-35.10) hours in the control group. Safety events that occurred as part of the primary outcome included immediate diffuse rash or urticaria (<1 hour) in 1 of 187 patients (0.5%) from the intervention group and 1 of 190 patients (0.5%) from the control group. In addition, delayed diffuse rash or urticaria occurring more than 1 hour following the oral penicillin challenge was described in 6 of 187 patients (3.2%) from the intervention group and 3 of 190 patients (1.6%) from the control group (RD, 1.63 pp; 95% CI, −1.46 to 4.72 pp). No serious adverse reactions were reported (Table 2 and eTable 4 in Supplement 1). All reported adverse events were subcategorized into immune or nonimmune mediated and are summarized in eTable 5 in Supplement 1. Treatment for an adverse event was required for 9 events in the intervention group and 4 in the control group, but none led to hospitalization or emergency department presentation (Table 2).

Efficacy

Skin testing was performed in 189 of 190 patients (99.5%) in the control group; 1 patient had an absent response to the histamine-positive control, and intradermal testing was not completed. This patient had a subsequent negative oral challenge (protocol violation) and did not report any adverse reactions. Therefore, this patient was included in the overall but not per-protocol analysis. Four of 190 patients (2.1%) in the control arm had positive intradermal testing results and were excluded from the oral challenge. This included 2 for penicillin G and 1 each for benzylpenicilloyl polylysine and ampicillin. One patient with clinician-diagnosed dermatographism had uninterpretable intradermal skin results due to testing positive to all reagents, including the negative sodium chloride control, and did not proceed to oral challenge.

The allergy label was removed in 186 of 187 participants (99.5%) in the intervention group and 186 of 190 (97.9%) in the control group (RD, 1.57 pp; 95% CI, −0.72 to 3.86 pp). Because 1 patient in both the control and intervention groups reached the primary outcome of a positive oral challenge, the difference in the efficacy of delabeling in the intervention group was explained by 4 patients in the control group who were excluded from the oral challenge due to positive intradermal skin tests. Most patients required a single clinic appointment for their allergy label removal (184 of 186 [98.9%] in both groups). Although the maximum observation and testing time spent in an individual clinic was not controlled by study protocol or procedures, the median (IQR) time from randomization to delabeling was shorter in the intervention group (1.80 [1.33-3.72] hours) compared with the control group (2.28 [1.72-5.48] hours), with a median difference of −0.45 (95% −0.65 to −0.27) hours (eTable 6 in Supplement 1).

Discussion

In this international, multicenter, randomized clinical trial that enrolled participants with low-risk penicillin allergy (PEN-FAST score <3), direct oral penicillin challenge was noninferior to the current standard of prick followed by intradermal skin testing followed, if negative, by 1-step oral challenge based on the primary end point of physician-observed positive immune-mediated penicillin challenge. There was also no difference between immediate or delayed adverse events reported by day 5.

The PEN-FAST tool was previously externally validated in a mixed prospective derivation and a retrospective validation cohort of patients tested for penicillin allergy from Australia and the US and in 2 additional adult populations.13,14,18 This randomized clinical trial now provides evidence that direct oral challenge is an effective and safe method of assessing low-risk penicillin allergies (PEN-FAST score <3) in a predominately White, adult, outpatient population. This supports the work of a previously published explorative single-center randomized clinical trial in North American of 2-step direct oral challenge.11 The present study demonstrated that 2-stage skin testing preceding oral challenge with penicillin provided no additional safety benefit in a well-defined low-risk cohort. The direct oral challenge was associated with a shorter time in the clinic and may have avoided minor skin reactions associated with positive skin testing. Fewer patients were delabeled of their penicillin allergy in the control group (97.9%) vs the intervention group (99.5%), which is related to 4 additional patients in the control group having positive results with intradermal testing (not statistically significant). When the pretest probability of a test is low such as in low-risk penicillin allergy, positive skin tests may represent false positives, and this may lead to unnecessary avoidance of penicillin.19 Of note, 2 patients in this study underwent oral challenge following a positive skin test (protocol violation), with both tolerating the oral challenge dose without complication. Previous data suggest that the positive predictive value of penicillin skin testing is 50% to 75%, which remains a disadvantage of skin testing in a low-risk population. In the US alone, this could lead to more than 100 000 patients labeled as penicillin allergic, based on a false-positive penicillin skin test, who would tolerate penicillin antibiotics and thus highlights that direct oral challenge without preceding skin testing could have an efficacy advantage.

Specialized allergy skin testing is a labor-intensive, expensive, and resource-rich intervention not currently available to large populations of high-income and low- and middle-income countries.20,21 Furthermore, a penicillin allergy label cannot be removed based on skin testing alone, and the oral challenge remains the gold standard. PEN-FAST is a tool to facilitate the identification of low-risk patients labeled as penicillin allergic. A recent survey from South African hospitals demonstrated that PEN-FAST could also be deployed in a low- and middle-income setting; 65% of hospital-admitted patients presented with a low-risk allergy, making them eligible for a direct penicillin oral challenge.21 The PALACE trial is an important strategy to improve global access to care and allow safe, fast, and cheap penicillin delabeling strategies to address this important public health issue. The PALACE trial demonstrates that PEN-FAST is now an internationally validated clinical decision rule that can accurately risk assess penicillin allergy and that 2-stage skin testing followed by oral challenge no longer needs to be the standard of care in low-risk phenotypes.

The World Health Organization has acknowledged the role of antibiotic allergy assessments as a cornerstone intervention of antimicrobial stewardship programs.22 The Infectious Diseases Society of America has identified penicillin allergy testing as a tool to benefit antimicrobial stewardship that requires more evidence for optimal use and scalability.23 The American Academy of Allergy, Asthma, and Immunology Drug Allergy Practice Parameter Update of 2022 recommends proactive penicillin allergy delabeling.10 Although recently published drug allergy practice parameters endorse consideration for a direct oral challenge to penicillin in adults with low-risk penicillin allergy histories, this only carries a conditional recommendation due to low-quality evidence.10 To our knowledge, the present randomized clinical trial provides for the first time a high level of evidence to support the safety and efficacy of direct oral penicillin challenge that will enable globally the implementation and simplification of penicillin delabeling practices in settings that do not require specialized testing.

Limitations

We acknowledge several limitations of this study. The PEN-FAST score was 0 or 1 for more than 94% of participants enrolled, limiting the generalizability of this study to those with a PEN-FAST score of less than 2. Given the PEN-FAST scoring, a similar distribution of lower scores is observed in other outpatient clinics.13 Furthermore, patients with a history of anaphylaxis with any drug were excluded from this study. Indeed, anaphylaxis requiring treatment represents a PEN-FAST score of 3 (main exclusion criteria among 82 of 197 patients). While this can be considered a limitation, patients with anaphylaxis who do not require treatment should be offered a direct challenge, but this is rarely the case in clinical practice. The observed rate of the primary outcome was lower than assumed in the power calculations. However, a lower rate would result in a smaller required sample size (or, alternatively, would increase the power of the study). Similarly, deviations from other assumptions in sample-size calculations (namely, 2-sided confidence intervals) do not affect the conclusions of this trial (the 2-sided 95% CI of −1.46 to 1.48 pp remains well below the noninferiority margin of 5 pp). While an absolute noninferiority margin of 5 pp represents a more than 10 times higher rate of an adverse event when the rate of outcome is 0.5%, we believe that this is still clinically acceptable considering the very low rate of the outcome, clinical nonseverity of the outcome, the effect of allergy label removal, and resources, cost, and time required for skin testing. Because the study was open label and, by design, patients in the intervention group would not have skin testing performed, the only patients presenting adverse reactions related to the skin testing would be in the control group. Although the open-label nature of the trial could have affected the assessment of the primary outcome, the 2 reviewers who classified the adverse events (immune and nonimmune mediated) were blinded to group assignments.

Conclusions

In this randomized clinical trial, in patients with low-risk penicillin allergy and a PEN-FAST score of less than 3, with most patients having a PEN-FAST score of 0 or 1, a direct oral challenge with penicillin was a safe and effective alternative to the current standard, which includes 2-stage skin testing followed by an oral challenge. Compared with skin testing, a direct oral penicillin challenge is less resource and time intensive, is less expensive, and has the potential to be performed outside of the specialist allergy setting, providing a scalable approach to address low-risk, unverified penicillin allergy in diverse treatment settings internationally.

Back to top
Article Information

Accepted for Publication: May 17, 2023.

Published Online: July 17, 2023. doi:10.1001/jamainternmed.2023.2986

Corresponding Author: Ana Maria Copaescu, MD, Division of Allergy and Clinical Immunology, Department of Medicine, McGill University Health Centre, McGill University, 1650 Cedar Ave, Montreal, QC H3G1A4, Canada (ana-maria.copaescu@mcgill.ca).

Author Contributions: Dr Copaescu and Prof Trubiano had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.

Concept and design: Copaescu, Vogrin, James, Stone, Ben-Shoshan, Turner, Phillips, Trubiano.

Acquisition, analysis, or interpretation of data: All authors.

Drafting of the manuscript: Copaescu, Vogrin, De Luca, Waldron, Awad, Lambros, Stone, Holmes, Phillips, Trubiano.

Critical revision of the manuscript for important intellectual content: Copaescu, Vogrin, James, Chua, Rose, Waldron, Godsell, Mitri, Douglas, Youcef Khoudja, Isabwe, Genest, Fein, Radojicic, Collier, Lugar, Stone, Ben-Shoshan, Turner, Holmes, Phillips, Trubiano.

Statistical analysis: Vogrin, Phillips.

Obtained funding: Stone, Trubiano.

Administrative, technical, or material support: Copaescu, James, Chua, Rose, Waldron, Awad, Mitri, Lambros, Douglas, Youcef Khoudja, Fein, Collier, Lugar, Stone, Phillips.

Supervision: Copaescu, Genest, Collier, Lugar, Stone, Ben-Shoshan, Holmes, Phillips, Trubiano.

Conflict of Interest Disclosures: Dr Copaescu reported support from the Montreal General Hospital Foundation and Research Institute of the McGill University Health Centre and was awarded the University of Melbourne Research Scholarship, the Anna Maria Solinas Laroche Career Award in Immunology, and the Anita Garbarino Girard/Anna Maria Solinas/Dr. Phil Gold Award of Distinction. Dr Douglas reported honoraria paid to institution from Gilead Sciences outside the submitted work. Dr Stone reported an American Academy of Allergy, Asthma, and Immunology Foundation Faculty Development Award during the conduct of the study. Dr Turner reported grants from the Centers for Disease Control and Prevention and the National Institutes of Health’s Antibacterial Resistance Leadership Group, as well as a research contract with PDI outside the submitted work. Dr Phillips reported grants from the National Institutes of Health, royalties from UpToDate, and personal fees from UpToDate, Janssen, Regeneron, AstraZeneca, Verve, and BioCryst outside the submitted work. Prof Trubiano was supported by the National Health and Medical Research Council Early Career Fellowship (GNT2008071). No other disclosures were reported.

Funding/Support: This work was supported by an unrestricted grant from the Austin Medical Research Foundation.

Role of the Funder/Sponsor: The funder had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

Disclaimer: A Trial Management Group designed and oversaw the study. The Trial Management Group maintains full access to the data and vouches for data accuracy and completeness and the study’s fidelity to the protocol and statistical analysis plan.

Data Sharing Statement: See Supplement 4.

Additional Contributions: We thank all of the participants who volunteered for this study, as well as the investigators and clinical and research staff at the trial centers (specifically, Linda Lostracco, Dayle Cunningham, Lisa Schultz, Marie-Serge Pognon, and Nadia Seminario of the McGill University Health Centre, as well as Ashleigh Eisch, PharmD, and Rachel Addison of the Duke University Medical Center). We would also like to thank the members of the independent data and safety monitoring committee (Patrick Charles, Ar Kar Aung, and Don Vicendese) for their dedication and their diligent review of the data. No compensation was provided for these contributions.

References
1.
Trubiano  JA, Chen  C, Cheng  AC, Grayson  ML, Slavin  MA, Thursky  KA; National Antimicrobial Prescribing Survey (NAPS).  Antimicrobial allergy ‘labels’ drive inappropriate antimicrobial prescribing: lessons for stewardship.   J Antimicrob Chemother. 2016;71(6):1715-1722. doi:10.1093/jac/dkw008 PubMedGoogle ScholarCrossref
2.
MacFadden  DR, LaDelfa  A, Leen  J,  et al.  Impact of reported beta-lactam allergy on inpatient outcomes: a multicenter prospective cohort study.   Clin Infect Dis. 2016;63(7):904-910. doi:10.1093/cid/ciw462 PubMedGoogle ScholarCrossref
3.
Trubiano  JA, Pai Mangalore  R, Baey  YW,  et al.  Old but not forgotten: antibiotic allergies in general medicine (the AGM study).   Med J Aust. 2016;204(7):273. doi:10.5694/mja15.01329 PubMedGoogle ScholarCrossref
4.
Blumenthal  KG, Lu  N, Zhang  Y, Li  Y, Walensky  RP, Choi  HK.  Risk of meticillin resistant Staphylococcus aureus and Clostridium difficile in patients with a documented penicillin allergy: population based matched cohort study.   BMJ. 2018;361:k2400. doi:10.1136/bmj.k2400 PubMedGoogle ScholarCrossref
5.
Moran  R, Devchand  M, Smibert  O, Trubiano  JA.  Antibiotic allergy labels in hospitalized and critically ill adults: a review of current impacts of inaccurate labelling.   Br J Clin Pharmacol. 2019;85(3):492-500. doi:10.1111/bcp.13830 PubMedGoogle ScholarCrossref
6.
Blumenthal  KG, Peter  JG, Trubiano  JA, Phillips  EJ.  Antibiotic allergy.   Lancet. 2019;393(10167):183-198. doi:10.1016/S0140-6736(18)32218-9 PubMedGoogle ScholarCrossref
7.
Antimicrobial stewardship interventions: a practice guide. World Health Organization. 2021. Accessed June 10, 2023. https://apps.who.int/iris/bitstream/handle/10665/340709/9789289054980-eng.pdf
8.
Trubiano  J, Phillips  E.  Antimicrobial stewardship’s new weapon? a review of antibiotic allergy and pathways to ‘de-labeling’.   Curr Opin Infect Dis. 2013;26(6):526-537. doi:10.1097/QCO.0000000000000006 PubMedGoogle ScholarCrossref
9.
Rose  MT, Slavin  M, Trubiano  J.  The democratization of de-labeling: a review of direct oral challenge in adults with low-risk penicillin allergy.   Expert Rev Anti Infect Ther. 2020;18(11):1143-1153. doi:10.1080/14787210.2020.1792775 PubMedGoogle ScholarCrossref
10.
Khan  DA, Banerji  A, Blumenthal  KG,  et al; Chief Editor(s); Workgroup Contributors; Joint Task Force on Practice Parameters Reviewers.  Drug allergy: a 2022 practice parameter update.   J Allergy Clin Immunol. 2022;150(6):1333-1393. doi:10.1016/j.jaci.2022.08.028 PubMedGoogle ScholarCrossref
11.
Mustafa  SS, Conn  K, Ramsey  A.  Comparing direct challenge to penicillin skin testing for the outpatient evaluation of penicillin allergy: a randomized controlled trial.   J Allergy Clin Immunol Pract. 2019;7(7):2163-2170. doi:10.1016/j.jaip.2019.05.037 PubMedGoogle ScholarCrossref
12.
Chua  KYL, Vogrin  S, Bury  S,  et al.  The penicillin allergy delabeling program: a multicenter whole-of-hospital health services intervention and comparative effectiveness study.   Clin Infect Dis. 2021;73(3):487-496. doi:10.1093/cid/ciaa653 PubMedGoogle ScholarCrossref
13.
Trubiano  JA, Vogrin  S, Chua  KYL,  et al.  Development and validation of a penicillin allergy clinical decision rule.   JAMA Intern Med. 2020;180(5):745-752. doi:10.1001/jamainternmed.2020.0403 PubMedGoogle ScholarCrossref
14.
Piotin  A, Godet  J, Trubiano  JA,  et al.  Predictive factors of amoxicillin immediate hypersensitivity and validation of PEN-FAST clinical decision rule.   Ann Allergy Asthma Immunol. 2022;128(1):27-32. doi:10.1016/j.anai.2021.07.005 PubMedGoogle ScholarCrossref
15.
Copaescu  AM, James  F, Vogrin  S,  et al.  Use of a penicillin allergy clinical decision rule to enable direct oral penicillin provocation: an international multicentre randomised control trial in an adult population (PALACE): study protocol.   BMJ Open. 2022;12(8):e063784. doi:10.1136/bmjopen-2022-063784 PubMedGoogle ScholarCrossref
16.
Chan  IS, Zhang  Z.  Test-based exact confidence intervals for the difference of two binomial proportions.   Biometrics. 1999;55(4):1202-1209. doi:10.1111/j.0006-341X.1999.01202.x PubMedGoogle ScholarCrossref
17.
Charlson  ME, Pompei  P, Ales  KL, MacKenzie  CR.  A new method of classifying prognostic comorbidity in longitudinal studies: development and validation.   J Chronic Dis. 1987;40(5):373-383. doi:10.1016/0021-9681(87)90171-8 PubMedGoogle ScholarCrossref
18.
Mak  R, Yuan Zhang  B, Paquette  V,  et al.  Safety of direct oral challenge to amoxicillin in pregnant patients at a Canadian tertiary hospital.   J Allergy Clin Immunol Pract. 2022;10(7):1919-1921.e1. doi:10.1016/j.jaip.2022.03.025PubMedGoogle ScholarCrossref
19.
Castells  M, Khan  DA, Phillips  EJ.  Penicillin allergy.   N Engl J Med. 2019;381(24):2338-2351. doi:10.1056/NEJMra1807761 PubMedGoogle ScholarCrossref
20.
Trubiano  JA, Beekmann  SE, Worth  LJ,  et al.  Improving antimicrobial stewardship by antibiotic allergy delabeling: evaluation of knowledge, attitude, and practices throughout the Emerging Infections Network.   Open Forum Infect Dis. 2016;3(3):ofw153. doi:10.1093/ofid/ofw153 PubMedGoogle ScholarCrossref
21.
Day  C, Mendelson  M, Peter  J; ADvISE study group.  Low self-reported penicillin allergy in South Africa—implications for global public health response.   JAC Antimicrob Resist. 2023;5(1):dlad015. doi:10.1093/jacamr/dlad015 PubMedGoogle ScholarCrossref
22.
Antimicrobial stewardship programmes in health-care facilities in low- and middle-income countries: a WHO practical toolkit. World Health Organization. 2019. Accessed June 10, 2023. https://apps.who.int/iris/bitstream/handle/10665/329404/9789241515481-eng.pdf
23.
Barlam  TF, Cosgrove  SE, Abbo  LM,  et al.  Implementing an antibiotic stewardship program: guidelines by the Infectious Diseases Society of America and the Society for Healthcare Epidemiology of America.   Clin Infect Dis. 2016;62(10):e51-e77. doi:10.1093/cid/ciw118 PubMedGoogle ScholarCrossref
×