[Skip to Navigation]
Sign In
Invited Commentary
Infectious Diseases
November 8, 2019

How Can We Routinely Measure Appropriateness of Antimicrobial Use in Hospitals at a National Level?

Author Affiliations
  • 1APEMAC, Université de Lorraine, Nancy, France
  • 2Infectious Diseases Department, Université de Lorraine, CHRU-Nancy, Nancy, France
  • 3Scientific Center for Quality of Healthcare (IQ Healthcare), Radboud Institute for Health Sciences, Radboud University Medical Center, Nijmegen, the Netherlands
JAMA Netw Open. 2019;2(11):e1915030. doi:10.1001/jamanetworkopen.2019.15030

The study by Ierano et al1 presents the results of a national audit assessing the appropriateness of surgical antimicrobial prophylaxis (SAP) in Australia. This well-designed and ambitious initiative provides data for action to guide antimicrobial stewardship (AMS) interventions.

International data consistently show that 12% to 19% of inpatient antimicrobial prescriptions are for SAP.1 The Australian National Antimicrobial Prescribing Survey (NAPS) was developed to collect surgical procedure–specific data, including details of the procedures and timing of antimicrobials for benchmarking and targeted feedback of SAP prescribing. The NAPS audit was conducted annually from January 2016 to June 2018. Participation was voluntary and data could be collected prospectively or retrospectively. Hospitals could adopt a convenience sampling method to audit either a targeted surgical group or all surgical procedures conducted during a specific period. Trained auditors collected data according to a standardized method and data collection form. Auditors were primarily pharmacists, nurses, and infectious disease physicians who were provided with structured education and online training to ensure consistency of methodology. All data from registered sites were entered in the Surgical NAPS online portal. Ongoing support and advice from a central clinical support team was also available by telephone and email to guide auditors, specifically with appropriateness assessments. Appropriateness of SAP was a composite measure based on antibiotic choice, timing of administration, duration, and repeated dosing, and these criteria were detailed in a standardized Appropriateness Assessment Guide.1

Almost one-fourth (22.5%) of Australian hospitals participated in the study.1 As expected, significant room for improvement was documented, mostly because of incorrect timing of SAP (but only two-thirds of surgical episodes included a documented incision time) and durations of treatment that were too long.1

Measurement of the appropriateness of antibiotic use is crucial in AMS. Data provide health care professionals and other stakeholders insight into the appropriateness of current antibiotic use, help them to periodically self-reflect on their use, and provide targets for improvement. In addition, data facilitate comparison across organizations. A wide range of quality indicators for the inpatient setting are available, especially for SAP.2 Is this study by Ierano et al1 the example to follow to routinely collect data on appropriateness of antibiotic use in hospitals at national level? Having a national registry in which hospitals can participate on a voluntary basis undoubtedly adds value, as it facilitates such benchmarking. This exists in Australia as the NAPS system, which also includes data for indications other than SAP, and a version of it is starting in the Netherlands.3 It is important that each hospital can easily access its data in real time: timely, repeated feedback to prescribers, along with explicit targets and a personalized action plan, is the most effective way to provide feedback.4,5

However, the problem with audits is that the manual collection of data is time-consuming. There are 2 main ways to address this issue. The first strategy is to conduct audits more frequently and on a smaller scale, possibly embedding data collection into the process of routine ward rounds conducted in daily practice by the AMS team. This approach has been used in Scotland, for example.6 Information technology tools, such as a mobile application, might facilitate data collection and help present the results to prescribers as run-sequence graphs with visual targets. The second strategy is to move toward automated data collection, focusing on a range of quality indicators. This could be facilitated by the increased uptake of electronic medical records in hospitals. Automated antimicrobial audits have been reported in the literature, but they are limited by the quality of diagnostic coding, which is usually quite poor.7,8

Another potential strategy would involve using antibiotic consumption data (eg, volume of prescribing data by defined daily dose), which are rather easily available, without diagnostic codes and systematically adjusting these data so that they approximate appropriateness of antibiotic use. To indicate that an instance of antibiotic misuse may have occurred, volumes could be adjusted for ecological effects or targets could be set. Data collection could be automated, and situations in which antibiotic misuse has likely occurred might trigger an in-depth review of appropriateness of use, perhaps by using audits. This approach has been suggested for children9 and is also used by the World Health Organization for the recently developed AWaRe index.10

Further studies are urgently needed for such alternative ways to easily get information on appropriateness of antibiotic use. Antimicrobial stewardship teams are often understaffed, and their time is better spent on improving rather than measuring appropriate antibiotic use.

Back to top
Article Information

Published: November 8, 2019. doi:10.1001/jamanetworkopen.2019.15030

Open Access: This is an open access article distributed under the terms of the CC-BY License. © 2019 Pulcini C et al. JAMA Network Open.

Corresponding Author: Céline Pulcini, MD, PhD, Centre Hospitalier Régional Universitaire de Nancy, Service de Maladies Infectieuses et Tropicales, Hôpitaux de Brabois, allée du Morvan, 54511 Vandoeuvre-Lès-Nancy, France (celine.pulcini@univ-lorraine.fr).

Conflict of Interest Disclosures: None reported.

Ierano  C, Thursky  K, Marshall  C,  et al.  Appropriateness of surgical antimicrobial prophylaxis practices in Australia.  JAMA Netw Open. 2019;2(11):e1915003. doi:10.1001/jamanetworkopen.2019.15003Google Scholar
Monnier  AA, Schouten  J, Le Maréchal  M,  et al Quality indicators for responsible antibiotic use in the inpatient setting: a systematic review followed by an international multidisciplinary consensus procedure.  J Antimicrob Chemother. 2018;73(suppl 6):vi30-vi39. doi:10.1093/jac/dky116PubMedGoogle ScholarCrossref
Berrevoets  MA, Ten Oever  J, Sprong  T,  et al.  Monitoring, documenting and reporting the quality of antibiotic use in the Netherlands: a pilot study to establish a national antimicrobial stewardship registry.  BMC Infect Dis. 2017;17(1):565. doi:10.1186/s12879-017-2673-5PubMedGoogle ScholarCrossref
Pulcini  C, Binda  F, Lamkang  AS,  et al.  Developing core elements and checklist items for global hospital antimicrobial stewardship programmes: a consensus approach.  Clin Microbiol Infect. 2019;25(1):20-25. doi:10.1016/j.cmi.2018.03.033PubMedGoogle ScholarCrossref
Ivers  N, Jamtvedt  G, Flottorp  S,  et al.  Audit and feedback: effects on professional practice and healthcare outcomes.  Cochrane Database Syst Rev. 2012;6(6):CD000259. doi:10.1002/14651858.CD000259.pub3PubMedGoogle Scholar
British Society for Antimicrobial Chemotherapy.  Antimicrobial stewardship: from principles to practice. http://bsac.org.uk/antimicrobial-stewardship-from-principles-to-practice-e-book/. Accessed October 2, 2019.
Smieszek  T, Pouwels  KB, Dolk  FCK,  et al.  Potential for reducing inappropriate antibiotic prescribing in English primary care.  J Antimicrob Chemother. 2018;73(suppl 2):ii36-ii43. doi:10.1093/jac/dkx500PubMedGoogle ScholarCrossref
Livorsi  DJ, Linn  CM, Alexander  B, Heintz  BH, Tubbs  TA, Perencevich  EN.  The value of electronically extracted data for auditing outpatient antimicrobial prescribing.  Infect Control Hosp Epidemiol. 2018;39(1):64-70. doi:10.1017/ice.2017.250PubMedGoogle ScholarCrossref
Hsia  Y, Sharland  M, Jackson  C, Wong  ICK, Magrini  N, Bielicki  JA.  Consumption of oral antibiotic formulations for young children according to the WHO Access, Watch, Reserve (AWaRe) antibiotic groups: an analysis of sales data from 70 middle-income and high-income countries.  Lancet Infect Dis. 2019;19(1):67-75. doi:10.1016/S1473-3099(18)30547-4PubMedGoogle ScholarCrossref
World Health Organization.  Adopt AWaRe: handle antibiotics with care. https://adoptaware.org. Accessed October 2, 2019.