Skip to main content

Effects of monthly evaluations on the rates of irrational antimicrobial prescription in the outpatient and emergency departments at Ningbo No. 6 Hospital, Ningbo, China

Abstract

Background

Antibiotic resistance is a major global public health problem. The primary cause of antibiotic resistance is inappropriate antibiotic use. In this study, we aimed to verify whether the monthly evaluation of antibiotic prescription improves clinical antibiotic use in outpatient and emergency departments.

Methods

A minimum of 25% of the prescriptions for antibacterial drugs were randomly selected at the outpatient and emergency departments to enter the monthly evaluation system from July 2016 to June 2019. We analysed the rate of irrational prescription of antibiotics, proportion of the use of antibiotics, and consistency between the evaluation and expert groups after implementing the monthly assessment to validate the role of monthly evaluations.

Results

After 3 years of monthly evaluations of antibiotic prescriptions, the utilisation rate of single antibiotics in the outpatient and emergency departments was found to increase each year. Each year, a decreasing trend was observed for the irrational use of antibiotics, whereas the proportion of antibiotics to the total drugs prescribed gradually decreased in the same period. In addition, the consistency of prescription evaluation results between the evaluation and expert groups increased continuously.

Conclusions

Monthly evaluation of antibiotic prescriptions is an effective management tool for the rational use of antibiotics in clinical practice. This practice could help reduce the combinative use of antibiotics, rate of irrational antibiotic prescription, and antibiotic use ratio, and play an important role in safe clinical drug use.

Background

Since the 1940s, an increasing number of antibiotics have been developed for human use. Antibiotics have saved countless lives in clinical practice, and they are among the most commonly prescribed drugs in human medicine [1]. However, with the increasing use of antibiotics, resistance has significantly increased worldwide [2]. Antibiotic resistance leads to treatment failures, prolonged hospital stays, and increased medical expenses and mortality rate [3]. In 2011, the theme for the World Health Day was ‘Combat Antimicrobial Resistance’; indeed, the World Health Organization called for global attention to the problem of antibiotic resistance [4, 5]. Ten years later, antibiotic resistance remains a major public health problem. More than 2.8 million people are infected with drug-resistant microbes each year in the United States alone, resulting in more than 35,000 deaths and hospitalisations. The economic and human costs associated with these infections are enormous. By 2050, the number of deaths from drug-resistant infections is expected to increase to 10 million a year, surpassing diabetes, heart disease, and cancer as the leading causes of human deaths [6].

The primary cause of antibiotic resistance is the inappropriate use of antibiotics. Accordingly, it is necessary to reduce the excessive rate of antibiotic prescription and improve the use of antimicrobials to curb resistance [7]. Performing audits and providing feedback on antibiotic prescriptions have been shown to effectively control antibiotic use and influence clinical outcomes. For example, prospective audits with interventions and feedback can significantly reduce the total number and improve the quality of antibiotic prescriptions [8, 9]. Integrating prescription restrictions, approval systems, and computer decision support into the electronic prescription process is an effective measure for improving antibiotic resistance [10,11,12]. Although prescription restrictions, approval systems, and computerised decision support are automated systems, they still require up-front human setup to function effectively. Evaluation criteria for automated systems are obtained from experienced pharmacists. In addition, with in-depth disease and drug research, the use of drugs is becoming more complicated, and the above automatic systems still require regular evaluation and optimisation by pharmacists. Therefore, the measures mentioned above were designed to improve the prescription process for antibiotics, but they are limited by the ability of individual reviewers. In addition, the effect of periodic retrospective analyses of antibiotic prescriptions on antibiotic use remains largely unexplored. We believe that professional evaluation teams rather than individual reviewers can have a more significant effect on antibiotic management. Unfortunately, periodic sampling evaluation of antibacterial prescriptions has rarely been reported. In this study, we established a monthly evaluation system, combined with an electronic prescription system, and verified whether the system could improve the rational prescription of antibacterial drugs. This innovative system involved three rounds of evaluation and publicity and served as an important supplement to prospective prescription reviews by improving the professionalism of physicians and evaluators.

Methods

Data source

A total of 58 749 antibiotic prescriptions from the outpatient and emergency departments were randomly selected from the Ningbo No. 6  Hospital from July 2016 to June 2019.

Basis for assessment

The appropriateness of prescription was evaluated based on the following documents and database.

  • Drug description

  • Prescribing point review management practices (Trial), 2010, China [13]

  • Scheme of special remediation activity on the clinical application of antimicrobial drugs, 2012, China [14]

  • Guidelines for clinical use of antimicrobial agents, 2015, China [15]

  • Clinical guidelines

  • UpToDate database (Wolters Kluwer, Alphen aan den Rijn, The Netherlands).

Sampling method

We first enabled the IPharmacare Drug Management System (IPharmacare, Hangzhou, Zhejiang, China). The IPharmacare Drug Management System is established by IPharmacare (Hangzhou, Zhejiang, China). The system is used for hospital drug management, including drug approval, prescription restrictions, and random sampling of prescriptions. Every month, 25% of the doctors in our hospital with the right to prescribe antibiotics were randomly selected by this system to evaluate the antibiotics prescribed in the outpatient and emergency departments. Among the doctors selected by the system, if a doctor had made more than 50 prescriptions, we drew 50 prescriptions, and if a doctor had made than 50 prescriptions, we evaluated all prescriptions. An additional parameter was that the number of prescriptions should not be less than 25% of the total prescribed in the hospital.

The above selection ratio and quantity are based on a scheme of special remediation activity for the clinical application of antimicrobial drugs, 2012, China [14].

Evaluation method

Prescription evaluation teams were established under the leadership of the Medical Services section and consisted of working groups and expert group members. The evaluation team consisted of six clinical pharmacists who conducted an initial evaluation of randomly selected prescriptions, and the expert group consisted of two chief pharmacists and two chief physicians who conducted a re-evaluation of irrationally prescribed antibiotics. For the initial evaluation, the clinical pharmacists assessed sample prescriptions, and prescriptions of antibiotics prescribed irrationally were recorded using Microsoft Excel (2010) spreadsheets. Irrational prescription types, problem descriptions, medication suggestions, and other parameters were then analysed.

Next, the prescription evaluation team leader re-evaluated any unreasonable prescriptions, which were then publicised on the hospital intranet for 1 week. The prescription evaluation team leader was contacted for any issues, and experts were organised to re-evaluate the problem to obtain the final evaluation result.

The sampling and preliminary evaluation of the previous month were completed before the 15th of each month. The evaluation results were publicised and studied by the entire hospital staff on the 15th of each month. If there were any objections within 7 days, the expert group would start the re-evaluation; otherwise, the evaluation result remained in effect.

Assessment measures

Unreasonable prescriptions were publicised regularly, and the final result was included in evaluating individual senior professional titles. Every doctor has a benchmark score of 100 each year. For each unqualified prescription, 0.1 point was deducted from the benchmark score. The result of applying for a senior professional position and the income of a doctor were related to the score.

Statistical analysis

SPSS version 16.0 (IBM, Armonk, NY, USA) was used for data processing, and results with P < 0.05 were considered statistically significant. The irrational prescription rates of antibacterial drugs in different years were analysed using the chi-square test.

Results

Antibiotic prescriptions in the outpatient and emergency departments

After implementing the monthly evaluation system, the rate of single antibiotic prescriptions in the outpatient departments increased each year from July 2016 to June 2019; the rate of single antibiotic prescriptions in the outpatient and emergency departments increased by 3.53 and 2.99 percentage points, respectively. In addition, the rate of combined prescriptions of two antibiotics decreased with time. Notably, the prescription rate in the emergency department was always higher than that in the outpatient department each year. In 2018 and 2019, the rate of triple antibiotic prescriptions was 0.00% (Table 1). From an economic perspective, the expense of antimicrobial drug prescription decreased from 16.00% of the total drug expense in 2016 to 14.73% in 2019. However, this difference was not statistically significant and may be due to the proportion of emergency antibiotics used (Table 2). These results suggest that the monthly evaluation system potentially helped in controlling the number of antibiotic prescriptions.

Table 1 Proportion and features of antibiotic prescriptions in the outpatient and emergency departments in Ningbo No. 6 Hospital, Ningbo, China, from July 2016 to December 2019
Table 2 Percentage of antibiotic prescriptions in the outpatient and emergency departments in Ningbo No. 6 Hospital, Ningbo, China, from July 2016 to December 2019

Rate of irrational antimicrobial drug prescription

An important aspect of the monthly evaluation system was notification to the relevant physician and publication of why the prescription was classified as unreasonable. The effect of this measure was directly reflected in the decrease in the proportion of irrational prescriptions. From July 2016 to June 2019, the rate of irrational prescriptions showed a significant downward trend. The irrationality rate in 2019 decreased by 1.6 percentage points compared with the rate in July–December 2016 (Table 3).

Table 3 Rate of irrational antimicrobial drug prescription in Ningbo No. 6 Hospital, Ningbo, China, from July 2016 to December 2019

These irrational prescriptions consist of four categories of problems: irrational antibiotic combined therapy, irrational usage and dosage, medications not matching the diagnosis, and no indication of antibiotics. From July 2016 to June 2019, the main problem of irrational prescription gradually shifted from irrational usage and dosage to no indication of antibiotics (Table 4).

Table 4 Proportion and features of irrational antibiotic prescriptions in the outpatient and emergency departments in Ningbo No. 6 Hospital, Ningbo, China, from July 2016 to December 2019

Consistency of prescription evaluation results

Considering the possibility of misevaluation by the evaluation team, a reassessment system and feedback channel were incorporated into the evaluation system. The number of unqualified prescriptions obtained in each expert group reassessment and the number of unqualified prescriptions obtained in the initial evaluations by clinical pharmacists were summarised to determine the consistency of prescription evaluation results for the initial reassessment. The results showed that from 2016 to 2019, the consistency rate between the initial and re-evaluation results increased (Table 5).

Table 5 Consistency of prescription evaluation results from the evaluation team and the expert group in Ningbo No. 6 Hospital, Ningbo, China, from July 2016 to December 2019

Discussion

Antibiotics play an important role in modern medicine. The discovery and use of antibiotics have led to medical breakthroughs, such as infection prevention after surgery. Furthermore, antibiotics have made substantial contributions to the control of infectious diseases [16]. As a result, human life expectancy has considerably increased in the second half of the last century. However, the problem of antibiotic resistance is growing rapidly. Resistance to widely used β-lactam antibiotics has developed with increasing frequency. Treatment of ceftriaxone- and fluoroquinolone-resistant gonorrhoeae has become challenging [2]. Vancomycin, a last line of treatment, can no longer completely kill Enterococcus faecalis [17]. Although the spread of antibiotic-resistant bacteria threatens human health, research on new antibiotics is slow. Owing to economic reasons, large pharmaceutical companies are turning to the research and development of drugs for chronic diseases [18]. We are now entering the post-antibiotic era. The loss of antibiotics means that common bacterial infections can kill people.

Fortunately, an association between antibiotic use and resistance has been recognised [19]. Prospective review and intervention of antibiotic prescriptions are considered a necessary measure in most healthcare systems. Antibiotic prescription management and monitoring with the participation of clinical pharmacists can effectively reduce the irrational use of antibiotics and financial waste [18, 20, 21]. The use of electronic prescriptions has also improved the effectiveness of antibiotic management. In addition, studies have found that different multi-antibiotic management regimens can achieve better control than a single program [22]. However, it is still necessary to explore other ways to manage antibiotic use.

In this study, we established a monthly evaluation system using random sampling and retrospective analysis of antibiotic prescriptions in the outpatient and emergency departments in a hospital. In contrast to the prospective reviews and interventions by clinical pharmacists, the monthly evaluation system was a response to the execution or review of antibiotic prescriptions. The monthly evaluation system supplements prospective review and intervention systems. Its main function is to compensate for human negligence in prescription review and, more importantly, to optimise the qualified prescription. This was demonstrated by the change in the proportion of antibiotics prescribed throughout this study, particularly the reduced rate of irrational prescription of antibiotics. Although the prescriptions approved by clinical pharmacists were qualified and had good curative effects, there was still room for improvement in the management of antibiotics owing to the differences in the experience and prescribing habits of doctors. Once the prescriptions were evaluated, they were reviewed by the evaluation team leader. Following both these rounds of review, the evaluation errors were minimised. The subsequent publicity of the results was one of the keys to the system. A US study suggested that disclosing institutional assessment scores could eventually change clinical practice [23]. Similarly, our results suggested that disclosing the evaluation results of irrational antibiotic prescriptions would also improve the level of antibiotic management by physicians and pharmacists. The publication of unreasonable prescriptions and the evaluation team’s suggestions for improvement served as valuable feedback for the continuous professional development of physicians and pharmacists. If there were any objections to the publication, a physician could report it to the evaluation expert panel and apply for its re-evaluation. As the last line of defence in our study, the expert group ensured the accuracy of the evaluation and improved the operational level of the evaluation team. This was borne out by the annual improvement in the initial response-to-evaluation consistency rate. More importantly, the change in antibiotic use did not affect disease treatment during the years when the system was implemented. There was no significant change in the rate of patient complaints regarding treatment outcomes.

However, there were limitations to the study. In this study, we were unable to evaluate whether patients without a prescription required antibiotic treatment. In addition, the system did not achieve the same results for antibiotic prescription management in the emergency department as it did in the outpatient department. There was a decrease in the proportion of single antibiotics prescribed in the emergency department, and there was a significant increase in the proportion of two-dose antibiotics prescribed (Table 1B). These results may be because most patients in the emergency department have an urgent condition, and the maximum antimicrobial treatment is administered to achieve a broader spectrum of antibiotic cover to save the lives of patients in critical situations. However, despite the implementation of evaluation systems, doctors did not avoid prescribing antibiotics when needed to prevent making a wrong prescription, which could cause a significant delay in the cure of disease. We will continue to study and improve the evaluation system.

Conclusions

We established a monthly evaluation system of antibiotic prescription with three rounds of evaluation and a public feedback system. We verified the effectiveness of this system in clinical antibiotic use management, which improved the professional level of medical staff, including evaluation team members. At present, the system is running efficiently. However, due to the spread of COVID-19 in 2020, the number of patients decreased considerably. We only intercepted the system data from July 2016 to 2019 for verification to exclude the epidemic factors. More detailed research is needed to develop more effective management systems for antibiotic use.

Availability of data and materials

All relevant data are presented in the article/supplementary material; further inquiries can be directed to the corresponding author.

References

  1. Davies J, Davies D. Origins and evolution of antibiotic resistance. Microbiol Mol Biol Rev. 2010;74(3):417–33.

    Article  CAS  Google Scholar 

  2. Alós JI. Antibiotic resistance: a global crisis. Enferm Infecc Microbiol Clin. 2015;33(10):692–9.

    Article  Google Scholar 

  3. Ferri M, Ranucci E, Romagnoli P, Giaccone V. Antimicrobial resistance: a global emerging threat to public health systems. Crit Rev Food Sci Nutr. 2017;57(13):2857–76.

    Article  CAS  Google Scholar 

  4. Goossens H, Ferech M, Vander Stichele R, Elseviers M. Outpatient antibiotic use in Europe and association with resistance: a cross-national database study. Lancet. 2005;365(9459):579–87.

    Article  Google Scholar 

  5. Okeke IN, Laxminarayan R, Bhutta ZA, Duse AG, Jenkins P, O’Brien TF, et al. Antimicrobial resistance in developing countries. Part I: recent trends and current status. Lancet Infect Dis. 2005;5(8):481–93.

    Article  CAS  Google Scholar 

  6. Morrison L, Zembower TR. Antimicrobial resistance. Gastrointest Endosc Clin N Am. 2020;30(4):619–35.

    Article  Google Scholar 

  7. Septimus EJ. Antimicrobial resistance: an antimicrobial/diagnostic stewardship and infection prevention approach. Med Clin North Am. 2018;102(5):819–29.

    Article  Google Scholar 

  8. Benoist H, de La Blanchardière A, Flatres A, Isnard C, Thibon P, Saint-Lorant G. Effect of a prospective audit with intervention and feedback on Clostridioides difficile infection management. Int J Clin Pharm. 2020;42(3):923–30.

    Article  CAS  Google Scholar 

  9. Taggart LR, Leung E, Muller MP, Matukas LM, Daneman N. Differential outcome of an antimicrobial stewardship audit and feedback program in two intensive care units: a controlled interrupted time series study. BMC Infect Dis. 2015;15:480.

    Article  Google Scholar 

  10. Thursky KA, Buising KL, Bak N, Macgregor L, Street AC, Macintyre CR, et al. Reduction of broad-spectrum antibiotic use with computerized decision support in an intensive care unit. Int J Qual Health Care. 2006;18(3):224–31.

    Article  Google Scholar 

  11. Evans RS, Pestotnik SL, Classen DC, Clemmer TP, Weaver LK, Orme JF Jr, et al. A computer-assisted management program for antibiotics and other antiinfective agents. N Engl J Med. 1998;338(4):232–8.

    Article  CAS  Google Scholar 

  12. McGregor JC, Weekes E, Forrest GN, Standiford HC, Perencevich EN, Furuno JP, et al. Impact of a computerized clinical decision support system on reducing inappropriate antimicrobial use: a randomized controlled trial. J Am Med Inf Assoc. 2006;13(4):378–84.

    Article  Google Scholar 

  13. 关于印发《医院处方点评管理规范 (试行) 》的通知 [Available from: http://www.nhc.gov.cn/wjw/ywfw/201306/094ebc83dddc47b5a4a63ebde7224615.shtml.

  14. 关于进一步开展全国抗菌药物临床应用专项整治活动的通知. http://www.nhc.gov.cn/wjw/xwdt/201305/e1a64829a869405e9d378191d00d860b.shtml.

  15. 关于施行《抗菌药物临床应用指导原则》的通知. http://www.nhc.gov.cn/wjw/gfxwj/201304/2c850f3dc54244ca846d8a17baf3613d.shtml.

  16. Arakawa Y. Epidemiology of drug-resistance and clinical microbiologists in the 21st century. Rinsho byori Japanese J Clin Pathol. 2000;Suppl 111:1–8.

  17. Edelsberg J, Weycker D, Barron R, Li X, Wu H, Oster G, et al. Prevalence of antibiotic resistance in US hospitals. Diagn Microbiol Infect Dis. 2014;78(3):255–62.

    Article  CAS  Google Scholar 

  18. Projan SJ, Shlaes DM. Antibacterial drug discovery: is it all downhill from here? Clin Microbiol Infect. 2004;10(Suppl 4):18–22.

    Article  Google Scholar 

  19. Bell BG, Schellevis F, Stobberingh E, Goossens H, Pringle M. A systematic review and meta-analysis of the effects of antibiotic consumption on antibiotic resistance. BMC Infect Dis. 2014;14:13.

    Article  Google Scholar 

  20. Nault V, Pepin J, Beaudoin M, Perron J, Moutquin JM, Valiquette L. Sustained impact of a computer-assisted antimicrobial stewardship intervention on antimicrobial use and length of stay. J Antimicrob Chemother. 2017;72(3):933–40.

    CAS  PubMed  Google Scholar 

  21. Goff DA, Karam GH, Haines ST. Impact of a national antimicrobial stewardship mentoring program: insights and lessons learned. Am J Health Syst Pharm. 2017;74(4):224–31.

    Article  Google Scholar 

  22. Baur D, Gladstone BP, Burkert F, Carrara E, Foschi F, Döbele S, et al. Effect of antibiotic stewardship on the incidence of infection and colonisation with antibiotic-resistant bacteria and Clostridium difficile infection: a systematic review and meta-analysis. Lancet Infect Dis. 2017;17(9):990–1001.

    Article  Google Scholar 

  23. Kim T, Do YK. Prescription of systemic steroids for acute respiratory infections in Korean outpatient settings: overall patterns and effects of the prescription appropriateness evaluation policy. J Prev Med Public Health. 2020;53(2):82–8.

    Article  Google Scholar 

Download references

Acknowledgements

We thank all our colleagues in the hospital who were involved in the operation and research of the system. We would like to thank Editage (www.editage.cn) for English language editing.

Funding

This study was supported by Social Development Science and Technology Project from Ningbo City (2017-110-19).

Author information

Authors and Affiliations

Authors

Contributions

Conceptualisation: QY and JH; Methodology: FY and JH; Software: QY; Formal analysis: QY and JH; Investigation: FY; Resources: LL and JJ; Data curation: QY and JH; Writing—Original draft preparation: QY and JH; Writing—review and editing: LL, JJ, and JH; Supervision: LL, JJ, and JH; Project administration: LL, JJ, and JH; Funding acquisition: QY. All authors have read and approved the final manuscript.

Corresponding author

Correspondence to Junhong He.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors confirm that there are no conflicts of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yang, Q., Yuan, F., Li, L. et al. Effects of monthly evaluations on the rates of irrational antimicrobial prescription in the outpatient and emergency departments at Ningbo No. 6 Hospital, Ningbo, China. Eur J Med Res 27, 98 (2022). https://doi.org/10.1186/s40001-022-00728-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40001-022-00728-6

Keywords