{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,3,19]],"date-time":"2025-03-19T14:54:17Z","timestamp":1742396057722,"version":"3.37.3"},"reference-count":117,"publisher":"Oxford University Press (OUP)","issue":"6","license":[{"start":{"date-parts":[[2022,3,10]],"date-time":"2022-03-10T00:00:00Z","timestamp":1646870400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Institute for Health Research (NIHR) through the Greater Manchester Patient Safety Translational Research Centre","award":["PSTRC-2016-003"]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,5,11]]},"abstract":"Abstract<\/jats:title>Objectives<\/jats:title>(1) Systematically review the literature on computerized audit and feedback (e-A&F) systems in healthcare. (2) Compare features of current systems against e-A&F best practices. (3) Generate hypotheses on how e-A&F systems may impact patient care and outcomes.<\/jats:p><\/jats:sec>Methods<\/jats:title>We searched MEDLINE (Ovid), EMBASE (Ovid), and CINAHL (Ebsco) databases to December 31, 2020. Two reviewers independently performed selection, extraction, and quality appraisal (Mixed Methods Appraisal Tool). System features were compared with 18 best practices derived from Clinical Performance Feedback Intervention Theory. We then used realist concepts to generate hypotheses on mechanisms of e-A&F impact. Results are reported in accordance with the PRISMA statement.<\/jats:p><\/jats:sec>Results<\/jats:title>Our search yielded 4301 unique articles. We included 88 studies evaluating 65 e-A&F systems, spanning a diverse range of clinical areas, including medical, surgical, general practice, etc. Systems adopted a median of 8 best practices (interquartile range 6\u201310), with 32 systems providing near real-time feedback data and 20 systems incorporating action planning. High-confidence hypotheses suggested that favorable e-A&F systems prompted specific actions, particularly enabled by timely and role-specific feedback (including patient lists and individual performance data) and embedded action plans, in order to improve system usage, care quality, and patient outcomes.<\/jats:p><\/jats:sec>Conclusions<\/jats:title>e-A&F systems continue to be developed for many clinical applications. Yet, several systems still lack basic features recommended by best practice, such as timely feedback and action planning. Systems should focus on actionability, by providing real-time data for feedback that is specific to user roles, with embedded action plans.<\/jats:p><\/jats:sec>Protocol Registration<\/jats:title>PROSPERO CRD42016048695.<\/jats:p><\/jats:sec>","DOI":"10.1093\/jamia\/ocac031","type":"journal-article","created":{"date-parts":[[2022,2,24]],"date-time":"2022-02-24T20:13:45Z","timestamp":1645733625000},"page":"1106-1119","source":"Crossref","is-referenced-by-count":10,"title":["Systematic review and narrative synthesis of computerized audit and feedback systems in healthcare"],"prefix":"10.1093","volume":"29","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0331-2777","authenticated-orcid":false,"given":"Jung Yin","family":"Tsang","sequence":"first","affiliation":[{"name":"Centre for Health Informatics, Division of Informatics, Imaging and Data Science, Faculty of Biology, Medicine and Health, Manchester Academic Health Science Centre, The University of Manchester, Manchester, UK"},{"name":"Centre for Primary Care and Health Services Research, University of Manchester, Manchester, UK"},{"name":"NIHR Greater Manchester Patient Safety Translational Research Centre (GMPSTRC), University of Manchester, Manchester, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6393-9969","authenticated-orcid":false,"given":"Niels","family":"Peek","sequence":"additional","affiliation":[{"name":"Centre for Health Informatics, Division of Informatics, Imaging and Data Science, Faculty of Biology, Medicine and Health, Manchester Academic Health Science Centre, The University of Manchester, Manchester, UK"},{"name":"NIHR Greater Manchester Patient Safety Translational Research Centre (GMPSTRC), University of Manchester, Manchester, UK"},{"name":"NIHR Applied Research Collaboration Greater Manchester, University of Manchester, Manchester, UK"}]},{"given":"Iain","family":"Buchan","sequence":"additional","affiliation":[{"name":"Institute of Population Health, University of Liverpool, Liverpool, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0929-436X","authenticated-orcid":false,"given":"Sabine N","family":"van der Veer","sequence":"additional","affiliation":[{"name":"Centre for Health Informatics, Division of Informatics, Imaging and Data Science, Faculty of Biology, Medicine and Health, Manchester Academic Health Science Centre, The University of Manchester, Manchester, UK"}]},{"given":"Benjamin","family":"Brown","sequence":"additional","affiliation":[{"name":"Centre for Health Informatics, Division of Informatics, Imaging and Data Science, Faculty of Biology, Medicine and Health, Manchester Academic Health Science Centre, The University of Manchester, Manchester, UK"},{"name":"Centre for Primary Care and Health Services Research, University of Manchester, Manchester, UK"},{"name":"NIHR Greater Manchester Patient Safety Translational Research Centre (GMPSTRC), University of Manchester, Manchester, UK"}]}],"member":"286","published-online":{"date-parts":[[2022,3,10]]},"reference":[{"key":"2022051112234239300_ocac031-B1","first-page":"CD000259","article-title":"Audit and feedback: effects on professional practice and healthcare outcomes","volume":"6","author":"Ivers","year":"2012","journal-title":"Cochrane Database Syst Rev"},{"issue":"6","key":"2022051112234239300_ocac031-B2","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1136\/qshc.2006.018549","article-title":"Does telling people what they have been doing change what they do? A systematic review of the effects of audit and feedback","volume":"15","author":"Jamtvedt","year":"2006","journal-title":"Qual Saf Health Care"},{"issue":"3","key":"2022051112234239300_ocac031-B3","doi-asserted-by":"crossref","first-page":"356","DOI":"10.1097\/MLR.0b013e3181893f6b","article-title":"Meta-analysis: audit and feedback features impact effectiveness on care quality","volume":"47","author":"Hysong","year":"2009","journal-title":"Med Care"},{"issue":"11","key":"2022051112234239300_ocac031-B4","doi-asserted-by":"crossref","first-page":"1534","DOI":"10.1007\/s11606-014-2913-y","article-title":"Growing literature, stagnant science? Systematic review, meta-regression and cumulative analysis of audit and feedback interventions in health care","volume":"29","author":"Ivers","year":"2014","journal-title":"J Gen Intern Med"},{"issue":"1","key":"2022051112234239300_ocac031-B5","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1186\/s13012-019-0883-5","article-title":"Clinical Performance Feedback Intervention Theory (CP-FIT): a new theory for designing, implementing, and evaluating feedback in health care based on a systematic review and meta-synthesis of qualitative research","volume":"14","author":"Brown","year":"2019","journal-title":"Implement Sci"},{"issue":"6","key":"2022051112234239300_ocac031-B6","doi-asserted-by":"crossref","first-page":"435","DOI":"10.7326\/M15-2248","article-title":"Practice feedback interventions: 15 suggestions for optimizing effectiveness","volume":"164","author":"Brehaut","year":"2016","journal-title":"Ann Intern Med"},{"issue":"1","key":"2022051112234239300_ocac031-B7","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1186\/s13012-017-0590-z","article-title":"A systematic review of electronic audit and feedback: intervention effectiveness and use of behaviour change theory","volume":"12","author":"Tuti","year":"2017","journal-title":"Implement Sci"},{"issue":"4","key":"2022051112234239300_ocac031-B8","doi-asserted-by":"crossref","first-page":"314","DOI":"10.1093\/jamia\/ocy190","article-title":"Evaluating visual analytics for health informatics applications: a systematic review from the American Medical Informatics Association Visual Analytics Working Group Task Force on Evaluation","volume":"26","author":"Wu","year":"2019","journal-title":"J Am Med Inform Assoc"},{"issue":"2","key":"2022051112234239300_ocac031-B9","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1016\/j.ijmedinf.2014.10.001","article-title":"Dashboards for improving patient care: review of the literature","volume":"84","author":"Dowding","year":"2015","journal-title":"Int J Med Inform"},{"issue":"1","key":"2022051112234239300_ocac031-B10","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1186\/s13012-017-0646-0","article-title":"Advancing the literature on designing audit and feedback interventions: identifying theory-informed hypotheses","volume":"12","author":"Colquhoun","year":"2017","journal-title":"Implement Sci"},{"issue":"3","key":"2022051112234239300_ocac031-B11","first-page":"258","article-title":"My approach to this job is\u2026one person at a time\u201d: perceived discordance between population-level quality targets and patient-centred care","volume":"60","author":"Ivers","year":"2014","journal-title":"Can Fam Physician"},{"key":"2022051112234239300_ocac031-B12","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1186\/1471-2288-9-59","article-title":"Methods for the synthesis of qualitative research: a critical review","volume":"9","author":"Barnett-Page","year":"2009","journal-title":"BMC Med Res Methodol"},{"issue":"1","key":"2022051112234239300_ocac031-B13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/2046-4053-4-1","article-title":"Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement","volume":"4","author":"Moher","year":"2015","journal-title":"Syst Rev"},{"issue":"4","key":"2022051112234239300_ocac031-B14","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1016\/j.ijnurstu.2009.01.009","article-title":"A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in Mixed Studies Reviews","volume":"46","author":"Pluye","year":"2009","journal-title":"Int J Nurs Stud"},{"issue":"1","key":"2022051112234239300_ocac031-B15","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1016\/j.ijnurstu.2011.07.002","article-title":"Testing the reliability and efficiency of the pilot Mixed Methods Appraisal Tool (MMAT) for systematic mixed studies review","volume":"49","author":"Pace","year":"2012","journal-title":"Int J Nurs Stud"},{"issue":"10","key":"2022051112234239300_ocac031-B16","doi-asserted-by":"crossref","first-page":"e1001895","DOI":"10.1371\/journal.pmed.1001895","article-title":"Using qualitative evidence in decision making for health and social interventions: an approach to assess confidence in findings from qualitative evidence syntheses (GRADE-CERQual)","volume":"12","author":"Lewin","year":"2015","journal-title":"PLoS Med"},{"issue":"1","key":"2022051112234239300_ocac031-B17","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1258\/135581907779497486","article-title":"Appraising qualitative research for inclusion in systematic reviews: a quantitative and qualitative comparison of three methods","volume":"12","author":"Dixon-Woods","year":"2007","journal-title":"J Health Serv Res Policy"},{"volume-title":"Qualitative Methods for Health Research","year":"2018","author":"Green","key":"2022051112234239300_ocac031-B18"},{"issue":"Suppl 1","key":"2022051112234239300_ocac031-B19","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1258\/1355819054308530","article-title":"Realist review-a new method of systematic review designed for complex policy interventions","volume":"10","author":"Pawson","year":"2005","journal-title":"J Health Serv Res Policy"},{"year":"2016","author":"Punton","key":"2022051112234239300_ocac031-B20"},{"issue":"3","key":"2022051112234239300_ocac031-B21","doi-asserted-by":"crossref","first-page":"550","DOI":"10.1093\/jamia\/ocw150","article-title":"An informatics-based approach to reducing heart failure all-cause readmissions: the Stanford heart failure dashboard","volume":"24","author":"Banerjee","year":"2017","journal-title":"J Am Med Inform Assoc"},{"issue":"3","key":"2022051112234239300_ocac031-B22","doi-asserted-by":"crossref","first-page":"365","DOI":"10.4338\/ACI-2011-03-RA-0022","article-title":"Fully automated surveillance of healthcare-associated infections with MONI-ICU: a breakthrough in clinical infection surveillance","volume":"2","author":"Blacky","year":"2011","journal-title":"Appl Clin Inform"},{"issue":"3","key":"2022051112234239300_ocac031-B23","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1016\/j.acra.2010.10.011","article-title":"Feasibility and satisfaction with a tailored web-based audit intervention for recalibrating radiologists\u2019 thresholds for conducting additional work-up","volume":"18","author":"Carney","year":"2011","journal-title":"Acad Radiol"},{"issue":"1","key":"2022051112234239300_ocac031-B24","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1007\/s10278-017-0015-1","article-title":"Minimizing barriers in learning for on-call radiology residents-end-to-end web-based resident feedback system","volume":"31","author":"Choi","year":"2018","journal-title":"J Digit Imaging"},{"issue":"3","key":"2022051112234239300_ocac031-B25","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1016\/j.jsat.2010.01.001","article-title":"A randomized controlled study of a web-based performance improvement system for substance abuse treatment providers","volume":"38","author":"Crits-Christoph","year":"2010","journal-title":"J Subst Abuse Treat"},{"issue":"5","key":"2022051112234239300_ocac031-B26","doi-asserted-by":"crossref","first-page":"538","DOI":"10.1093\/jamia\/ocx159","article-title":"A dashboard-based system for supporting diabetes care","volume":"25","author":"Dagliati","year":"2018","journal-title":"J Am Med Inform Assoc"},{"issue":"3","key":"2022051112234239300_ocac031-B27","doi-asserted-by":"crossref","first-page":"424","DOI":"10.1111\/1468-0009.12021","article-title":"Improving quality and safety of care using \u201ctechnovigilance\u201d: an ethnographic case study of secondary use of data from an electronic prescribing and decision support system","volume":"91","author":"Dixon-Woods","year":"2013","journal-title":"Milbank Q"},{"issue":"11","key":"2022051112234239300_ocac031-B28","doi-asserted-by":"crossref","first-page":"1053","DOI":"10.1056\/NEJMsa1508955","article-title":"Safer prescribing\u2014a trial of education, informatics, and financial incentives","volume":"374","author":"Dreischulte","year":"2016","journal-title":"N Engl J Med"},{"issue":"3","key":"2022051112234239300_ocac031-B29","doi-asserted-by":"crossref","first-page":"e015281","DOI":"10.1136\/bmjopen-2016-015281","article-title":"Process evaluation of the Data-driven Quality Improvement in Primary Care (DQIP) trial: case study evaluation of adoption and maintenance of a complex intervention to reduce high-risk primary care prescribing","volume":"7","author":"Grant","year":"2017","journal-title":"BMJ Open"},{"issue":"1","key":"2022051112234239300_ocac031-B30","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1186\/s13012-016-0531-2","article-title":"Process evaluation of the data-driven quality improvement in primary care (DQIP) trial: active and less active ingredients of a multi-component complex intervention to reduce high-risk primary care prescribing","volume":"12","author":"Grant","year":"2017","journal-title":"Implement Sci"},{"key":"2022051112234239300_ocac031-B31","doi-asserted-by":"crossref","first-page":"754e.1","DOI":"10.1016\/j.ajog.2016.07.004","article-title":"A dynamic quality assessment tool for laparoscopic hysterectomy to measure surgical outcomes","volume":"215","author":"Driessen","year":"2016","journal-title":"Am J Obstet Gynecol"},{"issue":"6","key":"2022051112234239300_ocac031-B32","doi-asserted-by":"crossref","first-page":"682","DOI":"10.1093\/intqhc\/mzr053","article-title":"A web-based diabetes intervention for physician: a cluster-randomized effectiveness trial","volume":"23","author":"Estrada","year":"2011","journal-title":"Int J Qual Health Care"},{"issue":"3","key":"2022051112234239300_ocac031-B33","doi-asserted-by":"crossref","first-page":"541","DOI":"10.4300\/JGME-D-14-00016.1","article-title":"A novel approach to practice-based learning and improvement using a web-based audit and feedback module","volume":"6","author":"Boggan","year":"2014","journal-title":"J Grad Med Educ"},{"issue":"5","key":"2022051112234239300_ocac031-B34","doi-asserted-by":"crossref","first-page":"e000959","DOI":"10.1136\/bmjopen-2012-000959","article-title":"Medication intensification in diabetes in rural primary care: a cluster-randomised effectiveness trial","volume":"2","author":"Billue","year":"2012","journal-title":"BMJ Open"},{"issue":"2","key":"2022051112234239300_ocac031-B35","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1089\/pop.2012.0065","article-title":"Health care worker perspectives inform optimization of patient panel-support tools: a qualitative study","volume":"16","author":"Feldstein","year":"2013","journal-title":"Popul Health Manag"},{"issue":"10","key":"2022051112234239300_ocac031-B36","first-page":"e256","article-title":"Effect of a patient panel-support tool on care delivery","volume":"16","author":"Feldstein","year":"2010","journal-title":"Am J Manag Care"},{"issue":"4","key":"2022051112234239300_ocac031-B37","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1093\/intqhc\/mzp019","article-title":"A hospital-randomized controlled trial of a formal quality improvement educational program in rural and small community Texas hospitals: one year results","volume":"21","author":"Filardo","year":"2009","journal-title":"Int J Qual Health Care"},{"issue":"6","key":"2022051112234239300_ocac031-B38","doi-asserted-by":"crossref","first-page":"440","DOI":"10.1177\/1062860608324546","article-title":"Challenges in conducting a hospital-randomized trial of an educational quality improvement intervention in rural and small community hospitals","volume":"23","author":"Filardo","year":"2008","journal-title":"Am J Med Qual"},{"issue":"1","key":"2022051112234239300_ocac031-B39","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1186\/s12882-020-01798-6","article-title":"Development, implementation and user experience of the Veterans Health Administration (VHA) dialysis dashboard","volume":"21","author":"Fischer","year":"2020","journal-title":"BMC Nephrol"},{"issue":"6","key":"2022051112234239300_ocac031-B40","doi-asserted-by":"crossref","first-page":"1030","DOI":"10.1016\/j.jpedsurg.2016.02.080","article-title":"A novel approach to leveraging electronic health record data to enhance pediatric surgical quality improvement bundle process compliance","volume":"51","author":"Fisher","year":"2016","journal-title":"J Pediatr Surg"},{"issue":"1","key":"2022051112234239300_ocac031-B41","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1007\/s10916-017-0858-5","article-title":"Effect of a real-time electronic dashboard on a rapid response system","volume":"42","author":"Fletcher","year":"2017","journal-title":"J Med Syst"},{"issue":"6","key":"2022051112234239300_ocac031-B42","doi-asserted-by":"crossref","first-page":"562","DOI":"10.2214\/AJR.11.7971","article-title":"Web-based mammography audit feedback","volume":"198","author":"Geller","year":"2012","journal-title":"Am J Roentgenol"},{"issue":"1","key":"2022051112234239300_ocac031-B43","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1186\/s13012-016-0516-1","article-title":"Effect of a web-based audit and feedback intervention with outreach visits on the clinical performance of multidisciplinary teams: a cluster-randomized trial in cardiac rehabilitation","volume":"11","author":"Gude","year":"2016","journal-title":"Implement Sci"},{"issue":"2","key":"2022051112234239300_ocac031-B44","doi-asserted-by":"crossref","first-page":"195","DOI":"10.4300\/JGME-D-16-00460.1","article-title":"Improving timely resident follow-up and communication of results in ambulatory clinics utilizing a web-based audit and feedback module","volume":"9","author":"Boggan","year":"2017","journal-title":"J Grad Med Educ"},{"issue":"4","key":"2022051112234239300_ocac031-B45","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1136\/bmjqs-2015-004795","article-title":"How does audit and feedback influence intentions of health professionals to improve practice? A laboratory experiment and field study in cardiac rehabilitation","volume":"26","author":"Gude","year":"2017","journal-title":"BMJ Qual Saf"},{"key":"2022051112234239300_ocac031-B46","first-page":"424","article-title":"Inside the black box of audit and feedback: a laboratory study to explore determinants of improvement target selection by healthcare professionals in cardiac rehabilitation","volume":"216","author":"Gude","year":"2015","journal-title":"Stud Health Technol Inform"},{"key":"2022051112234239300_ocac031-B47","first-page":"2101","article-title":"Improving guideline concordance in multidisciplinary teams: preliminary results of a cluster-randomized trial evaluating the effect of a web-based audit and feedback intervention with outreach visits","volume":"2015","author":"Engen-Verheul","year":"2015","journal-title":"AMIA Annu Symp Proc"},{"issue":"3","key":"2022051112234239300_ocac031-B48","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1111\/j.1464-5491.2010.03178.x","article-title":"Improved quality of Type 2 diabetes care following electronic feedback of treatment status to general practitioners: A cluster randomized controlled trial","volume":"28","author":"Guldberg","year":"2011","journal-title":"Diabet Med"},{"issue":"1","key":"2022051112234239300_ocac031-B49","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1016\/j.pcd.2010.01.001","article-title":"Suboptimal quality of type 2 diabetes care discovered through electronic feedback led to increased nurse-GP cooperation. A qualitative study","volume":"4","author":"Guldberg","year":"2010","journal-title":"Prim Care Diabetes"},{"issue":"3","key":"2022051112234239300_ocac031-B50","doi-asserted-by":"crossref","first-page":"258","DOI":"10.1016\/j.jhin.2008.04.005","article-title":"Web-based reporting of the results of the 2006 Four Country Prevalence Survey of Healthcare Associated Infections","volume":"69","author":"Harris","year":"2008","journal-title":"J Hosp Infect"},{"issue":"2","key":"2022051112234239300_ocac031-B51","first-page":"1133","article-title":"Integrating patient-reported outcomes into spine surgical care through visual dashboards: lessons learned from human-centered design","volume":"3","author":"Hartzler","year":"2015","journal-title":"EGEMS (Wash DC)"},{"issue":"4","key":"2022051112234239300_ocac031-B52","doi-asserted-by":"crossref","first-page":"196","DOI":"10.1111\/nicc.12186","article-title":"Improving compliance with central venous catheter care bundles using electronic records","volume":"20","author":"Hermon","year":"2015","journal-title":"Nurs Crit Care"},{"issue":"1","key":"2022051112234239300_ocac031-B53","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1055\/s-0039-1679868","article-title":"Timely data for targeted quality improvement interventions: use of a visual analytics dashboard for bronchiolitis","volume":"10","author":"Hester","year":"2019","journal-title":"Appl Clin Inform"},{"issue":"S2","key":"2022051112234239300_ocac031-B54","doi-asserted-by":"crossref","first-page":"667","DOI":"10.1007\/s11606-013-2707-7","article-title":"Examining clinical performance feedback in Patient-Aligned Care Teams","volume":"29","author":"Hysong","year":"2014","journal-title":"J Gen Intern Med"},{"key":"2022051112234239300_ocac031-B55","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1016\/j.jbi.2017.11.008","article-title":"Multi-method laboratory user evaluation of an actionable clinical performance information system: implications for usability and patient safety","volume":"77","author":"Brown","year":"2018","journal-title":"J Biomed Inform"},{"issue":"4","key":"2022051112234239300_ocac031-B56","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1136\/bmjqs-2015-004796","article-title":"Theory-based and evidence-based design of audit and feedback programmes: examples from two clinical intervention studies","volume":"26","author":"Hysong","year":"2017","journal-title":"BMJ Qual Saf"},{"issue":"1","key":"2022051112234239300_ocac031-B57","doi-asserted-by":"crossref","first-page":"196","DOI":"10.1186\/s12913-017-2131-5","article-title":"Understanding the implementation and adoption of a technological intervention to improve medication safety in primary care: a realist evaluation","volume":"17","author":"Jeffries","year":"2017","journal-title":"BMC Health Serv Res"},{"issue":"5","key":"2022051112234239300_ocac031-B58","doi-asserted-by":"crossref","first-page":"e014810","DOI":"10.1136\/bmjopen-2016-014810","article-title":"Understanding the implementation and adoption of an information technology intervention to support medicine optimisation in primary care: qualitative study using strong structuration theory","volume":"7","author":"Jeffries","year":"2017","journal-title":"BMJ Open"},{"issue":"12","key":"2022051112234239300_ocac031-B59","doi-asserted-by":"crossref","first-page":"1001","DOI":"10.1136\/bmjqs-2013-002595","article-title":"Insights from staff nurses and managers on unit-specific nursing performance dashboards: a qualitative study","volume":"23","author":"Jeffs","year":"2014","journal-title":"BMJ Qual Saf"},{"key":"2022051112234239300_ocac031-B60","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1016\/j.ypmed.2016.12.002","article-title":"Evaluation of the effect of an audit and feedback reporting tool on screening participation: The Primary Care Screening Activity Report (PCSAR)","volume":"96","author":"Jonah","year":"2017","journal-title":"Prev Med"},{"issue":"2","key":"2022051112234239300_ocac031-B61","doi-asserted-by":"crossref","first-page":"77","DOI":"10.7326\/0003-4819-158-2-201301150-00001","article-title":"Accuracy of electronically reported \u201cmeaningful use\u201d clinical quality measures: a cross-sectional study","volume":"158","author":"Kern","year":"2013","journal-title":"Ann Intern Med"},{"issue":"5","key":"2022051112234239300_ocac031-B62","doi-asserted-by":"crossref","first-page":"607","DOI":"10.1197\/jamia.M3167","article-title":"Computerized surveillance for adverse drug events in a pediatric hospital","volume":"16","author":"Kilbridge","year":"2009","journal-title":"J Am Med Inform Assoc"},{"issue":"9","key":"2022051112234239300_ocac031-B63","doi-asserted-by":"crossref","first-page":"743","DOI":"10.12788\/jhm.2811","article-title":"Internal medicine resident engagement with a laboratory utilization dashboard: mixed methods study","volume":"12","author":"Kurtzman","year":"2017","journal-title":"J Hosp Med"},{"issue":"10","key":"2022051112234239300_ocac031-B64","doi-asserted-by":"crossref","first-page":"1639","DOI":"10.1007\/s11606-018-4482-y","article-title":"Effect of Social Comparison Feedback on Laboratory Test Ordering for Hospitalized Patients: A Randomized Controlled Trial","volume":"33","author":"Ryskina","year":"2018","journal-title":"J Gen Intern Med"},{"issue":"5","key":"2022051112234239300_ocac031-B65","doi-asserted-by":"crossref","first-page":"833","DOI":"10.1097\/j.pain.0000000000000837","article-title":"Impact of the Opioid Safety Initiative on opioid-related prescribing in veterans","volume":"158","author":"Lin","year":"2017","journal-title":"Pain"},{"key":"2022051112234239300_ocac031-B66","doi-asserted-by":"crossref","first-page":"104299","DOI":"10.1016\/j.ijmedinf.2020.104299","article-title":"Mixed methods evaluation of a computerised audit and feedback dashboard to improve patient safety through targeting acute kidney injury (AKI) in primary care","volume":"145","author":"Tsang","year":"2021","journal-title":"Int J Med Inform"},{"issue":"12 Suppl HIT","key":"2022051112234239300_ocac031-B67","first-page":"e311","article-title":"Electronic health record feedback to improve antibiotic prescribing for acute respiratory infections","volume":"16","author":"Linder","year":"2010","journal-title":"Am J Manag Care"},{"key":"2022051112234239300_ocac031-B68","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1186\/s12875-014-0193-6","article-title":"General practitioners uses and perceptions of voluntary electronic feedback on treatment outcomes\u2014a qualitative study","volume":"15","author":"Lippert","year":"2014","journal-title":"BMC Fam Pract"},{"key":"2022051112234239300_ocac031-B69","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2012\/208123","article-title":"The Danish model for improvement of diabetes care in general practice: impact of automated collection and feedback of patient data","volume":"2012","author":"Schroll","year":"2012","journal-title":"Int J Family Med"},{"issue":"2","key":"2022051112234239300_ocac031-B70","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1016\/j.cmpb.2014.07.006","article-title":"Improving the work efficiency of healthcare-associated infection surveillance using electronic medical records","volume":"117","author":"Lo","year":"2014","journal-title":"Comput Methods Programs Biomed"},{"issue":"17","key":"2022051112234239300_ocac031-B71","doi-asserted-by":"crossref","first-page":"1552","DOI":"10.1001\/archinternmed.2011.394","article-title":"Electronic medical record reminders and panel management to improve primary care of elderly patients","volume":"171","author":"Loo","year":"2011","journal-title":"Arch Intern Med"},{"issue":"2","key":"2022051112234239300_ocac031-B72","doi-asserted-by":"crossref","first-page":"221","DOI":"10.4338\/ACI-2012-03-RA-0009","article-title":"Real-time pharmacy surveillance and clinical decision support to reduce adverse drug events in acute kidney injury","volume":"3","author":"McCoy","year":"2012","journal-title":"Appl Clin Inform"},{"issue":"7-8","key":"2022051112234239300_ocac031-B73","doi-asserted-by":"crossref","first-page":"1037","DOI":"10.1016\/j.nut.2013.02.007","article-title":"A feedback system to improve the quality of nutritional care","volume":"29","author":"Meijers","year":"2013","journal-title":"Nutrition"},{"issue":"3","key":"2022051112234239300_ocac031-B74","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1002\/jhm.2303","article-title":"Use of provider-level dashboards and pay-for-performance in venous thromboembolism prophylaxis","volume":"10","author":"Michtalik","year":"2015","journal-title":"J Hosp Med"},{"issue":"12","key":"2022051112234239300_ocac031-B75","first-page":"676","article-title":"User-centered collaborative design and development of an inpatient safety dashboard","volume":"43","author":"Mlaver","year":"2017","journal-title":"Jt Comm J Qual Patient Saf"},{"issue":"1","key":"2022051112234239300_ocac031-B76","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1055\/s-0039-3402756","article-title":"Use, perceived usability, and barriers to implementation of a patient safety dashboard integrated within a vendor EHR","volume":"11","author":"Bersani","year":"2020","journal-title":"Appl Clin Inform"},{"issue":"1","key":"2022051112234239300_ocac031-B77","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1097\/JAC.0000000000000166","article-title":"Salt in the Wound\u201d: safety net clinician perspectives on performance feedback derived from EHR data","volume":"40","author":"Bunce","year":"2017","journal-title":"J Ambul Care Manage"},{"issue":"1","key":"2022051112234239300_ocac031-B78","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1186\/s12882-018-1195-8","article-title":"Process based quality improvement using a continuous renal replacement therapy dashboard","volume":"20","author":"Mottes","year":"2019","journal-title":"BMC Nephrol"},{"issue":"4","key":"2022051112234239300_ocac031-B79","doi-asserted-by":"crossref","first-page":"604","DOI":"10.1136\/amiajnl-2011-000557","article-title":"Validity of electronic health record-derived quality measurement for performance monitoring","volume":"19","author":"Parsons","year":"2012","journal-title":"J Am Med Inform Assoc"},{"issue":"9","key":"2022051112234239300_ocac031-B80","doi-asserted-by":"crossref","first-page":"691","DOI":"10.1136\/bmjqs-2017-007393","article-title":"Next-generation audit and feedback for inpatient quality improvement using electronic health record data: a cluster randomised controlled trial","volume":"27","author":"Patel","year":"2018","journal-title":"BMJ Qual Saf"},{"issue":"10","key":"2022051112234239300_ocac031-B81","doi-asserted-by":"crossref","first-page":"e1003286","DOI":"10.1371\/journal.pmed.1003286","article-title":"Evaluation of a pharmacist-led actionable audit and feedback intervention for improving medication safety in UK primary care: An interrupted time series analysis","volume":"17","author":"Peek","year":"2020","journal-title":"PLoS Med"},{"issue":"1","key":"2022051112234239300_ocac031-B82","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1186\/s12911-020-1084-5","article-title":"Understanding the utilisation of a novel interactive electronic medication safety dashboard in general practice: a mixed methods study","volume":"20","author":"Jeffries","year":"2020","journal-title":"BMC Med Inform Decis Mak"},{"issue":"10","key":"2022051112234239300_ocac031-B83","doi-asserted-by":"crossref","first-page":"e0205419","DOI":"10.1371\/journal.pone.0205419","article-title":"Developing a learning health system: Insights from a qualitative process evaluation of a pharmacist-led electronic audit and feedback intervention to improve medication safety in primary care","volume":"13","author":"Jeffries","year":"2018","journal-title":"PLoS One"},{"issue":"1","key":"2022051112234239300_ocac031-B84","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1161\/CIRCOUTCOMES.114.001235","article-title":"Effect of a computer-guided, quality improvement program for cardiovascular disease risk management in primary health care: the treatment of cardiovascular risk using electronic decision support cluster-randomized trial","volume":"8","author":"Peiris","year":"2015","journal-title":"Circ Cardiovasc Qual Outcomes"},{"issue":"6","key":"2022051112234239300_ocac031-B85","doi-asserted-by":"crossref","first-page":"634","DOI":"10.1331\/JAPhA.2015.15074","article-title":"User testing and performance evaluation of the Electronic Quality Improvement Platform for Plans and Pharmacies","volume":"55","author":"Pringle","year":"2015","journal-title":"J Am Pharm Assoc"},{"issue":"Suppl 2","key":"2022051112234239300_ocac031-B86","doi-asserted-by":"crossref","first-page":"823","DOI":"10.1007\/s11606-020-06160-y","article-title":"Empowering implementation teams with a learning health system approach: leveraging data to improve quality of care for transient ischemic attack","volume":"35","author":"Rattray","year":"2020","journal-title":"J Gen Intern Med"},{"issue":"9","key":"2022051112234239300_ocac031-B87","doi-asserted-by":"crossref","first-page":"e2015920","DOI":"10.1001\/jamanetworkopen.2020.15920","article-title":"Assessment of the protocol-guided rapid evaluation of veterans experiencing new transient neurological symptoms (PREVENT) program for improving quality of care for transient ischemic attack: a nonrandomized cluster trial","volume":"3","author":"Bravata","year":"2020","journal-title":"JAMA Netw Open"},{"key":"2022051112234239300_ocac031-B88","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1186\/s13012-015-0259-4","article-title":"Feasibility and impact of implementing a private care system\u2019s diabetes quality improvement intervention in the safety net: a cluster-randomized trial","volume":"10","author":"Gold","year":"2015","journal-title":"Implement Sci"},{"key":"2022051112234239300_ocac031-B89","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1186\/1472-6947-13-63","article-title":"Effects of a computerized feedback intervention on safety performance by junior doctors: results from a randomized mixed method study","volume":"13","author":"Redwood","year":"2013","journal-title":"BMC Med Inform Decis Mak"},{"issue":"9","key":"2022051112234239300_ocac031-B90","doi-asserted-by":"crossref","first-page":"1697","DOI":"10.1111\/jdi.13500","article-title":"Electronic dashboard-based remote glycemic management program reduces length of stay and readmission rate among hospitalized adults","volume":"12","author":"Sheen","year":"2021","journal-title":"J Diabetes Investig"},{"issue":"2","key":"2022051112234239300_ocac031-B91","doi-asserted-by":"crossref","first-page":"179","DOI":"10.4158\/EP-2019-0264","article-title":"Implementation of an electronic dashboard with a remote management system to improve glycemic management among hospitalized adults","volume":"26","author":"Sheen","year":"2020","journal-title":"Endocr Pract"},{"issue":"2","key":"2022051112234239300_ocac031-B92","doi-asserted-by":"crossref","first-page":"e53","DOI":"10.2196\/jmir.8922","article-title":"Web-based just-in-time information and feedback on antibiotic use for village doctors in rural Anhui, China: randomized controlled trial","volume":"20","author":"Shen","year":"2018","journal-title":"J Med Internet Res"},{"issue":"5","key":"2022051112234239300_ocac031-B93","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1093\/intqhc\/mzi044","article-title":"Failure of Internet-based audit and feedback to improve quality of care delivered by primary care residents","volume":"17","author":"Simon","year":"2005","journal-title":"Int J Qual Health Care"},{"issue":"2","key":"2022051112234239300_ocac031-B94","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1136\/amiajnl-2013-002538","article-title":"Optimization of drug-drug interaction alert rules in a pediatric hospital\u2019s electronic health record system using a visual analytics dashboard","volume":"22","author":"Simpao","year":"2015","journal-title":"J Am Med Informatics Assoc"},{"issue":"8","key":"2022051112234239300_ocac031-B95","doi-asserted-by":"crossref","first-page":"1647","DOI":"10.1016\/j.ajem.2019.158500","article-title":"Electronic medical record-based interventions to encourage opioid prescribing best practices in the emergency department","volume":"38","author":"Smalley","year":"2020","journal-title":"Am J Emerg Med"},{"key":"2022051112234239300_ocac031-B96","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1016\/j.ijmedinf.2017.02.011","article-title":"Creation of a simple natural language processing tool to support an imaging utilization quality dashboard","volume":"101","author":"Swartz","year":"2017","journal-title":"Int J Med Inform"},{"issue":"12","key":"2022051112234239300_ocac031-B97","doi-asserted-by":"crossref","first-page":"1740","DOI":"10.1007\/s11606-007-0431-x","article-title":"Use of a registry-generated audit, feedback, and patient reminder intervention in an internal medicine resident clinic-a randomized trial","volume":"22","author":"Thomas","year":"2007","journal-title":"J Gen Intern Med"},{"issue":"4","key":"2022051112234239300_ocac031-B98","doi-asserted-by":"crossref","first-page":"491","DOI":"10.1136\/amiajnl-2011-000187","article-title":"Comparison of computerized surveillance and manual chart review for adverse events","volume":"18","author":"Tinoco","year":"2011","journal-title":"J Am Med Inform Assoc"},{"issue":"9","key":"2022051112234239300_ocac031-B99","doi-asserted-by":"crossref","first-page":"1114","DOI":"10.1016\/j.acra.2012.05.003","article-title":"Impact of an educational intervention designed to reduce unnecessary recall during screening mammography","volume":"19","author":"Carney","year":"2012","journal-title":"Acad Radiol"},{"issue":"17 Suppl 3","key":"2022051112234239300_ocac031-B100","doi-asserted-by":"crossref","first-page":"S75","DOI":"10.2146\/ajhp160556","article-title":"Impact of a quality-assessment dashboard on the comprehensive review of pharmacist performance","volume":"74","author":"Trinh","year":"2017","journal-title":"Am J Health Syst Pharm"},{"issue":"1","key":"2022051112234239300_ocac031-B101","doi-asserted-by":"crossref","first-page":"475","DOI":"10.1186\/s12913-019-4327-3","article-title":"Clinician dashboard views and improvement in preventative health outcome measures: a retrospective analysis","volume":"19","author":"Twohig","year":"2019","journal-title":"BMC Health Serv Res"},{"issue":"7","key":"2022051112234239300_ocac031-B102","first-page":"326","article-title":"Adopting real-time surveillance dashboards as a component of an enterprisewide medication safety strategy","volume":"37","author":"Waitman","year":"2011","journal-title":"Jt Comm J Qual Patient Saf"},{"issue":"4","key":"2022051112234239300_ocac031-B103","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1097\/JAC.0000000000000044","article-title":"An interactive, all-payer, multidomain primary care performance dashboard","volume":"37","author":"Ward","year":"2014","journal-title":"J Ambul Care Manage"},{"issue":"4","key":"2022051112234239300_ocac031-B104","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1007\/s11606-007-0439-2","article-title":"Employing the electronic health record to improve diabetes care: a multifaceted intervention in an integrated delivery system","volume":"23","author":"Weber","year":"2008","journal-title":"J Gen Intern Med"},{"issue":"6","key":"2022051112234239300_ocac031-B105","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1136\/bmjqs-2017-007361","article-title":"Effect of a population-level performance dashboard intervention on maternal-newborn outcomes: an interrupted time series study","volume":"27","author":"Weiss","year":"2018","journal-title":"BMJ Qual Saf"},{"issue":"8","key":"2022051112234239300_ocac031-B106","doi-asserted-by":"crossref","first-page":"635","DOI":"10.1136\/bmjqs-2018-008354","article-title":"Use of a maternal newborn audit and feedback system in Ontario: A collective case study","volume":"28","author":"Reszel","year":"2019","journal-title":"BMJ Qual Saf"},{"issue":"5","key":"2022051112234239300_ocac031-B107","doi-asserted-by":"crossref","first-page":"859","DOI":"10.1055\/s-0039-1698466","article-title":"Usability testing of an interactive dashboard for surgical quality improvement in a large congenital heart center","volume":"10","author":"Wu","year":"2019","journal-title":"Appl Clin Inform"},{"issue":"4","key":"2022051112234239300_ocac031-B108","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1016\/j.acra.2010.11.017","article-title":"Using a tailored web-based intervention to set goals to reduce unnecessary recall","volume":"18","author":"Carney","year":"2011","journal-title":"Acad Radiol"},{"issue":"6","key":"2022051112234239300_ocac031-B109","doi-asserted-by":"crossref","first-page":"418","DOI":"10.1177\/1062860607307995","article-title":"A hospital-randomized controlled trial of an educational quality improvement intervention in rural and small community hospitals in Texas following implementation of information technology","volume":"22","author":"Filardo","year":"2007","journal-title":"Am J Med Qual"},{"issue":"1","key":"2022051112234239300_ocac031-B110","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1136\/bmjqs-2015-005004","article-title":"Reporting and design elements of audit and feedback interventions: a secondary review","volume":"26","author":"Colquhoun","year":"2017","journal-title":"BMJ Qual Saf"},{"author":"Jamtvedt","key":"2022051112234239300_ocac031-B111","article-title":"Audit and feedback as a quality strategy"},{"key":"2022051112234239300_ocac031-B112","doi-asserted-by":"crossref","first-page":"m213","DOI":"10.1136\/bmj.m213","article-title":"Revitalising audit and feedback to improve patient care","volume":"368","author":"Foy","year":"2020","journal-title":"BMJ"},{"issue":"1","key":"2022051112234239300_ocac031-B113","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1186\/s13012-019-0887-1","article-title":"Clinical performance comparators in audit and feedback: a review of theory and evidence","volume":"14","author":"Gude","year":"2019","journal-title":"Implement Sci"},{"issue":"1","key":"2022051112234239300_ocac031-B114","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1186\/s12961-020-0528-9","article-title":"Research co-design in health: a rapid overview of reviews","volume":"18","author":"Slattery","year":"2020","journal-title":"Health Res Policy Syst"},{"issue":"4","key":"2022051112234239300_ocac031-B115","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1006\/ijhc.2001.0503","article-title":"Methods to support human-centred design","volume":"55","author":"Maguire","year":"2001","journal-title":"Int J Hum Comput Stud"},{"issue":"11","key":"2022051112234239300_ocac031-B116","doi-asserted-by":"crossref","first-page":"e367","DOI":"10.2196\/jmir.8775","article-title":"Beyond adoption: a new framework for theorizing and evaluating nonadoption, abandonment, and challenges to the scale-up, spread, and sustainability of health and care technologies","volume":"19","author":"Greenhalgh","year":"2017","journal-title":"J Med Internet Res"},{"issue":"4","key":"2022051112234239300_ocac031-B117","doi-asserted-by":"crossref","first-page":"581","DOI":"10.1111\/j.0887-378X.2004.00325.x","article-title":"Diffusion of innovations in service organizations: systematic review and recommendations","volume":"82","author":"Greenhalgh","year":"2004","journal-title":"Milbank Q"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/29\/6\/1106\/43674447\/ocac031.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/29\/6\/1106\/43674447\/ocac031.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,18]],"date-time":"2023-11-18T01:51:31Z","timestamp":1700272291000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/29\/6\/1106\/6546606"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,10]]},"references-count":117,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2022,3,10]]},"published-print":{"date-parts":[[2022,5,11]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocac031","relation":{},"ISSN":["1527-974X"],"issn-type":[{"type":"electronic","value":"1527-974X"}],"subject":[],"published-other":{"date-parts":[[2022,6,1]]},"published":{"date-parts":[[2022,3,10]]}}}