Meta-Analysis: Audit & Feedback Features Impact Effectiveness on Care Quality
Appendix B – Studies Included and Excluded from Meta-Analysis
Table of Contents
Studies Excluded After Abstract Review ................................................................................................................... 1
Not about feedback as defined in this study ......................................................................................................... 1
Patients, not clinicians, received feedback ........................................................................................................... 22
Not RCT ................................................................................................................................................................... 26
Only student participants ....................................................................................................................................... 27
Feedback unrelated to healthcare .......................................................................................................................... 29
Feedback unrelated to performance ..................................................................................................................... 30
No true control group ............................................................................................................................................. 31
No feedback only condition................................................................................................................................... 32
Feedback is not the intervention ........................................................................................................................... 33
Studies Excluded After Initial Screening .................................................................................................................. 34
No feedback only condition................................................................................................................................... 34
No control group ..................................................................................................................................................... 39
Insufficient information for calculating an effect size ....................................................................................... 42
Insufficient subjects per study arm ....................................................................................................................... 44
No measurable outcome......................................................................................................................................... 46
Articles Included in the Meta-Analysis ..................................................................................................................... 47
Studies Excluded After Abstract Review
Not about feedback as defined in this study
1. Anti-HIV agents. Darunavir shows its strength. TreatmentUpdate 2007 Jul;19(5):2-4.
2. Implementing CBT for traumatized children and adolescents after september 11: lessons
learned from the Child and Adolescent Trauma Treatments and Services (CATS) Project. J
Clin Child Adolesc Psychol 2007 Oct;36(4):581-92.
3. Adibi I, Hasani N, Ashoorioun V, Sadrearhami S, Monajemi AR. Integrating physical
examination and trunk anatomy; a new course for second year medical students. Med Teach
2007 Nov;29(9):975-7.
4. Agabio R, Marras P, Gessa GL, Carpiniello B. Alcohol use disorders, and at-risk drinking in
patients affected by a mood disorder, in Cagliari, Italy: sensitivity and specificity of different
questionnaires. Alcohol Alcohol 2007 Nov;42(6):575-81.
5. Agada FO, King-Im JU, Atkin SL, England RJA. Does thyroid subspecialization alter
practice and outcome? A completed 4-year audit loop. Clinical Otolaryngology: Official
Journal Of ENT-UK ; Official Journal Of Netherlands Society For Oto-Rhino-Laryngology
& Cervico-Facial Surgery 2005 Feb;30(1):48-51.
6. Ahlberg G, Enochsson L, Gallagher AG, Hedman L, Hogman C, McClusky DA, III, et al.
Proficiency-based virtual reality training significantly reduces the error rate for residents
during their first 10 laparoscopic cholecystectomies. Am J Surg 2007 Jun;193(6):797-804.
1
Meta-Analysis: Audit & Feedback
2
7. Al-Rawi WT, Jacobs R, Hassan BA, Sanderink G, Scarfe WC. Evaluation of web-based
instruction for anatomical interpretation in maxillofacial cone beam computed tomography.
Dentomaxillofac Radiol 2007 Dec;36(8):459-64.
8. Amsallem E, Kasparian C, Cucherat M, Chabaud S, Haugh M, Boissel JP, et al. Evaluation
of two evidence-based knowledge transfer interventions for physicians. A cluster
randomized controlled factorial design trial: the CardioDAS Study. Fundam Clin Pharmacol
2007 Dec;21(6):631-41.
9. Antommaria AH, Firth SD, Maloney CG. Evaluation of an innovative pediatric clerkship
structure using multiple outcome variables including career choice. J Hosp Med 2007
Nov;2(6):401-8.
10. Arean PA, Gum AM, Tang L, Unutzer J. Service use and outcomes among elderly persons
with low incomes being treated for depression. Psychiatr Serv 2007 Aug;58(8):1057-64.
11. Arnold SR, Bush AJ. Decline in inappropriate antibiotic use over a decade by pediatricians in
a Tennessee community. Ambulatory Pediatrics: The Official Journal Of The Ambulatory
Pediatric Association 2006 Jul;6(4):225-9.
12. Ash D, Barrett A, Hinks A, Squire C. Re-audit of radiotherapy waiting times 2003. Clinical
Oncology (Royal College Of Radiologists (Great Britain)) 2004 Sep;16(6):387-94.
13. Ashleigh RJ, Butterfield JS, Asquith J, Chalmers N, Murphy G. A cross-site vascular
radiology on-call service: the Manchester experience. Clinical Radiology 2005 Mar;60(3):38993.
14. Ataman OU, Barrett A, Davidson S, De Haas-Kock D, Dische S, Dubray B, et al. Audit of
effectiveness of routine follow-up clinics after radiotherapy for cancer: a report of the
REACT working group of ESTRO. Radiotherapy And Oncology: Journal Of The European
Society For Therapeutic Radiology And Oncology 2004 Nov;73(2):237-49.
15. Aufenacker TJ, Bannenberg J, van Geldere D, Scheijde E, Juttmann JW, Gouma DJ, et al.
[Quality of a non-subsidised multicentre randomised trial in non-academic hospitals; an
audit]. Nederlands Tijdschrift Voor Geneeskunde 2006 Jun 17;150(24):1337-41.
16. Avlund K, Vass M, Kvist K, Hendriksen C, Keiding N. Educational intervention toward
preventive home visitors reduced functional decline in community-living older women. J
Clin Epidemiol 2007 Sep;60(9):954-62.
17. Bagg SD, Pombo AP, Hopman WM. Toward benchmarks for stroke rehabilitation in
Ontario, Canada. American Journal Of Physical Medicine & Rehabilitation / Association Of
Academic Physiatrists 2006 Dec;85(12):971-6.
18. Baker GR, Norton PG, Flintoft V, Blais Régis, Brown A, Cox J, et al. The Canadian Adverse
Events Study: the incidence of adverse events among hospital patients in Canada. CMAJ:
Canadian Medical Association Journal = Journal De L'association Medicale Canadienne 2004
May 25;170(11):1678-86.
Meta-Analysis: Audit & Feedback
3
19. Banks EH, Chudnoff S, Karmin I, Wang C, Pardanani S. Does a surgical simulator improve
resident operative performance of laparoscopic tubal ligation? Am J Obstet Gynecol 2007
Nov;197(5):541-5.
20. Barnea A, Rassis A, Zaidel E. Effect of neurofeedback on hemispheric word recognition.
Brain And Cognition 2005 Dec;59(3):314-21.
21. Barreto FC, Barreto DV, Moyses RM, Neves KR, Canziani ME, Draibe SA, et al. K/DOQIrecommended intact PTH levels do not prevent low-turnover bone disease in hemodialysis
patients. Kidney Int 2008 Mar;73(6):771-7.
22. Bauer D, Kopp V, Fischer MR. Answer changing in multiple choice assessment change that
answer when in doubt--and spread the word! BMC Med Educ 2007;7:28.
23. Beach ML, Flood AB, Robinson CM, Cassells AN, Tobin JN, Greene MA, et al. Can
language-concordant prevention care managers improve cancer screening rates? Cancer
Epidemiol Biomarkers Prev 2007 Oct;16(10):2058-64.
24. Beck C, Heacock P, Mercer SO, Doan R, O'Sullivan PS, Stevenson JG, et al. Sustaining a
best-care practice in a nursing home. Journal For Healthcare Quality: Official Publication Of
The National Association For Healthcare Quality 2005 Jul;27(4):5-16.
25. Bellg AJ, Borrelli B, Resnick B, Hecht J, Minicucci DS, Ory M, et al. Enhancing treatment
fidelity in health behavior change studies: best practices and recommendations from the
NIH Behavior Change Consortium. Health Psychology: Official Journal Of The Division Of
Health Psychology, American Psychological Association 2004 Sep;23(5):443-51.
26. Berner MM, Harter M, Kriston L, Lohmann M, Ruf D, Lorenz G, et al. Detection and
management of alcohol use disorders in German primary care influenced by non-clinical
factors. Alcohol Alcohol 2007 Jul;42(4):308-16.
27. Bertakis KD, Azari R. Patient gender and physician practice style. J Womens Health
(Larchmt ) 2007 Jul;16(6):859-68.
28. Beyea JA, Wong E, Bromwich M, Weston WW, Fung K. Evaluation of a particle
repositioning maneuver Web-based teaching module. Laryngoscope 2008 Jan;118(1):175-80.
29. Bidlingmaier C, Kurnik K, Holscher G, Kappler M. Reconstituting factor concentrates:
Defining Evidence of Coaching Non-Experts (DEVICE) in haemophilia--a prospective
randomized feasibility study. Haemophilia 2007 Sep;13(5):470-2.
30. Bingener J, Boyd T, Van SK, Jung I, Saha A, Winston J, et al. Randomized double-blinded
trial investigating the impact of a curriculum focused on error recognition on laparoscopic
suturing training. Am J Surg 2008 Feb;195(2):179-82.
31. Boyle J, McCartney E, Forbes J, O'Hare A. A randomised controlled trial and economic
evaluation of direct versus indirect and individual versus group modes of speech and
language therapy for children with primary language impairment. Health Technol Assess
2007 Jul;11(25):iii-xii, 1.
Meta-Analysis: Audit & Feedback
4
32. Brazil K, Royle JA, Montemuro M, Blythe J, Church A. Moving to evidence-based practice
in long-term care: the role of a Best Practise Resource Centre in two long-term care settings.
Journal Of Gerontological Nursing 2004 Mar;30(3):14-9.
33. Bridges-Webb C, Giles B, Speechly C, Zurynski Y, Hiramanek N. Patients with dementia
and their carers. Ann N Y Acad Sci 2007 Oct;1114:130-6.
34. Brown H, Hofmeyr GJ, Nikodem VC, Smith H, Garner P. Promoting childbirth
companions in South Africa: a randomised pilot study. BMC Med 2007;5:7.
35. Brown JM, Poston RS, Gammie JS, Cardarelli MG, Schwartz K, Sikora JA, et al. Off-pump
versus on-pump coronary artery bypass grafting in consecutive patients: decision-making
algorithm and outcomes. The Annals Of Thoracic Surgery 2006 Feb;81(2):555.
36. Brown TB, Saini D, Pepper T, Mirza M, Nandigam HK, Kaza N, et al. Instructions to "put
the phone down" do not improve the quality of bystander initiated dispatcher-assisted
cardiopulmonary resuscitation. Resuscitation 2008 Feb;76(2):249-55.
37. Burger T, Fry D, Fusco R, Luschini M, Mayo JB, Ng V, et al. Multihospital surveillance of
nosocomial methicillin-resistant Staphylococcus aureus, vancomycin-resistant enterococcus,
and Clostridium difficile: analysis of a 4-year data-sharing project, 1999-2002. American
Journal Of Infection Control 2006 Sep;34(7):458-64.
38. Burton C, Pennington L, Roddam H, Russell I, Russell D, Krawczyk K, et al. Assessing
adherence to the evidence base in the management of poststroke dysphagia. Clinical
Rehabilitation 2006 Jan;20(1):46-51.
39. Butler NN, Wiet GJ. Reliability of the Welling scale (WS1) for rating temporal bone
dissection performance. Laryngoscope 2007 Oct;117(10):1803-8.
40. Burkhart PV, Rayens MK, Oakley MG, Abshire DA, Zhang M. Testing an intervention to
promote children's adherence to asthma self-management. J Nurs Scholarsh 2007;39(2):13340.
41. Butler V. Non-invasive ventilation (NIV). An audit across the North Central London
Critical Care Network (NCLCCN). Intensive & Critical Care Nursing: The Official Journal
Of The British Association Of Critical Care Nurses 2005 Aug 19;21(4):243-56.
42. Butter J, Grant TH, Egan M, Kaye M, Wayne DB, Carrion-Carire V, et al. Does ultrasound
training boost Year 1 medical student competence and confidence when learning abdominal
examination? Med Educ 2007 Sep;41(9):843-8.
43. Cadogan MP, Schnelle JF, Al-Sammarrai NR, Yamamoto-Mitani N, Cabrera G, Osterweil D,
et al. A standardized quality assessment system to evaluate pain detection and management
in the nursing home. Journal Of The American Medical Directors Association 2005
Jan;6(1):1-9.
Meta-Analysis: Audit & Feedback
5
44. Campbell DG, Felker BL, Liu CF, Yano EM, Kirchner JE, Chan D, et al. Prevalence of
depression-PTSD comorbidity: implications for clinical practice guidelines and primary carebased interventions. J Gen Intern Med 2007 Jun;22(6):711-8.
45. Cannick GF, Horowitz AM, Garr DR, Reed SG, Neville BW, Day TA, et al. Oral cancer
prevention and early detection: using the PRECEDE-PROCEED framework to guide the
training of health professional students. J Cancer Educ 2007;22(4):250-3.
46. Cannick GF, Horowitz AM, Garr DR, Reed SG, Neville BW, Day TA, et al. Use of the
OSCE to evaluate brief communication skills training for dental students. J Dent Educ 2007
Sep;71(9):1203-9.
47. Carcich GM, Rafti KR. Experienced registered nurses' satisfaction with using self-learning
modules versus traditional lecture/discussion to achieve competency goals during hospital
orientation. J Nurses Staff Dev 2007 Sep;23(5):214-20.
48. Casper ES. The theory of planned behavior applied to continuing education for mental
health professionals. Psychiatr Serv 2007 Oct;58(10):1324-9.
49. Chan H, Inoue S, Shimodera S, Fujita H, Fukuzawa K, Kii M, et al. Residential program for
long-term hospitalized persons with mental illness in Japan: Randomized controlled trial.
Psychiatry Clin Neurosci 2007 Oct;61(5):515-21.
50. Chang WR, McLean IP. CUSUM: a tool for early feedback about performance? BMC
Medical Research Methodology 2006 Mar 2;6:8.
51. Chen YC, Chiang LC. Effectiveness of hand-washing teaching programs for families of
children in paediatric intensive care units. J Clin Nurs 2007 Jun;16(6):1173-9.
52. Clancy DE, Huang P, Okonofua E, Yeager D, Magruder KM. Group visits: promoting
adherence to diabetes guidelines. J Gen Intern Med 2007 May;22(5):620-4.
53. Clevin L, Grantcharov TP. Does box model training improve surgical dexterity and
economy of movement during virtual reality laparoscopy? A randomised trial. Acta Obstet
Gynecol Scand 2008;87(1):99-103.
54. Cohen AT, Tapson VF, Bergmann JF, Goldhaber SZ, Kakkar AK, Deslandes B, et al.
Venous thromboembolism risk and prophylaxis in the acute hospital care setting
(ENDORSE study): a multinational cross-sectional study. Lancet 2008 Feb 2;371(9610):38794.
55. Cohen SN, Lanigan SW. Audit cycle of documentation in laser hair removal. Lasers In
Medical Science 2005 Sep 2;20(2):87-8.
56. Costanza ME, Luckmann R, Stoddard AM, White MJ, Stark JR, Avrunin JS, et al. Using
tailored telephone counseling to accelerate the adoption of colorectal cancer screening.
Cancer Detect Prev 2007;31(3):191-8.
Meta-Analysis: Audit & Feedback
6
57. Coopmans VC, Biddle C. CRNA performance using a handheld, computerized, decisionmaking aid during critical events in a simulated environment: a methodologic inquiry. AANA
J 2008 Feb;76(1):29-35.
58. Cousins DH, Sabatier B, Begue D, Schmitt C, Hoppe-Tichy T. Medication errors in
intravenous drug preparation and administration: a multicentre audit in the UK, Germany
and France. Quality & Safety In Health Care 2005 Jun;14(3):190-5.
59. Cox H, Puffer S, Morton V, Cooper C, Hodson J, Masud T, et al. Educating nursing home
staff on fracture prevention: a cluster randomised trial. Age Ageing 2008 Mar;37(2):167-72.
60. Crofts JF, Bartlett C, Ellis D, Hunt LP, Fox R, Draycott TJ. Management of shoulder
dystocia: skill retention 6 and 12 months after training. Obstet Gynecol 2007
Nov;110(5):1069-74.
61. Cullum S, Tucker S, Todd C, Brayne C. Effectiveness of liaison psychiatric nursing in older
medical inpatients with depression: a randomised controlled trial. Age Ageing 2007
Jul;36(4):436-42.
62. Daeppen JB, Bertholet N, Gmel G, Gaume J. Communication during brief intervention,
intention to change, and outcome. Subst Abus 2007;28(3):43-51.
63. Daeppen JB, Gaume J, Bady P, Yersin B, Calmes JM, Givel JC, et al. Brief alcohol
intervention and alcohol assessment do not influence alcohol use in injured patients treated
in the emergency department: a randomized controlled clinical trial. Addiction 2007
Aug;102(8):1224-33.
64. Davenport A. Audit of the effect of dialysate sodium concentration on inter-dialytic weight
gains and blood pressure control in chronic haemodialysis patients. Nephron Clinical
Practice 2006 Jul 12;104(3):c120-c125.
65. Davis J, Chryssafidou E, Zamora J, Davies D, Khan K, Coomarasamy A. Computer-based
teaching is as good as face to face lecture-based teaching of evidence based medicine: a
randomised controlled trial. BMC Med Educ 2007;7:23.
66. Dias JJ, Braybrooke J. Dupuytren's contracture: an audit of the outcomes of surgery. Journal
Of Hand Surgery (Edinburgh, Lothian) 2006 Oct 11;31(5):514-21.
67. Diez P, Hoskin PJ, Aird EG. Treatment planning and delivery of involved field radiotherapy
in advanced Hodgkin's disease: results from a questionnaire-based audit for the UK Stanford
V regimen vs ABVD clinical trial quality assurance programme (ISRCTN 64141244). Br J
Radiol 2007 Oct;80(958):816-21.
68. Doran DM, Harrison MB, Laschinger HS, Hirdes JP, Rukholm E, Sidani S, et al. Nursingsensitive outcomes data collection in acute care and long-term-care settings. Nursing
Research 2006 Mar;55(2 Suppl):S75-S81.
69. Drummond J, Mayan M, Schnirer L, So S. The comparative costs and effects of four models
to augment services for low-income families. Can J Nurs Res 2007 Sep;39(3):183-5.
Meta-Analysis: Audit & Feedback
7
70. Duggan PM, Palmer E, Devitt P. Electronic voting to encourage interactive lectures: a
randomised trial. BMC Med Educ 2007;7:25.
71. Duijm LE, Groenewoud JH, Fracheboud J, de Koning HJ. Additional double reading of
screening mammograms by radiologic technologists: impact on screening performance
parameters. J Natl Cancer Inst 2007 Aug 1;99(15):1162-70.
72. Duke GJ. Metropolitan audit of appropriate referrals refused admission to intensive care.
Anaesthesia And Intensive Care 2004 Oct;32(5):702-6.
73. Dunn NJ, Rehm LP, Schillaci J, Souchek J, Mehta P, Ashton CM, et al. A randomized trial
of self-management and psychoeducational group therapies for comorbid chronic
posttraumatic stress disorder and depressive disorder. J Trauma Stress 2007 Jun;20(3):22137.
74. Ebbert JO, Carr AB, Patten CA, Morris RA, Schroeder DR. Tobacco use quitline enrollment
through dental practices: a pilot study. J Am Dent Assoc 2007 May;138(5):595-601.
75. Eckardt AJ, Swales C, Bhattacharya K, Wassef WY, Phelan NP, Zubair S, et al. Open access
colonoscopy in the training setting: which factors affect patient satisfaction and pain?
Endoscopy 2008 Feb;40(2):98-105.
76. Eich HT, Gossmann A, Engert A, Kriz J, Bredenfeld H, Hansemann K, et al. A
Contribution to solve the problem of the need for consolidative radiotherapy after intensive
chemotherapy in advanced stages of Hodgkin's lymphoma--analysis of a quality control
program initiated by the radiotherapy reference center of the German Hodgkin Study Group
(GHSG). Int J Radiat Oncol Biol Phys 2007 Nov 15;69(4):1187-92.
77. Ell K, Unutzer J, Aranda M, Gibbs NE, Lee PJ, Xie B. Managing depression in home health
care: a randomized clinical trial. Home Health Care Serv Q 2007;26(3):81-104.
78. Ellis D, Crofts JF, Hunt LP, Read M, Fox R, James M. Hospital, simulation center, and
teamwork training for eclampsia management: a randomized controlled trial. Obstet Gynecol
2008 Mar;111(3):723-31.
79. Eon Y, Le Douy JY, Lamer B, Battini J, Bretagne JF. Quality and completeness of
histopathology reports of rectal cancer resections. Results of an audit in Brittany.
Gastroentérologie Clinique Et Biologique 2006 Feb;30(2):235-40.
80. Farrell MJ, Rose L. Use of mobile handheld computers in clinical nursing education. J Nurs
Educ 2008 Jan;47(1):13-9.
81. Filardo G, Nicewander D, Hamilton C, Herrin J, Galimbretti P, Tietze M, et al. A hospitalrandomized controlled trial of an educational quality improvement intervention in rural and
small community hospitals in Texas following implementation of information technology.
Am J Med Qual 2007 Nov;22(6):418-27.
Meta-Analysis: Audit & Feedback
8
82. Gerna G, Baldanti F, Torsellini M, Minoli L, Vigano M, Oggionnis T, et al. Evaluation of
cytomegalovirus DNAaemia versus pp65-antigenaemia cutoff for guiding preemptive
therapy in transplant recipients: a randomized study. Antivir Ther 2007;12(1):63-72.
83. Giesen P, Ferwerda R, Tijssen R, Mokkink H, Drijver R, van den Bosch W, et al. Safety of
telephone triage in general practitioner cooperatives: do triage nurses correctly estimate
urgency? Quality & Safety In Health Care 2007 Jun;16(3):181-4.
84. Goicoechea M, Vidal A, Capparelli E, Rigby A, Kemper C, Diamond C, et al. A computerbased system to aid in the interpretation of plasma concentrations of antiretrovirals for
therapeutic drug monitoring. Antivir Ther 2007;12(1):55-62.
85. Gordon JS, Andrews JA, Crews KM, Payne TJ, Severson HH. The 5A's vs 3A's plus
proactive quitline referral in private practice dental offices: preliminary results. Tob Control
2007 Aug;16(4):285-8.
86. Gorgels WJ, Oude Voshaar RC, Mol AJ, van de Lisdonk EH, Mulder J, van den HH, et al.
Consequences of a benzodiazepine discontinuation programme in family practice on
psychotropic medication prescription to the participants. Fam Pract 2007 Oct;24(5):504-10.
87. Grangeasse L, Coudert B, Pivot X, Fumoleau P, Depierre A, Chauffert B, et al. [Appropriate
cytotoxic drug usages in solid tumors: conformity to official labelling and level of scientific
evidence]. Bulletin Du Cancer 2006 Oct 1;93(10):1047-54.
88. Grepmair L, Mitterlehner F, Loew T, Bachler E, Rother W, Nickel M. Promoting
mindfulness in psychotherapists in training influences the treatment results of their patients:
a randomized, double-blind, controlled study. Psychother Psychosom 2007;76(6):332-8
89. Gupta T, Mandot A, Desai D, Abraham P, Joshi A, Shah S. Comparison of two schedules
(previous evening versus same morning) of bowel preparation for colonoscopy. Endoscopy
2007 Aug;39(8):706-9.
90. Haist SA, Wilson JF, Lineberry MJ, Griffith CH. A randomized controlled trial using
insinuated standardized patients to assess residents' domestic violence skills following a twohour workshop. Teach Learn Med 2007;19(4):336-42.
91. Haj-Ali R, Walker MP, Petrie CS, Steven J. Educational necessities to compensate for faculty
shortage. J Dent Educ 2007 Apr;71(4):511-5.
92. Hassan T, Nute SJ. An audit of referral practice for patients with impacted palatal canines
and the impact of referral guidelines. Br Dent J 2006 May 13;200(9):493-6.
93. Hepner KA, Rowe M, Rost K, Hickey SC, Sherbourne CD, Ford DE, et al. The effect of
adherence to practice guidelines on depression outcomes. Ann Intern Med 2007 Sep
4;147(5):320-9.
94. Hiom S, Roberts D, Hawksbee M, Burfield R, Francis M, Walker K, et al. Benchmarking the
current dispensing rate of Welsh hospital pharmacies. Journal Of Clinical Pharmacy And
Therapeutics 2006 Aug;31(4):357-62.
Meta-Analysis: Audit & Feedback
9
95. Hirabayashi Y, Seo N. Tracheal intubation by non-anaesthetist physicians using the Airway
Scope. Emerg Med J 2007 Aug;24(8):572-3.
96. Hollander JE, Pines JM. The emergency department crowding paradox: the longer you stay,
the less care you get. Ann Emerg Med 2007 Nov;50(5):497-9.
97. Holroyd BR, Bullard MJ, Latoszek K, Gordon D, Allen S, Tam S, et al. Impact of a triage
liaison physician on emergency department overcrowding and throughput: a randomized
controlled trial. Acad Emerg Med 2007 Aug;14(8):702-8.
98. Huotari K, Agthe N, Lyytikäinen O. Validation of surgical site infection surveillance in
orthopedic procedures. American Journal Of Infection Control 2007 May;35(4):216-21.
99. Hudson TJ, Owen RR, Thrush CR, Armitage TL, Thapa P. Guideline implementation and
patient-tailoring strategies to improve medication adherence for schizophrenia. J Clin
Psychiatry 2008 Jan;69(1):74-80.
100.
Hymowitz N, Schwab JV, Haddock CK, Pyle SA, Schwab LM. The pediatric residency
training on tobacco project: four-year resident outcome findings. Prev Med 2007
Dec;45(6):481-90.
101.
Ikizler TA. Parenteral nutrition offers no benefit over oral supplementation in malnourished
hemodialysis patients. Nat Clin Pract Nephrol 2008 Feb;4(2):76-7.
102.
Ioannidis G, Papaioannou A, Thabane L, Gafni A, Hodsman A, Kvern B, et al. Canadian
Quality Circle pilot project in osteoporosis: rationale, methods, and feasibility. Can Fam
Physician 2007 Oct;53(10):1694-700.
103.
Irvine AB, Bourgeois M, Billow M, Seeley JR. Internet training for nurse aides to prevent
resident aggression. J Am Med Dir Assoc 2007 Oct;8(8):519-26.
104.
Jantti H, Kuisma M, Uusaro A. The effects of changes to the ERC resuscitation guidelines
on no flow time and cardiopulmonary resuscitation quality: a randomised controlled study
on manikins. Resuscitation 2007 Nov;75(2):338-44.
105.
Johnson S, Thornicroft G, Afuwape S, Leese M, White IR, Hughes E, et al. Effects of
training community staff in interventions for substance misuse in dual diagnosis patients
with psychosis (COMO study): cluster randomised trial. Br J Psychiatry 2007 Nov;191:451-2.
106.
Kalet AL, Coady SH, Hopkins MA, Hochberg MS, Riles TS. Preliminary evaluation of the
Web Initiative for Surgical Education (WISE-MD). Am J Surg 2007 Jul;194(1):89-93.
107.
Kalvemark SS, Arnetz B, Hansson MG, Westerholm P, Hoglund AT. Developing ethical
competence in health care organizations. Nurs Ethics 2007 Nov;14(6):825-37.
108.
Kauric-Klein Z, Artinian N. Improving blood pressure control in hypertensive hemodialysis
patients. CANNT J 2007 Oct;17(4):24-6.
Meta-Analysis: Audit & Feedback
10
109.
Kelly M, Tan BK, Thompson J, Carroll S, Follington M, Arndt A, et al. Healthy adults can
more easily elevate the pelvic floor in standing than in crook-lying: an experimental study.
Aust J Physiother 2007;53(3):187-91.
110.
Khraisat A, Shanaah A, AlJaghbeer E, Berland D, Cannady PB, Jr. Morning report emails: a
unique model to improve the current format of an internal medicine training tradition. Med
Teach 2007 May;29(4):413.
111.
Knudson MM, Khaw L, Bullard MK, Dicker R, Cohen MJ, Staudenmayer K, et al. Trauma
training in simulation: translating skills from SIM time to real time. J Trauma 2008
Feb;64(2):255-63.
112.
Kramer M, Schmalenberg C. Revising the Essentials of Magnetism tool: there is more to
adequate staffing than numbers. The Journal Of Nursing Administration 2005
Apr;35(4):188-98.
113.
Kramer MS, Matush L, Vanilovich I, Platt R, Bogdanovich N, Sevkovskaya Z, et al. Effect
of prolonged and exclusive breast feeding on risk of allergy and asthma: cluster randomised
trial. BMJ 2007 Oct 20;335(7624):815.
114.
Kuriyama T, Absi EG, Williams DW, Lewis MAO. An outcome audit of the treatment of
acute dentoalveolar infection: impact of penicillin resistance. Br Dent J 2005 Jun
25;198(12):759.
115.
Kypri K, Langley JD, Saunders JB, Cashell-Smith ML, Herbison P. Randomized controlled
trial of web-based alcohol screening and brief intervention in primary care. Arch Intern Med
2008 Mar 10;168(5):530-6.
116.
Laaksonen E, Koski-Jannes A, Salaspuro M, Ahtinen H, Alho H. A randomized,
multicentre, open-label, comparative trial of disulfiram, naltrexone and acamprosate in the
treatment of alcohol dependence. Alcohol Alcohol 2008 Jan;43(1):53-61.
117.
Labarere J, Bosson JL, Sevestre MA, Sellier E, Richaud C, Legagneux A. Intervention
targeted at nurses to improve venous thromboprophylaxis. Int J Qual Health Care 2007
Oct;19(5):301-8.
118.
Landry MA, Lafrenaye S, Roy MC, Cyr C. A randomized, controlled trial of bedside versus
conference-room case presentation in a pediatric intensive care unit. Pediatrics 2007
Aug;120(2):275-80.
119.
Lavori PW, Wilt TJ, Sugarman J. Quality assurance questionnaire for professionals fails to
improve the quality of informed consent. Clin Trials 2007;4(6):638-49.
120.
Lee A, Joynt GM, Ho AM, Gin T, Hazlett CB. Effect of an integrated teaching intervention
on clinical decision analysis: a randomized, controlled study of undergraduate medical
students. Med Teach 2007 Mar;29(2-3):231-6.
121.
Legare F, Labrecque M, Leblanc A, Thivierge R, Godin G, Laurier C, et al. Does training
family physicians in shared decision making promote optimal use of antibiotics for acute
Meta-Analysis: Audit & Feedback
11
respiratory infections? Study protocol of a pilot clustered randomised controlled trial. BMC
Fam Pract 2007;8:65.
122.
Letelier LM, Zamarin N, Andrade M, Gabrielli L, Caiozzi G, Viviani P, et al. Exploring
language barriers to Evidence-based Health Care (EBHC) in post-graduate medical students:
a randomised trial. Educ Health (Abingdon ) 2007 Nov;20(3):82.
123.
Lieberman DA, Weiss DG, Harford WV, Ahnen DJ, Provenzale D, Sontag SJ, et al. Fiveyear colon surveillance after screening colonoscopy. Gastroenterology 2007
Oct;133(4):1077-85.
124.
Linden M, Schotte K. A randomized controlled clinical trial comparing "guideline exposed"
and "guideline naive" physicians in respect to dosage selection and treatment outcome with
doxepin in depressive disorders. Pharmacopsychiatry 2007 Mar;40(2):77-81.
125.
Liu JE, Mok E, Wong T, Xue L, Xu B. Evaluation of an integrated communication skills
training program for nurses in cancer care in Beijing, China. Nurs Res 2007 May;56(3):202-9.
126.
Loguercio AD, Reis A. Application of a dental adhesive using the self-etch and etch-andrinse approaches: an 18-month clinical evaluation. J Am Dent Assoc 2008 Jan;139(1):53-61.
127.
Low D, Healy D, Rasburn N. The use of the BERCI DCI Video Laryngoscope for teaching
novices direct laryngoscopy and tracheal intubation. Anaesthesia 2008 Feb;63(2):195-201.
128.
Lyons S, Galloway MJ, Osgerby J, Hanley J. An audit of thrombophilia screens: results from
the National Pathology Alliance benchmarking review. Journal Of Clinical Pathology 2006
Feb;59(2):156-9.
129.
Ma G, Davis DP, Schmitt J, Vilke GM, Chan TC, Hayden SR. The sensitivity and specificity
of transcricothyroid ultrasonography to confirm endotracheal tube placement in a cadaver
model. J Emerg Med 2007 May;32(4):405-7.
130.
Magrini N, Formoso G, Marata AM, Capelli O, Maestri E, Voci C, et al. Randomised
controlled trials for evaluating the prescribing impact of information meetings led by
pharmacists and of new information formats, in General Practice in Italy. BMC Health Serv
Res 2007;7:158.
131.
Maillet JP, Millar AM, Burke JM, Maillet MA, Maillet WA, Neish NR. Effect of
magnification loupes on dental hygiene student posture. J Dent Educ 2008 Jan;72(1):33-44.
132.
Majumdar SR, Johnson JA, McAlister FA, Bellerose D, Russell AS, Hanley DA, et al.
Multifaceted intervention to improve diagnosis and treatment of osteoporosis in patients
with recent wrist fracture: a randomized controlled trial. CMAJ 2008 Feb 26;178(5):569-75.
133.
Manikandan N. Effect of facial neuromuscular re-education on facial symmetry in patients
with Bell's palsy: a randomized controlled trial. Clin Rehabil 2007 Apr;21(4):338-43.
Meta-Analysis: Audit & Feedback
12
134.
Marín-Gómez M, Navarro-Collado MJ, Peiró S, Trenor-Gomis C, Payá-Rubio A, BernalDelgado E, et al. [The quality of care in shoulder pain. A medical audit]. Gaceta Sanitaria / S
E S P A S 2006 Mar;20(2):116-23
135.
Martin JA, Laube S, Edwards C, Gambles B, Anstey AV. Rate of acute adverse events for
narrow-band UVB and Psoralen-UVA phototherapy. Photodermatology, Photoimmunology
& Photomedicine 2007 Apr;23(2-3):68-72.
136.
Mathijssen IMJ, Arnaud E. Benchmarking for craniosynostosis. The Journal Of Craniofacial
Surgery 2007 Mar;18(2):436-42.
137.
Mayo NE, Nadeau L, Ahmed S, White C, Grad R, Huang A, et al. Bridging the gap: the
effectiveness of teaming a stroke coordinator with patient's personal physician on the
outcome of stroke. Age Ageing 2008 Jan;37(1):32-8.
138.
McFarlane SI, Castro J, Kaur J, Shin JJ, Kelling D, Jr., Farag A, et al. Control of blood
pressure and other cardiovascular risk factors at different practice settings: outcomes of care
provided to diabetic women compared to men. Journal Of Clinical Hypertension
(Greenwich, Conn) 2005 Feb;7(2):73-80.
139.
McGlynn B, Meddings RN, al-Saffar N, Gurun M, Hollins GW, Harnett AN. The
development and audit of a nurse-led urology/oncology clinic. Nursing Times 2004 Mar
23;100(12):54-6.
140.
McGregor SE, Hilsden RJ, Li FX, Bryant HE, Murray A. Low uptake of colorectal cancer
screening 3 yr after release of national recommendations for screening. Am J Gastroenterol
2007 Aug;102(8):1727-35.
141.
Menon-Nair A, Korner-Bitensky N, Wood-Dauphinee S, Robertson E. Assessment of
unilateral spatial neglect post stroke in Canadian acute care hospitals: are we neglecting
neglect? Clinical Rehabilitation 2006 Jul;20(7):623-34.
142.
Mensik JS. The Essentials of Magnetism for home health. The Journal Of Nursing
Administration 2007 May;37(5):230-4.
143.
Meurer WJ, Frederiksen SM, Majersik JJ, Zhang L, Sandretto A, Scott PA. Qualitative data
collection and analysis methods: the INSTINCT trial. Acad Emerg Med 2007
Nov;14(11):1064-71.
144.
Miller S, Le PV, Craig S, Adams V, Tudor C, Sonam, et al. How to make consent informed:
possible lessons from Tibet. IRB 2007 Nov;29(6):7-14.
145.
Milling TJ, Jones M, Khan T, Tad-y D, Melniker LA, Bove J, et al. Transtracheal 2-d
ultrasound for identification of esophageal intubation. J Emerg Med 2007 May;32(4):409-14.
146.
Milrod BL, Leon AC, Barber JP, Markowitz JC, Graf E. Do comorbid personality disorders
moderate panic-focused psychotherapy? An exploratory examination of the American
Psychiatric Association practice guideline. J Clin Psychiatry 2007 Jun;68(6):885-91.
Meta-Analysis: Audit & Feedback
13
147.
Mistiaen P, Achterberg W, Ament A, Halfens R, Huizinga J, Montgomery K, et al. Costeffectiveness of the Australian Medical Sheepskin for the prevention of pressure ulcers in
somatic nursing home patients: study protocol for a prospective multi-centre randomised
controlled trial (ISRCTN17553857). BMC Health Serv Res 2008;8:4.
148.
Mommaerts MY, Michiels MLE, De Pauw GA. A 2-year outcome audit of a versatile
orthodontic bone anchor. Journal Of Orthodontics 2005 Sep;32(3):175-81.
149.
Monette J, Miller MA, Monette M, Laurier C, Boivin JF, Sourial N, et al. Effect of an
educational intervention on optimizing antibiotic prescribing in long-term care facilities. J
Am Geriatr Soc 2007 Aug;55(8):1231-5.
150.
Morriss R, Dowrick C, Salmon P, Peters S, Dunn G, Rogers A, et al. Cluster randomised
controlled trial of training practices in reattribution for medically unexplained symptoms. Br
J Psychiatry 2007 Dec;191:536-42.
151.
ms-Wendling L, DeDonder J, Tidwell S, Pimple C, Schmiot L, Okeson D. Budgeting
nursing workload for required minimum data set assessments. J Nurs Manag 2007
May;15(4):442-8.
152.
Muller-Staub M, Needham I, Odenbreit M, Lavin MA, van AT. Improved quality of nursing
documentation: results of a nursing diagnoses, interventions, and outcomes implementation
study. Int J Nurs Terminol Classif 2007 Jan;18(1):5-17.
153.
Murphy MF, Casbard AC, Ballard S, Shulman IA, Heddle N, Aubuchon JP, et al. Prevention
of bedside errors in transfusion medicine (PROBE-TM) study: a cluster-randomized,
matched-paired clinical areas trial of a simple intervention to reduce errors in the
pretransfusion bedside check. Transfusion 2007 May;47(5):771-80.
154.
Murphy PS, Mills IW, Crossland A, Patel A. The impact of targeted training, a dedicated
protocol and on-site training material in reducing observer variability of prostate and
transition zone dimensions measured by transrectal ultrasonography, in multicentre
multinational clinical trials of men with symptomatic benign prostatic enlargement. BJU Int
2007 Jul;100(1):102-6.
155.
Murtagh MJ, Thomson RG, May CR, Rapley T, Heaven BR, Graham RH, et al. Qualitative
methods in a randomised controlled trial: the role of an integrated qualitative process
evaluation in providing evidence to discontinue the intervention in one arm of a trial of a
decision support tool. Qual Saf Health Care 2007 Jun;16(3):224-9.
156.
Myers MG, Leenen FH. Persistence of the antihypertensive effect of low-dose combination
therapy in mild hypertension. Blood Press 2006;15(6):325-32.
157.
Myles PS, Smith J, Knight J, Cooper DJ, Silbert B, McNeil J, et al. Aspirin and Tranexamic
Acid for Coronary Artery Surgery (ATACAS) Trial: rationale and design. Am Heart J 2008
Feb;155(2):224-30.
Meta-Analysis: Audit & Feedback
14
158.
Nakamura H. Primary prevention of cardiovascular diseases among hypercholesterolemic
Japanese with a low dose of pravastatin. Atheroscler Suppl 2007 Aug;8(2):13-7.
159.
Nguyen NT, Silver M, Robinson M, Needleman B, Hartley G, Cooney R, et al. Result of a
national audit of bariatric surgery performed at academic centers: a 2004 University
HealthSystem Consortium Benchmarking Project. Archives Of Surgery (Chicago, Ill : 1960)
2006 May;141(5):445.
160.
Nikendei C, Kraus B, Schrauth M, Weyrich P, Zipfel S, Herzog W, et al. Integration of roleplaying into technical skills training: a randomized controlled trial. Med Teach 2007
Nov;29(9):956-60.
161.
Noble VE, Nelson BP, Sutingco AN, Marill KA, Cranmer H. Assessment of knowledge
retention and the value of proctored ultrasound exams after the introduction of an
emergency ultrasound curriculum. BMC Med Educ 2007;7:40.
162.
Noordergraaf GJ, Drinkwaard BWPM, van Berkom PFJ, van Hemert HP, Venema A,
Scheffer GJ, et al. The quality of chest compressions by trained personnel: the effect of
feedback, via the CPREzy, in a randomized controlled trial using a manikin model.
Resuscitation 2006 May 2;69(2):241-52.
163.
Ogrinc G, West A, Eliassen MS, Liuw S, Schiffman J, Cochran N. Integrating practice-based
learning and improvement into medical student learning: evaluating complex curricular
innovations. Teach Learn Med 2007;19(3):221-9.
164.
Okong P, Byamugisha J, Mirembe F, Byaruhanga R, Bergstrom S. Audit of severe maternal
morbidity in Uganda--implications for quality of obstetric care. Acta Obstetricia Et
Gynecologica Scandinavica 2006;85(7):797-804.
165.
Özsunar Y, Çetin M, Taþkýn Füsun, Yücel A, Can S, Argýn M, et al. The level of quality of
radiology services in Turkey: a sampling analysis. Diagnostic And Interventional Radiology
(Ankara, Turkey) 2006 Dec;12(4):166-70.
166.
Palo R, Capraro L, Hovilehto S, Koivuranta M, Krusius T, Loponen E, et al. Populationbased audit of fresh-frozen plasma transfusion practices. Transfusion 2006 Nov;46(11):19215.
167.
Paskins Z, Potter T, Erb N, Obrenovic K, Rowe IF. Audits of the prevention and treatment
of corticosteroid-induced osteoporosis in outpatients with rheumatic diseases in the West
Midlands. Clinical Medicine (London, England) 2006 Mar;6(2):183-7.
168.
Patton SJ, Wallace AJ, Elles R. Benchmark for evaluating the quality of DNA sequencing:
proposal from an international external quality assessment scheme. Clinical Chemistry 2006
Apr 2;52(4):728-36.
169.
Paul F, Jones MC, Hendry C, Adair PM. The quality of written information for parents
regarding the management of a febrile convulsion: a randomized controlled trial. J Clin Nurs
2007 Dec;16(12):2308-22.
Meta-Analysis: Audit & Feedback
15
170.
Paul GM, Smith SM, Whitford DL, O'Shea E, O'Kelly F, O'Dowd T. Peer support in type 2
diabetes: a randomised controlled trial in primary care with parallel economic and qualitative
analyses: pilot study and protocol. BMC Fam Pract 2007;8:45.
171.
Park J, MacRae H, Musselman LJ, Rossos P, Hamstra SJ, Wolman S, et al. Randomized
controlled trial of virtual reality simulator training: transfer to live patients. Am J Surg 2007
Aug;194(2):205-11.
172.
Peabody JW, Luck J, Glassman P, Jain S, Hansen J, Spell M, et al. Measuring the quality of
physician practice by using clinical vignettes: a prospective validation study. Annals Of
Internal Medicine 2004 Nov 16;141(10):771-80.
173.
Peltier D, Regan-Smith M, Wofford J, Whelton S, Kennebecks G, Carney PA. Teaching
focused histories and physical exams in ambulatory care: a multi-institutional randomized
trial. Teach Learn Med 2007;19(3):244-50.
174.
Perkins GD, Davies RP, Stallard N, Bullock I, Stevens H, Lockey A. Advanced life support
cardiac arrest scenario test evaluation. Resuscitation 2007 Dec;75(3):484-90.
175.
Phelan EA, Balderson B, Levine M, Erro JH, Jordan L, Grothaus L, et al. Delivering
effective primary care to older adults: a randomized, controlled trial of the senior resource
team at group health cooperative. J Am Geriatr Soc 2007 Nov;55(11):1748-56.
176.
Pinget C, Martin E, Wasserfallen JB, Humair JP, Cornuz J. Cost-effectiveness analysis of a
European primary-care physician training in smoking cessation counseling. Eur J Cardiovasc
Prev Rehabil 2007 Jun;14(3):451-5.
177.
Pit SW, Byles JE, Cockburn J. Medication review: patient selection and general practitioner's
report of drug-related problems and actions taken in elderly Australians. J Am Geriatr Soc
2007 Jun;55(6):927-34.
178.
Potter J, Peel P, Mian S, Lowe D, Irwin P, Pearson M, et al. National audit of continence
care for older people: management of faecal incontinence. Age And Ageing 2007 May
13;36(3):268-73.
179.
Power P, Iacoponi E, Reynolds N, Fisher H, Russell M, Garety P, et al. The Lambeth Early
Onset Crisis Assessment Team Study: general practitioner education and access to an early
detection team in first-episode psychosis. Br J Psychiatry Suppl 2007 Dec;51:s133-s139
180.
Price EG, Windish DM, Magaziner J, Cooper LA. Assessing validity of standardized patient
ratings of medical students' communication behavior using the Roter interaction analysis
system. Patient Educ Couns 2008 Jan;70(1):3-9.
181.
Pugdahl K, Tankisi H, Fuglsang-Frederiksen A, Johnsen B, de Carvalho M, Fawcett PRW, et
al. Influence of medical audit on electrodiagnostic evaluation of polyneuropathy. A
multicentre study. Clinical Neurophysiology: Official Journal Of The International
Federation Of Clinical Neurophysiology 2005 Jan;116(1):49-55.
Meta-Analysis: Audit & Feedback
16
182.
Purcell DW, Garfein RS, Latka MH, Thiede H, Hudson S, Bonner S, et al. Development,
description, and acceptability of a small-group, behavioral intervention to prevent HIV and
hepatitis C virus infections among young adult injection drug users. Drug Alcohol Depend
2007 Nov;91 Suppl 1:S73-S80.
183.
Pusic MV, Leblanc VR, Miller SZ. Linear versus web-style layout of computer tutorials for
medical student learning of radiograph interpretation. Acad Radiol 2007 Jul;14(7):877-89.
184.
Querleu D, Leblanc E, Cartron G, Narducci F, Ferron G, Martel P. Audit of preoperative
and early complications of laparoscopic lymph node dissection in 1000 gynecologic cancer
patients. American Journal Of Obstetrics And Gynecology 2006 Nov 3;195(5):1287-92.
185.
Qureshi NN, Hatcher J, Chaturvedi N, Jafar TH. Effect of general practitioner education on
adherence to antihypertensive drugs: cluster randomised controlled trial. BMJ 2007 Nov
17;335(7628):1030.
186.
Rangaswamy C, Finn JI, Koelling TM. Angiotensin-converting enzyme inhibitor use in
elderly patients hospitalized with heart failure and left ventricular systolic dysfunction.
Cardiology 2005 Nov 2;103(1):17-23.
187.
Rapp DE, Gong EM, Reynolds WS, Lucioni A, Zagaja GP. Assessment of the core learning
objectives curriculum for the urology clerkship. J Urol 2007 Nov;178(5):2114-8.
188.
Rebergen DS, Bruinvels DJ, van der Beek AJ, van MW. Design of a randomized controlled
trial on the effects of counseling of mental health problems by occupational physicians on
return to work: the CO-OP-study. BMC Public Health 2007;7(147):183.
189.
Rego P, Ozolins I. IVIMEDS: a short report on an evaluation of the cardiovascular system
learning module. Med Teach 2007 Nov;29(9):961-5.
190.
Reynolds HW, Toroitich-Ruto C, Nasution M, Beaston-Blaakman A, Janowitz B.
Effectiveness of training supervisors to improve reproductive health quality of care: a
cluster-randomized trial in Kenya. Health Policy Plan 2008 Jan;23(1):56-66.
191.
Reynolds PA, Harper J, Dunne S, Cox M, Myint YK. Portable digital assistants (PDAs) in
dentistry: part II--pilot study of PDA use in the dental clinic. Br Dent J 2007 Apr
28;202(8):477-83.
192.
Ringsted C, Lippert F, Hesselfeldt R, Rasmussen MB, Mogensen SS, Frost T, et al.
Assessment of Advanced Life Support competence when combining different test methods-reliability and validity. Resuscitation 2007 Oct;75(1):153-60.
193.
Rivera ML, Donnelly J, Parry BA, Dinizio A, Johnson CL, Kline JA, et al. Prospective,
randomized evaluation of a personal digital assistant-based research tool in the emergency
department. BMC Med Inform Decis Mak 2008;8:3.
194.
Roach M, III, De SM, Rebbick T, Grignon D, Rotman M, Wolkov H, et al. Racial
differences in CYP3A4 genotype and survival among men treated on Radiation Therapy
Meta-Analysis: Audit & Feedback
17
Oncology Group (RTOG) 9202: a phase III randomized trial. Int J Radiat Oncol Biol Phys
2007 Sep 1;69(1):79-87.
195.
Roche PL, Ciccarelli MR, Gupta SK, Hayes BM, Molleston JP. Multi-school collaboration to
develop and test nutrition computer modules for pediatric residents. J Am Diet Assoc 2007
Sep;107(9):1586-9.
196.
Rodríguez-Molinero A, López-Diéguez M, Tabuenca AI, de la Cruz JJ, Banegas JR.
Functional assessment of older patients in the emergency department: comparison between
standard instruments, medical records and physicians' perceptions. BMC Geriatrics 2006 Sep
4;6:13.
197.
Roesch-Ely D, Scheffel H, Weiland S, Schwaninger M, Hundemer HP, Kolter T, et al.
Differential dopaminergic modulation of executive control in healthy subjects.
Psychopharmacology 2005 Apr 18;178(4):420-30.
198.
Rosted P, Bundgaard M, Fiske J, Pedersen AML. The use of acupuncture in controlling the
gag reflex in patients requiring an upper alginate impression: an audit. Br Dent J 2006 Dec
9;201(11):721.
199.
Rotter ML, Kampf G, Suchomel M, Kundi M. Long-term effect of a 1.5 minute surgical
hand rub with a propanol-based product on the resident hand flora. J Hosp Infect 2007
May;66(1):84-5.
200.
Roukema J, Steyerberg EW, van der LJ, Moll HA. Randomized trial of a clinical decision
support system: impact on the management of children with fever without apparent source.
J Am Med Inform Assoc 2008 Jan;15(1):107-13.
201.
Roumie CL, Elasy TA, Wallston KA, Pratt S, Greevy RA, Liu X, et al. Clinical inertia: a
common barrier to changing provider prescribing behavior. Jt Comm J Qual Patient Saf
2007 May;33(5):277-85.
202.
Rudd AG, Hoffman A, Down C, Pearson M, Lowe D. Access to stroke care in England,
Wales and Northern Ireland: the effect of age, gender and weekend admission. Age And
Ageing 2007 May 14;36(3):247-55.
203.
Russell NH, Szydlo R, McCann S, Potter MN, Craddock C, Towlson K, et al. The use of a
national transplant registry to benchmark transplant outcome for patients undergoing
autologous and allogeneic stem cell transplantation in the United Kingdom and Ireland.
British Journal Of Haematology 2004 Feb;124(4):499-503.
204.
Ryan GJ, Foster KT, Unterwagner W, Jia H. Impact of a diabetes certificate program on
PharmD students' knowledge and skills. Am J Pharm Educ 2007 Oct 15;71(5):84.
205.
Saeed A, Guerin M, Khan I, Keane P, Stack J, Hayes P, et al. Deferral of first review after
uneventful phacoemulsification cataract surgery until 2 weeks: randomized controlled study.
J Cataract Refract Surg 2007 Sep;33(9):1591-6.
Meta-Analysis: Audit & Feedback
18
206.
Schardt C, Adams MB, Owens T, Keitz S, Fontelo P. Utilization of the PICO framework to
improve searching PubMed for clinical questions. BMC Med Inform Decis Mak 2007;7:16.
207.
Schonrock-Adema J, Heijne-Penninga M, van Duijn MA, Geertsma J, Cohen-Schotanus J.
Assessment of professional behaviour in undergraduate medical education: peer assessment
enhances performance. Med Educ 2007 Sep;41(9):836-42.
208.
Schuetz P, Christ-Crain M, Wolbers M, Schild U, Thomann R, Falconnier C, et al.
Procalcitonin guided antibiotic therapy and hospitalization in patients with lower respiratory
tract infections: a prospective, multicenter, randomized controlled trial. BMC Health Serv
Res 2007;7:102.
209.
Schwenkglenks M, Jackisch C, Constenla M, Kerger JN, Paridaens R, Auerbach L, et al.
Neutropenic event risk and impaired chemotherapy delivery in six European audits of breast
cancer treatment. Supportive Care In Cancer: Official Journal Of The Multinational
Association Of Supportive Care In Cancer 2006 Sep 19;14(9):901-9.
210.
Selby G, Walker V, Diwakar V. A comparison of teaching methods: interactive lecture
versus game playing. Med Teach 2007 Nov;29(9):972-4.
211.
Selle KM, Salamon K, Boarman R, Sauer J. Providing interprofessional learning through
interdisciplinary collaboration: the role of "modelling". J Interprof Care 2008 Jan;22(1):8592.
212.
Senarath U, Fernando DN, Rodrigo I. Effect of training for care providers on practice of
essential newborn care in hospitals in Sri Lanka. J Obstet Gynecol Neonatal Nurs 2007
Nov;36(6):531-41.
213.
Shah SA, Kristensen S, Memon MA, White HL, Vermund SH. Syndromic management
training for non-formal care providers in Pakistan improves quality of care for sexually
transmitted diseases STD care: a randomized clinical trial. Southeast Asian J Trop Med
Public Health 2007 Jul;38(4):737-48.
214.
Shield R. Physicians' perspectives on end-of-life care: a qualitative inquiry. Med Health R I
2007 Dec;90(12):391-2.
215.
Siciliani L. Estimating technical efficiency in the hospital sector with panel data: a
comparison of parametric and non-parametric techniques. Applied Health Economics And
Health Policy 2006;5(2):99-116.
216.
Simmons JM, Matteucci P, Leon-Villapalos J, Mallucci PL, Withey SJ, Butler PEM.
Variations in clinical audit collection: a survey of plastic surgery units across the British Isles.
Annals Of The Royal College Of Surgeons Of England 2006 Mar;88(2):196-8.
217.
Simpkins J, Divine G, Wang M, Holmboe E, Pladevall M, Williams LK. Improving asthma
care through recertification: a cluster randomized trial. Arch Intern Med 2007 Nov
12;167(20):2240-8.
Meta-Analysis: Audit & Feedback
19
218.
Skrypniuk JV, Bailey D, Cosgriff PS, Fleming JS, Houston AS, Jarritt PH, et al. UK audit of
left ventricular ejection fraction estimation from equilibrium ECG gated blood pool images.
Nuclear Medicine Communications 2005 Mar;26(3):205-15.
219.
Slade GD, Rozier RG, Zeldin LP, Margolis PA. Training pediatric health care providers in
prevention of dental decay: results from a randomized controlled trial. BMC Health Serv Res
2007;7:176.
220.
Sloan FA, Trogdon JG, Curtis LH, Schulman KA. The effect of dementia on outcomes and
process of care for Medicare beneficiaries admitted with acute myocardial infarction. Journal
Of The American Geriatrics Society 2004 Feb;52(2):173-81.
221.
Sookpotarom P, Siriarchawatana T, Jariya Y, Vejchapipat P. Demonstration of nasogastric
intubation using video compact disc as an adjunct to the teaching processes. J Med Assoc
Thai 2007 Mar;90(3):468-72.
222.
Sorensen J, Frich L. Home visits by specially trained nurses after discharge from multidisciplinary pain care: a cost consequence analysis based on a randomised controlled trial.
Eur J Pain 2008 Feb;12(2):164-71.
223.
Sorensen LT, Hemmingsen U, Jorgensen T. Strategies of smoking cessation intervention
before hernia surgery--effect on perioperative smoking behavior. Hernia 2007
Aug;11(4):327-33.
224.
Stark R, Helenius IM, Schimming LM, Takahara N, Kronish I, Korenstein D. Real-time
EBM: from bed board to keyboard and back. J Gen Intern Med 2007 Dec;22(12):1656-60.
225.
Stefanidis D, Korndorffer JR, Jr., Markley S, Sierra R, Heniford BT, Scott DJ. Closing the
gap in operative performance between novices and experts: does harder mean better for
laparoscopic simulator training? J Am Coll Surg 2007 Aug;205(2):307-13.
226.
Strang J, Hunt C, Gerada C, Marsden J. What difference does training make? A randomized
trial with waiting-list control of general practitioners seeking advanced training in drug
misuse. Addiction 2007 Oct;102(10):1637-47.
227.
Street KN, Eaton N, Clarke B, Ellis M, Young PM, Hunt L, et al. Child disability case
studies: an interprofessional learning opportunity for medical students and paediatric nursing
students. Med Educ 2007 Aug;41(8):771-80.
228.
Sullivan G, Craske MG, Sherbourne C, Edlund MJ, Rose RD, Golinelli D, et al. Design of
the Coordinated Anxiety Learning and Management (CALM) study: innovations in
collaborative care for anxiety disorders. Gen Hosp Psychiatry 2007 Sep;29(5):379-87.
229.
Sytema S, Wunderink L, Bloemers W, Roorda L, Wiersma D. Assertive community
treatment in the Netherlands: a randomized controlled trial. Acta Psychiatr Scand 2007
Aug;116(2):105-12.
Meta-Analysis: Audit & Feedback
20
230.
Szczech LA, Klassen PS, Chua B, Hedayati SS, Flanigan M, McClellan WM, et al.
Associations between CMS's Clinical Performance Measures project benchmarks, profit
structure, and mortality in dialysis units. Kidney International 2006 Jun;69(11):2094-100.
231.
Teoh AY, Chong CN, Wong J, Lee KF, Chiu PW, Ng SS, et al. Routine early laparoscopic
cholecystectomy for acute cholecystitis after conclusion of a randomized controlled trial. Br
J Surg 2007 Sep;94(9):1128-32.
232.
Tolsgaard MG, Gustafsson A, Rasmussen MB, Hoiby P, Muller CG, Ringsted C. Student
teachers can be as good as associate professors in teaching clinical skills. Med Teach 2007
Sep;29(6):553-7.
233.
Tran YB, Frial T, Miller PS. Statin's cost-effectiveness: a Canadian analysis of commonly
prescribed generic and brand name statins. Can J Clin Pharmacol 2007;14(2):e205-e214.
234.
Tuncel A, Lucas S, Bensalah K, Zeltser IS, Jenkins A, Saeedi O, et al. A randomized
comparison of conventional vs articulating laparoscopic needle-drivers for performing
standardized suturing tasks by laparoscopy-naive subjects. BJU Int 2008 Mar;101(6):727-30.
235.
Twaddle ML, Maxwell TL, Cassel JB, Liao S, Coyne PJ, Usher BM, et al. Palliative care
benchmarks from academic medical centers. Journal Of Palliative Medicine 2007
Feb;10(1):86-98.
236.
Unal M, Yucel I, Altin M. Pain induced by phacoemulsification performed by residents using
topical anesthesia. Ophthalmic Surg Lasers Imaging 2007 Sep;38(5):386-91.
237.
Unsworth V, Franck LS, Choonara I. Parental assessment and management of children's
postoperative pain: a randomized clinical trial. J Child Health Care 2007 Sep;11(3):186-94.
238.
Van den BJ, Mackay M, Mpontshane N, Kany Kany LA, Chhagan M, Bennish ML.
Maintaining data integrity in a rural clinical trial. Clin Trials 2007;4(5):572-82.
239.
van Driel ML, Coenen S, Dirven K, Lobbestael J, Janssens I, Van Royen P, et al. What is the
role of quality circles in strategies to optimise antibiotic prescribing? A pragmatic clusterrandomised controlled trial in primary care. Quality & Safety In Health Care 2007
Jun;16(3):197-202.
240.
van Oostrom SH, Anema JR, Terluin B, de Vet HC, Knol DL, van MW. Cost-effectiveness
of a workplace intervention for sick-listed employees with common mental disorders: design
of a randomized controlled trial. BMC Public Health 2008;8:12.
241.
van Wyk JT, van Wijk MA, Sturkenboom MC, Mosseveld M, Moorman PW, van der LJ.
Electronic alerts versus on-demand decision support to improve dyslipidemia treatment: a
cluster randomized controlled trial. Circulation 2008 Jan 22;117(3):371-8.
242.
Vandeweerd JM, Davies JC, Pinchbeck GL, Cotton JC. Teaching veterinary radiography by
e-learning versus structured tutorial: a randomized, single-blinded controlled trial. J Vet Med
Educ 2007;34(2):160-7.
Meta-Analysis: Audit & Feedback
21
243.
Varela G, Molins L, Astudillo J, Borro JM, Canalís E, Freixinet J, et al. [Pilot benchmarking
study of thoracic surgery in Spain: comparison of cases of lung resection and indicators of
quality]. Archivos De Bronconeumología 2006 Jun;42(6):267-72.
244.
Vivekananda-Schmidt P, Lewis M, Coady D, Morley C, Kay L, Walker D, et al. Exploring
the use of videotaped objective structured clinical examination in the assessment of joint
examination skills of medical students. Arthritis Rheum 2007 Jun 15;57(5):869-76.
245.
Vollmar HC, Butzlaff ME, Lefering R, Rieger MA. Knowledge translation on dementia: a
cluster randomized trial to compare a blended learning approach with a "classical" advanced
training in GP quality circles. BMC Health Serv Res 2007;7:92.
246.
Walker L, Minchin A, Pickard J. Setting standards for planning off duty and audit of
practice. Nursing Times 2006 May 23;102(21):30-2.
247.
Walsh M, Laptook A, Kazzi SN, Engle WA, Yao Q, Rasmussen M, et al. A clusterrandomized trial of benchmarking and multimodal quality improvement to improve rates of
survival free of bronchopulmonary dysplasia for infants with birth weights of less than 1250
grams. Pediatrics 2007 May;119(5):876-90.
248.
Wayne DB, Didwania A, Feinglass J, Fudala MJ, Barsuk JH, McGaghie WC. Simulationbased education improves quality of care during cardiac arrest team responses at an academic
teaching hospital: a case-control study. Chest 2008 Jan;133(1):56-61.
249.
Weidner TG, Popp JK. Peer-assisted learning and orthopaedic evaluation psychomotor
skills. J Athl Train 2007 Jan;42(1):113-9.
250.
Weiner SJ, Schwartz A, Yudkowsky R, Schiff GD, Weaver FM, Goldberg J, et al. Evaluating
physician performance at individualizing care: a pilot study tracking contextual errors in
medical decision making. Med Decis Making 2007 Nov;27(6):726-34.
251.
Welk A, Immenroth M, Sakic P, Bernhardt O, Eberspacher H, Meyer G. Mental training in
dentistry. Quintessence Int 2007 Jun;38(6):489-97.
252.
Wells KB, Schoenbaum M, Duan N, Miranda J, Tang L, Sherbourne C. Cost-effectiveness of
quality improvement programs for patients with subthreshold depression or depressive
disorder. Psychiatr Serv 2007 Oct;58(10):1269-78.
253.
Wheeler DW, Degnan BA, Murray LJ, Dunling CP, Whittlestone KD, Wood DF, et al.
Retention of drug administration skills after intensive teaching. Anaesthesia 2008
Apr;63(4):379-84.
254.
Winett RA, Anderson ES, Wojcik JR, Winett SG, Bowden T. Guide to health: nutrition and
physical activity outcomes of a group-randomized trial of an Internet-based intervention in
churches. Ann Behav Med 2007 May;33(3):251-61.
255.
Wissow LS, Gadomski A, Roter D, Larson S, Brown J, Zachary C, et al. Improving child and
parent mental health in primary care: a cluster-randomized trial of communication skills
training. Pediatrics 2008 Feb;121(2):266-75.
Meta-Analysis: Audit & Feedback
22
256.
Wong CA, McCarthy RJ, Fitzgerald PC, Raikoff K, Avram MJ. Gastric emptying of water in
obese pregnant women at term. Anesth Analg 2007 Sep;105(3):751-5.
257.
Wong G, Jenkins C, Yao TJ, Irwin M. A trend toward improved learning of cardiovascular
pathophysiology in medical students from using a human patient simulator: results of a pilot
study. Adv Physiol Educ 2007 Dec;31(4):372.
258.
Yamakage M, Hayase T, Satoh JI, Namiki A. Work stress in medical anaesthesiology
trainees. Eur J Anaesthesiol 2007 Sep;24(9):809-11.
259.
Yener G, Aran S, Bahceci M, Ozdemir K, Gultekin F, Lowe W. Quinapril for treatment of
hypertension in Turkey: dose titration and diuretic combination treatment strategies. Clin
Drug Investig 2007;27(9):613-22.
260.
Zemencuk JK, Hofer TP, Hayward RA, Moseley RH, Saint S. What effect does physician
"profiling" have on inpatient physician satisfaction and hospital length of stay? BMC Health
Services Research 2006 Apr 4;6:45.
261.
Zimmerman JE, Kramer AA, McNair DS, Malila FM, Shaffer VL. Intensive care unit length
of stay: Benchmarking based on Acute Physiology and Chronic Health Evaluation
(APACHE) IV. Critical Care Medicine 2006 Oct;34(10):2517-29
Patients, not clinicians, received feedback
1. Anderson R, Harrison A, Lyons GM. Accelerometry-based feedback--can it improve
movement consistency and performance in rowing? Sports Biomechanics / International
Society Of Biomechanics In Sports 2005 Jul;4(2):179-95.
2. Aukee P, Immonen P, Laaksonen DE, Laippala P, Penttinen J, Airaksinen O. The effect of
home biofeedback training on stress incontinence. Acta Obstetricia Et Gynecologica
Scandinavica 2004 Oct;83(10):973-7.
3. Baram Y, Miller A. Auditory feedback control for improvement of gait in patients with
Multiple Sclerosis. Journal Of The Neurological Sciences 2007 Mar 15;254(1-2):90-4.
4. Bray S, Shimojo S, O'Doherty JP. Direct instrumental conditioning of neural activity using
functional magnetic resonance imaging-derived reward feedback. J Neurosci 2007 Jul
11;27(28):7498-507.
5. Brindle TJ, Nitz AJ, Uhl TL, Kifer E, Shapiro R. Measures of accuracy for active shoulder
movements at 3 different speeds with kinesthetic and visual feedback. The Journal Of
Orthopaedic And Sports Physical Therapy 2004 Aug;34(8):468-78.
6. Censi F, Calcagnini G, Cerutti S. Proposed corrections for the quantification of coupling
patterns by recurrence plots. IEEE Transactions On Bio-Medical Engineering 2004
May;51(5):856-9.
7. Chiviacowsky S, Wulf G. Feedback after good trials enhances learning. Research Quarterly
For Exercise And Sport 2007 Mar;78(2):40-7.
Meta-Analysis: Audit & Feedback
23
8. Eastep E, Beveridge S, Eisenman P, Ransdell L, Shultz B. Does augmented feedback from
pedometers increase adults' walking behavior? Perceptual And Motor Skills 2004
Oct;99(2):392-402.
9. Emmen MJ, Peters E, Elving LD, Bredie SJH, Wollersheim H, Bleijenberg G, et al. A brief
behavioral feedback intervention in hospital outpatients with a high cardiovascular risk.
Patient Education And Counseling 2006 Jan 4;60(1):32-40.
10. Geisner IM, Neighbors C, Lee CM, Larimer ME. Evaluating personal alcohol feedback as a
selective prevention for college students with depressed mood. Addict Behav 2007
Dec;32(12):2776-87.
11. Hanioka T, Ojima M, Hamajima N, Naito M. Patient feedback as a motivating force to quit
smoking. Community Dent Oral Epidemiol 2007 Aug;35(4):310-7.
12. Hartmann CW, Sciamanna CN, Blanch DC, Mui S, Lawless H, Manocchia M, et al. A
website to improve asthma care by suggesting patient questions for physicians: qualitative
analysis of user experiences. J Med Internet Res 2007;9(1):e3.
13. Hinterberger T, Neumann N, Pham M, Kübler A, Grether A, Hofmayer N, et al. A
multimodal brain-based feedback and communication system. Experimental Brain Research
Experimentelle Hirnforschung Expérimentation Cérébrale 2004 Feb 29;154(4):521-6.
14. Johnson SS, Driskell MM, Johnson JL, Dyment SJ, Prochaska JO, Prochaska JM, et al.
Transtheoretical model intervention for adherence to lipid-lowering drugs. Disease
Management: DM 2006 Apr;9(2):102-14.
15. Keogh J, Morrison S, Barrett R. Augmented visual feedback increases finger tremor during
postural pointing. Experimental Brain Research Experimentelle Hirnforschung
Expérimentation Cérébrale 2004 Dec 30;159(4):467-77.
16. Kernozek T, Iwasaki M, Fater D, Durall C, Langenhorst B. Movement-based feedback may
reduce spinal moments in male workers during lift and lowering tasks. Physiotherapy
Research International: The Journal For Researchers And Clinicians In Physical Therapy
2006 Sep;11(3):140-7.
17. Keuning H, Monné TK, IJsselsteijn WA, Houtsma AJ. The form of augmented forcefeedback fields and the efficiency and satisfaction in computer-aided pointing tasks. Human
Factors 2005;47(2):418-29.
18. Ledebt A, Becher J, Kapper J, Rozendaalr RM, Bakker R, Leenders IC, et al. Balance training
with visual feedback in children with hemiplegic cerebral palsy: effect on stance and gait.
Motor Control 2005 Oct;9(4):459-68.
19. LoPresti EF, Brienza DM. Adaptive software for head-operated computer controls. IEEE
Transactions On Neural Systems And Rehabilitation Engineering: A Publication Of The
IEEE Engineering In Medicine And Biology Society 2004 Mar;12(1):102-11.
Meta-Analysis: Audit & Feedback
24
20. Mahony RT, Malone PA, Nalty J, Behan M, O'connell PR, O'herlihy C. Randomized clinical
trial of intra-anal electromyographic biofeedback physiotherapy with intra-anal
electromyographic biofeedback augmented with electrical stimulation of the anal sphincter in
the early treatment of postpartum fecal incontinence. American Journal Of Obstetrics And
Gynecology 2004 Sep;191(3):885-90.
21. Marshall AL. Should all steps count when using a pedometer as a measure of physical
activity in older adults? J Phys Act Health 2007 Jul;4(3):305-14.
22. Munro KJ, Lutman ME. The influence of visual feedback on closed-set word test
performance over time. International Journal Of Audiology 2005 Dec;44(12):701-5.
23. Patton JL, Mussa-Ivaldi FA. Robot-assisted adaptive training: custom force fields for
teaching movement patterns. IEEE Transactions On Bio-Medical Engineering 2004
Apr;51(4):636-46.
24. Sevick MA, Napolitano MA, Papandonatos GD, Gordon AJ, Reiser LM, Marcus BH. Costeffectiveness of alternative approaches for motivating activity in sedentary adults: results of
Project STRIDE. Prev Med 2007 Jul;45(1):54-61.
25. Pleger B, Tegenthoff M, Ragert P, Förster AF, Dinse HR, Schwenkreis P, et al.
Sensorimotor retuning [corrected] in complex regional pain syndrome parallels pain
reduction. Annals Of Neurology 2005 Mar;57(3):425-9.
26. Richardson CR, Brown BB, Foley S, Dial KS, Lowery JC. Feasibility of adding enhanced
pedometer feedback to nutritional counseling for weight loss. Journal Of Medical Internet
Research 2005 Nov 17;7(5):e56.
27. Rickles NM, Svarstad BL, Statz-Paynter JL, Taylor LV, Kobak KA. Improving patient
feedback about and outcomes with antidepressant treatment: a study in eight community
pharmacies. Journal Of The American Pharmacists Association: Japha 2006 Jan;46(1):25-32.
28. Riddle CN, Baker SN. Manipulation of peripheral neural feedback loops alters human
corticomuscular coherence. The Journal Of Physiology 2005 Jul 15;566(Pt 2):625-39.
29. Reo JA, Mercer VS. Effects of live, videotaped, or written instruction on learning an upperextremity exercise program. Physical Therapy 2004 Jul;84(7):622-33.
30. Schettino LF, Adamovich SV, Hening W, Tunik E, Sage J, Poizner H. Hand preshaping in
Parkinson's disease: effects of visual feedback and medication state. Experimental Brain
Research Experimentelle Hirnforschung Expérimentation Cérébrale 2006 Jan 22;168(12):186-202.
31. Schmidt U, Landau S, Pombo-Carril MG, Bara-Carril N, Reid Y, Murray K, et al. Does
personalized feedback improve the outcome of cognitive-behavioural guided self-care in
bulimia nervosa? A preliminary randomized controlled trial. The British Journal Of Clinical
Psychology / The British Psychological Society 2006 Mar;45(Pt 1):111-21.
Meta-Analysis: Audit & Feedback
25
32. Sihvonen S, Sipilä S, Taskinen S, Era P. Fall incidence in frail older women after
individualized visual feedback-based balance training. Gerontology 2004 Nov;50(6):411-6.
33. Slade M, Leese M, Gillard M, Kuipers E, Thornicroft G. Pre-morbid IQ and response to
routine outcome assessment. Psychological Medicine 2006 Aug 17;36(8):1183-91.
34. Spittaels H, De Bourdeaudhuij I, Vandelanotte C. Evaluation of a website-delivered
computer-tailored intervention for increasing physical activity in the general population.
Preventive Medicine 2007 Mar 2;44(3):209-17.
35. Strauman TJ, Woods TE, Schneider KL, Kwapil L, Coe CL. Self-regulatory cognition and
immune reactivity: idiographic success and failure feedback effects on the natural killer cell.
Brain, Behavior, And Immunity 2004 Nov;18(6):544-54.
36. Swinnen SP, Puttemans V, Lamote S. Procedural memory in Korsakoff's disease under
different movement feedback conditions. Behavioural Brain Research 2005 Apr
15;159(1):127-33.
37. Tripp BP, McIlroy WE, Maki BE. Online mutability of step direction during rapid stepping
reactions evoked by postural perturbation. IEEE Transactions On Neural Systems And
Rehabilitation Engineering: A Publication Of The IEEE Engineering In Medicine And
Biology Society 2004 Mar;12(1):140-52.
38. van Leijenhorst L, Crone EA, Bunge SA. Neural correlates of developmental differences in
risk estimation and feedback processing. Neuropsychologia 2006 Mar 30;44(11):2158-70.
39. van Meel CS, Oosterlaan J, Heslenfeld DJ, Sergeant JA. Telling good from bad news:
ADHD differentially affects processing of positive and negative feedback during guessing.
Neuropsychologia 2005;43(13):1946-54.
40. Voerman GE, Sandsjö L, Vollenbroek-Hutten MMR, Groothuis-Oudshoorn CGM,
Hermens HJ. The influence of different intermittent myofeedback training schedules on
learning relaxation of the trapezius muscle while performing a gross-motor task. European
Journal Of Applied Physiology 2004 Oct 1;93(1-2):57-64.
41. Voerman GE, Sandsjö L, Vollenbroek-Hutten MMR, Larsman P, Kadefors R, Hermens HJ.
Effects of ambulant myofeedback training and ergonomic counselling in female computer
workers with work-related neck-shoulder complaints: a randomized controlled trial. Journal
Of Occupational Rehabilitation 2007 Mar;17(1):137-52.
42. Weiskopf N, Mathiak K, Bock SW, Scharnowski F, Veit R, Grodd W, et al. Principles of a
brain-computer interface (BCI) based on real-time functional magnetic resonance imaging
(fMRI). IEEE Transactions On Bio-Medical Engineering 2004 Jun;51(6):966-70.
43. Wilkin TJ, Mallam KM, Metcalf BS, Jeffery AN, Voss LD. Variation in physical activity lies
with the child, not his environment: evidence for an 'activitystat' in young children
(EarlyBird 16). International Journal Of Obesity (2005) 2006 Jul;30(7):1050-5.
Meta-Analysis: Audit & Feedback
26
44. Winzenberg T, Oldenburg B, Frendin S, De Wit L, Riley M, Jones G. The effect on behavior
and bone mineral density of individualized bone mineral density feedback and educational
interventions in premenopausal women: a randomized controlled trial [NCT00273260].
BMC Public Health 2006 Jan 23;6:12.
45. Wise JB, Posner AE, Walker GL. Verbal messages strengthen bench press efficacy. Journal
Of Strength And Conditioning Research / National Strength & Conditioning Association
2004 Feb;18(1):26-9.
46. Yip SLM, Ng GYF. Biofeedback supplementation to physiotherapy exercise programme for
rehabilitation of patellofemoral pain syndrome: a randomized controlled pilot study. Clinical
Rehabilitation 2006 Dec;20(12):1050-7.
Not RCT
1. Using performance feedback to change provider behavior. Performance Improvement
Advisor 2006 May;10(5):58.
2. Chate RAC, White S, Hale LRO, Howat AP, Bottomley J, Barnet-Lamb J, et al. The impact
of clinical audit on antibiotic prescribing in general dental practice. Br Dent J 2006 Nov
25;201(10):635-41.
3. Cheater FM, Hearnshaw H, Baker R, Keane M. Can a facilitated programme promote
effective multidisciplinary audit in secondary care teams? An exploratory trial. International
Journal Of Nursing Studies 2005 Sep;42(7):779-91.
4. Clay AS, Que L, Petrusa ER, Sebastian M, Govert J. Debriefing in the intensive care unit: a
feedback tool to facilitate bedside teaching. Critical Care Medicine 2007 Mar;35(3):738-54.
5. Edwards N, Danseco E, Heslin K, Ploeg J, Santos J, Stansfield M, et al. Development and
testing of tools to assess physical restraint use. Worldviews On Evidence-Based Nursing /
Sigma Theta Tau International, Honor Society Of Nursing 2006;3(2):73-85.
6. Elwyn G, Owen D, Roberts L, Wareham K, Duane P, Allison M, et al. Influencing referral
practice using feedback of adherence to NICE guidelines: a quality improvement report for
dyspepsia. Quality & Safety In Health Care 2007 Feb;16(1):67-70.
7. Forjuoh SN, Reis MD, Couchman GR, Symm B, Mason S, O'Banon R. Physician response
to written feedback on a medication discrepancy found with their elderly ambulatory
patients. Journal Of The American Geriatrics Society 2005 Dec;53(12):2173-7.
8. Garbett R, Hardy S, Manley K, Titchen A, McCormack B. Developing a qualitative approach
to 360-degree feedback to aid understanding and development of clinical expertise. Journal
Of Nursing Management 2007 Apr;15(3):342-7.
9. Kasatpibal N, Jamulitrat S, Chongsuvivatwong V, Nørgaard M, Sørensen HT. Impact of
surgeon-specific feedback on surgical site infection rates in Thailand. The Journal Of
Hospital Infection 2006 Jun 24;63(2):148-55.
Meta-Analysis: Audit & Feedback
27
10. Lee TW, Chan SC, Chua WT, Harbinder K, Khoo YL, Ow Yeang YL, et al. Audit of
diabetes mellitus in general practice. The Medical Journal Of Malaysia 2004 Aug;59(3):31722.
11. McMullan RE. An audit of 'early debond' cases in the national outcomes audit of patients
treated with upper and lower fixed appliances by Consultant Orthodontists in the UK.
Journal Of Orthodontics 2005 Dec;32(4):257.
12. Nicolson S, Pirotta M, Chondros P. Shared maternity care: all care--not enough
responsibility? An audit of patient care communications pre- and post- a multi-faceted
intervention. The Australian & New Zealand Journal Of Obstetrics & Gynaecology 2005
Dec;45(6):509-13.
13. Parra E, Ramos R, Betriú A, Paniagua J, Belart M, Martín F, et al. [Hemodialysis prospective
multicentric quality study]. Nefrología: Publicación Oficial De La Sociedad Española
Nefrologia 2006;26(6):688-94.
14. Rask KJ, Schuessler LD, Naylor DV. A statewide voluntary patient safety initiative: the
Georgia experiene. Joint Commission Journal On Quality And Patient Safety / Joint
Commission Resources 2006 Oct;32(10):564-72.
15. Weightman R, Walton R, Bury J. Audit of bloodborne virus prevention activity with drug
users seen in primary care. Communicable Disease And Public Health / PHLS 2004
Dec;7(4):301-5.
16. Wolthuis EK, Korevaar JC, Spronk P, Kuiper MA, Dzoljic M, Vroom MB, et al. Feedback
and education improve physician compliance in use of lung-protective mechanical
ventilation. Intensive Care Medicine 2005 Apr 25;31(4):540-6.
17. Yeung N, Cohen JD, Botvinick MM. The neural basis of error detection: conflict monitoring
and the error-related negativity. Psychological Review 2004 Oct;111(4):931-59.
Only student participants
1. Ali J, Adam RU, Sammy I, Ali E, Williams JI. The simulated Trauma Patient Teaching
Module--does it improve student performance? J Trauma 2007 Jun;62(6):1416-20.
2. Boehler ML, Rogers DA, Schwind CJ, Mayforth R, Quin J, Williams RG, et al. An
investigation of medical student reactions to feedback: a randomised controlled trial. Medical
Education 2006 Aug;40(8):746-9.
3. Chernoff RA, Davison GC. An evaluation of a brief HIV/AIDS prevention intervention for
college students using normative feedback and goal setting. AIDS Education And
Prevention: Official Publication Of The International Society For AIDS Education 2005
Apr;17(2):91-104.
Meta-Analysis: Audit & Feedback
28
4. Congedo M, Lubar JF, Joffe D. Low-resolution electromagnetic tomography neurofeedback.
IEEE Transactions On Neural Systems And Rehabilitation Engineering: A Publication Of
The IEEE Engineering In Medicine And Biology Society 2004 Dec;12(4):387-97.
5. Descarreaux M, Dugas C, Lalanne K, Vincelette M, Normand MC. Learning spinal
manipulation: the importance of augmented feedback relating to various kinetic parameters.
The Spine Journal: Official Journal Of The North American Spine Society 2006 Mar
30;6(2):138-45.
6. Gofton W, Dubrowski A, Tabloie F, Backstein D. The effect of computer navigation on
trainee learning of surgical skills. J Bone Joint Surg Am 2007 Dec;89(12):2819-27.
7. Juárez P, Walters ST, Daugherty M, Radi C. A randomized trial of motivational interviewing
and feedback with heavy drinking college students. Journal Of Drug Education
2006;36(3):233-46.
8. Larimer ME, Lee CM, Kilmer JR, Fabiano PM, Stark CB, Geisner IM, et al. Personalized
mailed feedback for college drinking prevention: a randomized clinical trial. Journal Of
Consulting And Clinical Psychology 2007 Apr;75(2):285-93.
9. Lipkus IM, Prokhorov AV. The effects of providing lung age and respiratory symptoms
feedback on community college smokers' perceived smoking-related health risks, worries and
desire to quit. Addictive Behaviors 2007 Mar 7;32(3):516-32.
10. Levitsky DA, Garay J, Nausbaum M, Neighbors L, Dellavalle DM. Monitoring weight daily
blocks the freshman weight gain: a model for combating the epidemic of obesity.
International Journal Of Obesity (2005) 2006 Jun;30(6):1003-10.
11. Lewis MA, Neighbors C. Optimizing personalized normative feedback: the use of genderspecific referents. Journal Of Studies On Alcohol And Drugs 2007 Mar;68(2):228-37.
12. Madan AK, Frantzides CT. Substituting virtual reality trainers for inanimate box trainers
does not decrease laparoscopic skills acquisition. JSLS 2007 Jan;11(1):87-9.
13. Murphy JG, Benson TA, Vuchinich RE, Deskins MM, Eakin D, Flood AM, et al. A
comparison of personalized feedback for college student drinkers delivered with and without
a motivational interview. Journal Of Studies On Alcohol 2004 Mar;65(2):200-3.
14. Neighbors C, Larimer ME, Lewis MA. Targeting misperceptions of descriptive drinking
norms: efficacy of a computer-delivered personalized normative feedback intervention.
Journal Of Consulting And Clinical Psychology 2004 Jun;72(3):434-47.
15. Neighbors C, Lewis MA, Bergstrom RL, Larimer ME. Being controlled by normative
influences: self-determination as a moderator of a normative feedback alcohol intervention.
Health Psychology: Official Journal Of The Division Of Health Psychology, American
Psychological Association 2006 Sep;25(5):571-9.
Meta-Analysis: Audit & Feedback
29
16. Neal DJ, Carey KB. Developing discrepancy within self-regulation theory: use of
personalized normative feedback and personal strivings with heavy-drinking college
students. Addictive Behaviors 2004 Feb;29(2):281-97.
17. Walters ST, Vader AM, Harris TR. A controlled trial of web-based feedback for heavy
drinking college students. Prevention Science: The Official Journal Of The Society For
Prevention Research 2007 Mar 29;8(1):83-8.
18. White HR, Morgan TJ, Pugh LA, Celinska K, Labouvie EW, Pandina RJ. Evaluating two
brief substance-use interventions for mandated college students. Journal Of Studies On
Alcohol 2006 Mar;67(2):309-17.
19. Wierinck E, Puttemans V, Swinnen S, van Steenberghe D. Effect of augmented visual
feedback from a virtual reality simulation system on manual dexterity training. European
Journal Of Dental Education: Official Journal Of The Association For Dental Education In
Europe 2005 Feb;9(1):10-6.
20. Wierinck E, Puttemans V, van Steenberghe D. Effect of tutorial input in addition to
augmented feedback on manual dexterity training and its retention. European Journal Of
Dental Education: Official Journal Of The Association For Dental Education In Europe
2006 Feb;10(1):24-31.
Feedback unrelated to healthcare
1. Butcher Z, Fairclough S, Stratton G, Richardson D. The effect of feedback and information
on children's pedometer step counts at school. Pediatr Exerc Sci 2007 Feb;19(1):29-38
2. Cave J, Washer P, Sampson P, Griffin M, Noble L. Explicitly linking teaching and
assessment of communication skills. Med Teach 2007 May;29(4):317-22.
3. Chiviacowsky S, Wulf G. Feedback after good trials enhances learning. Res Q Exerc Sport
2007 Mar;78(2):40-7.
4. Chen S, English T, Peng K. Self-verification and contextualized self-views. Personality And
Social Psychology Bulletin 2006 Jul;32(7):930-42.
5. Eklöf M, Hagberg M. Are simple feedback interventions involving workplace data associated
with better working environment and health? A cluster randomized controlled study among
Swedish VDU workers. Applied Ergonomics 2006 Mar 27;37(2):201-10.
6. Goodman JS, Wood RE. Feedback specificity, learning opportunities, and learning. The
Journal Of Applied Psychology 2004 Oct;89(5):809-21.
7. Goodman JS, Wood RE, Hendrickx M. Feedback specificity, exploration, and learning. The
Journal Of Applied Psychology 2004 Apr;89(2):248-62.
8. Krigolson O, Van Gyn G, Tremblay L, Heath M. Is there "feedback" during visual imagery?
Evidence from a specificity of practice paradigm. Canadian Journal Of Experimental
Psychology = Revue Canadienne De Psychologie Expérimentale 2006 Mar;60(1):24-32.
Meta-Analysis: Audit & Feedback
30
9. LaBrie JW, Hummer JF, Neighbors C, Pedersen ER. Live interactive group-specific
normative feedback reduces misperceptions and drinking in college students: a randomized
cluster trial. Psychol Addict Behav 2008 Mar;22(1):141-8.
10. Larimer ME, Lee CM, Kilmer JR, Fabiano PM, Stark CB, Geisner IM, et al. Personalized
mailed feedback for college drinking prevention: a randomized clinical trial. J Consult Clin
Psychol 2007 Apr;75(2):285-93.
11. Madan AK, Frantzides CT. Substituting virtual reality trainers for inanimate box trainers
does not decrease laparoscopic skills acquisition. JSLS 2007 Jan;11(1):87-9.
12. Semmler C, Brewer N, Wells GL. Effects of postidentification feedback on eyewitness
identification and nonidentification confidence. The Journal Of Applied Psychology 2004
Apr;89(2):334-46.
13. Silvera DH, Neilands T. Interpreting the uninterpretable: The effect of self-esteem on the
interpretation of meaningless feedback. Scandinavian Journal Of Psychology 2004
Feb;45(1):61-6.
14. te Velde AF, van der Kamp J, Barela JA, Savelsbergh GJP. Visual timing and adaptive
behavior in a road-crossing simulation study. Accident; Analysis And Prevention 2005 May
15;37(3):399-406.
15. White HR, Mun EY, Morgan TJ. Do brief personalized feedback interventions work for
mandated students or is it just getting caught that works? Psychol Addict Behav 2008
Mar;22(1):107-16.
16. White HR, Mun EY, Pugh L, Morgan TJ. Long-term effects of brief substance use
interventions for mandated college students: sleeper effects of an in-person personal
feedback intervention. Alcohol Clin Exp Res 2007 Aug;31(8):1380-91.
17. Yeung N, Holroyd CB, Cohen JD. ERP correlates of feedback and reward processing in the
presence and absence of response choice. Cerebral Cortex (New York, N Y : 1991) 2005
May 18;15(5):535-44.
Feedback unrelated to performance
1. Backstein D, Agnidis Z, Regehr G, Reznick R. The effectiveness of video feedback in the
acquisition of orthopedic technical skills. American Journal Of Surgery 2004 Mar;187(3):42732.
2. Eklöf M, Hagberg M, Toomingas A, Tornqvist EW. Feedback of workplace data to
individual workers, workgroups or supervisors as a way to stimulate working environment
activity: a cluster randomized controlled study. International Archives Of Occupational And
Environmental Health 2004 Oct 28;77(7):505-14.
3. Fletcher KE, Stern DT, White C, Gruppen LD, Oh MS, Cimmino VM. The physical
examination of patients with abdominal pain: the long-term effect of adding standardized
Meta-Analysis: Audit & Feedback
31
patients and small-group feedback to a lecture presentation. Teaching And Learning In
Medicine 2004;16(2):171-4.
4. Fu CHY, Vythelingum GN, Brammer MJ, Williams SCR, Amaro E, Jr., Andrew CM, et al.
An fMRI study of verbal self-monitoring: neural correlates of auditory verbal feedback.
Cerebral Cortex (New York, N Y : 1991) 2006 Jul 29;16(7):969-77.
5. Mahmood T, Darzi A. The learning curve for a colonoscopy simulator in the absence of any
feedback: no feedback, no learning. Surgical Endoscopy 2004 Aug 23;18(8):1224-30.
6. Van Sickle KR, Gallagher AG, Smith CD. The effect of escalating feedback on the
acquisition of psychomotor skills for laparoscopy. Surgical Endoscopy 2007 Feb 2;21(2):2204.
7. Wierinck E, Puttemans V, van Steenberghe D. Effect of reducing frequency of augmented
feedback on manual dexterity training and its retention. Journal Of Dentistry 2006 Oct
18;34(9):641-7.
8. Williams W, Purdy SC, Murray N, Dillon H, Lepage E, Challinor K, et al. Does the
presentation of audiometric test data have a positive effect on the perceptions of workplace
noise and noise exposure avoidance? Noise & Health 2004 Jul;6(24):75-84.
No true control group
1. Abella BS, Edelson DP, Kim S, Retzer E, Myklebust H, Barry AM, et al. CPR quality
improvement during in-hospital cardiac arrest using a real-time audiovisual feedback system.
Resuscitation 2007 Apr 26;73(1):54-61.
2. Beck CA, Richard H, Tu JV, Pilote L. Administrative Data Feedback for Effective Cardiac
Treatment: AFFECT, a cluster randomized trial. JAMA: The Journal Of The American
Medical Association 2005 Jul 20;294(3):309-17.
3. Herrin J, Cangialose CB, Nicewander D, Ballard DJ. Cost and effects of performance
feedback and nurse case management for medicare beneficiaries with diabetes: a randomized
controlled trial. Dis Manag 2007 Dec;10(6):328-36.
4. Madridejos-Mora R, mado-Guirado E, Pérez-Rodríguez MT. Effectiveness of the
combination of feedback and educational recommendations for improving drug prescription
in general practice. Medical Care 2004 Jul;42(7):643-8.
5. McClellan WM, Hodgin E, Pastan S, McAdams L, Soucie M. A randomized evaluation of
two health care quality improvement program (HCQIP) interventions to improve the
adequacy of hemodialysis care of ESRD patients: feedback alone versus intensive
intervention. Journal Of The American Society Of Nephrology: JASN 2004 Mar;15(3):75460.
Meta-Analysis: Audit & Feedback
32
6. Monti PM, Barnett NP, Colby SM, Gwaltney CJ, Spirito A, Rohsenow DJ, et al.
Motivational interviewing versus feedback only in emergency care for young adult problem
drinking. Addiction 2007 Aug;102(8):1234-43.
7. Naughton C, Feely J, Bennett K. A clustered randomized trial of the effects of feedback
using academic detailing compared to postal bulletin on prescribing of preventative
cardiovascular therapy. Fam Pract 2007 Oct;24(5):475-80.
8. Pit SW, Byles JE, Henry DA, Holt L, Hansen V, Bowman DA. A Quality Use of Medicines
program for general practitioners and older people: a cluster randomised controlled trial.
Med J Aust 2007 Jul 2;187(1):23-30.
9. Wadland WC, Holtrop JS, Weismantel D, Pathak PK, Fadel H, Powell J. Practice-based
referrals to a tobacco cessation quit line: assessing the impact of comparative feedback vs
general reminders. Annals Of Family Medicine 2007 Mar;5(2):135-42.
No feedback only condition
1. Bunting PS, Van Walraven C. Effect of a controlled feedback intervention on laboratory test
ordering by community physicians. Clinical Chemistry 2004 Feb 18;50(2):321-6.
2. Chossis I, Lane C, Gache P, Michaud PA, Pecoud A, Rollnick S, et al. Effect of training on
primary care residents' performance in brief alcohol intervention: a randomized controlled
trial. J Gen Intern Med 2007 Aug;22(8):1144-9.
3. Colon-Emeric CS, Lyles KW, House P, Levine DA, Schenck AP, Allison J, et al.
Randomized trial to improve fracture prevention in nursing home residents. Am J Med 2007
Oct;120(10):886-92.
4. Foster JM, Hoskins G, Smith B, Lee AJ, Price D, Pinnock H. Practice development plans to
improve the primary care management of acute asthma: randomised controlled trial. BMC
Fam Pract 2007;8:23.
5. Houston TK, Wall T, Allison JJ, Palonen K, Willett LL, Keife CI, et al. Implementing
achievable benchmarks in preventive health: a controlled trial in residency education.
Academic Medicine: Journal Of The Association Of American Medical Colleges 2006
Jul;81(7):608-16.
6. Johnston CC, Gagnon A, Rennick J, Rosmus C, Patenaude H, Ellis J, et al. One-on-one
coaching to improve pain assessment and management practices of pediatric nurses. J
Pediatr Nurs 2007 Dec;22(6):467-78.
7. Lafata JE, Gunter MJ, Hsu J, Kaatz S, Krajenta R, Platt R, et al. Academic detailing to
improve laboratory testing among outpatient medication users. Med Care 2007
Oct;45(10):966-72.
Meta-Analysis: Audit & Feedback
33
8. Pit SW, Byles JE, Henry DA, Holt L, Hansen V, Bowman DA. A Quality Use of Medicines
program for general practitioners and older people: a cluster randomised controlled trial.
Med J Aust 2007 Jul 2;187(1):23-30.
9. Shuval K, Berkovits E, Netzer D, Hekselman I, Linn S, Brezis M, et al. Evaluating the
impact of an evidence-based medicine educational intervention on primary care doctors'
attitudes, knowledge and clinical behaviour: a controlled trial and before and after study. J
Eval Clin Pract 2007 Aug;13(4):581-98.
10. Simunovic M, Goldsmith C, Thabane L, McLeod R, Denardi F, Whelan TJ, et al. The
Quality Initiative in Rectal Cancer (QIRC) trial: study protocol of a cluster randomized
controlled trial in surgery. BMC Surg 2008;8:4.
11. Stewart M, Brown JB, Hammerton J, Donner A, Gavin A, Holliday RL, et al. Improving
communication between doctors and breast cancer patients. Ann Fam Med 2007
Sep;5(5):387-94.
12. Thomas KG, Thomas MR, Stroebel RJ, McDonald FS, Hanson GJ, Naessens JM, et al. Use
of a registry-generated audit, feedback, and patient reminder intervention in an internal
medicine resident clinic--a randomized trial. J Gen Intern Med 2007 Dec;22(12):1740-4.
13. Wolthuis EK, Kesecioglu J, Hassink LH, Determann RM, Korevaar JC, Schultz MJ.
Adoption of lower tidal volume ventilation improves with feedback and education. Respir
Care 2007 Dec;52(12):1761-6.
Feedback is not the intervention
1. Okiishi JC, Lambert MJ, Eggett D, Nielsen L, Dayton DD, Vermeersch DA. An analysis of
therapist treatment effects: toward providing feedback to individual therapists on their
clients' psychotherapy outcome. Journal Of Clinical Psychology 2006 Sep;62(9):1157-72.
2. Schneider A, Wensing M, Biessecker K, Quinzler R, Kaufmann-Kolle P, Szecsenyi J. Impact
of quality circles for improvement of asthma care: results of a randomized controlled trial. J
Eval Clin Pract 2008 Apr;14(2):185-90.
No abstract
1. Martin WE, Miller SC, Welch LC, Burrill J. Improving access to hospice: the Physician
Feedback and Reminders to Improve Access to Hospice (PFRIAH) study. Med Health R I
2007 Dec;90(12):388-90.
Qualitative data only
1. Hartmann CW, Sciamanna CN, Blanch DC, Mui S, Lawless H, Manocchia M, et al. A
website to improve asthma care by suggesting patient questions for physicians: qualitative
analysis of user experiences. J Med Internet Res 2007;9(1):e3.
Meta-Analysis: Audit & Feedback
34
Studies Excluded After Initial Screening
No feedback only condition
1. Anderson FA, Jr., Wheeler HB, Goldberg RJ, Hosmer DW, Forcier A, Patwardhan NA.
Changing clinical practice. Prospective study of the impact of continuing medical education
and quality assurance programs on use of prophylaxis for venous thromboembolism.
Archives of Internal Medicine 154(6):669-77, 1994 Mar 28.
2. Bahrami M, Deery C, Clarkson JE, Pitts NB, Johnston M, Ricketts I, et al. Effectiveness of
strategies to disseminate and implement clinical guidelines for the management of impacted
and unerupted third molars in primary dental care, a cluster randomised controlled trial. Br
Dent J 2004 Dec 11;197(11):691-6.
3. Baker R, Fraser RC, Stone M, Lambert P, Stevenson K, Shiels C. Randomised controlled
trial of the impact of guidelines, prioritized review criteria and feedback on implementation
of recommendations for angina and asthma.[see comment][comment]. British Journal of
General Practice 53(489):284-91, 2003 Apr.
4. Belcher DW. Implementing preventive services. Success and failure in an outpatient trial.
Archives Of Internal Medicine 1990 Dec;150(12):2533-41.
5. Brady WJ, Hissa DC, McConnell M, Wones RG. Should physicians perform their own
quality assurance audits? Journal Of General Internal Medicine: Official Journal Of The
Society For Research And Education In Primary Care Internal Medicine 1988 Nov;3(6):5605.
6. Brown LF, Keily PA, Spencer AJ. Evaluation of a continuing education intervention
"Periodontics in General Practice". Community Dentistry And Oral Epidemiology 1994
Dec;22(6):441-7.
7. Buffington J, Bell KM, LaForce FM. A target-based model for increasing influenza
immunizations in private practice. Genesee Hospital Medical Staff. Journal Of General
Internal Medicine: Official Journal Of The Society For Research And Education In Primary
Care Internal Medicine 1991 May;6(3):204-9.
8. Buntinx F, Knottnerus JA, Crebolder HF, Essed GG. Reactions of doctors to various forms
of feedback designed to improve the sampling quality of cervical smears. Quality Assurance
In Health Care: The Official Journal Of The International Society For Quality Assurance In
Health Care / ISQA 1992 Jun;4(2):161-6.
9. Buntinx F, Knottnerus JA, Crebolder HF, Seegers T, Essed GG, Schouten H. Does
feedback improve the quality of cervical smears? A randomized controlled trial. The British
Journal Of General Practice: The Journal Of The Royal College Of General Practitioners
1993 May;43(370):194-8.
Meta-Analysis: Audit & Feedback
35
10. Chassin MR, McCue SM. A randomized trial of medical quality assurance. Improving
physicians' use of pelvimetry. JAMA: The Journal Of The American Medical Association
1986 Aug 22;256(8):1012-6.
11. Curtis JR, Olivieri J, Allison JJ, Gaffo A, Juarez L, Kovac SH, et al. A group randomized trial
to improve safe use of nonsteroidal anti-inflammatory drugs. Am J Manag Care 2005
Sep;11(9):537-43.
12. De Almeida Neto AC, Kavanagh DJ, Boakes RA. A pharmacy based protocol and training
program for non-prescription analgesics. Journal of Social and Administrative Pharmacy
2000 Feb 9;17(3):183-92.
13. Ferguson TB, Jr., Peterson ED, Coombs LP, Eiken MC, Carey ML, Grover FL, et al. Use of
continuous quality improvement to increase use of process measures in patients undergoing
coronary artery bypass graft surgery: a randomized controlled trial. JAMA 2003 Jul
2;290(1):49-56.
14. Finkelstein JA, Davis RL, Dowell SF, Metlay JP, Soumerai SB, Rifas-Shiman SL, et al.
Reducing antibiotic use in children: a randomized trial in 12 practices. Pediatrics 2001
Jul;108(1):1-7.
15. Foy R, Penney GC, Grimshaw JM, Ramsay CR, Walker AE, MacLennan G, et al. A
randomised controlled trial of a tailored multifaceted strategy to promote implementation of
a clinical guideline on induced abortion care. BJOG 2004 Jul;111(7):726-33.
16. Frijling BD, Lobo CM, Hulscher ME, Akkermans RP, Braspenning JC, Prins A, et al.
Multifaceted support to improve clinical decision making in diabetes care: a randomized
controlled trial in general practice. Diabet Med 2002 Oct;19(10):836-42.
17. Frijling BD, Lobo CM, Hulscher ME, Akkermans RP, van Drenth BB, Prins A, et al.
Intensive support to improve clinical decision making in cardiovascular care: a randomised
controlled trial in general practice. Qual Saf Health Care 2003 Jun;12(3):181-7.
18. Goff DC, Jr., Gu L, Cantley LK, Parker DG, Cohen SJ. Enhancing the quality of care for
patients with coronary heart disease: the design and baseline results of the hastening the
effective application of research through technology (HEART) trial. Am J Manag Care 2002
Dec;8(12):1069-78.
19. Goff DC, Jr., Gu L, Cantley LK, Sheedy DJ, Cohen SJ. Quality of care for secondary
prevention for patients with coronary heart disease: results of the Hastening the Effective
Application of Research through Technology (HEART) trial. Am Heart J 2003
Dec;146(6):1045-51.
20. Goff DC, Jr., Massing MW, Bertoni AG, Davis J, Ambrosius WT, McArdle J, et al.
Enhancing quality of heart failure care in managed Medicare and Medicaid in North
Carolina: results of the North Carolina Achieving Cardiac Excellence (NC ACE) Project.
Am Heart J 2005 Oct;150(4):717-24.
Meta-Analysis: Audit & Feedback
36
21. Grady KE, Lemkau JP, Lee NR, Caddell C. Enhancing mammography referral in primary
care. Prev Med 1997 Nov;26(6):791-800.
22. Gullion DS, Tschann JM, Adamson TE, Coates TJ. Management of hypertension in private
practice: A randomized controlled trial in continuing medical education. The Journal of
Continuing Education in the Health Professions 1988;8:239-55.
23. Hendryx MS, Fieselmann JF, Bock MJ, Wakefield DS, Helms CM, Bentler SE. Outreach
education to improve quality of rural ICU care. Results of a randomized trial. Am J Respir
Crit Care Med 1998 Aug;158(2):418-23.
24. Hillman AL, Ripley K, Goldfarb N, Nuamah I, Weiner J, Lusk E. Physician financial
incentives and feedback: failure to increase cancer screening in Medicaid managed care. Am J
Public Health 1998 Nov;88(11):1699-701.
25. Holm M. Intervention against long-term use of hypnotics/sedatives in general practice.
Scand J Prim Health Care 1990 Jul;8(2):113-7.
26. Horbar JD, Carpenter JH, Buzas J, Soll RF, Suresh G, Bracken MB, et al. Collaborative
quality improvement to promote evidence based surfactant for preterm infants: a cluster
randomised trial. BMJ 2004 Oct 30;329(7473):1004.
27. Hux JE, Melady MP, DeBoer D. Confidential prescriber feedback and education to improve
antibiotic use in primary care: a controlled trial. CMAJ 1999 Aug 24;161(4):388-92.
28. Joseph AM, Arikian NJ, An LC, Nugent SM, Sloan RJ, Pieper CF. Results of a randomized
controlled trial of intervention to implement smoking guidelines in Veterans Affairs medical
centers: increased use of medications without cessation benefit. Med Care 2004
Nov;42(11):1100-10.
29. Katz DA, Muehlenbruch DR, Brown RL, Fiore MC, Baker TB. Effectiveness of
implementing the agency for healthcare research and quality smoking cessation clinical
practice guideline: a randomized, controlled trial. J Natl Cancer Inst 2004 Apr 21;96(8):594603.
30. Kerry S, Oakeshott P, Dundas D, Williams J. Influence of postal distribution of the Royal
College of Radiologists' guidelines, together with feedback on radiological referral rates, on
X-ray referrals from general practice: a randomized controlled trial. Fam Pract 2000
Feb;17(1):46-52.
31. Kerse NM, Flicker L, Jolley D, Arroll B, Young D. Improving the health behaviours of
elderly people: randomised controlled trial of a general practice education programme. BMJ
1999 Sep 11;319(7211):683-7.
32. Kiefe CI, Allison JJ, Williams OD, Person SD, Weaver MT, Weissman NW. Improving
quality improvement using achievable benchmarks for physician feedback: a randomized
controlled trial. JAMA 2001 Jun 13;285(22):2871-9.
Meta-Analysis: Audit & Feedback
37
33. Kim CS, Kristopaitis RJ, Stone E, Pelter M, Sandhu M, Weingarten SR. Physician education
and report cards: do they make the grade? results from a randomized controlled trial. Am J
Med 1999 Dec;107(6):556-60.
34. Kinsinger LS, Harris R, Qaqish B, Strecher V, Kaluzny A. Using an office system
intervention to increase breast cancer screening. J Gen Intern Med 1998 Aug;13(8):507-14.
35. Lemelin J, Hogg W, Baskerville N. Evidence to action: a tailored multifaceted approach to
changing family physician practice patterns and improving preventive care. CMAJ 2001 Mar
20;164(6):757-63.
36. Leviton LC, Goldenberg RL, Baker CS, Schwartz RM, Freda MC, Fish LJ, et al. Methods to
encourage the use of antenatal corticosteroid therapy for fetal maturation: a randomized
controlled trial. JAMA 1999 Jan 6;281(1):46-52.
37. Linn BS. Continuing medical education. Impact on emergency room burn care. JAMA 1980
Aug 8;244(6):565-70.
38. Lomas J. Making clinical policy explicit. Legislative policy making and lessons for developing
practice guidelines. Int J Technol Assess Health Care 1993;9(1):11-25.
39. Manfredi C, Czaja R, Freels S, Trubitt M, Warnecke R, Lacey L. Prescribe for health.
Improving cancer screening in physician practices serving low-income and minority
populations. Arch Fam Med 1998 Jul;7(4):329-37.
40. Manheim LM, Feinglass J, Hughes R, Martin GJ, Conrad K, Hughes EF. Training house
officers to be cost conscious. Effects of an educational intervention on charges and length of
stay. Med Care 1990 Jan;28(1):29-42.
41. Mayer JA, Eckhardt L, Stepanski BM, Sallis JF, Elder JP, Slymen DJ, et al. Promoting skin
cancer prevention counseling by pharmacists. Am J Public Health 1998 Jul;88(7):1096-9.
42. McAlister NH, Covvey HD, Tong C, Lee A, Wigle ED. Randomised controlled trial of
computer assisted management of hypertension in primary care. British Medical Journal
(Clinical Research Ed) 1986 Sep 13;293(6548):670-4.
43. McCartney P, Macdowall W, Thorogood M. A randomised controlled trial of feedback to
general practitioners of their prophylactic aspirin prescribing. BMJ 1997 Jul 5;315(7099):356.
44. McCartney P, Macdowall W, Thorogood M. Feedback in primary care can improve the
prescribing of hormone replacement therapy in women with a history of hysterectomy.
British Journal of Clinical Governance 2001;6(1):17-21.
45. Pimlott NJ, Hux JE, Wilson LM, Kahan M, Li C, Rosser WW. Educating physicians to
reduce benzodiazepine use by elderly patients: a randomized controlled trial. CMAJ 2003
Apr 1;168(7):835-9.
Meta-Analysis: Audit & Feedback
38
46. Quinley JC, Shih A. Improving physician coverage of pneumococcal vaccine: a randomized
trial of a telephone intervention. J Community Health 2004 Apr;29(2):103-15.
47. Rantz MJ, Popejoy L, Petroski GF, Madsen RW, Mehr DR, Zwygart-Stauffacher M, et al.
Randomized clinical trial of a quality improvement intervention in nursing homes.
Gerontologist 2001 Aug;41(4):525-38.
48. Roski J. Changing practice patterns as a result of implementing the Agency for Health Care
Policy and Research guideline in 20 primary care clinics. Tob Control 1998;7 Suppl:S19-S20.
49. Sauaia A, Ralston D, Schluter WW, Marciniak TA, Havranek EP, Dunn TR. Influencing care
in acute myocardial infarction: a randomized trial comparing 2 types of intervention. Am J
Med Qual 2000 Sep;15(5):197-206.
50. Smith DK, Shaw RW, Slack J, Marteau TM. Training obstetricians and midwives to present
screening tests: evaluation of two brief interventions. Prenat Diagn 1995 Apr;15(4):317-24.
51. Solomon DH, Katz JN, La Tourette AM, Coblyn JS. Multifaceted intervention to improve
rheumatologists' management of glucocorticoid-induced osteoporosis: a randomized
controlled trial. Arthritis Rheum 2004 Jun 15;51(3):383-7.
52. Sondergaard J, Andersen M, Vach K, Kragstrup J, Maclure M, Gram LF. Detailed postal
feedback about prescribing to asthma patients combined with a guideline statement showed
no impact: a randomised controlled trial. Eur J Clin Pharmacol 2002 May;58(2):127-32.
53. Thompson RS, Rivara FP, Thompson DC, Barlow WE, Sugg NK, Maiuro RD, et al.
Identification and management of domestic violence: a randomized trial. Am J Prev Med
2000 Nov;19(4):253-63.
54. van den HP, Grol R, van den Hoogen HJ, van den Bosch WJ. Practice visits as a tool in
quality improvement: mutual visits and feedback by peers compared with visits and feedback
by non-physician observers. Qual Health Care 1999 Sep;8(3):161-6.
55. van der WT, Grol RP, Knottnerus JA. Feasibility of a national cholesterol guideline in daily
practice. A randomized controlled trial in 20 general practices. Int J Qual Health Care 1999
Apr;11(2):131-7.
56. Veninga CC, Denig P, Zwaagstra R, Haaijer-Ruskamp FM. Improving drug treatment in
general practice. J Clin Epidemiol 2000 Jul;53(7):762-72.
57. Verstappen WH, van der WT, Sijbrandij J, Smeele I, Hermsen J, Grimshaw J, et al. Effect of
a practice-based strategy on test ordering performance of primary care physicians: a
randomized trial. JAMA 2003 May 14;289(18):2407-12.
58. Vingerhoets E, Wensing M, Grol R. Feedback of patients' evaluations of general practice
care: a randomised trial. Qual Health Care 2001 Dec;10(4):224-8.
Meta-Analysis: Audit & Feedback
39
59. Vinicor F, Cohen SJ, Mazzuca SA, Moorman N, Wheeler M, Kuebler T, et al. DIABEDS: a
randomized trial of the effects of physician and/or patient education on diabetes patient
outcomes. Journal of Chronic Diseases 40(4):345-56, 1987.
60. Wells KB, Sherbourne C, Schoenbaum M, Duan N, Meredith L, Unutzer J, et al. Impact of
disseminating quality improvement programs for depression in managed primary care: a
randomized controlled trial. JAMA 2000 Jan 12;283(2):212-20.
61. Winickoff RN, Wilner S, Neisuler R, Barnett GO. Limitations of provider interventions in
hypertension quality assurance. Am J Public Health 1985 Jan;75(1):43-6.
62. Winkens RA, Pop P, Bugter-Maessen AM, Grol RP, Kester AD, Beusmans GH, et al.
Randomised controlled trial of routine individual feedback to improve rationality and reduce
numbers of test requests. Lancet 1995 Feb 25;345(8948):498-502.
63. Young JM, D'Este C, Ward JE. Improving family physicians' use of evidence-based smoking
cessation strategies: a cluster randomization trial. Prev Med 2002 Dec;35(6):572-83.
64. Young JM, Ward JE. Randomised trial of intensive academic detailing to promote
opportunistic recruitment of women to cervical screening by general practitioners. Aust N Z
J Public Health 2003;27(3):273-81.
65. Zwar N, Wolk J, Gordon J, Sanson-Fisher R, Kehoe L. Influencing antibiotic prescribing in
general practice: a trial of prescriber feedback and management guidelines. Fam Pract 1999
Oct;16(5):495-500.
No control group
1. Baker R, Farooqi A, Tait C, Walsh S. Randomised controlled trial of reminders to enhance
the impact of audit in general practice on management of patients who use benzodiazepines.
Quality In Health Care: QHC 1997 Mar;6(1):14-8.
2. Baker R, Falconer SJ, Lambert PC. Randomised controlled trial of the effectiveness of
feedback in improving test ordering in general practice. Scandinavian Journal of Primary
Health Care 21(4):219-23, 2003 Dec.
3. Baker R, Fraser RC, Stone M, Lambert P, Stevenson K, Shiels C. Randomised controlled
trial of the impact of guidelines, prioritized review criteria and feedback on implementation
of recommendations for angina and asthma.[see comment][comment]. British Journal of
General Practice 53(489):284-91, 2003 Apr.
4. Borgiel AE, Williams JI, Davis DA, Dunn EV, Hobbs N, Hutchison B, et al. Evaluating the
effectiveness of 2 educational interventions in family practice. CMAJ 1999 Oct
19;161(8):965-70.
5. Cohen DI, Jones P, Littenberg B, Neuhauser D. Does cost information availability reduce
physician test usage? A randomized clinical trial with unexpected findings. Medical Care
1982 Mar;20(3):286-92.
Meta-Analysis: Audit & Feedback
40
6. Fairbrother G, Hanson KL, Friedman S, Butts GC. The impact of physician bonuses,
enhanced fees, and feedback on childhood immunization coverage rates. Am J Public Health
1999 Feb;89(2):171-5.
7. Feder G, Griffiths C, Highton C, Eldridge S, Spence M, Southgate L. Do clinical guidelines
introduced with practice based education improve care of asthmatic and diabetic patients? A
randomised controlled trial in general practices in east London. BMJ (Clinical Research Ed)
1995 Dec 2;311(7018):1473-8.
8. Goff DC, Jr., Massing MW, Bertoni AG, Davis J, Ambrosius WT, McArdle J, et al.
Enhancing quality of heart failure care in managed Medicare and Medicaid in North
Carolina: results of the North Carolina Achieving Cardiac Excellence (NC ACE) Project.
Am Heart J 2005 Oct;150(4):717-24.
9. Guadagnoli E, Soumerai SB, Gurwitz JH, Borbas C, Shapiro CL, Weeks JC, et al. Improving
discussion of surgical treatment options for patients with breast cancer: local medical
opinion leaders versus audit and performance feedback. Breast Cancer Res Treat 2000
May;61(2):171-5.
10. Harvey PA, Murphy MC, Dornom E, Berlowitz DJ, Lim WK, Jackson B. Implementing
evidence-based guidelines:inpatient management of chronic obstructive pulmonary disease.
Intern Med J 2005 Mar;35(3):151-5.
11. Hayes R, Bratzler D, Armour B, Moore L, Murray C, Stevens BR, et al. Comparison of an
enhanced versus a written feedback model on the management of Medicare inpatients with
venous thrombosis. Joint Commission Journal on Quality Improvement 27(3):155-68, 2001
Mar.
12. Hendryx MS, Fieselmann JF, Bock MJ, Wakefield DS, Helms CM, Bentler SE. Outreach
education to improve quality of rural ICU care. Results of a randomized trial. Am J Respir
Crit Care Med 1998 Aug;158(2):418-23.
13. Hillman AL, Ripley K, Goldfarb N, Weiner J, Nuamah I, Lusk E. The use of physician
financial incentives and feedback to improve pediatric preventive care in Medicaid managed
care. Pediatrics 1999 Oct;104(4 Pt 1):931-5.
14. Kiefe CI, Allison JJ, Williams OD, Person SD, Weaver MT, Weissman NW. Improving
quality improvement using achievable benchmarks for physician feedback: a randomized
controlled trial. JAMA 2001 Jun 13;285(22):2871-9.
15. Lagerløv P, Loeb M, Andrew M, Hjortdahl P. Improving doctors' prescribing behaviour
through reflection on guidelines and prescription feedback: a randomised controlled study.
Quality In Health Care: QHC 2000 Sep;9(3):159-65.
16. Lomas J. Making clinical policy explicit. Legislative policy making and lessons for developing
practice guidelines. Int J Technol Assess Health Care 1993;9(1):11-25.
Meta-Analysis: Audit & Feedback
41
17. Moher M, Yudkin P, Wright L, Turner R, Fuller A, Schofield T, et al. Cluster randomised
controlled trial to compare three methods of promoting secondary prevention of coronary
heart disease in primary care. BMJ 2001 Jun 2;322(7298):1338.
18. Palmer RH, Louis TA, Hsu LN, Peterson HF, Rothrock JK, Strain R, et al. A randomized
controlled trial of quality assurance in sixteen ambulatory care practices. Med Care 1985
Jun;23(6):751-70.
19. Pimlott NJ, Hux JE, Wilson LM, Kahan M, Li C, Rosser WW. Educating physicians to
reduce benzodiazepine use by elderly patients: a randomized controlled trial. CMAJ 2003
Apr 1;168(7):835-9.
20. Sauaia A, Ralston D, Schluter WW, Marciniak TA, Havranek EP, Dunn TR. Influencing care
in acute myocardial infarction: a randomized trial comparing 2 types of intervention. Am J
Med Qual 2000 Sep;15(5):197-206.
21. Siriwardena AN, Rashid A, Johnson MR, Dewey ME. Cluster randomised controlled trial of
an educational outreach visit to improve influenza and pneumococcal immunisation rates in
primary care.[see comment][erratum appears in Br J Gen Pract 2002 Oct;52(483):855].
British Journal of General Practice 52(482):735-40, 2002 Sep.
22. Soumerai SB, McLaughlin TJ, Gurwitz JH, Guadagnoli E, Hauptman PJ, Borbas C, et al.
Effect of local medical opinion leaders on quality of care for acute myocardial infarction: a
randomized controlled trial. JAMA 1998 May 6;279(17):1358-63.
23. Tierney WM, Hui SL, McDonald CJ. Delayed feedback of physician performance versus
immediate reminders to perform preventive care. Effects on physician compliance. Med
Care 1986 Aug;24(8):659-66.
24. Thompson RS, Rivara FP, Thompson DC, Barlow WE, Sugg NK, Maiuro RD, et al.
Identification and management of domestic violence: a randomized trial. Am J Prev Med
2000 Nov;19(4):253-63.
25. Veninga CC, Denig P, Zwaagstra R, Haaijer-Ruskamp FM. Improving drug treatment in
general practice. J Clin Epidemiol 2000 Jul;53(7):762-72.
26. Verstappen WH, van der WT, Sijbrandij J, Smeele I, Hermsen J, Grimshaw J, et al. Effect of
a practice-based strategy on test ordering performance of primary care physicians: a
randomized trial. JAMA 2003 May 14;289(18):2407-12.
27. Vingerhoets E, Wensing M, Grol R. Feedback of patients' evaluations of general practice
care: a randomised trial. Qual Health Care 2001 Dec;10(4):224-8.
28. Winickoff RN, Wilner S, Neisuler R, Barnett GO. Limitations of provider interventions in
hypertension quality assurance. Am J Public Health 1985 Jan;75(1):43-6.
29. Winkens RA, Pop P, Bugter-Maessen AM, Grol RP, Kester AD, Beusmans GH, et al.
Randomised controlled trial of routine individual feedback to improve rationality and reduce
numbers of test requests. Lancet 1995 Feb 25;345(8948):498-502.
Meta-Analysis: Audit & Feedback
42
30. Young JM, D'Este C, Ward JE. Improving family physicians' use of evidence-based smoking
cessation strategies: a cluster randomization trial. Prev Med 2002 Dec;35(6):572-83.
31. Young JM, Ward JE. Randomised trial of intensive academic detailing to promote
opportunistic recruitment of women to cervical screening by general practitioners. Aust N Z
J Public Health 2003;27(3):273-81.
32. Zwar N, Wolk J, Gordon J, Sanson-Fisher R, Kehoe L. Influencing antibiotic prescribing in
general practice: a trial of prescriber feedback and management guidelines. Fam Pract 1999
Oct;16(5):495-500.
Insufficient information for calculating an effect size
1. Balas EA, Boren SA, Hicks LL, Chonko AM, Stephenson K. Effect of linking practice data
to published evidence. A randomized controlled trial of clinical direct reports. Med Care
1998 Jan;36(1):79-87.
2. Boekeloo BO, Becker DM, Levine DM, Belitsos PC, Pearson TA. Strategies for increasing
house staff management of cholesterol with inpatients. American Journal Of Preventive
Medicine 1990;6(2 Suppl):51-9.
3. Brodey BB, Cuffel B, McCulloch J, Tani S, Maruish M, Brodey I, et al. The acceptability and
effectiveness of patient-reported assessments and feedback in a managed behavioral
healthcare setting. The American Journal Of Managed Care 2005 Dec;11(12):774-80.
4. Buntinx F, Knottnerus JA, Crebolder HF, Essed GG. Reactions of doctors to various forms
of feedback designed to improve the sampling quality of cervical smears. Quality Assurance
In Health Care: The Official Journal Of The International Society For Quality Assurance In
Health Care / ISQA 1992 Jun;4(2):161-6.
5. Fairbrother G, Hanson KL, Friedman S, Butts GC. The impact of physician bonuses,
enhanced fees, and feedback on childhood immunization coverage rates. Am J Public Health
1999 Feb;89(2):171-5.
6. Fallowfield L, Jenkins V, Farewell V, Saul J, Duffy A, Eves R. Efficacy of a Cancer Research
UK communication skills training model for oncologists: a randomised controlled trial.
Lancet 2002 Feb 23;359(9307):650-6.
7. Gehlbach SH, Wilkinson WE, Hammond WE, Clapp NE, Finn AL, Taylor WJ, et al.
Improving drug prescribing in a primary care practice. Medical Care 1984 Mar;22(3):193-201.
8. Hemminki E, Teperi J, Tuominen K. Need for and influence of feedback from the Finnish
birth register to data providers. Quality Assurance In Health Care: The Official Journal Of
The International Society For Quality Assurance In Health Care / ISQA 1992 Jun;4(2):1339.
Meta-Analysis: Audit & Feedback
43
9. Jones HE, Cleave B, Zinman B, Szalai JP, Nichol HL, Hoffman BR. Efficacy of feedback
from quarterly laboratory comparison in maintaining quality of a hospital capillary blood
glucose monitoring program. Diabetes Care 1996 Feb;19(2):168-70.
10. Kafuko JM. Rational drug use in rural health units of Uganda: Effect of national standard
treatment guidelines on rational drug use. 1999.
11. Kattan M, Crain EF, Steinbach S, Visness CM, Walter M, Stout JW, et al. A randomized
clinical trial of clinician feedback to improve quality of care for inner-city children with
asthma. Pediatrics 2006 Jun;117(6):e1095-e1103.
12. Leviton LC, Goldenberg RL, Baker CS, Schwartz RM, Freda MC, Fish LJ, et al. Methods to
encourage the use of antenatal corticosteroid therapy for fetal maturation: a randomized
controlled trial. JAMA 1999 Jan 6;281(1):46-52.
13. Lobach DF. Electronically distributed, computer-generated, individualized feedback
enhances the use of a computerized practice guideline. Proceedings: A Conference Of The
American Medical Informatics Association / AMIA Annual Fall Symposium AMIA Fall
Symposium 1996;493-7.
14. Lomas J. Making clinical policy explicit. Legislative policy making and lessons for developing
practice guidelines. Int J Technol Assess Health Care 1993;9(1):11-25.
15. Meyer TJ, Van KD, Marsh S, Prochazka AV. Reduction of polypharmacy by feedback to
clinicians. J Gen Intern Med 1991 Mar;6(2):133-6.
16. Mitchell E, Sullivan F, Grimshaw JM, Donnan PT, Watt G. Improving management of
hypertension in general practice: a randomised controlled trial of feedback derived from
electronic patient data. The British Journal Of General Practice: The Journal Of The Royal
College Of General Practitioners 2005 Feb;55(511):94-101.
17. Nilsson G, Hjemdahl P, Hassler A, Vitols S, Wallen NH, Krakau I. Feedback on prescribing
rate combined with problem-oriented pharmacotherapy education as a model to improve
prescribing behaviour among general practitioners. Eur J Clin Pharmacol 2001
Jan;56(11):843-8.
18. O'Connell DL, Henry D, Tomlins R. Randomised controlled trial of effect of feedback on
general practitioners' prescribing in Australia. BMJ 1999 Feb 20;318(7182):507-11.
19. Quinley JC, Shih A. Improving physician coverage of pneumococcal vaccine: a randomized
trial of a telephone intervention. J Community Health 2004 Apr;29(2):103-15.
20. Roski J. Changing practice patterns as a result of implementing the Agency for Health Care
Policy and Research guideline in 20 primary care clinics. Tob Control 1998;7 Suppl:S19-S20.
21. Rust CT, Sisk FA, Kuo AR, Smith J, Miller R, Sullivan KM. Impact of resident feedback on
immunization outcomes. Arch Pediatr Adolesc Med 1999 Nov;153(11):1165-9.
Meta-Analysis: Audit & Feedback
44
22. Sanazaro PJ, Worth RM. Concurrent quality assurance in hospital care. Report of a study by
Private Initiative in PSRO. N Engl J Med 1978 May 25;298(21):1171-7.
23. Sandbaek A, Kragstrup J. Randomized controlled trial of the effect of medical audit on
AIDS prevention in general practice. Fam Pract 1999 Oct;16(5):510-4.
24. Sauaia A, Ralston D, Schluter WW, Marciniak TA, Havranek EP, Dunn TR. Influencing care
in acute myocardial infarction: a randomized trial comparing 2 types of intervention. Am J
Med Qual 2000 Sep;15(5):197-206.
25. Smith DH, Christensen DB, Stergachis A, Holmes G. A randomized controlled trial of a
drug use review intervention for sedative hypnotic medications. Med Care 1998
Jul;36(7):1013-21.
26. Solomon DH, Katz JN, La Tourette AM, Coblyn JS. Multifaceted intervention to improve
rheumatologists' management of glucocorticoid-induced osteoporosis: a randomized
controlled trial. Arthritis Rheum 2004 Jun 15;51(3):383-7.
27. Steele MA, Bess DT, Franse VL, Graber SE. Cost effectiveness of two interventions for
reducing outpatient prescribing costs. DICP 1989 Jun;23(6):497-500.
28. Thompson RS, Rivara FP, Thompson DC, Barlow WE, Sugg NK, Maiuro RD, et al.
Identification and management of domestic violence: a randomized trial. Am J Prev Med
2000 Nov;19(4):253-63.
29. Veninga CC, Lagerlov P, Wahlstrom R, Muskova M, Denig P, Berkhof J, et al. Evaluating an
educational intervention to improve the treatment of asthma in four European countries.
Drug Education Project Group. Am J Respir Crit Care Med 1999 Oct;160(4):1254-62.
Insufficient subjects per study arm
1. Anderson FA, Jr., Wheeler HB, Goldberg RJ, Hosmer DW, Forcier A, Patwardhan NA.
Changing clinical practice. Prospective study of the impact of continuing medical education
and quality assurance programs on use of prophylaxis for venous thromboembolism.
Archives of Internal Medicine 154(6):669-77, 1994 Mar 28.
2. Baker R, Farooqi A, Tait C, Walsh S. Randomised controlled trial of reminders to enhance
the impact of audit in general practice on management of patients who use benzodiazepines.
Quality In Health Care: QHC 1997 Mar;6(1):14-8.
3. Balas EA, Boren SA, Hicks LL, Chonko AM, Stephenson K. Effect of linking practice data
to published evidence. A randomized controlled trial of clinical direct reports. Med Care
1998 Jan;36(1):79-87.
4. Boekeloo BO, Becker DM, Levine DM, Belitsos PC, Pearson TA. Strategies for increasing
house staff management of cholesterol with inpatients. American Journal Of Preventive
Medicine 1990;6(2 Suppl):51-9.
Meta-Analysis: Audit & Feedback
45
5. Cohen DI, Jones P, Littenberg B, Neuhauser D. Does cost information availability reduce
physician test usage? A randomized clinical trial with unexpected findings. Medical Care
1982 Mar;20(3):286-92.
6. De Almeida Neto AC, Kavanagh DJ, Boakes RA. A pharmacy based protocol and training
program for non-prescription analgesics. Journal of Social and Administrative Pharmacy
2000 Feb 9;17(3):183-92.
7. Dickinson JC, Warshaw GA, Gehlbach SH, Bobula JA, Muhlbaier LH, Parkerson GR, Jr.
Improving hypertension control: impact of computer feedback and physician education.
Medical Care 1981 Aug;19(8):843-54.
8. Everett GD, deBlois CS, Chang PF, Holets T. Effect of cost education, cost audits, and
faculty chart review on the use of laboratory services. Archives Of Internal Medicine 1983
May;143(5):942-4.
9. Gama R, Nightingale PG, Broughton PM, Peters M, Bradby GV, Berg J, et al. Feedback of
laboratory usage and cost data to clinicians: does it alter requesting behaviour? Annals Of
Clinical Biochemistry 1991 Mar;28 ( Pt 2):143-9.
10. Hendryx MS, Fieselmann JF, Bock MJ, Wakefield DS, Helms CM, Bentler SE. Outreach
education to improve quality of rural ICU care. Results of a randomized trial. Am J Respir
Crit Care Med 1998 Aug;158(2):418-23.
11. Howe A. Detecting psychological distress: can general practitioners improve their own
performance? The British Journal Of General Practice: The Journal Of The Royal College
Of General Practitioners 1996 Jul;46(408):407-10.
12. Kafuko JM. Rational drug use in rural health units of Uganda: Effect of national standard
treatment guidelines on rational drug use. 1999.
13. Katz DA, Muehlenbruch DR, Brown RL, Fiore MC, Baker TB. Effectiveness of
implementing the agency for healthcare research and quality smoking cessation clinical
practice guideline: a randomized, controlled trial. J Natl Cancer Inst 2004 Apr 21;96(8):594603.
14. Lobach DF. Electronically distributed, computer-generated, individualized feedback
enhances the use of a computerized practice guideline. Proceedings: A Conference Of The
American Medical Informatics Association / AMIA Annual Fall Symposium AMIA Fall
Symposium 1996;493-7.
15. Lomas J. Making clinical policy explicit. Legislative policy making and lessons for developing
practice guidelines. Int J Technol Assess Health Care 1993;9(1):11-25.
16. Lundborg CS, Wahlstrom R, Oke T, Tomson G, Diwan VK. Influencing prescribing for
urinary tract infection and asthma in primary care in Sweden: a randomized controlled trial
of an interactive educational intervention. J Clin Epidemiol 1999 Aug;52(8):801-12.
Meta-Analysis: Audit & Feedback
46
17. Martin AR, Wolf MA, Thibodeau LA, Dzau V, Braunwald E. A trial of two strategies to
modify the test-ordering behavior of medical residents. N Engl J Med 1980 Dec
4;303(23):1330-6.
18. Mayefsky JH, Foye HR. Use of a chart audit: teaching well child care to paediatric house
officers. Med Educ 1993 Mar;27(2):170-4.
19. Norton PG, Dempsey LJ. Self-audit: its effect on quality of care. J Fam Pract 1985
Oct;21(4):289-91.
20. Palmer RH, Louis TA, Hsu LN, Peterson HF, Rothrock JK, Strain R, et al. A randomized
controlled trial of quality assurance in sixteen ambulatory care practices. Med Care 1985
Jun;23(6):751-70.
21. Reid RA, Lantz KH. Physician profiles in training the graduate internist. J Med Educ 1977
Apr;52(4):301-7.
22. Sauaia A, Ralston D, Schluter WW, Marciniak TA, Havranek EP, Dunn TR. Influencing care
in acute myocardial infarction: a randomized trial comparing 2 types of intervention. Am J
Med Qual 2000 Sep;15(5):197-206.
23. Sinclair C, Frankel M. The effect of quality assurance activities on the quality of mental
health services. QRB Quality Review Bulletin 1982 Jul;8(7):7-15.
24. Thompson RS, Rivara FP, Thompson DC, Barlow WE, Sugg NK, Maiuro RD, et al.
Identification and management of domestic violence: a randomized trial. Am J Prev Med
2000 Nov;19(4):253-63.
25. Winickoff RN, Coltin KL, Morgan MM, Buxbaum RC, Barnett GO. Improving physician
performance through peer comparison feedback. Med Care 1984 Jun;22(6):527-34.
26. Wones RG. Failure of low-cost audits with feedback to reduce laboratory test utilization.
Med Care 1987 Jan;25(1):78-82.
No measurable outcome
1. Lomas J. Making clinical policy explicit. Legislative policy making and lessons for developing
practice guidelines. Int J Technol Assess Health Care 1993;9(1):11-25.
2. Sauaia A, Ralston D, Schluter WW, Marciniak TA, Havranek EP, Dunn TR. Influencing care
in acute myocardial infarction: a randomized trial comparing 2 types of intervention. Am J
Med Qual 2000 Sep;15(5):197-206.
3. Simon GE, VonKorff M, Rutter C, Wagner E. Randomised trial of monitoring, feedback,
and management of care by telephone to improve treatment of depression in primary care.
BMJ 2000 Feb 26;320(7234):550-4.
Meta-Analysis: Audit & Feedback
47
4. Sondergaard J, Andersen M, Stovring H, Kragstrup J. Mailed prescriber feedback in addition
to a clinical guideline has no impact: a randomised, controlled trial. Scand J Prim Health
Care 2003 Mar;21(1):47-51.
5. Thompson RS, Rivara FP, Thompson DC, Barlow WE, Sugg NK, Maiuro RD, et al.
Identification and management of domestic violence: a randomized trial. Am J Prev Med
2000 Nov;19(4):253-63.
Articles Included in the Meta-Analysis
1. Anderson JF, McEwan KL, Hrudey WP. Effectiveness of notification and group education
in modifying prescribing of regulated analgesics. CMAJ 1996 Jan 1;154(1):31-9.
2. Bentz CJ, Bayley KB, Bonin KE, Fleming L, Hollis JF, Hunt JS, et al. Provider feedback to
improve 5A's tobacco cessation in primary care: a cluster randomized clinical trial. Nicotine
& Tobacco Research: Official Journal Of The Society For Research On Nicotine And
Tobacco 2007 Mar;9(3):341-9.
3. Berman MF, Simon AE. The effect of a drug and supply cost feedback system on the use of
intraoperative resources by anesthesiologists. Anesth Analg 1998 Mar;86(3):510-5.
4. Bonevski B, Sanson-Fisher RW, Campbell E, Carruthers A, Reid AL, Ireland M.
Randomized controlled trial of a computer strategy to increase general practitioner
preventive care. Prev Med 1999 Dec;29(6 Pt 1):478-86.
5. Eccles M, Steen N, Grimshaw J, Thomas L, McNamee P, Soutter J, et al. Effect of audit and
feedback, and reminder messages on primary-care radiology referrals: a randomised trial.
Lancet 2001 May 5;357(9266):1406-9.
6. Everett GD, deBlois CS, Chang PF, Holets T. Effect of cost education, cost audits, and
faculty chart review on the use of laboratory services. Archives Of Internal Medicine 1983
May;143(5):942-4.
7. Fihn SD, McDonell MB, Diehr P, Anderson SM, Bradley KA, Au DH, et al. Effects of
sustained audit/feedback on self-reported health status of primary care patients. The
American Journal Of Medicine 2004 Feb 15;116(4):241-8.
8. Heller RF, D'Este C, Lim LL, O'Connell RL, Powell H. Randomised controlled trial to
change the hospital management of unstable angina. The Medical Journal Of Australia 2001
Mar 5;174(5):217-21.
9. Hershey CO, Porter DK, Breslau D, Cohen DI. Influence of simple computerized feedback
on prescription charges in an ambulatory clinic. A randomized clinical trial. Med Care 1986
Jun;24(6):472-81.
10. Kogan JR, Reynolds EE, Shea JA. Effectiveness of report cards based on chart audits of
residents' adherence to practice guidelines on practice performance: a randomized controlled
trial. Teach Learn Med 2003;15(1):25-30.
Meta-Analysis: Audit & Feedback
48
11. Lomas J, Enkin M, Anderson GM, Hannah WJ, Vayda E, Singer J. Opinion leaders vs audit
and feedback to implement practice guidelines. Delivery after previous cesarean section.
JAMA 1991 May 1;265(17):2202-7.
12. Mainous AG, III, Hueston WJ, Love MM, Evans ME, Finger R. An evaluation of statewide
strategies to reduce antibiotic overuse. Fam Med 2000 Jan;32(1):22-9.
13. Marton KI, Tul V, Sox HC, Jr. Modifying test-ordering behavior in the outpatient medical
clinic. A controlled trial of two educational interventions. Arch Intern Med 1985
May;145(5):816-21.
14. Meyer TJ, Van KD, Marsh S, Prochazka AV. Reduction of polypharmacy by feedback to
clinicians. J Gen Intern Med 1991 Mar;6(2):133-6.
15. Raasch BA, Hays R, Buettner PG. An educational intervention to improve diagnosis and
management of suspicious skin lesions. J Contin Educ Health Prof 2000;20(1):39-51.
16. Robling MR, Houston HL, Kinnersley P, Hourihan MD, Cohen DR, Hale J, et al. General
practitioners' use of magnetic resonance imaging: an open randomized trial comparing
telephone and written requests and an open randomized controlled trial of different methods
of local guideline dissemination. Clin Radiol 2002 May;57(5):402-7.
17. Schectman JM, Kanwal NK, Schroth WS, Elinsky EG. The effect of an education and
feedback intervention on group-model and network-model health maintenance organization
physician prescribing behavior. Med Care 1995 Feb;33(2):139-44.
18. Socolar RR, Raines B, Chen-Mok M, Runyan DK, Green C, Paterno S. Intervention to
improve physician documentation and knowledge of child sexual abuse: a randomized,
controlled trial. Pediatrics 1998 May;101(5):817-24.
19. Sommers LS, Sholtz R, Shepherd RM, Starkweather DB. Physician involvement in quality
assurance. Med Care 1984 Dec;22(12):1115-38.
20. Wahlstrom R, Kounnavong S, Sisounthone B, Phanyanouvong A, Southammavong T,
Eriksson B, et al. Effectiveness of feedback for improving case management of malaria,
diarrhoea and pneumonia--a randomized controlled trial at provincial hospitals in Lao PDR.
Trop Med Int Health 2003 Oct;8(10):901-9.