University of Colorado Denver
Program Review
Self Study Preparation --- School of Medicine
The foundation of each program review is an analytical and evaluative self study
document, which is prepared by the department under review with the active
involvement of faculty and staff.
The main objectives of the self-study are to encourage departments to assess
their strengths, weaknesses, overall direction and goals and to determine present and
future needs with respect to personnel, programs and resources. The self-study should
cover every aspect of the department, including teaching, research, clinical work and
university and community service. The self-study should address all levels and types of
education --- for example, undergraduate, graduate, professional, online and continuing.
Additionally, the self-study should cover: the department’s resources and resource
needs; the depth, breadth, stability and diversity of the faculty; and the strengths or
weaknesses of departmental faculty development and mentoring programs.
Please use the following guide as your prepare your self-study. We ask that you
complete each section (or label the section “Not Applicable”). Include teaching
evaluations, faculty bio-sketches or other supporting materials as appendices.
Additionally, centers and institutes that are part of the department under review must
also be addressed in the self-study. The department is responsible for providing an
electronic copy to the SOM Dean’s Office and to the UCD Office of Academic Resources
and Services (OARS), plus a sufficient number of printed copies to be distributed to the
provost’s office, the dean, the AVC–OARS, the External Review Team and Program
Review Panel liaison.
Please note that: (1) The self-study process should involve all faculty members in
the department; and (2) Each section of the self-study should include evaluative, as well
as descriptive, information.
If you have questions or need additional information, please contact one of the
Program Review Liaisons from the SOM: Steven Lowenstein, M.D., M.P.H. (at
steven.lowenstein@ucdenver.edu) or Brenda Bucklin, M.D. (at
Brenda.bucklin@ucdenver.edu). The Office of Institutional Research and the budget
office may provide additional assistance in collecting basic information.
1) Introduction, overview and description
a) General department description – organization, purpose, programs
i) Provide an overview of the department’s outstanding characteristics, role
and mission within the university, programs offered, personnel, national
reputation, financial status, and success or placement of graduates.
ii) Include a general description of the department (size, structure, sites of
practice); note any major changes in size, organization or leadership since
the last departmental review.
iii) Faculty data (Please complete Tables 1 and 2).
iv) Comparative data from similar national programs (if available and
meaningful).
b) General description of the self-study process
i) Describe how you conducted your self-study
ii) State how faculty input was obtained and incorporated into the self-study
2) Mission, Vision, Values and Strategic Plan
a) Provide the department’s current mission statement, vision and strategic plan (or
reference the strategic plan).
b) How is the strategic vision consistent with the current UC Denver Strategic Plan?
c) To what extent are stated program goals and objectives being met, and what
evidence is provided for these achievements?
3) Progress since last review
a) Describe the department’s progress since the last program review.
b) Describe implementation and outcomes of previous program review
recommendations.
4) Educational programs and the educational experience
a) Describe the educational activities of the department, including undergraduate
and graduate student, residents and fellowship training. Include a description of
major Continuing Medical education (CME), online or distance learning
programs. Limit discussion to major courses, training programs and other
educational activities in which faculty of the department are leaders or play active
roles.
b) Describe areas of special expertise; note courses or training programs that are
particularly strong. Also highlight any new education programs developed since
the last departmental review (for example: innovative courses or curricula; new
evaluation tools; novel teaching methods).
c) Provide trend data, if appropriate (numbers of courses taught, students, residents
or fellows enrolled).
d) Comment on the curriculum or training programs with respect to rigor, relevance
and consistency with national or other professional standards.
i) Are the courses or educational experiences adequate in depth and breadth
for students, residents and other learners? Discuss any gaps or weaknesses.
ii) Are the knowledge and skill goals for students, residents and other learners
well-defined? Have these goals changed since the last departmental review?
Are educational goals communicated clearly and effectively to students,
residents and other learners?
2
iii) How is the rigor of the curriculum assessed? Are the learning goals referred
to above being met?
iv) How is student and resident learning measured?
v) Are faculty members available to properly supervise trainees, and are faculty
members available to students and residents for advising and counseling?
e) Analyze student/resident/fellow learning outcomes.
i) Summarize the results of teaching evaluations (for medical students,
residents, fellows or graduate students, as applicable).
(a) Include (as an appendix) faculty teaching evaluations for the past two
years.
ii) How have the results obtained from measuring learning outcomes been used
to revise and strengthen the program(s)?
f) With respect to graduate training programs:
i) How effective is your department in recruiting top residents or graduate
student?
ii) Summarize the success of graduates on recent board examinations.
iii) Summarize the results (including any deficiencies) of recent accreditation,
GME or Residency Review Committee reports.
iv) How well are graduates in each program finding employment or being
accepted into graduate programs in their field of study?
g) Describe the department’s other major accomplishments in education over the
past five years. Highlight:
(1) Education training for faculty;
(2) Inter-disciplinary collaborations in education (within or external to the
SOM);
(3) Local or national awards or recognition.
(4) Recruitment of faculty with special interests or talents in education
h) State how the department has addressed the specific challenges and
recommendations brought up during the last review.
i)
Resources
i) Assess the adequacy of key resources to support teaching. Consider faculty
breadth and depth, space, support staff, equipment, operating funds, and
library or computing resources.
j) Weaknesses and Challenges
i) List courses or training programs that need revision or improvement.
ii) Describe your department’s major faculty recruitment needs (with respect to
education).
iii) Summarize any other challenges, problems, gaps or deficiencies in your
department’s overall teaching program.
k) Plans
i) Describe the department’s specific plans to strengthen its educational
programs. Refer to the challenges, weaknesses, gaps and deficiencies listed
above. Outline plans for program improvement:
(1) Focusing on the short-term (1-2 years); and
(2) Long-term (the next 3-5 years)
5) RESEARCH AND CREATIVE WORK
3
a) Describe the funded research activities of the department. Highlight unique
aspects of the research programs, including areas of special focus and expertise.
b) Use Table 3 to summarize grant funding over the past 5 years for all faculty with
primary appointments in your department.
c) List the department's major accomplishments in research, scholarship and
creative work over the past five years. Highlight:
(1) New research program developed since the last departmental review;
(2) Grant funding – emphasize trends since last review;
(3) Other noteworthy achievements, such as discoveries, publications,
awards and national or international acclaim;
(4) Areas of inter-disciplinary research collaboration, both within and external
to the School of Medicine and University;
(5) Recruitment of faculty with strong research portfolios or unique talents;
d) State how the division has addressed the specific challenges and
recommendations brought up during the last review.
e) Resources
i) Assess the adequacy of key resources to support research. Consider faculty
breadth and depth, space, support staff, grant-writing assistance, equipment
(including common facilities), operating funds, and library or computing
resources.
ii) Discuss support (for example, grant-writing assistance, research support,
training, start-up funds) available to junior faculty to help them build their
research programs.
f)
Weaknesses and Challenges
i) Describe major gaps or deficiencies in the department’s research programs.
ii) Describe your department’s major faculty recruitment needs (with respect to
research).
iii) With respect to the research development of junior faculty, what
improvements and resources are needed?
iv) Summarize any other problems, gaps or deficiencies in the department’s
research programs.
g) Plans
i) Describe the department’s specific plans to strengthen its research programs.
Refer to the challenges, weaknesses, gaps and deficiencies listed above.
Outline plans for program improvement:
(1) Focusing on the short-term (1-2 years); and
(2) Long-term (the next 3-5 years).
6) CLINICAL PROGRAMS
a) Describe the clinical activities of the department. Include data regarding the size
of the clinical practice and different sites of practice. List the major clinical
programs and areas of expertise.
b) Summarize the growth in clinical activities since the last departmental review.
List achievements, such as innovative programs, discoveries, referrals, improved
outcomes, awards, or regional or national acclaim.
4
c) Describe trends in clinical activity since last departmental review. Include
quantitative data (e.g., census or enrollment data, contracts, referrals, patient
satisfaction, clinical income).
d) Highlight faculty with special training, unique expertise or regional or national
acclaim.
e) List areas of inter-disciplinary clinical collaboration, both within and external to
the School of Medicine and University.
f)
State how the department has addressed the specific challenges and
recommendations brought up during the last review.
g) Resources
i) Assess the adequacy of key resources to support clinical programs.
Consider resources such as faculty breadth and depth, space, support staff,
equipment and facilities, hospital support and other resources.
h) Weaknesses and challenges
i) Describe your department’s major faculty recruitment needs (with respect to
clinical service).
ii) Summarize any other problems, gaps or deficiencies in clinical programs
i)
Plans
i) Describe the department’s specific plans to strengthen its clinical programs.
Refer to the challenges, weaknesses, gaps and deficiencies listed above.
Outline plans for program improvement:
(1) Focusing on the short-term (1-2 years); and
(2) Long-term (the next 3-5 years)
7) DIVERSITY AND COMMUNITY SERVICE
a) Provide data, if available, regarding the gender and ethnic diversity of the faculty.
b) Provide data, if available, regarding the gender and ethnic diversity of graduate
trainees.
c) Highlight special achievements of the department or faculty in outreach or
community service.
d) Describe efforts the department has made to recruit and retain women and
under-represented minorities. State whether, and how, the department is
complying with campus policies governing faculty searches and diversity,
including diversity training for search committee members.
e) To what extent are issues related to diversity and health disparities addressed in
courses in the curriculum?
8) RESOURCES AND FINANCES
a) List the various sources of financial support for the department. Provide a pie
chart showing percentages of revenues from clinical earnings, research grants,
contracts, state funds and other sources.
b) Provide a summary of the department’s revenues and expenses over the past 5
years.
i) Explain any favorable or unfavorable trends;
ii) Describe key financial challenges;
5
iii) Outline the department’s plans to maintain or improve its financial strength.
c) Provide a summary of average salaries (by rank) in the department. Assess
whether salaries in the department are competitive when compared with AAMC
averages or other benchmarks.
d) How adequate are the program’s resources – physical, financial and other
resources?
e) How adequate are the support resources (e.g., professional and support staff,
library, media, operating expenses, space, technology) to achieve the goals of
the program?
9) DEPARTMENTAL GOVERNANCE AND ADMINISTRATION
a) Describe the governance structure of the department (vice-chairs, division or
program heads, executive committees, other decision-making bodies).
b) How frequently does the department meet? For what purposes?
c) State how faculty members and staff are involved in fiscal, personnel and
academic decisions.
d) Does the department have sufficient numbers of administrative staff to support its
educational, research and service missions?
10) FACULTY DEVELOPMENT
a) Describe the department’s system of mentoring for junior faculty. What programs
exist for professional and career development of faculty?
b) Do all faculty receive regular performance feedback from the department chair
(or division head)? Do all faculty members participate in annual reviews? Are
Professional Plans revised annually?
c) Do all Assistant Professors receive a comprehensive mid-course (year 3-4)
review? Who performs these reviews?
d) Identify barriers to academic success, especially for junior faculty.
e) Describe any problems with faculty retention over the past five years.
11) SUMMARY (Address each of the following)
a) Summarize your department’s development and progress since the last
departmental review. Briefly summarize the department’s strengths, weaknesses
and challenges.
b) Summarize important trends and key emerging opportunities.
c) How would you rank your department (compared with departments in other U.S.
medical schools)?
d) Recommendations for Program Improvement
i) What improvements should faculty, professional staff and administrators
undertake to enhance the academic and service programs of the
department?
ii) What steps are most critical to take your department to the next higher level?
e) Please list specific questions or issues that you would like the external reviewers
to address during their visit.
f) Please include a final paragraph (or two) describing the department’s vision for
the future.
6
Table I: DATA SUMMARY
Department of: _______________________
Date: ___________
I. Number of regular faculty (excluding PRA’s) with primary appointments ( > .50 FTE):
Based primarily at: University: ____
NJH:
____
DHMC:
____
VAMC:
____
TCH:
____
TOTAL: ______
II. Classified or unclassified/exempt administrative (FTE):
III. Research Associates and PRA’s (FTE):
_______
IV. Clinical Faculty (volunteer or paid <.5 FTE)
V. Income during most recent fiscal year:
State support:
Grants/Contracts
UPI
Gifts
Other
_______
________
Total $________
Fiscal Year _______
$ ________
________
________
________
________
7
Table II: Faculty Summary
Notes:
Include data for all faculty who have primary appointments in your department, whether
funded by the University of Colorado or by affiliated institutions. Do not include residents
or fellows.
Number of Faculty
FT1 CL2
Rank
Professor
Associate Professor
Assistant Professor
Instructor3
Research Professor
Assoc Research Profess
Assist Research Profess
Research Instructor4
Research Associates5
TOTAL
1.
2.
3.
4.
Total
Tenured
FT = Full-time; include faculty who are at or above .5 FTE
CL = Volunteer and paid (<.50 FTE) clinical faculty
Include Instructors and Senior Instructors
Include Research Instructors and Senior Research Instructors
5. Include Professional Research Associates (PRA’s), Senior PRA’s, Research Associates and
Senior Research Associates
8
Table III. Grants
Notes:
1. List grants obtained in the past 5 years by each faculty member who has a primary
appointment in your department.
2. Include all sources of research funding.
3. Organize table by faculty rank; within each rank, organize by faculty member
(alphabetical order) and grant start date.
INVESTIGATOR
P.I. or Coinvestigator1
Agency and Project Title
PI
NIH/R01 Host cell protease and HIVGP160 in AIDS
% salary
support2
Start
date
End
date
$ Direct
$ Indi
.15
04/99
03/02
139,148
70,965
EXAMPLE
Smith
1. Use the following codes for grants:
 PI = Principal Investigator
 CO-Inv = Co-investigator on grant to this department
 CO-Inv-O = Co-investigator on grant to another department
 CO-Inv-C = Co-investigator on grant to a Center
2. Average % salary support over term of grant
9