Assessment Plan & Report AY13-14 (A Focus on AY12-13 Graduates)

advertisement
Assessment Plan & Report AY13-14
(A Focus on AY12-13 Graduates)
PART I. PROGRAM DETAILS
School/Unit ☐: Dentistry ☐ Nursing  Medicine ☐Pharmacy
Provost Office: ☐ Physician Assistant ☐ Graduate Programs in Nutrition ☐ Radiation Therapy
Academic Major: __________________________________________________
Authorized Award(s) (Include all degree/certificates for this major): Doctor of Philosophy
Is this a joint degree program? ☐ Yes 
No
If yes, what is the partnering institution? __________________
Program website address:
http://www.ohsu.edu/xd/education/schools/school-of-medicine/academic-programs/graduate-studies/degreeprograms.cfm
Number of graded credit hours: Minimum 135
Program Chair/Director: ___________________________________________
PART 2. PROGRAM PURPOSE STATEMENT
Clearly and concisely states program purpose from perspective student point of view.
The purposes of the School of Medicine Doctor of Philosophy (PhD) programs are to educate students in
biomedical, engineering, population and informatics sciences, train them to think critically and independently, and
teach them how to design and conduct independent research. Our students are dedicated to undertaking careers as
independent scientists, dedicated teachers and imaginative leaders and scholars in academia, government and
industry. Graduates of the School of Medicine PhD programs are capable of independent thought and research and
hold the knowledge, skills, and personal qualities to advance basic and applied aspects within their specialty area.
PART 3. STUDENT LEARNING OUTCOME (SLO) STATEMENTS
At the end of the OHSU School of Medicine PhD programs, the graduate will be able to:
1. Demonstrate a basic knowledge of central concepts in the relevant scientific field;
2. Demonstrate advanced knowledge in one specialized area;
3. Advance knowledge in selected area of concentration;
4. Formulate hypothesis based on current concepts in the field;
5. Design, conduct, and interpret their own research;
6. Demonstrate doctoral-level competence in written and verbal communication;
7. Interpret and critique scientific literature;
8. Apply fundamental knowledge of ethics in research; and
9. Develop ancillary skills, where necessary, for career development.
The above SLOs map to the OHSU Core Competencies in the following manner:
 Professional Knowledge and Skills (SLO 1, 2 & 3)
 Reasoning and Judgment (SLO 4, 5, & 8)
 Evidence-based Practice and Research (SLO 7)
 Lifelong Learning (SLO 3, 4, & 7)
 Communication (SLO 6 & 9)
 Professionalism & Ethics (SLO 8 & 9)
 Inter-professional Teamwork (SLO 8 & 9)
 Safety & Quality Improvement (SLO 1, 4 & 5)

Systems (SLO 8 & 9)
PART 4. STUDENT LEARNING OUTCOMES ASSESSMENT
Ethics & Professionalism (DIRECT):
All graduate students are required to complete at least one course in ethics and professional conduct successfully.
In addition, all students must be in full certification compliance, as necessary, throughout their time in the
program, specifically while working in research settings or with protected health information Compliance
certificates , appropriate for the student’s program and available via the OHSU Big Brain modules (e.g., laboratory
safety, Responsible Conduct of Research involving animal or human subjects, or involving recombinant DNA or
infectious or biological agents, HIPAA privacy) are required.
Student assessments focus on their ability to recognize ethical issues and act in accordance with ethical standards
of conduct in the design, implementation, analysis, and dissemination of scientific research. Students are assessed
on these areas based on behavior in and out of the research environment. . Examples of expectations include
experimental data are not manipulated, laboratory notebooks reflect the results that were obtained, verification of
experimental results by replication of experiments or rigorous examination, proper allocation of credit work done
by others, professional behavior at conferences and other settings, and respecting the rights of study participants
and fellow lab workers.
Ethics and professionalism issues are to be individually discussed with students and evaluated at regular intervals.
Prior to a student being advanced to candidacy, these discussions and evaluations are between Program Directors
(or designee) and the student. After a student has been advanced to candidacy, ethics and professionalism issues
are discussed during Thesis Advisory Committee (Thesis/Dissertation Advisory Committee) meetings where
assessment of students’ understanding of ethical issues is based on class/session attendance, participation in
class/session discussions, and completion of various projects/reports throughout courses and the conduct of
research. Additionally, any situations that dictate immediate action by programs due to ethical or professional
conduct violations will be addressed swiftly and appropriately.
SLOS: 1, 3, 4, 5 6, & 8
Journal Club or Equivalent (DIRECT):
Students participate in journal club course or equivalent where they are expected to orally present an article
critique as well as be active listeners and participants in sessions where their peers present articles. Students are
to select an article that represents an important advance in thinking about a specified topic.. Students are to place
the article in the context of the larger body of literature in the field and specialized techniques explained in a
succinct fashion that an intelligent scientist understands. Presentations highlight the important findings and the
conclusions the authors draw while considering whether the data are of sufficient quality and support the authors'
conclusions. Students discuss what questions the paper raises and future directions of research. The specific
format and expectations of the various journal clubs vary; however, the above reflects the core expectations.
SLOs: 1, 2, 6, & 7
Core Knowledge (DIRECT):
Students must successfully complete a core curriculum, with a 3.0+ GPA, comprised of basic core principles
appropriate for their program. The core program(s) sets the curriculum for each of these areas and assessment
measures are embedded within those courses. Qualifying exams that include testing core knowledge, occur after a
major portion of the required coursework is completed, generally after the first two years of study is complete.
SLOs: 1, 3, 4, 5, & 6
Formative Assessment and Mentorship via Thesis Advisory Committee (Thesis/Dissertation
Advisory Committee) (DIRECT):
The progress of each student in the program is under the direction of a supervising profession and the
Thesis/Dissertation Advisory Committee who represent the School of Medicine Graduate Program. The
2
Thesis/Dissertation Advisory Committee is responsible for the students’ progress and approves the program of
courses and the area of research a student will pursue. Assessment of the student’s ongoing research is conducted
by the Thesis/Dissertation Advisory Committee and includes formative assessment and feedback regarding the
students research capabilities. The Thesis/Dissertation Advisory Committee shall be appointed by the Program
Director to guide and advise the student in the thesis/dissertation research and preparation of the
thesis/dissertation document. The Thesis/Dissertation Advisory Committee shall be appointed within one year
after advancement to Ph.D. candidacy or upon commencement of the thesis or dissertation research, whichever is
earlier. The Associate Dean for Graduate Studies must approve the appointment of each Advisory Committee based
upon the recommendation of the Program Director. The committee shall consist of no fewer than four members of
the Graduate Faculty for a Ph.D. dissertation committee.
SLOs: 1-9
Scientific Conferences (DIRECT):
All students are required to present research findings during an open scientific conference. Conferences can range
from the OHSU Research Week to state, regional, national, or international meetings. Students succinctly and
appropriately present research findings to advance knowledge in the field using doctoral-level communication
(oral and/or written) skills demonstrating their ability to interpret and critique relevant literature, design and
implement research studies, and apply knowledge of ethical issues in research . Scientific conferences are
opportunities for students to develop ancillary skills to obtain positions outside scientific research. Ancillary skill
development may be recommended by the Thesis/Dissertation Advisory Committee and will be highly
individualized.
SLOs: 2-9
Completion of Student Research (DIRECT):
Students in the PhD program will be able to analyze, plan, organize, and conduct original research with minimal
direction from a supervisor. Research areas will be determined by the research mentor with whom the student
chooses to work. Assessment of the student’s ongoing research will be conducted by the Thesis/Dissertation
Advisory Committee. Research capabilities will also be assessed through the students Qualifying Core Knowledge
Assessment and dissertation reviews.
SLOs: 1-8
Dissertation Defense (DIRECT):
The doctoral dissertation defense, required of all Ph.D. candidates, should be based on a logical program of
research designed to answer fundamental questions in some field of biomedical or other relevant science must
show evidence of originality on the part of the candidate in the planning and execution of independent
experimental work. Doctoral candidates must be the primary contributor to the design of the experiment(s), in the
collection, analysis and interpretation of the data, and in the writing of the thesis or dissertation document. The
results must represent a meaningful contribution to knowledge and be worthy of publication in peer-reviewed
scientific journals.
SLOs: 1-8
PART 5. STANDARDS, CRITERIA, & RUBRICS
Ethics & Professionalism (DIRECT):
A primary ethics & professionalism course for School of Medicine graduate students (for example CONJ 650 or BMI
515). In an ethics class, students are expected to: (1) define and refine expected standards of conduct; (2) increase
confidence in dealing with difficult issues; and (3) meet current NIH requirements for formal training in research
ethics. Registered students will receive a grade of “Pass” or “No-Pass” (Fail) based on class attendance, including
small group discussions, answering the evaluation questionnaires, and certified completion of required online
courses such as : (1) Laboratory Safety, (2) Responsible Conduct of Research (RCR), and (3) training in plagiarism.
3
Attendance at all class sessions is expected and monitored. Any student with unexcused absences will receive a
“No-pass” grade.
Targets:
 100% of students are required to pass the introductory ethics course requirements.
 100% of students are required to gain and retain full compliance certifications throughout their program
 No students (0%) will be reported or dismissed from laboratories , research groups or a program due to
inappropriate or dangerous use of equipment or experimental design, inappropriate use or disclosure of
data, inability to document or communicate results, and/or non-compliance or unethical behavior
Journal Club or Equivalent (DIRECT):
Students are assessed based on their ability to lead a discussion and critique of a peer-review journal article. In
general students receive informal feedback during and immediately following the session on how to improve their
ability to assess and evaluate scientific data in published literature. Summative feedback either is in the form of a
letter grade or is Pass/Fail.

100% of students are expected to receive a passing grade in each journal club in which the student is
enrolled or in each course/activity in which this assessment occurs.
Core Knowledge (DIRECT):
Students are assessed in their coursework. After a major portion of the required coursework is completed,
generally after the first two years of study is completed with a 3.0 GPA or better, students are assessed on their
ability to pass a Core Knowledge Exam (Comprehensive and/or Qualifying Exam).
Targets:
 90% of students will have an overall GPA of 3.0 or better
 80% of students will pass the Comprehensive Exam at end of year one (where offered) and Qualifying
Examination on the first attempt (before the end of the 3rd year).
 100% of students will pass a Core Knowledge Exam before the end of year three.
Formative Assessment and Mentorship via Thesis Advisory Committee (Thesis/Dissertation
Advisory Committee) (DIRECT):
During the regularly scheduled Thesis/Dissertation Advisory Committee meetings, which will be established after
the student is a Doctoral Candidate, students receive formative feedback about their progress. Due to the highly
individualized and subjective nature of doctoral education, it is difficult to quantify a single standard for
satisfactory progress. However, this issue is being taken under advisement to determine how to address over the
coming year.
Targets:
 100% of students receive satisfactory progress reports from their Thesis/Dissertation Advisory Committee
Scientific Conferences (DIRECT):
Students are to present their research to their peers at scientific conferences. These conferences can be local or
international in scope. Students will present original research, engage conference participants in conversations
regarding their data and upon return reflect on the conference and information shared and gained with their thesis
mentor and thesis advisory committee, or lab groups.
Targets:
 100% participation for all post qualified students.
4
Completion of Student Research (DIRECT):
Students in the PhD program will be able to analyze, plan, organize, and conduct original research with minimal
direction from a supervisor.
Target:
 100% of students will pass their research courses
 100% of students will receive a satisfactory assessments from their Thesis/Dissertation Advisory
Committee regarding their program progression
 100% of students will receive a satisfactory assessment on all components of their core exam on the first
attempt
Dissertation Defense (DIRECT):
The evaluation of the doctoral dissertation is based on the following areas: the research meets standards of
excellence in the application of scientific principles to an inquiry; the observations are relevant, reliable, and free
from uncontrolled influence; the analysis is thoughtful and relevance to the field is well articulated. The writing
must meet acceptable standards of scientific exposition in English.
Target:
 100% of students who defend their dissertation will receive a passing grade
 80% of students will defend their dissertation within the established time to degree.
5
PART 6. STUDENT LEARNING OUTCOMES & ASSESSMENT FINDINGS (AY 12-13)
Reminder: The finding tables should focus on the results of any assessments that
occurred for students during the AY12-13 year.
SAMPLE BASED ON A PROGRAM WITH 10 STUDENTS EACH YEAR IN A 5 YEAR PROGRAM:
Target
 100% of students are required
to pass the CONJ 650/or
similar ethics course
requirements on the first
attempt
 80% of students will have an
overall GPA of 3.0 or better
 100% of students receive
satisfactory progress reports
from their Thesis/Dissertation
advisory committee
Number
Percentage
10
90%
50
100%
35 students
70
Thesis/Dissertation
Advisory
Committee
meetings
85%
Explanatory Notes regarding
sample table
9 of 10 students passed CONJ 650 on
the first attempt
All 50 of your students had a GPA at
the end of AY 12-13 of a 3.0 or better.
35 students with Thesis/Dissertation
Advisory Committees established met
with this committee bi-annually.
70 Thesis/Dissertation Advisory
Committee meetings in AY 12-13.
60 of the 70 (85%) Thesis/
Dissertation Advisory Committee
meetings resulted in satisfactory
progress reports.
Ethics & Professionalism (DIRECT):
Target
Number of Students
Attempting Assessment
 100% of students are required to pass
the CONJ 650/or similar ethics course
requirements on the first attempt
 100% of students are required to gain
and retain full compliance certifications
throughout their program
 No students (0%) will be reported or
dismissed from laboratories, research
groups or a program due to
inappropriate or dangerous use of
equipment or experimental design,
inappropriate use or disclosure of data,
inability to document or communicate
results, and/or non-compliance or
6
Percentage of
Students the met the
target
unethical behavior
Journal Club or Equivalent (DIRECT):
Target
Number of Students
Attempting Assessment
Percentage of
Students the met the
target
Number of Students
Attempting Assessment
Percentage of
Students the met the
target
 100% of students are expected to
receive a passing grade in each journal
club in which the student is enrolled or
in each course/activity in which this
assessment occurs
Qualifying Core Knowledge (DIRECT):
Target
 -90% of students will have an overall
GPA of 3.0 or better

 100% of students will receive a
satisfactory assessment on the written
portion of their core exam on the firstattempt
 100% of students will receive a
satisfactory assessment on the
presentation portion of their core exam
on the first-attempt
 100% of students will receive a
satisfactory assessment on the oral
portion of their core exam on the firstattempt
Formative Assessment and Mentorship via Thesis Advisory Committee (Thesis/Dissertation
Advisory Committee) (DIRECT):
Target
Number of Students
Attempting Assessment
Percentage of
Students the met the
target
Number of Students
Attempting Assessment
Percentage of
Students the met the
target
 100% of students receive satisfactory
progress reports from their
Thesis/Dissertation Advisory
Committee
Scientific Conferences (DIRECT):
Target
 100% participation for all post
7
qualified students.
Completion of Student Research (DIRECT):
Target
Number of Students
Attempting Assessment
Percentage of
Students the met the
target
Number of Students
Attempting Assessment
Percentage of
Students the met the
target
 100% of students will pass their
research courses
Dissertation Defense (DIRECT):
Target
 100% of students who defend their
dissertation will receive a passing
grade
 80% of students will defend their
dissertation within the established
time to degree.
8
Assessment Plan & Report AY13-14
(A Focus on AY12-13 Graduates)
Download