Assessment Plan & Report AY13-14 (A Focus on AY12-13 Graduates) PART I. PROGRAM DETAILS School/Unit ☐: Dentistry ☐ Nursing Medicine ☐Pharmacy Provost Office: ☐ Physician Assistant ☐ Graduate Programs in Nutrition ☐ Radiation Therapy Academic Major: __________________________________________________ Authorized Award(s) (Include all degree/certificates for this major): Doctor of Philosophy Is this a joint degree program? ☐ Yes No If yes, what is the partnering institution? __________________ Program website address: http://www.ohsu.edu/xd/education/schools/school-of-medicine/academic-programs/graduate-studies/degreeprograms.cfm Number of graded credit hours: Minimum 135 Program Chair/Director: ___________________________________________ PART 2. PROGRAM PURPOSE STATEMENT Clearly and concisely states program purpose from perspective student point of view. The purposes of the School of Medicine Doctor of Philosophy (PhD) programs are to educate students in biomedical, engineering, population and informatics sciences, train them to think critically and independently, and teach them how to design and conduct independent research. Our students are dedicated to undertaking careers as independent scientists, dedicated teachers and imaginative leaders and scholars in academia, government and industry. Graduates of the School of Medicine PhD programs are capable of independent thought and research and hold the knowledge, skills, and personal qualities to advance basic and applied aspects within their specialty area. PART 3. STUDENT LEARNING OUTCOME (SLO) STATEMENTS At the end of the OHSU School of Medicine PhD programs, the graduate will be able to: 1. Demonstrate a basic knowledge of central concepts in the relevant scientific field; 2. Demonstrate advanced knowledge in one specialized area; 3. Advance knowledge in selected area of concentration; 4. Formulate hypothesis based on current concepts in the field; 5. Design, conduct, and interpret their own research; 6. Demonstrate doctoral-level competence in written and verbal communication; 7. Interpret and critique scientific literature; 8. Apply fundamental knowledge of ethics in research; and 9. Develop ancillary skills, where necessary, for career development. The above SLOs map to the OHSU Core Competencies in the following manner: Professional Knowledge and Skills (SLO 1, 2 & 3) Reasoning and Judgment (SLO 4, 5, & 8) Evidence-based Practice and Research (SLO 7) Lifelong Learning (SLO 3, 4, & 7) Communication (SLO 6 & 9) Professionalism & Ethics (SLO 8 & 9) Inter-professional Teamwork (SLO 8 & 9) Safety & Quality Improvement (SLO 1, 4 & 5) Systems (SLO 8 & 9) PART 4. STUDENT LEARNING OUTCOMES ASSESSMENT Ethics & Professionalism (DIRECT): All graduate students are required to complete at least one course in ethics and professional conduct successfully. In addition, all students must be in full certification compliance, as necessary, throughout their time in the program, specifically while working in research settings or with protected health information Compliance certificates , appropriate for the student’s program and available via the OHSU Big Brain modules (e.g., laboratory safety, Responsible Conduct of Research involving animal or human subjects, or involving recombinant DNA or infectious or biological agents, HIPAA privacy) are required. Student assessments focus on their ability to recognize ethical issues and act in accordance with ethical standards of conduct in the design, implementation, analysis, and dissemination of scientific research. Students are assessed on these areas based on behavior in and out of the research environment. . Examples of expectations include experimental data are not manipulated, laboratory notebooks reflect the results that were obtained, verification of experimental results by replication of experiments or rigorous examination, proper allocation of credit work done by others, professional behavior at conferences and other settings, and respecting the rights of study participants and fellow lab workers. Ethics and professionalism issues are to be individually discussed with students and evaluated at regular intervals. Prior to a student being advanced to candidacy, these discussions and evaluations are between Program Directors (or designee) and the student. After a student has been advanced to candidacy, ethics and professionalism issues are discussed during Thesis Advisory Committee (Thesis/Dissertation Advisory Committee) meetings where assessment of students’ understanding of ethical issues is based on class/session attendance, participation in class/session discussions, and completion of various projects/reports throughout courses and the conduct of research. Additionally, any situations that dictate immediate action by programs due to ethical or professional conduct violations will be addressed swiftly and appropriately. SLOS: 1, 3, 4, 5 6, & 8 Journal Club or Equivalent (DIRECT): Students participate in journal club course or equivalent where they are expected to orally present an article critique as well as be active listeners and participants in sessions where their peers present articles. Students are to select an article that represents an important advance in thinking about a specified topic.. Students are to place the article in the context of the larger body of literature in the field and specialized techniques explained in a succinct fashion that an intelligent scientist understands. Presentations highlight the important findings and the conclusions the authors draw while considering whether the data are of sufficient quality and support the authors' conclusions. Students discuss what questions the paper raises and future directions of research. The specific format and expectations of the various journal clubs vary; however, the above reflects the core expectations. SLOs: 1, 2, 6, & 7 Core Knowledge (DIRECT): Students must successfully complete a core curriculum, with a 3.0+ GPA, comprised of basic core principles appropriate for their program. The core program(s) sets the curriculum for each of these areas and assessment measures are embedded within those courses. Qualifying exams that include testing core knowledge, occur after a major portion of the required coursework is completed, generally after the first two years of study is complete. SLOs: 1, 3, 4, 5, & 6 Formative Assessment and Mentorship via Thesis Advisory Committee (Thesis/Dissertation Advisory Committee) (DIRECT): The progress of each student in the program is under the direction of a supervising profession and the Thesis/Dissertation Advisory Committee who represent the School of Medicine Graduate Program. The 2 Thesis/Dissertation Advisory Committee is responsible for the students’ progress and approves the program of courses and the area of research a student will pursue. Assessment of the student’s ongoing research is conducted by the Thesis/Dissertation Advisory Committee and includes formative assessment and feedback regarding the students research capabilities. The Thesis/Dissertation Advisory Committee shall be appointed by the Program Director to guide and advise the student in the thesis/dissertation research and preparation of the thesis/dissertation document. The Thesis/Dissertation Advisory Committee shall be appointed within one year after advancement to Ph.D. candidacy or upon commencement of the thesis or dissertation research, whichever is earlier. The Associate Dean for Graduate Studies must approve the appointment of each Advisory Committee based upon the recommendation of the Program Director. The committee shall consist of no fewer than four members of the Graduate Faculty for a Ph.D. dissertation committee. SLOs: 1-9 Scientific Conferences (DIRECT): All students are required to present research findings during an open scientific conference. Conferences can range from the OHSU Research Week to state, regional, national, or international meetings. Students succinctly and appropriately present research findings to advance knowledge in the field using doctoral-level communication (oral and/or written) skills demonstrating their ability to interpret and critique relevant literature, design and implement research studies, and apply knowledge of ethical issues in research . Scientific conferences are opportunities for students to develop ancillary skills to obtain positions outside scientific research. Ancillary skill development may be recommended by the Thesis/Dissertation Advisory Committee and will be highly individualized. SLOs: 2-9 Completion of Student Research (DIRECT): Students in the PhD program will be able to analyze, plan, organize, and conduct original research with minimal direction from a supervisor. Research areas will be determined by the research mentor with whom the student chooses to work. Assessment of the student’s ongoing research will be conducted by the Thesis/Dissertation Advisory Committee. Research capabilities will also be assessed through the students Qualifying Core Knowledge Assessment and dissertation reviews. SLOs: 1-8 Dissertation Defense (DIRECT): The doctoral dissertation defense, required of all Ph.D. candidates, should be based on a logical program of research designed to answer fundamental questions in some field of biomedical or other relevant science must show evidence of originality on the part of the candidate in the planning and execution of independent experimental work. Doctoral candidates must be the primary contributor to the design of the experiment(s), in the collection, analysis and interpretation of the data, and in the writing of the thesis or dissertation document. The results must represent a meaningful contribution to knowledge and be worthy of publication in peer-reviewed scientific journals. SLOs: 1-8 PART 5. STANDARDS, CRITERIA, & RUBRICS Ethics & Professionalism (DIRECT): A primary ethics & professionalism course for School of Medicine graduate students (for example CONJ 650 or BMI 515). In an ethics class, students are expected to: (1) define and refine expected standards of conduct; (2) increase confidence in dealing with difficult issues; and (3) meet current NIH requirements for formal training in research ethics. Registered students will receive a grade of “Pass” or “No-Pass” (Fail) based on class attendance, including small group discussions, answering the evaluation questionnaires, and certified completion of required online courses such as : (1) Laboratory Safety, (2) Responsible Conduct of Research (RCR), and (3) training in plagiarism. 3 Attendance at all class sessions is expected and monitored. Any student with unexcused absences will receive a “No-pass” grade. Targets: 100% of students are required to pass the introductory ethics course requirements. 100% of students are required to gain and retain full compliance certifications throughout their program No students (0%) will be reported or dismissed from laboratories , research groups or a program due to inappropriate or dangerous use of equipment or experimental design, inappropriate use or disclosure of data, inability to document or communicate results, and/or non-compliance or unethical behavior Journal Club or Equivalent (DIRECT): Students are assessed based on their ability to lead a discussion and critique of a peer-review journal article. In general students receive informal feedback during and immediately following the session on how to improve their ability to assess and evaluate scientific data in published literature. Summative feedback either is in the form of a letter grade or is Pass/Fail. 100% of students are expected to receive a passing grade in each journal club in which the student is enrolled or in each course/activity in which this assessment occurs. Core Knowledge (DIRECT): Students are assessed in their coursework. After a major portion of the required coursework is completed, generally after the first two years of study is completed with a 3.0 GPA or better, students are assessed on their ability to pass a Core Knowledge Exam (Comprehensive and/or Qualifying Exam). Targets: 90% of students will have an overall GPA of 3.0 or better 80% of students will pass the Comprehensive Exam at end of year one (where offered) and Qualifying Examination on the first attempt (before the end of the 3rd year). 100% of students will pass a Core Knowledge Exam before the end of year three. Formative Assessment and Mentorship via Thesis Advisory Committee (Thesis/Dissertation Advisory Committee) (DIRECT): During the regularly scheduled Thesis/Dissertation Advisory Committee meetings, which will be established after the student is a Doctoral Candidate, students receive formative feedback about their progress. Due to the highly individualized and subjective nature of doctoral education, it is difficult to quantify a single standard for satisfactory progress. However, this issue is being taken under advisement to determine how to address over the coming year. Targets: 100% of students receive satisfactory progress reports from their Thesis/Dissertation Advisory Committee Scientific Conferences (DIRECT): Students are to present their research to their peers at scientific conferences. These conferences can be local or international in scope. Students will present original research, engage conference participants in conversations regarding their data and upon return reflect on the conference and information shared and gained with their thesis mentor and thesis advisory committee, or lab groups. Targets: 100% participation for all post qualified students. 4 Completion of Student Research (DIRECT): Students in the PhD program will be able to analyze, plan, organize, and conduct original research with minimal direction from a supervisor. Target: 100% of students will pass their research courses 100% of students will receive a satisfactory assessments from their Thesis/Dissertation Advisory Committee regarding their program progression 100% of students will receive a satisfactory assessment on all components of their core exam on the first attempt Dissertation Defense (DIRECT): The evaluation of the doctoral dissertation is based on the following areas: the research meets standards of excellence in the application of scientific principles to an inquiry; the observations are relevant, reliable, and free from uncontrolled influence; the analysis is thoughtful and relevance to the field is well articulated. The writing must meet acceptable standards of scientific exposition in English. Target: 100% of students who defend their dissertation will receive a passing grade 80% of students will defend their dissertation within the established time to degree. 5 PART 6. STUDENT LEARNING OUTCOMES & ASSESSMENT FINDINGS (AY 12-13) Reminder: The finding tables should focus on the results of any assessments that occurred for students during the AY12-13 year. SAMPLE BASED ON A PROGRAM WITH 10 STUDENTS EACH YEAR IN A 5 YEAR PROGRAM: Target 100% of students are required to pass the CONJ 650/or similar ethics course requirements on the first attempt 80% of students will have an overall GPA of 3.0 or better 100% of students receive satisfactory progress reports from their Thesis/Dissertation advisory committee Number Percentage 10 90% 50 100% 35 students 70 Thesis/Dissertation Advisory Committee meetings 85% Explanatory Notes regarding sample table 9 of 10 students passed CONJ 650 on the first attempt All 50 of your students had a GPA at the end of AY 12-13 of a 3.0 or better. 35 students with Thesis/Dissertation Advisory Committees established met with this committee bi-annually. 70 Thesis/Dissertation Advisory Committee meetings in AY 12-13. 60 of the 70 (85%) Thesis/ Dissertation Advisory Committee meetings resulted in satisfactory progress reports. Ethics & Professionalism (DIRECT): Target Number of Students Attempting Assessment 100% of students are required to pass the CONJ 650/or similar ethics course requirements on the first attempt 100% of students are required to gain and retain full compliance certifications throughout their program No students (0%) will be reported or dismissed from laboratories, research groups or a program due to inappropriate or dangerous use of equipment or experimental design, inappropriate use or disclosure of data, inability to document or communicate results, and/or non-compliance or 6 Percentage of Students the met the target unethical behavior Journal Club or Equivalent (DIRECT): Target Number of Students Attempting Assessment Percentage of Students the met the target Number of Students Attempting Assessment Percentage of Students the met the target 100% of students are expected to receive a passing grade in each journal club in which the student is enrolled or in each course/activity in which this assessment occurs Qualifying Core Knowledge (DIRECT): Target -90% of students will have an overall GPA of 3.0 or better 100% of students will receive a satisfactory assessment on the written portion of their core exam on the firstattempt 100% of students will receive a satisfactory assessment on the presentation portion of their core exam on the first-attempt 100% of students will receive a satisfactory assessment on the oral portion of their core exam on the firstattempt Formative Assessment and Mentorship via Thesis Advisory Committee (Thesis/Dissertation Advisory Committee) (DIRECT): Target Number of Students Attempting Assessment Percentage of Students the met the target Number of Students Attempting Assessment Percentage of Students the met the target 100% of students receive satisfactory progress reports from their Thesis/Dissertation Advisory Committee Scientific Conferences (DIRECT): Target 100% participation for all post 7 qualified students. Completion of Student Research (DIRECT): Target Number of Students Attempting Assessment Percentage of Students the met the target Number of Students Attempting Assessment Percentage of Students the met the target 100% of students will pass their research courses Dissertation Defense (DIRECT): Target 100% of students who defend their dissertation will receive a passing grade 80% of students will defend their dissertation within the established time to degree. 8 Assessment Plan & Report AY13-14 (A Focus on AY12-13 Graduates)