Wilkes University Nesbitt School of Pharmacy Master Assessment Plan Revised April 2015 1 Table of Contents Purpose .......................................................................................................................................................................................................................... 3 Mission Vision Values .................................................................................................................................................................................................... 3 Student Affairs Related Assessments ............................................................................................................................................................................ 5 Scholarship .................................................................................................................................................................................................................... 5 Curricular Related Assessments .................................................................................................................................................................................... 6 Assessment Notes ......................................................................................................................................................................................................... 7 School of Pharmacy Stakeholders ................................................................................................................................................................................. 8 Definitions ................................................................................................................................................................................................................... 10 Strategic Plan ............................................................................................................................................................................................................... 11 2 The revision process for the Master Assessment Plan 2014 was in response to a number of internal and external factors, including evolving demands from Accreditation Council on Pharmacy Education (ACPE), new Wilkes educational outcomes, updated Center for Advancement of Pharmacy Education (CAPE) 2013 outcomes, and proposed accreditation standards 2016 (which were first made available in draft form in January 2014). This plan replaces the School of Pharmacy Master Assessment Plan 2010 version 5. This plan was generated by the Acting Assistant Dean for Academic Affairs and Assessment and thoroughly vetted through the Assessment Committee with comments from the faculty of the School of Pharmacy and the Executive Committee. Purpose The purpose of the revised Master Assessment Plan is to serve as a guide for all assessment activities related to the operations of the School of Pharmacy. This process helps ensure continuous quality improvement for the Doctor of Pharmacy program at Wilkes University. Mission Vision Values The Mission of the School of Pharmacy is to develop pharmacists who will provide high quality health care and to make meaningful contributions to the science and practice of pharmacy. The Vision of the School of Pharmacy is to be recognized as an exceptional pharmacy program through innovative education, contemporary practice, and valuable scientific contributions. Values Teamwork Professionalism Lifelong Learning Cultural Competency Personalized Attention Community Engagement 3 Dean Nesbitt School of Pharmacy School of Pharmacy Executive Committee Dean Assistant Dean for Academic Affairs and Assessment Assistant Dean for Student Affairs Chair of Pharmacy Practice Chair of Pharmaceutical Sciences Director of Experiential Learning Assistant to the Dean (non-voting) Assistant Dean for Academic Affairs and Assessment Assistant Dean for Student Affairs Administrative Assistant Assistant to the Dean Chair of Pharmaceutical Sciiences Chair of Pharmacy Practice Administrative Assistant Director of Experiential Administrative Assistant Director of Residencies Pharmacy Librarian Practice Faculty Laboratory Director Administrative Assistant Science Faculty Experiential Coordinator Figure 1 Organizational Chart 4 Fiscal Scholarship Student Affairs Related Assessments Assessment Standard Map (2016) 1, 17 1 1 1 1, 16 1, 12 Cycle Accountable Review Process Notification Annual Annual Semester Every semester Annual Annual P3 APPE grades (P/F/H) Co-curricular evaluation and Professional Development 2, 4, 13 4, 12 Every rotation Annual Student Affairs Student Affairs Student Affairs Advisor Student Affairs Care Lab Coordinator Student Affairs Exp Director ADSA Advisors ADSA ADSA ADSA ADSA ADSA ADSA and ADAA ADSA ADSA Early Alert Notification 17 Ongoing ADSA ADSA ADSA ADSA ADSA Care Lab Coordinator Exp Director Dean through Student Senate, Experiential Faculty ADSA, Advisors ADSA Scholarly productivity 19 Annually through SER and evaluations for faculty and staff Chairs Chairs Dean Budget Process 23 Annual Dean, Chairs Executive Dean Progression rates Withdrawal rates Academic Probation rates GPA Admissions info (PCAT, SAT, GPA) OSCE 5 Curricular Related Assessments Overall Assessments Assessment Standard Map (2016) Cycle Accountable Review Process Notification SoP Graduating Survey IPE outcomes assessment 4, 11 11 Annual Annual Exec Curriculum ADAA ADAA IPPE/APPE Capacity Chart Writing Across the Curriculum Map of content to courses (Appendices) PCOA NAPLEX pass rates NAPLEX Areas MPJE AACP Graduate Survey (most recent P4 class) AACP Preceptor Survey AACP Faculty Survey AACP Alumni Survey (of last five graduating classes) Student Response Survey 22 1 10 Annual Every three years One Map Every Year Dean Chair Pharm Practice Exp Director ADAA Curriculum Experiential Curriculum Curriculum ADAA ADAA ADAA 1, 10, 12 1 1, 10 1, 10 9, 10, 14, Annual – P3s Annual Annual Annual Annual ADSA/ADAA ADAA ADAA ADAA ADAA Exec Assessment Exec Exec Curriculum Exec Curriculum ADAA ADAA ADAA ADAA ADAA 20 9, 10, 23 15 Every other year (even) Annual Every other year (odd) ADAA ADAA ADAA Experiential Exec Exec Curriculum ADAA ADAA ADAA 19, 20 Every course Chairs faculty ADAA APPE – PxDx Report Noel Levitz Student Satisfaction Inventory 13 14 Annual Every other year (odd) Experiential Office of Information, Analysis, & Planning ADAA ADAA Current Strategic Plan Measures (i.e. formative assessment of mission/vision/objectives) Comprehensive programmatic review 7, 24 Annual Objectives Every three years – initiatives Semi-annual retreat (4 retreats = 1 comprehensive cycle Chairs/Institution al Assessment Exp Director Director Institutional Assessment ADAA Assessment Strategic Planning ADAA ADAA with Exec Assessment ADAA 1-25 6 Assessment Notes The student affairs related assessments focus on enrollment and progression measures for students. The office of the Assistant Dean for Student Affairs maintains most of the records. The use of OSCEs in the P3 care lab will serve as one of the pre-APPE assessments. While it relates directly to student progression (student affairs), it also relates to curricular effectiveness leading up to APPEs (academic affairs). Co-curricular evaluation involves analysis of student involvement, leadership, and professional attitudes and behavior. The Dean will solicit some of this information primary through student senate. The use of the electronic portfolio, E-Value, will capture reflections and identify development in students and will be overseen by advisors. The scholarship assessment is done primarily through the annual review of faculty members. The department chairs will solicit and evaluate the scholarly productivity. The curricular related assessments focus on curricular content and quality issues. The office of the Assistant Dean for Academic Affairs and Assessment maintains these assessments. The curriculum committee will be charged each year to review a specific Accreditation Appendix, with the comprehensive review being completed every three years. The semi-annual programmatic review is designed to complete a full evaluation of all aspects of the PharmD program every two years. Since educational outcomes are continuously monitored, a larger focus of the review will be on the structure and process to promote achievement of educational outcomes. Assessment Notification Policy The purpose of the policy is to determine a clear course of action for identifying and referring abnormal assessment results to responsible parties so that meaningful change can be implemented, if applicable. The policy specifies that any person (or committee) in a position to review results of an assessment measure shall internally determine a threshold for considering the result abnormal or inadequate. It is understood that this threshold may change with committee turnover. When an abnormal or inadequate assessment result has been identified, the person shall notify the appropriate Assistant Dean’s office (Academic Affairs [ADAA] for curricular assessments or Student Affairs [ADSA] for student-related assessments). As the central hub for collecting assessment results, the ADAA or ADSA office will consider the abnormal or inadequate result along with all other assessment measures and forward, when applicable, a recommendation to a person or committee for consideration and action to address the concern. This “closes the loop,” as future assessment measures will identify change based on the action of the responsible person or committee. It is expected that this process will operate seamlessly as at least one of the Assistant Deans serves on all standing committees in the School of Pharmacy. 7 School of Pharmacy Stakeholders Who Dean Meets NA Reports To Provost and SoP Assistant Dean for Student Affairs NA Dean Assistant Dean for Academic Affairs NA Dean Academic Departments Pharmacy Practice Pharmaceutical Sciences Monthly Executive Committee and SoP Faculty Executive Committee Monthly SoP Faculty and University Standing Committees Monthly Executive committee and SoP Faculty Curriculum Student Affairs Responsibility Annual and projected budget, staffing, and facility management. All aspects of admission, progression, and graduation. Maintains data sets relevant to student success. All aspects of programmatic assessment and accreditation processes. Provides assistance with data analysis and tool development and maintains relevant data sets. Each department formulates own mission statement which is in support of the role, mission, and goals of the SoP. Assessment is focused on mission, meeting department needs, faculty development and the development and delivery of the professional curriculum. In collaboration with Dean, provides fundamental responsibility and oversight for program success. Develops annual charges for standing committees based on end-ofyear reports from committees and departments. Reviews and responds to issues and situations as needed. Committees address annual charges form Executive Committee Continually appraises and evaluates the professional and pre-professional pharmacy education curriculum, outcome statements, curricular maps, and develops recommendations for curricular revisions to assure optimal student learning and outcomes. Reviews and approves course changes and forwards recommendations to University curriculum committee. Develops policy and makes recommendations pertaining to standards for professional and pharmacy student recruitment and admission to the existing program. Also develops policy for academic standards related to curricular progression and completion. Establishes recommendations 8 Strategic Planning Assessment Student Senate Monthly Dean, Student Body Ad Hoc Taskforces As needed Varies Semiannual Program Review At the end of SoP Faculty, each semester staff, and students for awarding professional scholarships, awards, prizes, and oversees the awards process. Develops, monitors, refines, and reports on the SoP Strategic Plan. Works with Assessment Committee on determining measures of success. Oversees assessment measures for all aspects of the program. Works with Strategic Planning committee by offering assessment measures for annual strategic objectives. Made up of six elected representatives from each class, club presidents, and class officers. Elects student representatives to SoP standing committees, tracks some co-curricular activities of the student body, oversees Nesbitt Cup volunteer competition, and determines financial support for student clubs. Supports the work of committees and individuals as needed. Particularly useful when expertise across committees and/or departments is required. Reviews ¼ of the entire program each semester. Generally evaluates: Student Affairs related assessments (Standards 14-18, 2016), Facilities and Infrastructure (Standards 5-9, 2123), Faculty and Staff factors (Standards 18-20), and other Global Curricular Issues (Standards 1-4, 10-13, 24-25) 9 Definitions Assessment: measurement with intent to improve. Direct Assessment Evidence: data reflecting the outcome itself; the knowledge, skill, or attitude is tested observed or measured directly (e.g. exam scores, writing assignments, portfolios of student work, faculty publications, grant awards). Evaluation: the broad process of utilizing many pieces of assessment data to form judgments about the quality and effectiveness of the Doctor of Pharmacy program at Wilkes University. Formative Assessment: the process of gathering information about work in progress of the purpose of making informed changes to the work. Impact Measures: data collection methods used to measure the long-term effects of a project, course, or program. Implementation Measures: data collection methods used to measure performance the execution of a project, course, or program. Individual Assessment: assessment to ensure individuals (students and faculty) are meeting desired outcomes. Institutional Assessment: assessment of the institution (Wilkes University) as a whole to ensure the achievement of the School of Pharmacy’s mission and goals (e.g. accreditation self-study report, program review, student retention and progression). Mapping: using a visual format for showing how various entities or variables relate. For example, linking content in courses to the intended learning outcomes. The purpose of mapping is to quickly identify strengths or gaps in the relationship being considered. Master Assessment Plan: the document that outlines the plan for the collection, evaluation, and use of assessment data for the School of Pharmacy to ensure the mission and goals are accomplished. Peer Comparison: The process of using data from groups designated as peers for the purpose of comparison. Program Assessment: assessment of an academic degree program (PharmD) using aggregate data collected at various phases in the program from students, alumni, faculty, employees, and others to ensure that graduating students are ready for careers as entry-level pharmacists. Programmatic Outcomes: measures of programmatic success. Goals that describe how a program will be different because of selected initiatives. Summative Assessment: assessment that occurs at the end of a course, project, or program in order to measure outcomes. Trend Analysis: analysis of data sets over time in order to determine patterns of skill, thought, or behavior. SER (Self Evaluation Report): An annual report generated by faculty as part of the annual evaluation process. The SER is given to department chairs. Student Learning Outcomes: measures of student success. Goals that describe how students will be different because of a learning experience. 10 Strategic Plan STRATEGIC INITIATIVES: 2013-2016 1. 2. 3. 4. 5. 6. Evolve to remain innovators in education capable of attracting high quality students. Create a culture of research and scholarship within the School of Pharmacy Assess viability of university based practice programs. Develop strategic collaborations with universities, health care systems, insurance providers, pharmacies, pharmaceutical industry, etc. Embrace and enhance inter-professional education Enhance culture of integrative assessment. STRATEGIC OBJECTIVES: Academic Year 2013-2014 1. Develop a plan to evaluate the content, format, and sequence of the curriculum. (SI 1,5,6) o Accountable -Curriculum and Assessment o Timeline -Complete plan by end of academic year 2. Craft a business plan to implement a center for information mastery. (SI 1,3,4) o Accountable -Jon Ference and team o Timeline -End of academic year 3. Craft a business plan to implement a center for medication therapy management. (SI 1,3,4) o Accountable -Eric Wright and team o Timeline -End of academic year 4. Identify and engage external sources of funding. (SI 1,2,4) o Accountable -Dean, Exec, Individual faculty o Timeline -Ongoing 5. Develop marketing plan to attract high quality students. . (SI 1) o Accountable -SOP point person with Melanie Mickleson, Jack Chielli, &/or Admissions o Timeline -End of academic year 6. Determine factors affecting student marketability post-graduation. . (SI 1) 11 o o Accountable Timeline -Exec To coincide with career fair (employer surveys) 7. Create a report which documents current Interprofessional elements in the curriculum and identify if areas of enhancement are needed. (SI 1, 5) o Accountable -Curriculum o Timeline -End of academic year 8. Pilot Spanish Specialty Track. . (SI 1) o Accountable -Curriculum o Timeline -End of fall semester 9. Develop formalized FAQ sheet for Advisors. . (SI 1) o Accountable -Assistant Dean (Student Affairs) o Timeline End of academic year 10. Consider non-rolling admissions for PPGS and utilization of PharmCAS for transfers. (SI 1) o Accountable -Student Affairs o Timeline -End of academic year 11. Assess need to revise programmatic objectives (outcomes). . (SI 1,6) o Accountable -Assessment / Curriculum o Timeline End of fall semester 12. Assess processes of assessment by capturing timelines and monitoring change in response to assessment activities. (SI 1,6) o Accountable -Assessment o Timeline -Ongoing 13. Implement faculty development programs for teaching and research. (SI 1,2) o Accountable -Assistant Dean for Academic Affairs and Assessment o Timeline -Ongoing 14. Foster faculty collaborations in scholarship. (SI 2) o Accountable -Chairs, Executive Committee, Individual Faculty 12 o Timeline -Ongoing 15. Increase student participation in scholarly activities. (SI 2) o Accountable -Dean, Chairs, Individual Faculty o Timeline -Ongoing 16. Sustain and seek opportunities to promote the cultural competency of faculty, staff, and students. (SI 1) o Accountable -Dean, Individual Faculty o Timeline -Ongoing 13 STRATEGIC OBJECTIVES: Academic Year 2014--‐2015 1. Evaluate the curriculum for “critical items” and create a tool of speicfi measures that define success for these items (SI1) a. Accountable: Assessment Committee 2. Create a formal assessment plan formal assessment plan for evaluating and addressing emerging concerns (student employment challenges, direct competition, facilities, etc) (SI1) a. Accountable: Strategic Planning Committee 3. Evaluate and propose an alternate sequence to the School of Pharmacy curriculum. (SI1) a. Accountable: Curriculum Committee 4. Support and explore curricular tracks/concentrations (Spanish, Leadership, etc). (SI1) a. Accountable: Curriculum Committee 5. Evaluate the atmosphere and potential for a satellite school in a secondary location. (SI1) a. Accountable: Executive Committee 6. Develop a plan to increase the resources for faculty and students to conduct, present, and be exposed to meaningful research. (SI2) a. Accountable: Dean and Department Chairs 7. Create a list of possible collaborations or partnerships for which the School may pursue in the next 3-5 years. (SI3) a. Accountable: Executive Committee 8. Create a subcommittee in charge of coordinating and assessing interprofessional activities at all levels of Pharmacy education (SI5). a. Accountable: Chair, Department of Pharmacy Practice 9. Develop a plan for implementing and evaluating pre-APPE assessments (OSCE, PCOA, etc) (SI6) a. Accountable: Assessment Committee 10. Decide if the School will adopt examination software and create a draft plan for implementation and assessment. (SI6). o Accountable: Executive Committee 14 Reserved for STRATEGIC OBJECTIVES: Academic Year 2015-2016 15