DON Program Evaluation Plan 1 Western Carolina University College of Applied Sciences Department of Nursing Program Assessment Plan for Academic Year 2006-2007 Department: Programs: Name of Person Completing Report: Nursing BSN and MSN Vincent P. Hall, PhD, RN Head, Department of Nursing 207 Moore Building Phone: 7467 Email: hallv@wcu.edu Department Mission Statement: The Department of Nursing adheres to and supports the mission of Western Carolina University. The Department prepares professional nurses at the baccalaureate and graduate levels to address the health care needs of diverse populations in the region. In accordance with its teaching mission, the Department provides a scholarly atmosphere that stimulates service, research, and creative activities by its faculty and students. Alignment of Program Mission with University and College Mission: The Department of Nursing provides quality nursing education at the baccalaureate and graduate level. The primary responsibility of the department is teaching while at the same time providing an atmosphere that supports faculty and student service, scholarly activity, and engagement with the region. This is consistent with the missions of the University and College of Applied Sciences. BSN Program Student Learning Outcomes: 1. 2. 3. 4. 5. 6. 7. 8. 9. Base practice on current knowledge, theory, and research. Demonstrate responsibility and accountability for practice. Advocate for clients and the nursing profession. Practice effectively across a variety of settings and with diverse populations. Serve as a member and leader within interdisciplinary health care teams. Form partnerships with clients and with other health care professionals. Provide health education to clients and peers. Manage human and material resources within the health care system. Participate in political and regulatory processes that affect the health and well being of society. 10. Assume responsibility for life-long learning and professional career development. DON Program Evaluation Plan 2 MSN Program Student Learning Outcomes: 1. Synthesize concepts and theories from nursing and related disciplines to form the basis for advanced practice. 2. Analyze socio-cultural, ethical, economic and political issues that influence patient/client and community outcomes. 3. Utilize the process of scientific inquiry to validate and refine knowledge and research relevant to advanced practice nursing. 4. Demonstrate expertise in a defined area of advanced practice. 5. Integrate health promotion and disease prevention concepts in advanced practice nursing. 6. Demonstrate cultural sensitivity and an understanding of human diversity in delivery of health care across the lifespan. 7. Demonstrate proficiency in the use and management of advanced technology related to a defined area of advanced practice nursing. 8. Demonstrate the ability to engage in multidisciplinary professional relationships in the conduct of advanced practice. Evaluation Plan: In order to meet standards for our accrediting bodies, the Council on Collegiate Nursing Education (CCNE), the Council on Accreditation of Nursing Anesthesia Programs (COA), and our approval body, the NC Board of Nursing (NCBON), a new program evaluation plan for the department was developed in 2001 and implemented in September of that year. The evaluation plan is outcome-based, inclusive of our BSN and MSN programs, and reflects the requirements of CCNE, COA, and the NCBON for total program evaluation. The evaluation (assessment) plan is reviewed and revised each year and appears on the next page. DON Program Evaluation Plan 3 Western Carolina University College of Applied Sciences Department of Nursing Program Evaluation Plan for BSN and MSN Outcome 1. The Mission, Philosophy, and Terminal Outcomes of the BSN and MSN Programs are congruent with those of the University and the Department of Nursing (DON) faculty beliefs and goals. 2. BSN & MSN programs are logically organized, internally consistent, and based on the Areas of Evaluation BSN & MSN Philosophy, Conceptual Framework (CF), Terminal and Level Outcomes A. Curriculum Plan Indicators (When Applicable) A. BSNapproval by NC State Board of Nursing (NCSBN) Timeframe: Data Collection Individual(s) Responsible Methodology Evaluation/ Development of Recommendations At least every 5 years (Beginning of academic year -2000, 2005) Curriculum Committee (CC) Content analysis done by CC or designated subgroups of CC. CC B. BSN & MSNAccreditatio n by CCNE (compliance with standards) A. BSNapproval by NCSBN Decision-Making Faculty Organization, who direct implementatio n of any changes and re-evaluation timeframe at a one and/or two year interval after implementation. A. At least every 5 years (Beginning of academic year -2000, 2005) A. CC A. CC or designated subgroup of CC will review the curriculum plan at least every 5 years or more frequently as needed. A. CC Faculty Organization, who direct implementatio n of any changes and re-evaluation DON Program Evaluation Plan 4 Philosophy, CF, and Terminal Outcomes. timeframe at a one and/or two year interval after implementation. B. Individual Courses B. BSN & MSNAccreditatio n by CCNE (compliance with standards) B. As needed B. Any faculty or Level Team B. Level B. Proposed changes Teams and/or in individual courses CC originate at the team level. Proposed substantive changes (i.e., changes in course description, objectives, or significant changes in content) are referred to the CC. DON Program Evaluation Plan 5 Outcome 3. BSN & MSN Programs reflect current professional standards and practice guidelines as well as those of the communities of interest. Areas of Evaluation Indicators (When Applicable) A. BSNA. AACN Essentials for approval by Baccalaureate NCSBN and Masters Nursing Education, NCBON Approval Standards and Practice Act, ANA Standards of Clinical Nursing Practice and AP Nursing, NONPF Criteria for Evaluation of NP Programs, AANP Standards of Practice, SREB Nurse Education Guidelines, COA/CRNA Standards. Timeframe: Data Collection A. At least every 5 years (Beginning of academic year -2000, 2005) Individual(s) Responsible A. CC Methodology Development of Decision-Making Recommendations A. CC A. CC or designated subgroup will perform content analysis on curriculum plans and content at least every 5 years to ensure compliance with standards. Faculty Organization, who direct implementatio n of any changes and re-evaluation timeframe at a one and/or two year interval after implementation. DON Program Evaluation Plan 6 B. 1) DON Advisory Council 2) Department Head's Student Advisory Council B. BSN & MSNAccreditatio n by CCNE (compliance with standards) B. 1) Annually 2) Annually B. Department Head B. Department Head completes content analysis on minutes/report from respective council meetings and presents to faculty on annual basis. B. Department Head DON Program Evaluation Plan 7 Outcome 4. Course content and teaching/learn ing practices contribute to fulfillment of course objectives, level outcomes & Program Terminal Outcomes. Areas of Evaluation Indicators (When Applicable) Timeframe: Data Collection Individual(s) Responsible A. NCLEX Program Report A. 50th percentile or better for categories within each content dimension of the test plan. A. Annually A. CC B. ATI Exam B. 65th percentile or > student group performance on Institutional Profile B. Annually B. CC C. Course Evaluations C. Semiannually or annually C. Level Team Methodology Development of Decision-Making Recommendations A. & B. CC A. & B. CC reviews NCLEX Program Report. Categories where student group performance falls below the 50th percentile* will be analyzed for possible causes and solutions. CC reviews ATI data. When student group performance falls below 65th percentile compared to bachelor norm group*, data will be analyzed for possible causes and solutions. (* over 2 year period) C. Level Teams perform course evaluation based on student course evaluation data and student performance. Proposed substantive changes (i.e., changes A. & B. Faculty Organization, who direct implementatio n of changes and reevaluation timeframe at a one and/or two year interval after implementation. C. Level Team C. Level Teams and/or for minor changes or CC Faculty Organization for substantive changes who direct DON Program Evaluation Plan 8 in course description, objectives, or significant changes in content) are referred to the CC. implementation of changes and re-evaluation timeframe at a one and/or two year interval after implementation. 5. Clinical facilities provide experiences that assist in meeting BSN & MSN course objectives and Program Terminal Outcomes. Clinical Course Evaluations Semiannually or annually Level Team Level Teams perform Level Teams clinical course evaluations based on student and faculty evaluation data. Changes that involve the use of new facilities where agency contracts must be Level Team directs implementation of changes and re-evaluation timeframe at a one and/or two year interval after implementation. DON Program Evaluation Plan 9 Outcome Areas of Evaluation Indicators (When Applicable) Timeframe: Data Collection 5. (cont.) 6. Graduating students, alumni, and employers are satisfied with the BSN and MSN program. Alumni Surveys: A. Graduating BSN Seniors B. BSN Alumni (1 & 5 yrs.) C. Graduating MSNs D. MSN Alumni (1 & 5yrs.) 80% or greater satisfaction rate on all alumni surveys. A. May B. Summer C. August D. Summer Individual(s) Responsible Methodology Development of Decision-Making Recommendations Negotiated are referred to the Department Head. Level team faculty and/or Department Head negotiate proposed changes within contracted clinical facilities on a case-bycase basis or at annual clinical agency meetings. Undergraduate Distributed by CC, AA, or and Graduate secretaries, alumni IR Secretaries at affairs, or IR at times month of noted in column 2. CC, graduation and AA, IR analyzes and 1 year. Alumni summarizes data as Affairs (AA) at appropriate. 5 years (2000, 2005, 2010, etc.). Faculty Organization, who direct implementatio n of changes and reevaluation timeframe at a one and/or two year interval after implementation. DON Program Evaluation Plan 10 Employer Surveys (every 5 years) 80% or greater satisfaction rate on all employer surveys. DON Advisory Council 7. BSN and MSN students are able to fulfill level and program terminal outcomes. November (2000, 2005, 2010, etc.) Institutional Research (IR) Annually Department Head Content analysis on minutes/report from council meeting with presentation to faculty on annual basis. Department Head A. Student Affairs Committee (SAC) A. SAC reviews potential student application packets. Applicants are scored and ranked based on A. (cont.) criteria. Qualified students are offered admission Remainder of applicants placed on waiting list. Capstone Faculty reviews application packets for RN to BSN option on an ongoing basis; admission recommendations are made to SAC as A. SAC BSN Students: A. Admission Criteria A. -Cumulative GPA 2.75 or > PreLicensure (PL). 2.5 or > Capstone A.Annually (Fall for PL students). A. (cont.) A. (cont.) -Completion of all -Ongoing Major Requirements (Capstonewith a C (2.0) or > RN to -60 or > semester BSN) hours of college credit -PL students: competitive Verbal SAT scores and Essay Question Score A. SAC DON Program Evaluation Plan 11 necessary. B. Retention Rates C. Graduation Rates B. -90% or > retention rate (PL students) -Enrolled in at least 2 WCU courses per year (Capstone) C. 90% or > graduation rate (within 2 years for PL students, 5 years Capstone) B. Biannually C. Annually B. Level Team C. SAC B. Level Teams review B. Level student group progress Team, CC, or SAC at the end of each semester. Student attrition for academic reasons is analyzed individually and collectively for patterns. Any proposals that involve changes in curriculum or admission processes are made to the CC or SAC respectively. C. SAC reviews graduation rate data. Any proposals that involve changes in curriculum or admission processes are made to the CC or faculty respectively. C. CC or SAC B., C., D., & E. Faculty Organization, who direct implementatio n of changes and reevaluation timeframe at a one and/or two year interval after implementation DON Program Evaluation Plan 12 Outcome 7. (cont.) Areas of Evaluation Indicators (When Applicable) Timeframe: Data Collection Individual(s) Responsible Methodology Development of Decision-Making Recommendations D. NCLEX Pass Rates D. 90% or > firsttime pass rate D. Annually D. CC D.CC analyzes NCLEX Performance Report and Individual Candidate Reports from unsuccessful candidates for patterns and deficiencies. D. CC E. Employment Rates -Graduating Seniors -BSN Alumni (1 year) E. 95% or > employment rate in nursing E. Annually E. AA E. AA analyzes graduate & alumni surveys for rates and types of employment. A report of findings is developed and presented to faculty on an annual basis. E. AA A. -BSN from nationally accredited nursing program -GPA 3.0 on 4.0 scale last 60 hours Undergrad. Work or 2.85 on 4.0 A. Annually (Fall) A. SAC A. SAC or subgroup A. SAC reviews applicant pool. Applicants are scored and ranked. Qualified applicants are offered admission. Admission of qualified students continues until seats MSN Students: A. Admission Criteria A. SAC DON Program Evaluation Plan 13 scale cumulatively -GRE scores: Combined Verbal and Quant. of 850, minimum 400 Verbal, Analytic 4.0 -Intro. Statistics course -Undergraduate Research course -RN with NC licensure -1 year or > clinical nursing experience as RN B. Retention Rates B. 85% or > retention rate are filled prior to beginning academic year. B. Annually B. Graduate Level Team B. Level Team reviews B. Level student group progress Team, CC, or SAC at the end of each semester. Student attrition for academic reasons is analyzed individually and collectively for patterns. Any proposals that involve changes in curriculum or B., C., D., & E. Faculty Organization, who direct implementation of changes and re-evaluation timeframe at a one and/or two DON Program Evaluation Plan 14 Outcome Areas of Evaluation Indicators (When Applicable) Timeframe: Data Collection Individual(s) Responsible Methodology Development of B., C., D., & E. (cont.) year interval after implementation. B. (cont.) admission processes are made to the CC or SAC respectively. 7. (cont.) Decision-Making Recommendations C. Graduation Rates C. 85% or > graduation rate (within 3 years) C. Annually C. Graduate Director C. Graduate Director reviews graduation rate data. Any proposals that involve changes in curriculum or admission processes are made to the CC or SAC respectively. C. Graduate Director D. –Competency Exams -Research Project or Thesis Defense -Certification Exam Pass Rates (ANCC and/or AANP) -Nurse Educator (NE) (NLN) Certification Exam D. –Successful completion of Competency Exams -Successful defense of Research Project or Thesis -90% or > first time pass rate for FNP or NE exam (2 years post graduation – optional) D. Annually D. Graduate Director D. Graduate Director distributes selfaddressed/stamped cards for MSN graduates to report exam status. Upon return of cards, Director conducts random interviews with graduates (appx. 20-30% of class) to determine their D. Graduate Director DON Program Evaluation Plan 15 E. Employment Rates-Graduating MSN -MSN Alumni (1 year) 8. Library collection and Learning Lab Facilities support the achievement of BSN & MSN outcomes. E. 80% or > employment rate as FNP in primary care setting or as Nurse Educator in appropriate setting. E. Annually E. Graduate Director A. Library holdings A. Additions to collection annually. Review of entire collection at least every five years A. Nursing Faculty Library Liaison (NFLL) (1 Cullowheebased, 1 Enkabased) B. Learning Lab supplies and equipment B. Annually B. Level Directors perception of program effectiveness. E. Graduate Director analyzes graduate & alumni surveys for rates and types of employment. A report of findings is developed and presented to faculty on an annual basis. A. NFLL reviews newly published literature; seek input from faculty on collection needs, and compiles list of recommendations. Review of entire collection is done in conjunction with collection supervisor at library. NFLL may designate individuals or subgroups to review holdings. B. Level Directors or designee(s) examine learning lab needs. E. Graduate Director A. NFLL A. Faculty organization. B. Level Directors B. Department Head in conjunction with Level Directors DON Program Evaluation Plan 16 9. Faculty accomplishme nts are congruent with the mission, philosophy, and terminal outcomes of the DON. Annual Faculty Evaluation (AFE) Documents and Annual Review of Faculty Activities Documentation A. Teaching: # of advisees, thesis/project committees (member or supervised) B. Service: # of Departmental, College, University committees. # of memberships/ offices in professional associations or honor societies. # of student recruitment activities. # of community service activities C. Research/ Creative Works: # of refereed or nonrefereed publications, textbooks or chapters, professional conference papers and presentations, journal manuscripts reviewed, externally Annually April/May Department Head & FA Department Head & FA reviews documents submitted by faculty for AFE process; within the framework of teaching, service, scholarship, & practice, the data is analyzed as an aggregate for congruency. A report of findings is compiled and presented to faculty. Department Head & FA Department Head/Faculty Organization, who direct implementation of changes and re-evaluation timeframe at a one and/or two year interval after implementation. DON Program Evaluation Plan 17 funded grant applications written/received. D. Practice: # and type of practice activities. # and type of professional credentials/ Certifications. VPH; 8/01: Approved by Department of Nursing Faculty; 9/01 Revised VPH; 3/02: Revision Approved by Faculty; 4/02; Reviewed and Revised by Nursing Executive Committee; 8/04: Revisions approved by Nursing Faculty 8/04; Reviewed and Revised by Nursing Executive Committee-9/05; Reviewed and Revised by Program Evaluation Committee-1/06: Revisions approved by Nursing Faculty 1/06. Key to Abbreviations: AA – Alumni Affairs Committee CC – Curriculum Committee DH – Department Head FA – Faculty Affairs Committee IR – Institutional Research (University Level) SAC – Student Affairs Committee