Florida International University: Program Outcome Assessment Results 2009-2010 Academic Unit: College of Nursing and Health Sciences Degree Program: Master of Science in Nursing Link to Unit’s Mission: The mission of the CNHS/Nursing Unit is to teach, conduct research, and serve the community. The College prepares diverse health care professionals as providers and leaders in the delivery of high quality, accessible, culturally competent care within a highly technological and global environment. The College promotes, expands and validates scientific knowledge and evidence-based practice through interdisciplinary research. Program Outcome Assessment Methods MSN students will demonstrate professional nurse specialist content/discipline knowledge and skills on the comprehensive EXIT examinations. CRITERIA Pass rates on national standardized comprehensive EXIT examinations (HESI/Fitzgerald/PNP/Anesthesia Self-Evaluation Examination [SEE]). Examination content includes all core competencies. Content/discipline knowledge and skills are theory-based actions reflected in the core competencies found in: STANDARD MSN students enrolled in the final semester course will pass at the facultydetermined passing score (depends on national average for each certification exam) on the national standardized comprehensive EXIT examination. Results (Data Summary and Analysis) Term #Students EXIT %Pass (1st Sitting) NURSE PRACTITIONER (NP) Summer 2010 Child Adult Family No cohort 38 100% 60 100% Total 98 100% PROCEDURE 1) The EXIT examination is administered during the final semester synthesis course. National Organization Of 2) The data will be aggregated to determine the percentile of the students who met NURSE ANESTHESIA Nurse Practitioner Faculties the standard. Fall 2009 Domains And Core Competencies Of Nurse 3) All students in the synthesis course will be assessed. Total 30 100% (self-evaluation exam) Practitioner Practice (NONPF, 2006); or Scope and Standards for Nurse Anesthesia Practice (AANA, 2005) Use of Results for Improving Program NP-MSN Tracks: In 2010, 100% of the NP students passed the standardized comprehensive EXIT examinations; For 2010-2011 administrators and faculty will institute the following strategies: 1) Mandatory comprehensive EXIT examination during the final semester and a 2-3 day examination review session 2) Students who score below the identified EXIT examination acceptable passing score will develop a remediation plan; and 3) Previous strategies will continue to be implemented (See previous MSN student learning outcome reports). See additional strategies under certification examination pass rates. NP-ANESTHESIA Track: The nurse anesthesia EXIT exam in Fall 2009 was a self-evaluation exam; however, the nurse anesthesia certification pass rate was 76.7%, a decrease from 84.6% in 2008. Strategies initiated during 2010-2011 were the following: 1) Re-sequence 4 courses to better balance curricular load; 2) Modify test blueprints and incorporate certification exam question formats; 3) Continue computerized exams to match certification exam delivery; 4) Incorporate review questions prior to clinical to bridge theory-clinical gap; 5) Establish a pass/fail EXIT comprehensive exam that includes an oral/written component; 6) Contract with a new external board exam review group that will provide computerized practice exams and pre & post review course mock exam data. 1 Florida International University: Program Outcome Assessment Results 2009-2010 Academic Unit: College of Nursing and Health Sciences Degree Program: Master of Science in Nursing Link to Unit’s Mission: The mission of the CNHS/Nursing Unit is to teach, conduct research, and serve the community. The College prepares diverse health care professionals as providers and leaders in the delivery of high quality, accessible, culturally competent care within a highly technological and global environment. The College promotes, expands and validates scientific knowledge and evidence-based practice through interdisciplinary research. Program Outcome Assessment Methods Results (Data Summary and Analysis) Post graduation, MSN graduates will demonstrate professional nurse specialist content/discipline knowledge and skills on the national certification examinations. CRITERIA Pass rates on certification examinations - American Nurses Credentialing Center (ANCC), American Academy of Nurse Practitioners (AANP), Pediatric Nursing Certification Board, and the Nurse Anesthesia National Certification Examination (NCE). CERT EXAM Pass Rates (1st Sitting) Adult NP-AANP Adult NP-ANCC Pediatric NP-ANCC Family NP-AANP Family NP-ANCC A Psych NP-ANCC NP-% PASS RATE # 2002 %CON Pass %U.S. Pass # 2003 %CON Pass %U.S. Pass 13 4 30.8% 100.0% 79.1% 82.3% 12 5 5 58.3% 60.0% 100.0% 77.9% 53.7% 85.1% 4 5 __ 26 75.0% 60.0% 86.9% 84.8% 54% Nurse Anesthesia STANDARD Pass rates for MSN alumni (first sitting) will be within 10% range of the national pass rates. CERT EXAM Pass Rates (1st Sitting) Adult NP-AANP Adult NP-ANCC Pediatric NP-ANCC Family NP-AANP Family NP-ANCC A Psych NP-ANCC Fam/Psy NP-ANCC Ped Nurs Cert Board NP-% PASS RATE 61.5% 62.5% 50.0% 70.0% 81.3% 20.0% 2004 %CON Pass 5 13 3 2 6 80.0% 53.9% 0.0% 0.0% 50.0% 82.7% 50.6% 88.1% # 2005 %CON Pass %U.S. Pass 5 22 5 80.0% 63.6% 60.0% 83.0% 82.4% 48.9% 66.7% 75.0% 91.7% 79.9% 97.0% __ 22 68% __ 29 48% 14 85.7% 35 94.4% 33 2007 92.8% 84.3% 78.7% 92.8% 93.2% 80.1% %U.S. Pass 6 8 __ 46 2006 13 16 16 10 16 5 # 37 15 4 8 75.7% 53.3% 75.0% 62.5% 2008 90.0% 87.2% 73.9% 83.0% 15 9 60.0% 44.4% 67% 2009 85.3% 82.4% 38 19 12 14 14 4 82.00% 63.16% 91.67% 79.00% 92.86% 50.00% 87.54% 85.05% 7 71.4% 93.1% PROCEDURE 4 25.0% 78.8% 93.07% Pass rates will be reported from 9 55.6% 79.9% 80.62% 4 75.0% 82.9% American Nurses Credentialing __ __ __ 4 75.00% Center (ANCC), American 76 62% 77 68% 35 54% 101 82% Academy of Nurse Practitioners (AANP), Pediatric Nurse Anesthesia 37 91.9% 35 92.1% 26 84.6% 30 76.7% 86.7% Nursing Certification, and the Nurse Anesthesia National Certification Examination (NCE) for all the alumni. Use of Results for Improving Program NP-MSN Tracks: In 2009 all NP nurse practitioner certification pass rates were 82%, an increase from 54% in 2008. For 2010-2011 administrators and faculty teaching in the NP tracks will continue the following strategies: 1) Continue the numerical passing grade for all graduate courses from “B” =80-83 to “B+” =85-88; 2) Reduced the number of conditionally admitted students; 3) Previous strategies will continue to be implemented (See previous outcome reports); and 4) See additional strategies under comprehensive EXIT examination pass rates. ANESTHESIA-MSN Track: The nurse anesthesia certification pass rate in 2009 was 76.7%, a decrease from 84.6% in 2008. Administrators attribute part of the decrease in the certification pass rate to a new national testing format: multiple-multiple choice questions, short answer, clicking on anatomical locations, and calculated answers (the national pass rate also decreased). Strategies initiated during 2010-2011 were the following: 1) Re-sequence 4 courses to better balance curricular load; 2) Modify test blueprints and incorporate certification exam question formats; 3) Continue computerized exams to match certification exam delivery; 4) Incorporate review questions prior to clinical to bridge theory-clinical gap; 5) Establish a pass/fail comprehensive EXIT exam that includes oral/written component; 6) Contract with a new external board exam review group that will provide computerized practice exams and pre & post review course mock exam data. 2 Florida International University: Program Outcome Assessment Results 2009-2010 Academic Unit: College of Nursing and Health Sciences Degree Program: Master of Science in Nursing Link to Unit’s Mission: The mission of the CNHS/Nursing Unit is to teach, conduct research, and serve the community. The College prepares diverse health care professionals as providers and leaders in the delivery of high quality, accessible, culturally competent care within a highly technological and global environment. The College promotes, expands and validates scientific knowledge and evidence-based practice through interdisciplinary research. Program Outcome As nurse specialists, MSN alumni will function as effective communicators in advanced practice. Assessment Methods CRITERIA Alumni Survey: Effective communication item statements evaluated are noted in the results. STANDARD On a 5 point Likert-type scale (1 = Not at all 5 = Very much), alumni will rate the communication survey items with an average of 3.5 or higher . PROCEDURE 1) At two (2) months and one (1) year post graduation, alumni will be sent the survey. 2) Data will be aggregated to determine the mean of the statement. CRITERIA Employer Performance Appraisal: Effective communication item statements evaluated are noted in the results. STANDARD On a 5 point Likert-type scale (1 = Not at all 5 = Very much), alumni will rate at least one of the communication survey items with an average of 3.5 or higher. PROCEDURE 1) The Appraisal will be included with the POST 1 YR Alumni Survey. Alumni recipients are instructed to have his/her employer return the survey. 2) Data will be aggregated to determine the mean of the statement. Results (Data Summary and Analysis) EXIT MSN Alumni Survey: On the following statements: “FIU CON prepared you to function as a professional nurse in: Fall 09 Sum 10 Sum 10 ANP FNP Return=2 (4%) 10(10%) 13(13%) -#2 communicating effectively with individuals/families.” 4.00 4.56 4.08 -#3 communicating effectively intra-professionally.” 4.00 4.44 4.15 -#7 using consultation activities to meet client needs.” 4.00 4.44 3.85 -#8 performing professional education activities.” 4.00 4.56 3.92 -#10 assuming leadership roles in ANP.” 4.00 4.22 3.85 Sum 10 P-MSN 4 (4%) 4.50 4.50 4.25 4.25 4.25 POST 1 YR MSN Alumni Survey: (Spring 2010) On the following statements: “FIU CON prepared you to function as a professional nurse in: Total Return = 32 (10%) Return= 17 -#2 communicating effectively with individuals/families.” 4.18 -#3 communicating effectively intra-professionally.” 4.18 -#7 using consultation activities to meet client needs.” 4.47 -#8 performing professional education activities.” 4.12 -#10 assuming leadership roles in ANP.” 4.24 MSN Employer Performance Appraisal (Spring, 2010) On the following statement: “Indicate appropriate performance factors for this employee, taking into consideration the employee’s educational level and job title/description: Total Return = 18 (5%) Return= 9 -#3 Inter-relationships” (rapport) 4.67 -#4 Leadership” 4.56 -#5 Written/verbal communication skills” 4.67 -#6 Participation in organization” 4.56 *< 3.50 Use of Results for Improving Program During 2009-2010 the MSN faculty members completed revising MSN course objectives based on curriculum guidelines The Essentials of Masters Education for Advanced Practice Nursing (American Association of Colleges of Nursing, 1996), recommendations from the CCNE professional accreditation visitors and the MSN consultants (Dr. Stanhope and Dr. Kapustin), and feedback from students and alumni on the alumni surveys. The MSN faculty revised course objectives and topical outlines to strengthen the areas of ethics, health care policy, health care financing, and the domains and core competencies of nurse practitioner practice. The course objectives revision will be implemented during 2010-2011. 3 Florida International University: Program Outcome Assessment Results 2009-2010 Academic Unit: College of Nursing and Health Sciences Degree Program: Master of Science in Nursing Link to Unit’s Mission: The mission of the CNHS/Nursing Unit is to teach, conduct research, and serve the community. The College prepares diverse health care professionals as providers and leaders in the delivery of high quality, accessible, culturally competent care within a highly technological and global environment. The College promotes, expands and validates scientific knowledge and evidence-based practice through interdisciplinary research. Program Outcome As nurse specialists, MSN alumni will function as effective caregivers in advanced practice. Assessment Methods CRITERIA Alumni Survey: Professional nurse specialist item statements evaluated are noted in the results. STANDARD On a 5 point Likert-type scale (1 = Not at all 5 = Very much), alumni will rate caregiver survey items with an average of 3.5 or higher.. PROCEDURE 1) At two (2) months and one (1) year post graduation, alumni will be sent the survey. 2) Data will be aggregated to determine the mean of the statement. CRITERIA Employer Performance Appraisal: Professional nurse specialist item statements evaluated are noted in the results. STANDARD On a 5 point Likert-type scale (1 = Not at all 5 = Very much), alumni will rate at least one of the professional nurse specialist survey items with an average of 3.5 or higher. PROCEDURE 1) The Appraisal will be included with the POST 1 YR Alumni Survey. Alumni recipients are instructed to have his/her employer return the survey. 2) Data will be aggregated to determine the mean of the statement. Results (Data Summary and Analysis) EXIT MSN Alumni Survey: On the following statements: “FIU CON prepared you to function as a professional nurse in: Fall 09 Sum 10 ANP Return=2 (4%) 10(10%) -#1 assessing individuals’ and families’ needs.” 3.50 4.44 -#4 performing advanced practice therapeutics.” 4.50 4.33 -#5 managing client care.” 4.50 4.33 -#6 adapting advanced practice therapeutics to situations.” 4.50 4.33 -#9 conducting research studies for improving nursing practice.” 4.00 4.44 -#11 understanding legal and ethical implications for ANP." 4.50 4.11 -#12 understanding cultural implications for ANP." 4.00 4.33 -#13 obtaining advanced certification.” 4.50 4.44 Sum 10 FNP 13(13%) 4.08 4.15 4.25 3.92 4.08 4.00 4.00 4.08 Sum 10 P-MSN 4(4%) 4.50 4.50 4.50 4.25 4.00 3.75 4.25 4.25 POST 1 YR MSN Alumni Survey: (Spring 2010) On the following statements: “FIU CON prepared you to function as a professional nurse in: Total Return = 32 (10%) Return= 17 -#1 assessing individuals’ and families’ needs.” 4.18 -#4 performing advanced practice therapeutics.” 4.29 -#5 managing client care.” 4.41 -#6 adapting advanced practice therapeutics to situations.” 4.53 -#9 conducting research studies for improving nursing practice.” 4.18 -#11 understanding legal and ethical implications for ANP." 4.41 -#12 understanding cultural implications for ANP." 4.47 -#13 obtaining advanced certification.” 4.29 MSN Employer Performance Appraisal: (Spring, 2009) On the following statement: “Indicate appropriate performance factors for this employee, taking into consideration the employee’s educational level and job title/description: Total Return = 18 (5%) Return= 9 -#1 Knowledge base” 4.78 -#2 Professional performance” 4.89 *< 3.50 Use of Results for Improving Program During 2009-2010 the MSN faculty members completed revising MSN course objectives based on curriculum guidelines The Essentials of Masters Education for Advanced Practice Nursing (American Association of Colleges of Nursing, 1996), recommendations from the CCNE professional accreditation visitors and the MSN consultants (Dr. Stanhope and Dr. Kapustin), and feedback from students and alumni on the alumni surveys. The MSN faculty revised course objectives and topical outlines to strengthen the areas of ethics, health care policy, health care financing, and the domains and core competencies of nurse practitioner practice. The course objectives revision will be implemented during 2010-2011. 4 Florida International University: Program Outcome Assessment Results 2009-2010 Academic Unit: College of Nursing and Health Sciences Degree Program: Master of Science in Nursing Link to Unit’s Mission: The mission of the CNHS/Nursing Unit is to teach, conduct research, and serve the community. The College prepares diverse health care professionals as providers and leaders in the delivery of high quality, accessible, culturally competent care within a highly technological and global environment. The College promotes, expands and validates scientific knowledge and evidence-based practice through interdisciplinary research. Support System Assessment Method Results (Data Summary and Analysis) CNHS administrators and staff will provide courteous, timely, and competent services and effective support to MSN students. CRITERIA Alumni survey: Level of satisfaction item statements evaluated are noted in the results. EXIT MSN Alumni Survey: Indicate your level of satisfaction for Nursing resources/ support services during your program of study: STANDARD On a 5 point Likert-type scale (1 = Not at all 5 = Very much), alumni will rate the level of satisfaction survey items with an average of 3.5 or higher. PROCEDURE 1) At two (2) months and one (1) year post graduation, alumni will be sent the survey. 2) Data will be aggregated to determine the mean of the statement. Fall 09 NURSING program information (printed) NURSING web site NURSING support personnel (e.g., secretaries) NURSING pre-program advisement services NURSING program advisement services NURSING scholarship/financial aid information NURSING skills laboratory (ies) NURSING audiovisual materials NURSING computer laboratory NURSING library materials NURSING student governance Sum 10 ANP Return=2(4%) Return=10(10%) 4.50 4.20 5.00 4.20 4.00 4.10 4.50 4.22 5.00 4.20 4.00 4.80 4.50 4.30 5.00 4.22 4.50 4.60 3.50 4.60 4.00 5.10 Sum 10 FNP Return=13(13%) 4.21 4.00 3.64 4.36 3.86 3.71 3.93 3.93 4.29 4.21 4.92 Sum 10 P-MSN Return=4(4%) 4.50 4.75 3.00* 3.25* 3.75 5.00 4.75 4.25 4.00 4.50 5.00 Spring 10 POST 1 YR Return=17 4.36 4.44 4.33 4.13 4.07 3.85 4.40 4.40 4.14 4.00 3.89 Indicate your level of satisfaction for Florida International University (FIU) resources/ support services during your program of study: FIU web site 4.50 4.40 4.57 4.25 4.12 FIU advisement service 4.50 4.11 4.43 4.75 4.00 FIU admission services 3.50 4.20 3.79 3.50 4.00 FIU registration services 3.50 4.40 4.14 2.75* 3.71 FIU financial aid services 4.00 4.60 3.93 3.50 3.67 FIU Learning Center 4.00 5.00 4.14 4.50 4.14 FIU library services 4.50 4.30 4.36 4.50 4.41 FIU health services 4.00 4.80 4.79 4.00 3.64 FIU student governance 4.00 5.10 4.93 5.00 3.56 *< 3.50 Use of Results for Improving Student Learning CON support personnel: Support personnel will attend appropriate training sessions to increase knowledge and skills. CON pre-program/program advisement services: 1) Student advisement workshops will be held annually by experienced faculty/staff for new and current faculty; 2) A student services satisfaction survey is currently being developed. FIU services: At meetings with FIU administrators, issues with FIU services (registration, etc.) were discussed. 5 Florida International University: Program Outcome Assessment Results 2009-2010 Academic Unit: College of Nursing and Health Sciences Degree Program: Master of Science in Nursing Link to Unit’s Mission: The mission of the CNHS/Nursing Unit is to teach, conduct research, and serve the community. The College prepares diverse health care professionals as providers and leaders in the delivery of high quality, accessible, culturally competent care within a highly technological and global environment. The College promotes, expands and validates scientific knowledge and evidence-based practice through interdisciplinary research. Summarize use of results for continuous improvement of the educational program: Comprehensive (EXIT) Examination NP-MSN Tracks: In 2010, 100% of the NP students passed the standardized comprehensive EXIT examinations; For 2010-2011 administrators and faculty will continue the following strategies: 1) Mandatory comprehensive EXIT examinations and a 3 day examination review session. Students must take the HESI and Fitzgerald (pre/post) examinations and must attend a 3 day Fitzgerald Review session; 2) To pass the capstone course, all students must receive a passing score (determined by the individual examination passing scores) on the two comprehensive EXIT examinations (HESI and Fitzgerald post-test). Child Health students will use the PNP examination; 3) Faculty will provide remediation if students do not pass any of the comprehensive EXIT examinations; 4) If all efforts fail and students still do not pass the comprehensive EXIT examinations, they will be required to repeat the course the following semester; 5) Previous strategies will continue to be implemented (See previous MSN student learning outcome reports). See additional strategies under certification examination pass rates. NP-ANESTHESIA Track: The nurse anesthesia EXIT exam in Fall 2009 was a self-evaluation exam; however, the nurse anesthesia certification pass rate was 76.7%, a decrease from 84.6% in 2008. Strategies initiated during 2010-2011 were the following: 1) Re-sequence 4 courses to better balance curricular load; 2) Modify test blueprints and incorporate certification exam question formats; 3) Continue computerized exams to match certification exam delivery; 4) Incorporate review questions prior to clinical to bridge theory-clinical gap; 5) Establish a pass/fail EXIT comprehensive exam that includes an oral/written component; 6) Contract with a new external board exam review group that will provide computerized practice exams and pre & post review course mock exam data. Certification Examinations NP-MSN Tracks: In 2009 all NP nurse practitioner certification pass rates were 82%, an increase from 54% in 2008. For 2010-2011 administrators and faculty teaching in the NP tracks will continue the following strategies: 1) Continue the numerical passing grade for all graduate courses from “B” =80-83 to “B+” =85-88; 2) Reduced the number of conditionally admitted students; 3) Previous strategies will continue to be implemented (See previous outcome reports); and 4) See additional strategies under comprehensive EXIT examination pass rates. ANESTHESIA-MSN Track: The nurse anesthesia certification pass rate in 2009 was 76.7%, a decrease from 84.6% in 2008. Administrators attribute part of the decrease in the certification pass rate to a new national testing format: multiple-multiple choice questions, short answer, clicking on anatomical locations, and calculated answers (the national pass rate also decreased). Strategies initiated during 2010-2011 were the following: 1) Re-sequence 4 courses to better balance curricular load; 2) Modify test blueprints and incorporate certification exam question formats; 3) Continue computerized exams to match certification exam delivery; 4) Incorporate review questions prior to clinical to bridge theory-clinical gap; 5) Establish a pass/fail comprehensive EXIT exam that includes oral/written component; 6) Contract with a new external board exam review group that will provide computerized practice exams and pre & post review course mock exam data. Alumni Surveys During 2009-2010 the MSN faculty members completed revising MSN course objectives based on curriculum guidelines The Essentials of Masters Education for Advanced Practice Nursing (American Association of Colleges of Nursing, 1996), recommendations from the CCNE professional accreditation visitors and the MSN consultants (Dr. Stanhope and Dr. Kapustin), and feedback from students and alumni on the alumni surveys. The MSN faculty revised course objectives and topical outlines to strengthen the areas of ethics, health care policy, health care financing, and the domains and core competencies of nurse practitioner practice. The course objectives revision will be implemented during 2010-2011. Program Support/Services During 2009-20010 the following changes were made to support services based on feedback (level of satisfaction items below average of 3.5) from alumni: CON support personnel: Support personnel will attend appropriate training sessions to increase knowledge and skills. CON pre-program/program advisement services: 1) Student advisement workshops will be held annually by experienced faculty/staff for new and current faculty; 2) A student services satisfaction survey is currently being developed. FIU services: At meetings with FIU administrators, issues with FIU services (registration, etc.) were discussed. 6 Florida International University: Program Outcome Assessment Results 2009-2010 Academic Unit: College of Nursing and Health Sciences Degree Program: Master of Science in Nursing Link to Unit’s Mission: The mission of the CNHS/Nursing Unit is to teach, conduct research, and serve the community. The College prepares diverse health care professionals as providers and leaders in the delivery of high quality, accessible, culturally competent care within a highly technological and global environment. The College promotes, expands and validates scientific knowledge and evidence-based practice through interdisciplinary research. NOTE: Due to low return rates on mailed Alumni EXIT and POST 1 YEAR surveys, the alumni surveys were developed in an online format during summer 2101 using Qualtrics software. New procedures will be developed on emailing these surveys during the 2010-11 academic year and forward. 7