Results - CNHS - Florida International University

advertisement
Florida International University:
Program Outcome Assessment Results 2009-2010
Academic Unit: College of Nursing and Health Sciences
Degree Program: Master of Science in Nursing
Link to Unit’s Mission: The mission of the CNHS/Nursing Unit is to teach, conduct research, and serve the community. The College prepares diverse health care professionals as
providers and leaders in the delivery of high quality, accessible, culturally competent care within a highly technological and global environment. The College promotes, expands
and validates scientific knowledge and evidence-based practice through interdisciplinary research.
Program Outcome
Assessment Methods
MSN students will
demonstrate professional
nurse specialist
content/discipline knowledge
and skills on the
comprehensive EXIT
examinations.
CRITERIA
Pass rates on national standardized comprehensive EXIT examinations
(HESI/Fitzgerald/PNP/Anesthesia Self-Evaluation Examination [SEE]).
Examination content includes all core competencies.
Content/discipline
knowledge and skills are
theory-based actions
reflected in the core
competencies found in:
STANDARD
MSN students enrolled in the final semester course will pass at the facultydetermined passing score (depends on national average for each certification exam)
on the national standardized comprehensive EXIT examination.
Results
(Data Summary and Analysis)
Term
#Students EXIT %Pass (1st Sitting)
NURSE PRACTITIONER (NP)
Summer 2010
Child
Adult
Family
No cohort
38
100%
60
100%
Total
98
100%
PROCEDURE
1) The EXIT examination is administered during the final semester synthesis course.
National Organization Of
2) The data will be aggregated to determine the percentile of the students who met
NURSE ANESTHESIA
Nurse Practitioner Faculties
the standard.
Fall 2009
Domains And Core
Competencies Of Nurse
3) All students in the synthesis course will be assessed.
Total
30
100% (self-evaluation exam)
Practitioner Practice
(NONPF, 2006); or
Scope and Standards for
Nurse Anesthesia Practice
(AANA, 2005)
Use of Results for Improving Program
NP-MSN Tracks: In 2010, 100% of the NP students passed the standardized comprehensive EXIT examinations; For 2010-2011 administrators and faculty will institute the following
strategies: 1) Mandatory comprehensive EXIT examination during the final semester and a 2-3 day examination review session 2) Students who score below the identified EXIT
examination acceptable passing score will develop a remediation plan; and 3) Previous strategies will continue to be implemented (See previous MSN student learning outcome
reports). See additional strategies under certification examination pass rates.
NP-ANESTHESIA Track: The nurse anesthesia EXIT exam in Fall 2009 was a self-evaluation exam; however, the nurse anesthesia certification pass rate was 76.7%, a decrease from
84.6% in 2008. Strategies initiated during 2010-2011 were the following: 1) Re-sequence 4 courses to better balance curricular load; 2) Modify test blueprints and incorporate
certification exam question formats; 3) Continue computerized exams to match certification exam delivery; 4) Incorporate review questions prior to clinical to bridge theory-clinical
gap; 5) Establish a pass/fail EXIT comprehensive exam that includes an oral/written component; 6) Contract with a new external board exam review group that will provide
computerized practice exams and pre & post review course mock exam data.
1
Florida International University:
Program Outcome Assessment Results 2009-2010
Academic Unit: College of Nursing and Health Sciences
Degree Program: Master of Science in Nursing
Link to Unit’s Mission: The mission of the CNHS/Nursing Unit is to teach, conduct research, and serve the community. The College prepares diverse health care professionals as
providers and leaders in the delivery of high quality, accessible, culturally competent care within a highly technological and global environment. The College promotes, expands
and validates scientific knowledge and evidence-based practice through interdisciplinary research.
Program Outcome
Assessment Methods
Results
(Data Summary and Analysis)
Post graduation,
MSN graduates
will demonstrate
professional nurse
specialist
content/discipline
knowledge and
skills on the
national
certification
examinations.
CRITERIA
Pass rates on certification
examinations - American
Nurses Credentialing Center
(ANCC), American Academy
of Nurse Practitioners (AANP),
Pediatric Nursing Certification
Board, and the Nurse
Anesthesia National
Certification Examination
(NCE).
CERT EXAM
Pass Rates (1st Sitting)
Adult NP-AANP
Adult NP-ANCC
Pediatric NP-ANCC
Family NP-AANP
Family NP-ANCC
A Psych NP-ANCC
NP-% PASS RATE
#
2002
%CON
Pass
%U.S.
Pass
#
2003
%CON
Pass
%U.S.
Pass
13
4
30.8%
100.0%
79.1%
82.3%
12
5
5
58.3%
60.0%
100.0%
77.9%
53.7%
85.1%
4
5
__
26
75.0%
60.0%
86.9%
84.8%
54%
Nurse Anesthesia
STANDARD
Pass rates for MSN alumni
(first sitting) will be within
10% range of the national pass
rates.
CERT EXAM
Pass Rates (1st Sitting)
Adult NP-AANP
Adult NP-ANCC
Pediatric NP-ANCC
Family NP-AANP
Family NP-ANCC
A Psych NP-ANCC
Fam/Psy NP-ANCC
Ped Nurs Cert Board
NP-% PASS RATE
61.5%
62.5%
50.0%
70.0%
81.3%
20.0%
2004
%CON
Pass
5
13
3
2
6
80.0%
53.9%
0.0%
0.0%
50.0%
82.7%
50.6%
88.1%
#
2005
%CON
Pass
%U.S.
Pass
5
22
5
80.0%
63.6%
60.0%
83.0%
82.4%
48.9%
66.7%
75.0%
91.7%
79.9%
97.0%
__
22
68%
__
29
48%
14
85.7%
35
94.4%
33
2007
92.8%
84.3%
78.7%
92.8%
93.2%
80.1%
%U.S.
Pass
6
8
__
46
2006
13
16
16
10
16
5
#
37
15
4
8
75.7%
53.3%
75.0%
62.5%
2008
90.0%
87.2%
73.9%
83.0%
15
9
60.0%
44.4%
67%
2009
85.3%
82.4%
38
19
12
14
14
4
82.00%
63.16%
91.67%
79.00%
92.86%
50.00%
87.54%
85.05%
7
71.4%
93.1%
PROCEDURE
4
25.0%
78.8%
93.07%
Pass rates will be reported from
9
55.6%
79.9%
80.62%
4
75.0%
82.9%
American Nurses Credentialing
__
__
__
4
75.00%
Center (ANCC), American
76
62%
77
68%
35
54%
101
82%
Academy of Nurse
Practitioners (AANP), Pediatric Nurse Anesthesia
37
91.9%
35
92.1%
26
84.6%
30
76.7%
86.7%
Nursing Certification, and the
Nurse Anesthesia National
Certification Examination
(NCE) for all the alumni.
Use of Results for Improving Program
NP-MSN Tracks: In 2009 all NP nurse practitioner certification pass rates were 82%, an increase from 54% in 2008. For 2010-2011 administrators and faculty teaching in the
NP tracks will continue the following strategies: 1) Continue the numerical passing grade for all graduate courses from “B” =80-83 to “B+” =85-88; 2) Reduced the number of
conditionally admitted students; 3) Previous strategies will continue to be implemented (See previous outcome reports); and 4) See additional strategies under comprehensive
EXIT examination pass rates. ANESTHESIA-MSN Track: The nurse anesthesia certification pass rate in 2009 was 76.7%, a decrease from 84.6% in 2008. Administrators
attribute part of the decrease in the certification pass rate to a new national testing format: multiple-multiple choice questions, short answer, clicking on anatomical locations, and
calculated answers (the national pass rate also decreased). Strategies initiated during 2010-2011 were the following: 1) Re-sequence 4 courses to better balance curricular load; 2)
Modify test blueprints and incorporate certification exam question formats; 3) Continue computerized exams to match certification exam delivery; 4) Incorporate review
questions prior to clinical to bridge theory-clinical gap; 5) Establish a pass/fail comprehensive EXIT exam that includes oral/written component; 6) Contract with a new external
board exam review group that will provide computerized practice exams and pre & post review course mock exam data.
2
Florida International University:
Program Outcome Assessment Results 2009-2010
Academic Unit: College of Nursing and Health Sciences
Degree Program: Master of Science in Nursing
Link to Unit’s Mission: The mission of the CNHS/Nursing Unit is to teach, conduct research, and serve the community. The College prepares diverse health care professionals as
providers and leaders in the delivery of high quality, accessible, culturally competent care within a highly technological and global environment. The College promotes, expands
and validates scientific knowledge and evidence-based practice through interdisciplinary research.
Program
Outcome
As nurse
specialists,
MSN alumni
will function as
effective
communicators
in advanced
practice.
Assessment Methods
CRITERIA
Alumni Survey: Effective communication item statements evaluated are
noted in the results.
STANDARD
On a 5 point Likert-type scale (1 = Not at all  5 = Very much), alumni
will rate the communication survey items with an average of 3.5 or
higher .
PROCEDURE
1) At two (2) months and one (1) year post graduation, alumni will be
sent the survey.
2) Data will be aggregated to determine the mean of the statement.
CRITERIA
Employer Performance Appraisal: Effective communication item
statements evaluated are noted in the results.
STANDARD
On a 5 point Likert-type scale (1 = Not at all  5 = Very much), alumni
will rate at least one of the communication survey items with an average
of 3.5 or higher.
PROCEDURE
1) The Appraisal will be included with the POST 1 YR Alumni Survey.
Alumni recipients are instructed to have his/her employer return the
survey.
2) Data will be aggregated to determine the mean of the statement.
Results
(Data Summary and Analysis)
EXIT MSN Alumni Survey:
On the following statements: “FIU CON prepared you to function as a professional nurse in:
Fall 09
Sum 10
Sum 10
ANP
FNP
Return=2 (4%) 10(10%)
13(13%)
-#2 communicating effectively with individuals/families.” 4.00
4.56
4.08
-#3 communicating effectively intra-professionally.”
4.00
4.44
4.15
-#7 using consultation activities to meet client needs.”
4.00
4.44
3.85
-#8 performing professional education activities.”
4.00
4.56
3.92
-#10 assuming leadership roles in ANP.”
4.00
4.22
3.85
Sum 10
P-MSN
4 (4%)
4.50
4.50
4.25
4.25
4.25
POST 1 YR MSN Alumni Survey: (Spring 2010)
On the following statements: “FIU CON prepared you to function as a professional nurse in:
Total Return = 32 (10%)
Return= 17
-#2 communicating effectively with individuals/families.” 4.18
-#3 communicating effectively intra-professionally.”
4.18
-#7 using consultation activities to meet client needs.”
4.47
-#8 performing professional education activities.”
4.12
-#10 assuming leadership roles in ANP.”
4.24
MSN Employer Performance Appraisal (Spring, 2010)
On the following statement: “Indicate appropriate performance factors for this employee, taking into consideration the
employee’s educational level and job title/description:
Total Return = 18 (5%)
Return= 9
-#3 Inter-relationships” (rapport)
4.67
-#4 Leadership”
4.56
-#5 Written/verbal communication skills”
4.67
-#6 Participation in organization”
4.56
*< 3.50
Use of Results for Improving Program
During 2009-2010 the MSN faculty members completed revising MSN course objectives based on curriculum guidelines The Essentials of Masters Education for Advanced Practice Nursing (American Association
of Colleges of Nursing, 1996), recommendations from the CCNE professional accreditation visitors and the MSN consultants (Dr. Stanhope and Dr. Kapustin), and feedback from students and alumni on the alumni
surveys. The MSN faculty revised course objectives and topical outlines to strengthen the areas of ethics, health care policy, health care financing, and the domains and core competencies of nurse practitioner
practice. The course objectives revision will be implemented during 2010-2011.
3
Florida International University:
Program Outcome Assessment Results 2009-2010
Academic Unit: College of Nursing and Health Sciences
Degree Program: Master of Science in Nursing
Link to Unit’s Mission: The mission of the CNHS/Nursing Unit is to teach, conduct research, and serve the community. The College prepares diverse health care professionals as
providers and leaders in the delivery of high quality, accessible, culturally competent care within a highly technological and global environment. The College promotes, expands
and validates scientific knowledge and evidence-based practice through interdisciplinary research.
Program
Outcome
As nurse
specialists, MSN
alumni will
function as
effective
caregivers in
advanced practice.
Assessment Methods
CRITERIA
Alumni Survey: Professional nurse specialist item statements
evaluated are noted in the results.
STANDARD
On a 5 point Likert-type scale (1 = Not at all  5 = Very much),
alumni will rate caregiver survey items with an average of 3.5 or
higher..
PROCEDURE
1) At two (2) months and one (1) year post graduation, alumni
will be sent the survey.
2) Data will be aggregated to determine the mean of the
statement.
CRITERIA
Employer Performance Appraisal: Professional nurse specialist
item statements evaluated are noted in the results.
STANDARD
On a 5 point Likert-type scale (1 = Not at all  5 = Very much),
alumni will rate at least one of the professional nurse specialist
survey items with an average of 3.5 or higher.
PROCEDURE
1) The Appraisal will be included with the POST 1 YR Alumni
Survey. Alumni recipients are instructed to have his/her
employer return the survey.
2) Data will be aggregated to determine the mean of the
statement.
Results
(Data Summary and Analysis)
EXIT MSN Alumni Survey:
On the following statements: “FIU CON prepared you to function as a professional nurse in:
Fall 09
Sum 10
ANP
Return=2 (4%) 10(10%)
-#1 assessing individuals’ and families’ needs.”
3.50
4.44
-#4 performing advanced practice therapeutics.”
4.50
4.33
-#5 managing client care.”
4.50
4.33
-#6 adapting advanced practice therapeutics to situations.”
4.50
4.33
-#9 conducting research studies for improving nursing practice.” 4.00
4.44
-#11 understanding legal and ethical implications for ANP."
4.50
4.11
-#12 understanding cultural implications for ANP."
4.00
4.33
-#13 obtaining advanced certification.”
4.50
4.44
Sum 10
FNP
13(13%)
4.08
4.15
4.25
3.92
4.08
4.00
4.00
4.08
Sum 10
P-MSN
4(4%)
4.50
4.50
4.50
4.25
4.00
3.75
4.25
4.25
POST 1 YR MSN Alumni Survey: (Spring 2010)
On the following statements: “FIU CON prepared you to function as a professional nurse in:
Total Return = 32 (10%)
Return= 17
-#1 assessing individuals’ and families’ needs.”
4.18
-#4 performing advanced practice therapeutics.”
4.29
-#5 managing client care.”
4.41
-#6 adapting advanced practice therapeutics to situations.”
4.53
-#9 conducting research studies for improving nursing practice.” 4.18
-#11 understanding legal and ethical implications for ANP."
4.41
-#12 understanding cultural implications for ANP."
4.47
-#13 obtaining advanced certification.”
4.29
MSN Employer Performance Appraisal: (Spring, 2009)
On the following statement: “Indicate appropriate performance factors for this employee, taking into consideration the
employee’s educational level and job title/description:
Total Return = 18 (5%)
Return= 9
-#1 Knowledge base”
4.78
-#2 Professional performance”
4.89
*< 3.50
Use of Results for Improving Program
During 2009-2010 the MSN faculty members completed revising MSN course objectives based on curriculum guidelines The Essentials of Masters Education for Advanced Practice Nursing (American Association of
Colleges of Nursing, 1996), recommendations from the CCNE professional accreditation visitors and the MSN consultants (Dr. Stanhope and Dr. Kapustin), and feedback from students and alumni on the alumni
surveys. The MSN faculty revised course objectives and topical outlines to strengthen the areas of ethics, health care policy, health care financing, and the domains and core competencies of nurse practitioner practice.
The course objectives revision will be implemented during 2010-2011.
4
Florida International University:
Program Outcome Assessment Results 2009-2010
Academic Unit: College of Nursing and Health Sciences
Degree Program: Master of Science in Nursing
Link to Unit’s Mission: The mission of the CNHS/Nursing Unit is to teach, conduct research, and serve the community. The College prepares diverse health care professionals as
providers and leaders in the delivery of high quality, accessible, culturally competent care within a highly technological and global environment. The College promotes, expands
and validates scientific knowledge and evidence-based practice through interdisciplinary research.
Support
System
Assessment Method
Results
(Data Summary and Analysis)
CNHS
administrators
and staff will
provide
courteous,
timely, and
competent
services and
effective
support to MSN
students.
CRITERIA
Alumni survey: Level of satisfaction item
statements evaluated are noted in the
results.
EXIT MSN Alumni Survey:
Indicate your level of satisfaction for Nursing resources/ support services during your program of study:
STANDARD
On a 5 point Likert-type scale (1 = Not at
all  5 = Very much), alumni will rate the
level of satisfaction survey items with an
average of 3.5 or higher.
PROCEDURE
1) At two (2) months and one (1) year post
graduation, alumni will be sent the survey.
2) Data will be aggregated to determine
the mean of the statement.
Fall 09
NURSING program information (printed)
NURSING web site
NURSING support personnel (e.g., secretaries)
NURSING pre-program advisement services
NURSING program advisement services
NURSING scholarship/financial aid information
NURSING skills laboratory (ies)
NURSING audiovisual materials
NURSING computer laboratory
NURSING library materials
NURSING student governance
Sum 10
ANP
Return=2(4%) Return=10(10%)
4.50
4.20
5.00
4.20
4.00
4.10
4.50
4.22
5.00
4.20
4.00
4.80
4.50
4.30
5.00
4.22
4.50
4.60
3.50
4.60
4.00
5.10
Sum 10
FNP
Return=13(13%)
4.21
4.00
3.64
4.36
3.86
3.71
3.93
3.93
4.29
4.21
4.92
Sum 10
P-MSN
Return=4(4%)
4.50
4.75
3.00*
3.25*
3.75
5.00
4.75
4.25
4.00
4.50
5.00
Spring 10
POST 1 YR
Return=17
4.36
4.44
4.33
4.13
4.07
3.85
4.40
4.40
4.14
4.00
3.89
Indicate your level of satisfaction for Florida International University (FIU) resources/ support services during your program of study:
FIU web site
4.50
4.40
4.57
4.25
4.12
FIU advisement service
4.50
4.11
4.43
4.75
4.00
FIU admission services
3.50
4.20
3.79
3.50
4.00
FIU registration services
3.50
4.40
4.14
2.75*
3.71
FIU financial aid services
4.00
4.60
3.93
3.50
3.67
FIU Learning Center
4.00
5.00
4.14
4.50
4.14
FIU library services
4.50
4.30
4.36
4.50
4.41
FIU health services
4.00
4.80
4.79
4.00
3.64
FIU student governance
4.00
5.10
4.93
5.00
3.56
*< 3.50
Use of Results for Improving Student Learning
CON support personnel: Support personnel will attend appropriate training sessions to increase knowledge and skills.
CON pre-program/program advisement services: 1) Student advisement workshops will be held annually by experienced faculty/staff for new and current faculty; 2) A student services satisfaction survey
is currently being developed.
FIU services: At meetings with FIU administrators, issues with FIU services (registration, etc.) were discussed.
5
Florida International University:
Program Outcome Assessment Results 2009-2010
Academic Unit: College of Nursing and Health Sciences
Degree Program: Master of Science in Nursing
Link to Unit’s Mission: The mission of the CNHS/Nursing Unit is to teach, conduct research, and serve the community. The College prepares diverse health care professionals as
providers and leaders in the delivery of high quality, accessible, culturally competent care within a highly technological and global environment. The College promotes, expands
and validates scientific knowledge and evidence-based practice through interdisciplinary research.
Summarize use of results for continuous improvement of the educational program:
Comprehensive (EXIT) Examination
NP-MSN Tracks: In 2010, 100% of the NP students passed the standardized comprehensive EXIT examinations; For 2010-2011 administrators and faculty will continue the
following strategies: 1) Mandatory comprehensive EXIT examinations and a 3 day examination review session. Students must take the HESI and Fitzgerald (pre/post)
examinations and must attend a 3 day Fitzgerald Review session; 2) To pass the capstone course, all students must receive a passing score (determined by the individual
examination passing scores) on the two comprehensive EXIT examinations (HESI and Fitzgerald post-test). Child Health students will use the PNP examination; 3) Faculty will
provide remediation if students do not pass any of the comprehensive EXIT examinations; 4) If all efforts fail and students still do not pass the comprehensive EXIT examinations,
they will be required to repeat the course the following semester; 5) Previous strategies will continue to be implemented (See previous MSN student learning outcome reports). See
additional strategies under certification examination pass rates.
NP-ANESTHESIA Track: The nurse anesthesia EXIT exam in Fall 2009 was a self-evaluation exam; however, the nurse anesthesia certification pass rate was 76.7%, a decrease
from 84.6% in 2008. Strategies initiated during 2010-2011 were the following: 1) Re-sequence 4 courses to better balance curricular load; 2) Modify test blueprints and
incorporate certification exam question formats; 3) Continue computerized exams to match certification exam delivery; 4) Incorporate review questions prior to clinical to bridge
theory-clinical gap; 5) Establish a pass/fail EXIT comprehensive exam that includes an oral/written component; 6) Contract with a new external board exam review group that will
provide computerized practice exams and pre & post review course mock exam data.
Certification Examinations
NP-MSN Tracks: In 2009 all NP nurse practitioner certification pass rates were 82%, an increase from 54% in 2008. For 2010-2011 administrators and faculty teaching in the
NP tracks will continue the following strategies: 1) Continue the numerical passing grade for all graduate courses from “B” =80-83 to “B+” =85-88; 2) Reduced the number of
conditionally admitted students; 3) Previous strategies will continue to be implemented (See previous outcome reports); and 4) See additional strategies under comprehensive
EXIT examination pass rates. ANESTHESIA-MSN Track: The nurse anesthesia certification pass rate in 2009 was 76.7%, a decrease from 84.6% in 2008. Administrators
attribute part of the decrease in the certification pass rate to a new national testing format: multiple-multiple choice questions, short answer, clicking on anatomical locations, and
calculated answers (the national pass rate also decreased). Strategies initiated during 2010-2011 were the following: 1) Re-sequence 4 courses to better balance curricular load; 2)
Modify test blueprints and incorporate certification exam question formats; 3) Continue computerized exams to match certification exam delivery; 4) Incorporate review questions
prior to clinical to bridge theory-clinical gap; 5) Establish a pass/fail comprehensive EXIT exam that includes oral/written component; 6) Contract with a new external board exam
review group that will provide computerized practice exams and pre & post review course mock exam data.
Alumni Surveys
During 2009-2010 the MSN faculty members completed revising MSN course objectives based on curriculum guidelines The Essentials of Masters Education for Advanced
Practice Nursing (American Association of Colleges of Nursing, 1996), recommendations from the CCNE professional accreditation visitors and the MSN consultants (Dr.
Stanhope and Dr. Kapustin), and feedback from students and alumni on the alumni surveys. The MSN faculty revised course objectives and topical outlines to strengthen the areas
of ethics, health care policy, health care financing, and the domains and core competencies of nurse practitioner practice. The course objectives revision will be implemented
during 2010-2011.
Program Support/Services
During 2009-20010 the following changes were made to support services based on feedback (level of satisfaction items below average of 3.5) from alumni:
CON support personnel: Support personnel will attend appropriate training sessions to increase knowledge and skills.
CON pre-program/program advisement services: 1) Student advisement workshops will be held annually by experienced faculty/staff for new and current faculty; 2) A student
services satisfaction survey is currently being developed.
FIU services: At meetings with FIU administrators, issues with FIU services (registration, etc.) were discussed.
6
Florida International University:
Program Outcome Assessment Results 2009-2010
Academic Unit: College of Nursing and Health Sciences
Degree Program: Master of Science in Nursing
Link to Unit’s Mission: The mission of the CNHS/Nursing Unit is to teach, conduct research, and serve the community. The College prepares diverse health care professionals as
providers and leaders in the delivery of high quality, accessible, culturally competent care within a highly technological and global environment. The College promotes, expands
and validates scientific knowledge and evidence-based practice through interdisciplinary research.
NOTE: Due to low return rates on mailed Alumni EXIT and POST 1 YEAR surveys, the alumni surveys were developed in an online format during summer 2101 using Qualtrics
software. New procedures will be developed on emailing these surveys during the 2010-11 academic year and forward.
7
Download