NPS
Graduating
Students
Survey
Summary Report
2010
Office Of Institutional Research
Table of Contents
Introduction ................................................................................................................................................. 1
Methodology ............................................................................................................................................... 1
Results ......................................................................................................................................................... 3
Theme I: Strategic Planning for the Next NPS Centennial ...................................................3
Theme II: Integrating a Campus-wide Program of Continuous Improvement ..................3
Theme III: Supporting an Evolving Academic Enterprise ...................................................4
Results Summary ........................................................................................................................................ 6
Discussion .................................................................................................................................................... 7
Summary ...................................................................................................................................................... 9
Appendices ................................................................................................................................................. 10
Appendix A: Survey Instrument
Appendix B: Crosswalk of NPS Graduating Student Survey Items with WASC Criteria for Review
Appendix C: Survey Item Frequency Responses
Appendix D: Respondent Survey Comment
NPS GRADUATING STUDENTS SURVEY
SUMMARY REPORT 2010
INTRODUCTION
The Naval Postgraduate School (NPS) has identified its vision and guiding principles as: to
prepare the intellectual leaders of tomorrow’s forces, and to be the world leader in naval and
defense-related graduate education and supporting research. Feedback from students has been
integral in helping to monitor and to evaluate the School’s effectiveness in manifesting its vision;
therefore, since 1993, the NPS Graduating Student Survey has been administered at the end of
each quarter to all students who are graduating.
The results of the first compilation of surveys can be found in the document titled Naval
Postgraduate School Exit Survey: 1993-2004: A Twelve Year Trend Study. In 2006, the NPS Exit
Survey was redesigned to be more responsive to accreditation collections needs, and the new
version was administered to all students who were scheduled to graduate in the fourth quarter, or
September 2006. Since that time, the survey has been called the Graduating Students Survey.
METHODOLOGY
The NPS Graduating Students Survey consisted of 37 items rated on a five-point Likert scale,
extending from strongly disagree to strongly agree, as well as a non-choice option (Appendix
A). The last item asks for (open-ended) comments on any experience at NPS. Current standards
from the Western Association of Schools and Colleges (WASC) helped to guide the
development of the survey items. The relationship between the survey items and the WASC
standards can be referenced from the document "Crosswalk of NPS Graduating Students Survey
Items with WASC Criteria for Review" (Appendix B).
Students who were about to graduate at the end of each quarter (December 2009, March, June,
and September 2010) of Academic Year (AY) 2010 were notified via email and through
subsequent reminders that the Graduating Students Survey was posted, and awaiting their
completion.
Of 844 surveys distributed, there were 551 total respondents (65.3% response rate). The third
column of Chart 1 shows the response rate for each group. The first two columns of the chart
show the demographic breakdown of the surveyed population and respondent population. The
respondents are thus generally representative of the population of students graduating in AY
2010.
Page 1 of 11
NPS Graduating Students Survey Summary
Office of Institutional Research
Chart 1
Demographics of Surveyed and Respondent Students
and Response Rates by Group
Surveyed Respondent
844
551
Total (Resident)
Female
11.0%
Response
Rate
65.3%
11.0%
62.4%
Surveyed Respondent
Response
Rate
GSBPP
GSEAS
GSOIS
SIGS
Provost
19.9%
21.9%
27.6%
29.7%
0.8%
22.7%
20.0%
29.9%
26.3%
1.1%
74.4%
59.5%
70.8%
57.8%
85.7%
Navy
Air Force
Army
Marine Corps
International
Other
Civilian
39.9%
14.2%
10.3%
13.6%
14.5%
0.5%
7.0%
42.3%
13.1%
10.0%
13.8%
15.4%
0.5%
4.9%
69.1%
60.0%
63.2%
66.1%
69.7%
75.0%
45.8%
Asian American/Pacific Islander
Black/African American
Hispanic/Latinos
White
Am. Indian/Alaskan
International
Unknown
3.4%
6.0%
5.3%
66.4%
0.9%
14.5%
3.4%
3.3%
6.2%
4.2%
67.7%
0.9%
15.4%
2.4%
62.1%
66.7%
51.1%
66.6%
62.5%
69.7%
44.8%
Page 2 of 11
NPS Graduating Students Survey Summary
Office of Institutional Research
In addition to survey responses (Appendix C), comments were requested (Appendix D). All
comments were separated into the following categories for a simple content analysis:
Classrooms/ Laboratories
Curriculum
Facilities
Faculty
Housing
Library
Medical
Miscellaneous
Naval Postgraduate School
Parking
Support Services
Thesis
RESULTS
The results of the survey were separated into areas related to the three major themes outlined in
the Capacity and Preparatory Review (CPR) Report submitted by NPS to WASC on December
17, 2008.
Theme I: Strategic Planning for the Next NPS Centennial
90% of all respondents agreed that the university supports teaching and research to enhance the
combat effectiveness of all forces, and it is successful in achieving that goal
96% of the total respondents would recommend NPS to other military officers or defense
civilians for their graduate education
Theme II: Integrating a Campus-wide Program of Continuous Improvement
Issues related to Curriculum, Faculty and Relevancy were reflected in the total number of
responses in the following ways:
Curriculum:
 13% did not think their coursework and research were closely related
 6% did not think that NPS is always working to improve instruction and research
 19% did not think NPS provided opportunities to learn outside of the regular curricular
program
 10% did not think a thesis or capstone project was a valuable component of their
education
 30% did not think NPS provided them with sufficient electives to pursue special military
career interests
 6% did not think that refresher courses helped to prepare them for subsequent work; 56%
did not take refresher courses.
96% of the total respondents agreed that they understood the body of knowledge and skills they
were expected to have as a student at NPS, and 93% of respondents felt they were prepared to
successfully complete their education at NPS.
Page 3 of 11
NPS Graduating Students Survey Summary
Office of Institutional Research
Faculty:
93%-97% agreed that faculty were dedicated to teaching, involved students in active and
participative learning experiences, were well-qualified, dedicated to student success, delivered
fair and relevant grades and tests, and were available outside the classroom for additional
assistance
 5% did not receive faculty advice and guidance needed to successfully complete their
thesis or capstone project
 11% did not think that faculty utilized student feedback to improve the educational
program
Relevancy:
 9% did not think that their education at NPS was relevant to their current or future
assignments and responsibilities
 7% did not think their curriculum was national-security or defense-related
 8% did not think that the defense-related orientation at NPS made their education more
relevant than if they were at a civilian institution.
 29% did not agree or did not know if their thesis or capstone project made a useful
contribution to combat effectiveness or national security
Theme III: Supporting an Evolving Academic Enterprise
Issues related to Facilities and Parking were reflected in the total number of responses in the
following ways:
Classroom and Non-Laboratory Facilities:
 6%: not responsive to course needs
 7%: inadequate number
 10%: not equipped with current technologies
 9%: poor working condition
 9%: overall appearance and quality left a negative impression of NPS
 12%: poorly maintained
Laboratory Facilities:
 4%: not responsive to course needs
 5%: not in good working condition
 7%: not equipped with current technologies
 5%: overall appearance and quality left a negative impression of NPS
 8%: not focused on combat capabilities
Parking:
 52%: Parking and commuting are problems at NPS
Page 4 of 11
NPS Graduating Students Survey Summary
Office of Institutional Research
Issues related to the Administration, Diversity, and Supportive Services were reflected in
the total number of responses in the following ways:




4% did not agree that university administration is committed to supporting teaching and
research for the purpose of enhancing the combat effectiveness of US and allied armed
forces.
When asked if diversity in service, culture ethnicity and gender enriched their education,
4% did not agree if diversity in service, 6% did not agree if diversity in culture, 11% did
not agree if diversity in ethnicity, and 16% did not agree if diversity in gender enriched
their education at NPS.
In response to questions asked about computer and IT services, 92% of the total
respondents answered positively when asked if these services met all their coursework
and research needs.
In response to questions asked about services provided by the Dudley Knox Library,
between 92% - 96% of the total respondents answered positively when asked if books,
databases, journals and Reference Assistance and Instruction met their coursework and
research needs.
When asked if certain aspects of Supportive Services provided students with sufficient support
to enable students to meet their educational goals






2-9% did not think the Program Officer and the Program Office staff provided them with
sufficient support
5% did not think Student Services provided sufficient support
3% did not think the Registrar office provided them with sufficient support
7% did not think the Scheduling office provided them with sufficient support
11% disagreed NPS personnel facilitated students’ transition to life at NPS
18% did not know NPS had an appeals process for student academic complaints
Page 5 of 11
NPS Graduating Students Survey Summary
Office of Institutional Research
RESULTS SUMMARY
The following 2 charts highlight the top 10 positive and negative responses for all residents from
the surveys administered in AY 2010:
Chart 2
Top 10 Positive Responses for All Residents
Survey Question
2010
% All Resident
Respondents
2009
Data
97%
95%
26. NPS faculty in my program was
generally available to provide additional
assistance outside the classroom when I
needed it.
48. The CLASSROOM and other NONLABORATORY facilities for my program
had the following characteristics:
Accessible
10. I understood the body of knowledge
and skills I was expected to master for my
degree program.
25. NPS faculty in my program were
dedicated to my success as a student.
24. NPS faculty members involved me in
active and participative learning
experiences.
23. NPS faculty in my program were
dedicated to teaching.
46. I would recommend NPS to other
military officers or defense civilians for
their graduate education.
39. Databases: NPS library resources met
all my course work and research needs.
28. My faculty appeared to be well
qualified for the defense related teaching
and research done in my curriculum or
program.
13. The tests that I took at NPS were fair
and relevant.
’09 Top 10 dropped out in ‘10
Item#
40: Journals: NPS Library resources met research needs
42: Reference Assistance & Instruction: NPS Library
resources met research needs
44: Services: NPS Library resources met research needs
12 : The grades I received at NPS accurately reflected
the level of my performance
97%
96%
96%
96%
94%
96%
96%
95%
95%
95%
95%
%
94
93
92
92
Page 6 of 11
NPS Graduating Students Survey Summary
Office of Institutional Research
96%
92%
Chart 3
Top 10 Negative Responses for All Residents
Survey Question
2010
% All Resident
Respondents
2009
Data
52%
46%
30%
31%
19%
21%
19%
30%
17%
15%
16%
20%
14%
15%
14%
16%
12%
16%
47. Commuting and parking were not a
problem at NPS
16. My NPS program provided me with
sufficient electives to pursue my special
military career interests
15. NPS provided opportunities for
learning outside the regular curricular
program.
22. I was aware that NPS had an appeals
process for student academic complaints
62. Adequate health services were
available for my family and me while at
NPS.
20. Diversity in gender enriched my NPS
education
7. My thesis or capstone research project
at NPS made a useful contribution to
combat effectiveness or another national
security need.
8. My coursework and research at NPS
were closely integrated
52. The CLASSROOM and other NONLABORATORY facilities for my program
had the following characteristics: Well
Maintained
19. Diversity in ethnicity enriched my
NPS education
11%
14%
DISCUSSION
Theme I: Strategic Planning for the Next NPS Centennial:
Similar to last year, high numbers of respondents agree that NPS supports teaching and research
to enhance the combat effectiveness of all forces, and is successful in achieving that goal.
However, several comments suggested a lack of perceived relevance of education to current or
future careers within the military. In particular, some alumni comments relayed disappointment
Page 7 of 11
NPS Graduating Students Survey Summary
Office of Institutional Research
in curricula not being detailed or specific enough in terms of training for future assignments.
Despite these observational findings, this year’s results saw a 4% increase in the number of
respondents who would recommend NPS to other military officers or defense civilians for their
graduate education.
Theme II: Integrating a Campus-wide Program of Continuous Improvement:
A large majority of respondents (85.8%) agreed that NPS is always working to improve
instruction and research. The majority of the respondents also felt that faculty are highlyqualified, dedicated to student success, deliver fair and relevant grades and tests, and are
available outside the classroom for assistance (93-97%).
However, a moderate percentage of respondents (11%) did not think that faculty utilized student
feedback to improve the educational program. This finding is similar to observations seen in last
year’s analyses- though trends show improvement in this field by 2% from AY 2009 and 4%
from AY 2010.
Fifteen percent of the survey respondents were International students. Although this rate reflects
a 3% decrease from last year’s respondent pool, some alumni recommendations on improvement
are noteworthy to mention. For instance a few International students made recommendations for
NPS to establish a “template” for international student courses with more guidance on what
curriculum should be taken. Similar comments were made by U.S. alumni who expressed
difficulty adjusting academically, after not being in school for a long time. Comparable findings
were observed in the survey item results. For instance, when asked if refresher courses were
sufficient to prepare students for subsequent coursework, only 38% agreed. Yet, the majority of
alumni feel that they understood the body of knowledge and skills they were expected to master
for their degree program (96.2%), and that NPS personnel facilitated the transition to student life
(80.9%).
The AY 2010 survey results saw a 14% increase from last year in the rate of alumni who did not
agree or did not know if their thesis or capstone project made a useful contribution to combat
effectiveness or national security. Despite 10% of respondents disagreeing that completing a
thesis or capstone project was a valuable component of their education, a large amount of the
comments touched upon the thesis process. Namely the student comments relayed how time
consuming and difficult the thesis process is. Recommendations were made suggesting an
earlier briefing on the process of completing thesis research, as well as more timely feedback
from faculty. Some alumni also made suggestions of the possibility of having either a thesis or a
Capstone project, as more time to do one would be more beneficial.
Also, noteworthy, several of the student comments suggested the lack of relevance and perceived
need for SGL’s. Overall, alumni were generally more satisfied when compared to last year, in
areas related to curriculum, faculty and relevancy of education.
Page 8 of 11
NPS Graduating Students Survey Summary
Office of Institutional Research
Theme III: Supporting an Evolving Academic Enterprise:
Supportive Services, such as the Registrar, Admissions Office, Student Services, and the
Program Office mostly received positive responses for providing sufficient support to enable
students to meet their educational goals. Several positive comments by respondents singularly
recognized the services and staff of the Dudley Knox Library and ITACS. Both services were
highly esteemed for efficiency and helpfulness. In fact, the AY 2010 survey results saw a slight
increase in student satisfaction with computer and IT services meeting all of their coursework
and research needs.
Last year’s survey results highlighted suggestions for better communications, whether they relate
to assisting students in the transition to student life from the NPS administration, or as ongoing
support. This area seems to have improved, especially in regards to the appeals process for
student academic complaints. For instance, last year, nearly one third of the total respondents
did not know NPS had an appeals process for student academic complaints. And in AY 2008,
38% of the respondents were unaware of the appeals process. In AY 2010, the rate dropped
dramatically to 18% of the respondents not being aware of the appeals process. Thus, this
finding points to an improvement on the part of NPS in supporting students.
While building construction continued from the previous year, there were still many comments
in regards to the condition and maintenance of facilities. In particular, the construction of Root
and Spanagel halls were noted as being obstructive to learning and inadequate. Alumni feedback
relayed issues with the lack of temperature control, general uncleanliness of the halls, and the
lack of designated study spaces. While a great majority responded positively to computer and IT
services, it is noteworthy that many comments expressed a need for efficient/high-speed
computer support within some labs. Also, several recommendations were made for the addition
of power outlets on desks in classrooms for laptop use.
An overwhelming amount of comments continue to be made regarding the inadequacy of
medical and health services in staffing, scheduling, and the availability of specialized services.
Parking and commuting continue to be an issue for many, as reflected by the 6% increase in
negative feedback from last year. Despite these results, the issue of parking has generally
improved, as there has been a consistent decline of negative feedback from AY 2008.
SUMMARY
Overall, a large majority of the respondents agreed that the university supports teaching and
research to enhance the effectiveness of all forces, and is successful in doing so. Several student
comments reflected a deep appreciation for NPS as a unique institution, with a high caliber and
diverse faculty. The general high regard for NPS was also reflected in a 4% increase in the
percent of graduating students who would recommend NPS to other military officers or defense
civilians.
Page 9 of 11
NPS Graduating Students Survey Summary
Office of Institutional Research
The state of parking and facilities continued to yield fairly high dissatisfied responses, as do
health care services. At the same time, many comments suggested an overall sense of
appreciation for the MST Bus System.
Issues with the relevancy/variety of coursework, and issues with the amount of courses needed to
graduate within the prescribed NPS timeframe, were brought to the forefront. Another area rated
lower this year compared to last in student feedback, was the usefulness of thesis and/or capstone
projects. Suggestions on how faculty teaching can improve included more timely communication
with students (especially regarding thesis reviews and feedback of assignments) and updating
teaching procedures.
Despite these findings, most every other field surveyed has increased in the rate of positive
responses. In particular, this year a higher rate (87.6%) of graduating students thought that the
defense-related orientation at NPS made their education more relevant than if they were at a
civilian institution- demonstrating an overall increased appreciation for the value of a graduate
education at NPS.
Highlight of Most Satisfied Responses:
Faculty
Library
ITACS
Support
Services
Dedicated to student success, available for assistance, involved students in
active and participative learning.
Databases, journals, and reference assistance & instruction, and services
helped meet course work and research needs.
ITAC’s services appreciated as quick and efficient
Bus system mostly regarded as useful
Highlight of Most Dissatisfied Responses:
Insufficient space availability.
Classroom and Non-Laboratory – poor heating/ventilation; not equipped
with current technologies; lack of basic janitorial maintenance – greater
satisfaction from last year, but still impacts on quality of education.
Lack of study spaces; lack of power strips for laptops in classrooms.
Communications Between faculty and students, especially regarding thesis research.
Course load heavy with little time for family or thesis research; Course work
Curriculum
and research not closely related; Not specific enough for proper job
training/placement; Insufficient electives; lack of communication with
faculty; SGL’s time consuming and usually irrelevant to career.
Inadequate staffing, scheduling, and specialized services.
Health Services
Several comments made on the need for a thesis writing guide, or some type
Thesis Issues
of a guideline to aid in the process.
Parking
Facilities
Page 10 of 11
NPS Graduating Students Survey Summary
Office of Institutional Research
APPENDICES
The following appendices can be accessed on the SharePoint site:
http://infores/ir/default.aspx
Appendix A: Survey Instrument
Appendix B: Crosswalk of NPS Graduating Student Survey Items with WASC Criteria for Review
Appendix C: Survey Item Frequency Responses
Appendix D: Respondent Survey Comments
Page 11 of 11
NPS Graduating Students Survey Summary
Office of Institutional Research