CENTRAL WASHINGTON UNIVERSITY 2014 FACULTY SURVEY OF STUDENT ENGAGEMENT (FSSE) RESPONSES COMPARED TO NATIONAL STUDENT SURVEY OF ENGAGEMENT (NSSE) I. II. III. IV. V. VI. VII. Executive Summary………………………… 2. Methodology………………………………….. 2. A. FSSE……………………………………………2. B. NSSE………………………………………..…3. C. Report Format………………………..….3. Academic Challenge…………………………4. Learning with Peers………………………….5. Experiences with Faculty………………….6. Campus Environment……………………….7. High Impact Practices……………………….8. Tom Henderson, Director of Institutional Assessment Acknowledgement to David Braskamp of Organization Effectiveness for generating data files I. EXECUTIVE SUMMARY Central Washington University (CWU) administered the Faculty Survey of Student Engagement to all CWU tenured and tenure-track faculty and adjuncts during the spring quarter of 2014. This report compares faculty responses to FSSE questions to student responses of the same or similar National Survey of Student Engagement (NSSE) questions. The comparisons are in five sections: Academic Challenge Learning with Peers Experiences with Faculty Campus Environment High Impact Practices Readers may be interested in specific sections and may perceive the magnitude of comparisons differently. II. METHODOLOGY A. FSSE Administration The FSSE is “…designed to measure faculty expectations regarding the extent to which students at institutions engage in educational practices empirically linked to high levels of learning and development.” A copy of the FSSE survey is at: http://fsse.iub.edu/pdf/2014/fsse14_survey.pdf 222 CWU faculty completed the 2014 FSSE out of 703 invitations for a response rate of 32% and a sampling error of ±5.4%. The average response rate for FSSE institutions was 48%. An invitation email was sent to faculty on 4/22/14. Email reminders were sent to faculty who had not yet responded on 4/28/14. 5/01/14, and 5/7/14. CWU faculty responded to two FSSE questions that help categorize their responses. Table 1 – CWU FSSE Respondent Characteristics During the current school year, have you taught an undergraduate course? What is the class level of most students in your selected course section? 9/22/14 Yes No Missing Lower division Upper division Other Missing Count Percent 195 88% 17 8% 10 5% 59 27% 131 59% 4 2% 28 13% CWU 2014 FSSE Compared to NSSE Responses page 2 of 10 B. NSSE Administration The NSSE survey was emailed to all CWU first-year (1,513) and senior (2,244) students during the spring 2014 quarter. An invitation email was sent on April 9, 2014. Four reminder emails were sent on 4/15/14, 4/17/14, 4/23/14, and 4/29/14. All respondents received a 10% coupon from the Wildcat Shop (either in person or online). In addition, thirty respondents were randomly selected for early fall 2014 registration. The response rate to the survey was 17.6%. 1,513 first year students were invited, 315 gave full or partial responses. 2,244 seniors were invited, there were 348 responses. In all 663 students responded out of 3,757 invited for a response rate of 17.6%. 184 of the senior respondents were enrolled in online degree programs, 35 of them responded for a response rate of 19%. Table 2 – 2014 NSSE Response Rates Response Rate Sampling Error First year Students Seniors CWU Far West CWU Far West 21% 18% 16% 22% ± 4,9% ± 1.3% ± 4,8% ± 0.9% All responses CWU Far West 18% 21% The response rate to CWU’s NSSE exam was 18%. The response rate of institutions of similar size was 21%. C. Report Format The following tables are formatted as follows:: The four left columns show the FSSE question and the percent of faculty who report that they agree “Very much” or “Quite a bit” that lower division and upper division courses at CWU engaged students in various methods depending on the question The four middle columns show the question number, question, and the comparable percent of CWU first-year and senior student responses The two right columns show: o the difference in faculty percentages [lower division (LD) and upper division (UD)] and student percentages [(first year (FY) and seniors (SR)] o the differences graphed in data bars that extend from minus 100% (student percents were higher) to positive 100% (faculty percents were higher). 9/22/14 CWU 2014 FSSE Compared to NSSE Responses page 3 of 10 III. ACADEMIC CHALLENGE Table 3 – Academic Challenge Comparisons Academic Challenge Higher-Order Learning Faculty Responses Percentage of faculty whose coursework substantially emphasizes the following in their selected course section: FSSE Item 27b. Applying facts, theories, or methods to practical problems or new situations 27c. Analyzing an idea … in depth by examining its parts 27d. Evaluating a point of view, decision, or information source 27e. Forming a new idea or understanding from various pieces of information Class Very much or Quite a bit % LD UD LD UD LD UD LD UD 71 89 76 87 60 74 78 82 Reflective & Integrative Learning Percentage of faculty who reported that it is important that the typical student do the following in their selected course section: FSSE Item 23a. Combine ideas from different courses when completing assignments 23b. Connect his or her learning to societal problems or issues 23c. Include diverse perspectives \in course discussions or assignments 23d. Examine the strengths and weaknesses of his or her own views on a topic or issue 23e. Try to better understand someone else's views 23f. Learn something that changes the way he or she understands an issue or concept 23g. Connect ideas from your course to his or her prior experiences and knowledge Class Very much or Quite a bit % LD UD LD UD LD UD LD UD LD UD LD UD LD UD 70 82 70 77 60 66 76 84 69 75 95 93 87 95 Learning Strategies Percentage of faculty who reported they substantially encourage students to do the following in their selected course section: FSSE Item 25e. Identify key information from reading assignments 25f. Review notes after class 25g. Summarize what has been learned from class or from course materials 9/22/14 Student Responses Differenmce Distribution of student responses to: How much has your coursework emphasized the following during the current school year? NSSE Item 4b. 4c. 4d. 4e. Applying facts, theories, or methods to practical problems or new situations Analyzing an idea, experience, or line of reasoning in depth by examining its parts Evaluating a point of view, decision, or information source Forming a new idea or understanding from various pieces of information Class FY SR FY SR FY SR FY SR Very much Data Bars or Quite a Difference (±100%) bit % 73 79 73 80 69 73 69 77 -2% 10% 4% 7% -9% 1% 9% 5% Distribution of student responses to: About how often have you done the following during the current school year? Class 2a. 2b. 2c. 2d. 2e. 2f. 2g. NSSE Item Combined ideas from different courses when completing assignments Connected your learning to societal problems or issues Included diverse perspectives in course discussions or assignments Examined the strengths and weaknesses of your own views on a topic or issue Tried to better understand someone else's views Learned something that changed the way you understand an issue or concept Connected ideas from your courses to your prior experiences and knowledge FY SR FY SR FY SR FY SR FY SR FY SR FY SR Very much or Quite a Difference Data Bars bit % (±100%) 48 23% 78 3% 53 16% 68 9% 44 16% 58 8% 61 16% 71 12% 63 6% 78 -3% 65 30% 69 25% 74 13% 88 7% Distribution of student responses to: About how often have you done the following during the current school year? Class % Very much or Quite a bit LD UD LD UD LD UD 66 77 52 54 65 66 Class 9a. 9b. 9c. NSSE Item Identified key information from reading assignments Reviewed your notes after class Summarized what you learned in class or from course materials CWU 2014 FSSE Compared to NSSE Responses FY SR FY SR FY SR % Very much or Difference Data Bars Quite a bit (±100%) 79 -13% 86 -9% 66 -14% 66 -12% 58 7% 68 -2% page 4 of 10 Table 4 –Academic Challenge continued Quantitative Reasoning Percentage of faculty who reported that it is important that the typical student do the following in their selected course section: FSSE Item 22d. Reach conclusions based on his or her own analysis of numerical information 22e. Use numerical information to examine a real-world problem or issue 22f. Evaluate what others have concluded from numerical information Class Very much or Quite a bit % LD UD LD UD LD UD 61 64 59 57 56 56 Class Very much or Quite a bit % LD 38 UD 55 Class Very much or Quite a bit % Distribution of student responses to: About how often have you done the following during the current school year? NSSE Item 6a. 6b. 6c. Reached conclusions based on your own analysis of numerical information Used numerical information to examine a real-world problem or issue Evaluated what others have concluded from numerical information Class FY SR FY SR FY SR Very much Data Bars or Quite a Difference (±100%) bit % 52 61 38 53 33 52 9% 3% 22% 4% 22% 4% Additional Academic Challenge Items 21. FSSE Item In your selected course section, to what extent do you think the typical student does his or her best work? Class 10. NSSE Item ...to what extent have your courses challenged you to do your best work? Very much or Quite a Difference Data Bars bit % (±100%) FY 54 -15% SR 48 8% Note. Response options ranged from 1=Not at all to 7=Very much; FSSE Item Percentage of faculty who reported that it is important that their institution increase its emphasis on the following: 2a. Students spending significant amounts of time studying and on academic work LD UD NSSE Item Class Very much Data Bars or Quite a Difference (±100%) bit % Distribution of student responses to: How much does your institution emphasize the following? 86 85 14a. Spending significant amounts of time studying and on academic work FY SR 75 79 11% 6% IV. LEARNING WITH PEERS Table 5 – Learning with Peers Comparisons Learning with Peers Collaborative Learning Percentage of faculty who substantially encourage students to do the following in their selected course section: FSSE Item 25a. Ask other students for help understanding course material 25b. Explain course material to other students 25c. Prepare for exams by discussing or working through course material with other 25d. Work with other students on course projects or assignments 9/22/14 Class Very much or Quite a bit % LD UD LD UD LD UD LD UD 64 64 62 59 75 61 70 66 Distribution of student responses to: About how often have you done the following during the current school year? NSSE Item 1e. 1f. 1g. 1h. Asked another student to help you understand course material Explained course material to one or more students Prepared for exams by discussing or working through course material with other Worked with other students on course projects or assignments CWU 2014 FSSE Compared to NSSE Responses Class FY SR FY SR FY SR FY SR Very much Data Bars or Quite a Difference (±100%) bit % 44 43 51 64 47 50 47 72 page 5 of 10 20% 21% 10% -5% 28% 12% 22% -6% Table 6 – Learning with Peers continued Discussions with Diverse Others Percentage of faculty who reported that students have substantial opportunities to engage in discussions with people from the following groups in their selected course section: FSSE Item 26a. People of a race or ethnicity other than their own 26b. People from an economic background other than their own 26c. People with religious beliefs other than their own 26d. People with political views other than their own Class Very much or Quite a bit % LD UD LD UD LD UD LD UD 28 38 40 40 38 35 48 38 Distribution of student responses to: About how often have you had discussions with people from the following groups during the current school year? NSSE Item 8a. 8b. 8c. 8d. People of a race or ethnicity other than your own People from an economic background other than your own People with religious beliefs other than your own People with political views other than your own Class FY SR FY SR FY SR FY SR Very much Data Bars or Quite a Difference (±100%) bit % 63 71 69 79 63 76 61 76 -35% -33% -29% -40% -25% -41% -13% -38% V. EXPERIENCES WITH FACULTY Table 7 – Experiences with Faculty Comparisons Experiences with Faculty Student-Faculty Interaction Percentage of faculty who frequently did each of the following with the undergraduate students they teach or advise during the current school year: FSSE Item 8a. Talked about their career plans 8b. Worked on activities other than coursework (committees, student groups, etc.) Discussed course topics, ideas, or concepts outside of class Discussed their academic performance 8c. 8d. Class Very much or Quite a bit % LD UD LD UD LD UD LD UD 53 77 33 43 52 67 55 69 Effective Teaching Practices Percentage of faculty who substantially do the following in their undergraduate courses: FSSE Item 10a. Clearly explain course goals and requirements 10b. Teach course sessions in an organized way 10c. Use examples or illustrations to explain difficult points 10g. Provide feedback to students on drafts or works in progress 10h. Provide prompt and detailed feedback on tests or completed assignments 9/22/14 Distribution of student responses to: About how often you have done the following during the current school year? NSSE Item 3a. 3b. 3c. 3d. Talked about career plans with a faculty member Worked with a faculty member on activities other than coursework (committees, Discussed course topics, ideas, or concepts with a faculty member outside of class Discussed your academic performance with a faculty member Class FY SR FY SR FY SR FY SR Very much Data Bars or Quite a Difference (±100%) bit % 38 47 18 29 23 38 31 37 16% 30% 15% 14% 29% 29% 25% 32% Distribution of student responses to: To what extent have your instructors done the following during the current school year? Class Very much or Quite a bit % LD UD LD UD LD UD LD UD LD UD 95 95 90 98 98 98 79 76 95 91 NSSE Item 5a. 5b. 5c. 5d. 5e. Clearly explained course goals and requirements Taught course sessions in an organized way Used examples or illustrations to explain difficult points Provided feedback on a draft or work in progress Provided prompt and detailed feedback on tests or completed assignments. CWU 2014 FSSE Compared to NSSE Responses Class FY SR FY SR FY SR FY SR FY SR Very much Data Bars or Quite a Difference (±100%) bit % 78 84 75 83 70 78 63 59 61 68 page 6 of 10 17% 12% 15% 15% 28% 20% 16% 17% 34% 24% VI. CAMPUS ENVIRONMENT Table 8 – Campus Environment Comparisons Campus Environment Quality of Interactions Faculty perceptions of the quality of student interactions with the following people at their institution: FSSE Item 3a. Other students 3b. Academic advisors 3c. Faculty 3d. Student services staff (career services, student activities, housing, etc.) Other administrative staff and offices (registrar, financial aid, etc.) 3e. Distribution of student responses to: Indicate the quality of your interactions with the following people at your institution. Class Very much or Quite a bit % LD UD LD UD LD UD LD UD LD UD 29 29 13 15 24 29 7 10 9 8 Supportive Environment Percentage of faculty who reported that it is important that their institution increase its emphasis on each of the following: FSSE Item 2b. 2c. 2d. 2e. 2f. 2g. 2h. 2i. Providing support to help students succeed academically Students using learning support services (tutoring services, writing center, etc.) Encouraging contact among students from different backgrounds (social, racial/ethnic, Providing opportunities for students to be involved socially Providing support for students' overall wellbeing (recreation, health care, counseling, Helping students manage their nonacademic responsibilities (work, family, etc.) Students attending campus activities and events (performing arts, athletic events, Students attending events that address important social, economic, or political Class Very much or Quite a bit % LD UD LD UD LD UD LD UD LD UD LD UD LD UD LD UD 81 84 81 77 71 74 49 53 78 67 47 45 57 45 69 63 Class Very much or Quite a bit % 1a. Participate in an internship, co-op, field LD 78 experience, student teaching, or clinical UD 85 FSSE Item Class Yes % Percentage of faculty who participate in the following activity in a typical 7-day week: 6b. Supervising undergraduate internships or other field experiences 9/22/14 LD UD 13a. Students 13b. Academic advisors 13c. Faculty 13d. Student services staff (career services, student activities, housing, etc.) 13e. Other administrative staff and offices (registrar, financial aid, etc.) Class FY SR FY SR FY SR FY SR FY SR % that Faculty answered less Data Bars 5 to 7 student % (±100%) 50 -22% 61 -32% 54 -41% 46 -31% 48 -24% 58 -30% 38 -31% 32 -22% 37 -28% 42 -34% Distribution of student responses to: How much does your institution emphasize the following? High Impact Practices Internship Percentage of faculty who think it is important for undergraduates at their institution to do the following before they graduate: FSSE Item NSSE Item NSSE Item 14b. Providing support to help students succeed academically 14c. Using learning support services (tutoring services, writing center, etc.) 14d. Encouraging contact among students from different backgrounds (social, racial/ethnic, 14e. Providing opportunities to be involved socially 14f. Providing support for your overall wellbeing (recreation, health care, counseling, 14g. Helping you manage your non-academic responsibilities (work, family, etc.) 14h. Attending campus activities and events (performing arts, athletic events, etc.) 14i. Attending events that address important social, economic, or political issues Class FY SR FY SR FY SR FY SR FY SR FY SR FY SR FY SR Very much Faculty Data Bars or Quite a less (±100%) bit % student % 75 63 74 66 52 48 67 58 74 58 45 21 62 48 46 34 6% 21% 7% 11% 19% 26% -18% -5% 4% 9% 2% 25% -5% -3% 23% 28% Distribution of student responses to: Which of the following have you done or do you plan to do before you graduate? NSSE Item 11a. Participate in an internship, co-op, field experience, student teaching, or clinical Class FY SR Very much Faculty Data Bars or Quite a less (±100%) bit % student % 77 71 32 49 CWU 2014 FSSE Compared to NSSE Responses page 7 of 10 1% 13% Table 9 Campus Environment continued Learning Community Percentage of faculty who think it is important for undergraduates at their institution to do the following before they graduate: FSSE Item 1c. Participate in a learning community or some other formal program where groups of students take two or more classes together Class Very much or Quite a bit % LD 41 UD 47 Study Abroad Percentage of faculty who think it is important for undergraduates at their institution to do the following before they graduate: FSSE Item 1d. Participate in a study abroad program Class Very much or Quite a bit % LD UD 34 37 Distribution of student responses to: Which of the following have you done or do you plan to do before you graduate? NSSE Item 11c. Participate in a learning community or some other formal program where groups of students take two or more classes together Class Very much Faculty Data Bars or Quite a less (±100%) bit % student % FY 39 2% SR 31 16% Distribution of student responses to: Which of the following have you done or do you plan to do before you graduate? NSSE Item 11d. Participate in a study abroad program Class FY SR Very much Faculty Data Bars or Quite a less (±100%) bit % student % 36 13 -2% 23% VII HIGH IMPACT PRACTICES Table 10 – High Impact Practices Faculty compared to Students High Impact Practices (continued) Undergraduate Research Percentage of faculty who think it is important for undergraduates at their institution to do the following before they graduate: FSSE Item Class Very much or Quite a bit % 1e. Work with a faculty member on a research LD 59 project UD 58 FSSE Item Class Yes % Percentage of faculty who participate in the following activity in a typical 7-day week: 6a. Working with undergraduates on research LD UD 1f. Complete a culminating senior experience (capstone course, senior project or thesis, NSSE Item 11e. Work with a faculty member on a research project Class FY SR Very much Faculty Data Bars or Quite a less (±100%) bit % student % 36 34 24% 24% 43 45 Culminating Senior Experience Percentage of faculty who think it is important for undergraduates at their institution to do the following before they graduate: FSSE Item Distribution of student responses to: Which of the following have you done or do you plan to do before you graduate? Class Very much or Quite a bit % LD UD 79 81 Class Very much or Quite a bit % LD 49 UD 65 Distribution of student responses to: Which of the following have you done or do you plan to do before you graduate? NSSE Item 11f. Complete a culminating senior experience (capstone course, senior project or thesis, Class FY SR Very much Faculty Data Bars or Quite a less (±100%) bit % student % 63 71 16% 10% Service-Learning FSSE Item 9. About how many of your undergraduate courses at this institution have included a community-based project (service-learning)? NSSE Item 12. About how many of your courses at this institution have included a communitybased project (service-learning)? Class Some, Faculty Data Bars Most, or less (±100%) All student % FY 39 10% SR 55 10% Percentage of faculty who think it is important for undergraduates at their institution to do the following before they graduate: 1g. Participate in a community-based project (service-learning) as part of a course 9/22/14 LD UD 58 56 CWU 2014 FSSE Compared to NSSE Responses page 8 of 10 Table 11 – High Impact Practices continued Additional Engagement Items Faculty Course Goals and Student-Perceived Gains Percentage of faculty who reported substantially structuring their selected course section so that students learn and develop in the following areas: FSSE Item 29a. Writing clearly and effectively 29b. Speaking clearly and effectively 29c. Thinking critically and analytically 29d. Analyzing numerical and statistical information 29e. Acquiring job- or work-related knowledge and skills 29f. Working effectively with others 29g. Developing or clarifying a personal code of values and ethics 29h. Understanding people of other backgrounds (economic, racial/ethnic, political, religious, 29i. Solving complex real-world problems 29j. Being an informed and active citizen Distribution of student responses to: How much has your experience at this institution contributed to your knowledge, skills, and personal development in the following areas? Class Very much or Quite a bit % LD UD LD UD LD UD LD UD LD UD LD UD LD UD LD UD LD UD LD UD 56 71 31 53 93 97 40 42 47 73 64 70 45 46 42 46 58 70 62 56 Course Engagement Percentage of faculty who reported that it is important that the typical student do the following in their selected course section: FSSE Item 22a. Ask questions or contribute to course discussions in other ways 22b. Prepare two or more drafts of a paper or assignment before turning it in 22c. Come to class having completed readings or assignments Class Very much or Quite a bit % LD UD LD UD LD UD 88 98 44 59 94 96 Additional Engagement Items (continued) Student Leadership Percentage of faculty who think it is important for undergraduates at their institution to do the following before they graduate: FSSE Item 1b. Class Very much or Quite a bit % Hold a formal leadership role in a student LD 17 organization or group UD 40 Memorization Percentage of faculty whose coursework substantially emphasizes the following in their selected course section: 27a. Memorizing course material LD 29 UD 21 9/22/14 NSSE Item 17a. Writing clearly and effectively 17b. Speaking clearly and effectively 17c. Thinking critically and analytically 17d. Analyzing numerical and statistical information 17e. Acquiring job- or work-related knowledge and skills 17f. Working effectively with others 17g. Developing or clarifying a personal code of values and ethics 17h. Understanding people of other backgrounds (economic, racial/ethnic, political, religious, 17i. Solving complex real-world problems 17j. Being an informed and active citizen Class FY SR FY SR FY SR FY SR FY SR FY SR FY SR FY SR FY SR FY SR Very much Faculty Data Bars or Quite a less (±100%) bit % student % 69 73 49 67 78 80 53 59 45 72 59 71 54 54 57 55 52 60 51 56 -13% -2% -17% -14% 14% 16% -13% -18% 3% 1% 4% -1% -9% -7% -15% -10% 6% 10% 11% 0% Distribution of student responses to: About how often have you done the following during the current school year? NSSE Item 1a. 1b. 1c. Asked questions or contributed to course discussions in other ways Prepared two or more drafts of a paper or assignment before turning it in Come to class without completing readings or assignments (Never of Sometimes) Class FY SR FY SR FY SR Very much Faculty Data Bars or Quite a less (±100%) bit % student % 58 82 52 53 83 80 30% 17% -8% 5% 11% 16% Distribution of student responses to: Which of the following have you done or do you plan to do before you graduate? NSSE Item 11b. Hold a formal leadership role in a student organization or group Class FY SR Very much Faculty Data Bars or Quite a less (±100%) bit % student % 35 41 -18% -1% Distribution of student responses to: How much has your coursework emphasized the following during the current school year? 4a. Memorizing course material FY 67 -38% SR 58 -36% CWU 2014 FSSE Compared to NSSE Responses page 9 of 10 Table 12 – High Impact Practices continued Time Spent by Students Percentage of faculty who think the typical student in their selected course section spends 16 hours or more on each of the following in an average 7-day week: FSSE Item 20a. Participating in co-curricular activities 20b. Working for pay on campus 20c. Working for pay off campus 20d. Doing community service or volunteer work 20e. Relaxing and socializing (time with friends, video games, TV or videos, keeping up with 20f. Providing care for dependents (children, parents, etc.) 20g. Commuting to campus (driving, walking, etc.) 9/22/14 Class Very much or Quite a bit % LD UD LD UD LD UD LD UD LD UD LD UD LD UD 0 4 8 16 26 49 0 0 60 52 9 16 0 2 Distribution of student responses to: About how many hours do you spend in a typical 7-day week doing the following? NSSE Item 15b. Participating in co-curricular activities 15c. Working for pay on campus 15d. Working for pay off campus 15e. Doing community service or volunteer work 15f. Relaxing and socializing (time with friends, video games, TV or videos, keeping up with 15g. Providing care for dependents (children, parents, etc.) 15h. Commuting to campus (driving, walking, etc.) CWU 2014 FSSE Compared to NSSE Responses Class FY SR FY SR FY SR FY SR FY SR FY SR FY SR Very much Faculty Data Bars or Quite a less (±100%) bit % student % 6 6 5 13 5 33 2 5 43 24 3 18 3 2 page 10 of 10 -6% -2% 3% 2% 21% 16% -2% -5% 18% 28% 7% -2% -3% 0%