NSSE Benchmark Report November 2005 Texas Tech University NSSE 2005 Benchmark Report Texas Tech University To focus discussions about the importance of student engagement and guide institutional improvement efforts, NSSE created five clusters or benchmarks of effective educational practice: (1) Level of academic challenge, (2) Active and collaborative learning, (3) Student-faculty interaction, (4) Enriching educational experiences, and (5) Supportive campus environment. Using approximately 225,000 randomly selected students from 518 institutions that participated in NSSE 2005, this Benchmark Report compares the performance of your institution with its selected peer group, Carnegie group, and the 2005 national norms. In addition, page 8 provides two other comparisons between your school and above-average institutions with benchmarks in the top 50% nationally and high-performing institutions with benchmarks in the top 10% nationally. These displays allow you to determine if the engagement of your typical student differs in a statistically significant, meaningful way from the average student in these comparison groups. More detailed information about how benchmarks are created can be found in the 2005 annual report and on the NSSE website at nsse.iub.edu. Guide to Your Benchmark Report Class Means are reported for first-year students and seniors. Only students who were part of the base random sample or random oversample are included in these analyses. Students in targeted oversamples are not included. Statistical Significance Benchmarks with mean differences that are larger than would be expected by chance alone are noted with one, two, or three asterisks, denoting one of three significance levels (p<.05, p< .01, and p<.001). The smaller the significance level, the smaller the likelihood that the difference is due to chance. Please note that statistical significance does not guarantee that the result is substantive or important. Large sample sizes (like those seen with NSSE data) tend to produce more statistically significant results even though the magnitude of mean differences may be inconsequential. Level of Academic Challenge Benchmark Mean Comparisons NSSEville compared with: NSSEville Selected Peers Master's Effect Class Mean The mean is the weighted arithmetic average of student level benchmark scores. Although institutional benchmark score calculations have not changed from prior years, reference group calculations were revised in 2005. First-Year Seniors Mean Mean 50.1 55.2 56.8 60.5 Sig a Size *** *** NSSE 2005 Effect b Mean -.51 -.42 51.7 56.1 First-Year Sig a *** ** Size Effect b Mean -.17 -.12 Sig 52.6 56.5 a *** *** Size Seniors 100 100 75 75 60.5 56.8 51.7 50.1 55.2 52.6 50 50 25 25 0 56.1 56.5 Master's NSSE 2005 b -.24 -.15 Effect Size Effect size indicates the “practical significance” of the mean difference. It is calculated by dividing the mean difference by the standard deviation of the group with which the institution is being compared (selected peers, Carnegie type, or 2005 national norm). In practice, an effect size of .2 is often considered small, .5 moderate, and .8 large. A positive sign indicates that your institution’s mean was greater, thus showing an affirmative result for the institution. A negative sign indicates the institution lags behind the comparison group. Look for patterns of effect sizes that point to areas of student or institutional performance that warrant attention. 0 NSSEville Selected Peers Master's NSSE 2005 NSSEville Selected Peers Level of Academic Challenge Items Challenging intellectual and creative work is central to student learning and collegiate quality. Colleges and universities promote high levels of student achievement by emphasizing the importance of academic effort and setting high expectations for student performance. Benchmark Description & Survey Items A theoretical rationale for measuring the benchmark and the individual items used in its creation are summarized. ● Preparing for class (studying, reading, writing, rehearsing, etc. related to academic program) ● Number of assigned textbooks, books, or book-length packs of course readings ● Number of written papers or reports of 20 pages or more; number of written papers or reports of between 5 and 19 pages; and number of written papers or reports of fewer than 5 pages ● Coursework emphasizing analysis of the basic elements of an idea, experience or theory ● Coursework emphasizing synthesis and organizing of ideas, information, or experiences into new, more complex interpretations and relationships ● Coursework emphasizing the making of judgments about the value of information, arguments, or methods ● Coursework emphasizing application of theories or concepts to practical problems or in new situations ● Working harder than you thought you could to meet an instructor's standards or expectations ● Campus environment emphasizing time studying and on academic work Bar Charts A visual display of first-year and senior mean benchmark scores for your institution and three reference groups. Page 2 NSSE 2005 Benchmark Report Mean Comparisons Texas Tech University Level of Academic Challenge Benchmark Mean Comparisons Texas Tech compared with: Texas Tech Selected Peers Doc-Ext Effect Class First-Year Seniors Mean Mean 46.7 52.3 48.9 53.4 Sig a Size ** b Mean -.17 -.07 51.3 55.1 First-Year 100 75 75 46.7 48.9 51.3 52.6 a *** ** Size Effect b Mean -.34 -.19 Sig 52.6 56.5 a *** *** Size 53.4 55.1 56.5 52.3 Texas Tech Selected Peers Doc-Ext NSSE 2005 25 Texas Tech Selected Peers Doc-Ext NSSE 2005 0 Level of Academic Challenge Items Challenging intellectual and creative work is central to student learning and collegiate quality. Colleges and universities promote high levels of student achievement by emphasizing the importance of academic effort and setting high expectations for student performance. ● Preparing for class (studying, reading, writing, rehearsing, etc. related to academic program) ● Number of assigned textbooks, books, or book-length packs of course readings ● Number of written papers or reports of 20 pages or more; number of written papers or reports of between 5 and 19 pages; and number of written papers or reports of fewer than 5 pages ● Coursework emphasizing analysis of the basic elements of an idea, experience or theory ● Coursework emphasizing synthesis and organizing of ideas, information, or experiences into new, more complex interpretations and relationships ● Coursework emphasizing the making of judgments about the value of information, arguments, or methods ● Coursework emphasizing application of theories or concepts to practical problems or in new situations ● Working harder than you thought you could to meet an instructor's standards or expectations ● Campus environment emphasizing time studying and on academic work a * p<.05 ** p<.01 ***p<.001 (2-tailed). b Effect size = mean difference divided by comparison group standard deviation. Page 3 b -.44 -.30 50 25 0 Sig Seniors 100 50 NSSE 2005 Effect NSSE 2005 Benchmark Report Mean Comparisons Texas Tech University Active and Collaborative Learning Benchmark Mean Comparisons Texas Tech compared with: Texas Tech Selected Peers Doc-Ext Effect Class First-Year Seniors Mean Mean 35.0 48.2 37.7 49.4 Sig a Size ** NSSE 2005 Effect b Mean -.18 -.07 38.9 47.8 First-Year Sig a *** Size Effect b Mean -.25 .02 42.4 51.5 Sig a *** *** Seniors 100 100 75 75 50 50 51.5 48.2 49.4 47.8 Texas Tech Selected Peers Doc-Ext 42.4 35.0 37.7 38.9 25 25 0 Texas Tech Selected Peers Doc-Ext NSSE 2005 0 NSSE 2005 Active and Collaborative Learning Items Students learn more when they are intensely involved in their education and asked to think about what they are learning in different settings. Collaborating with others in solving problems or mastering difficult material prepares students for the messy, unscripted problems they will encounter daily during and after college. ● ● ● ● ● ● ● Asked questions in class or contributed to class discussions Made a class presentation Worked with other students on projects during class Worked with classmates outside of class to prepare class assignments Tutored or taught other students Participated in a community-based project as part of a regular course Discussed ideas from your readings or classes with others outside of class (students, family members, co-workers, etc.) a * p<.05 ** p<.01 ***p<.001 (2-tailed). b Effect size = mean difference divided by comparison group standard deviation. Page 4 Size b -.47 -.19 NSSE 2005 Benchmark Report Mean Comparisons Texas Tech University Student-Faculty Interaction Benchmark Mean Comparisons Texas Tech compared with: Texas Tech Selected Peers Doc-Ext Effect Class First-Year Seniors Mean Mean 31.2 40.0 30.8 40.6 Sig a Size b Mean .03 -.03 100 75 75 50 50 30.7 Size Effect b Mean .03 -.03 34.0 44.1 Sig a ** ** Size b -.16 -.19 44.1 40.0 40.6 40.6 Texas Tech Selected Peers Doc-Ext 34.0 25 0 a Seniors 100 30.8 Sig 30.7 40.6 First-Year 31.2 NSSE 2005 Effect 25 Texas Tech Selected Peers Doc-Ext NSSE 2005 0 NSSE 2005 Student-Faculty Interaction Items Students learn firsthand how experts think about and solve practical problems by interacting with faculty members inside and outside the classroom. As a result, their teachers become role models, mentors, and guides for continuous, life-long learning. ● ● ● ● ● ● Discussed grades or assignments with an instructor Talked about career plans with a faculty member or advisor Discussed ideas from your readings or classes with faculty members outside of class Worked with faculty members on activities other than coursework (committees, orientation, student-life activities, etc.) Received prompt feedback from faculty on your academic performance (written or oral) Worked with a faculty member on a research project outside of course or program requirements a * p<.05 ** p<.01 ***p<.001 (2-tailed). b Effect size = mean difference divided by comparison group standard deviation. Page 5 NSSE 2005 Benchmark Report Mean Comparisons Texas Tech University Enriching Educational Experiences Benchmark Mean Comparisons Texas Tech compared with: Texas Tech Selected Peers Doc-Ext Effect Class First-Year Seniors Mean Mean 25.2 35.8 27.0 39.3 Sig a Size * *** NSSE 2005 Effect b Mean -.14 -.21 28.2 41.0 First-Year Sig a *** *** Size Effect b Mean -.24 -.30 27.8 42.1 Sig a *** *** Size b -.21 -.35 Seniors 100 100 75 75 50 50 39.3 41.0 42.1 Doc-Ext NSSE 2005 35.8 25.2 27.0 28.2 27.8 25 0 25 Texas Tech Selected Peers Doc-Ext NSSE 2005 0 Texas Tech Selected Peers Enriching Educational Experiences Items Complementary learning opportunities in and out of class augment academic programs. Diversity experiences teach students valuable things about themselves and others. Technology facilitates collaboration between peers and instructors. Internships, community service, and senior capstone courses provide opportunities to integrate and apply knowledge. ● ● ● ● ● ● ● ● ● ● ● Participating in co-curricular activities (organizations, publications, student government, sports, etc.) Practicum, internship, field experience, co-op experience, or clinical assignment Community service or volunteer work Foreign language coursework & study abroad Independent study or self-designed major Culminating senior experience (comprehensive exam, capstone course, thesis, project, etc.) Serious conversations with students of different religious beliefs, political opinions, or personal values Serious conversations with students of a different race or ethnicity Using electronic technology to discuss or complete an assignment Campus environment encouraging contact among students from different economic, social, and racial or ethnic backgrounds Participate in a learning community or some other formal program where groups of students take two or more classes together a * p<.05 ** p<.01 ***p<.001 (2-tailed). b Effect size = mean difference divided by comparison group standard deviation. Page 6 NSSE 2005 Benchmark Report Mean Comparisons Texas Tech University Supportive Campus Environment Benchmark Mean Comparisons Texas Tech compared with: Texas Tech Selected Peers Doc-Ext Effect Class First-Year Seniors Mean Mean 57.3 52.9 59.9 57.2 Sig a Size * *** b Mean -.14 -.24 Sig 100 75 75 56.8 60.2 50 25 25 Selected Peers Mean 60.2 57.5 Sig a ** *** Size Doc-Ext NSSE 2005 0 Texas Tech 53.2 Selected Peers Doc-Ext NSSE 2005 Supportive Campus Environment Items Students perform better and are more satisfied at colleges that are committed to their success and cultivate positive working and social relations among different groups on campus. ● ● ● ● ● ● Campus environment provides the support you need to help you succeed academically Campus environment helps you cope with your non-academic responsibilities (work, family, etc.) Campus environment provides the support you need to thrive socially Quality of relationships with other students Quality of relationships with faculty members Quality of relationships with administrative personnel and offices a * p<.05 ** p<.01 ***p<.001 (2-tailed). b Effect size = mean difference divided by comparison group standard deviation. Page 7 b -.16 -.25 57.5 57.2 50 Texas Tech Effect b .03 -.01 52.9 0 Size Seniors 100 59.9 a 56.8 53.2 First-Year 57.3 NSSE 2005 Effect NSSE 2005 Benchmark Report Comparisons with Highly Engaging Institutions Texas Tech University First-Year Texas Tech compared with NSSE 2005 Top 50% Senior First-Year Texas Tech LAC ACL SFI EEE SCE LAC ACL SFI EEE SCE NSSE 2005 Top 10% mean mean sig a effect size b mean sig a effect size b 46.7 35.0 31.2 25.2 57.3 52.3 48.2 40.0 35.8 52.9 56.0 46.3 37.8 30.4 64.5 59.5 55.1 49.6 47.8 62.5 *** -.73 -.72 -.36 -.41 -.42 -.52 -.42 -.45 -.68 -.54 60.5 50.6 42.4 33.9 69.5 64.1 59.5 56.9 55.9 67.0 *** -1.15 -.98 -.60 -.71 -.74 -.92 -.68 -.79 -1.23 -.82 *** *** *** *** *** *** *** *** *** *** *** *** *** *** *** *** *** *** Level of Academic Challenge 100 75 56.0 50 60.5 59.5 25 0 Active and Collaborative Learning Student-Faculty Interaction 100 100 Top 50% Senior 75 75 46.3 50 Texas Tech 64.1 52.3 46.7 First-Year Legend Senior 50.6 55.1 59.5 48.2 56.9 49.6 50 35.0 37.8 42.4 40.0 31.2 25 25 Top 10% 0 0 This display compares your students with those attending schools that scored in the top 50% and top 10% of all NSSE 2005 institutions on the benchmark. First-Year First-Year Senior Senior Enriching Educational Experiences Supportive Campus Environment 100 100 75 75 50 25 25.2 30.4 33.9 69.5 57.3 55.9 47.8 64.5 62.5 67.0 52.9 50 35.8 25 0 0 First-Year Senior a * p<.05 ** p<.01 ***p<.001 (2-tailed). b Effect size = mean difference divided by comparison group standard deviation. First-Year Senior Page 8 NSSE 2005 Benchmark Report Detailed Benchmark Statistics and Effect Sizes Texas Tech University First-Year Students Mean Statistics N Mean SD Reference Group Comparison Statistics Distribution Statistics Conf. Interval SE Lower Upper 5 .7 .2 .1 .0 .1 .1 Percentile Distribution 25 50 75 95 Mean Diff. Conf. Interval SE Lower Upper Sig. Effect Conf. Interval size Lower Upper LEVEL OF ACADEMIC CHALLENGE Texas Tech Selected Peers Doc-Ext NSSE 2005 Top 50% Top 10% 354 2,776 21,820 106,053 52,055 12,161 46.7 48.9 51.3 52.6 56.0 60.5 13.4 12.8 13.1 13.4 12.8 12.0 45.3 48.4 51.1 52.6 55.9 60.3 48.1 49.3 51.4 52.7 56.1 60.7 25 28 30 31 35 40 38 40 42 44 47 52 47 48 51 53 56 61 55 57 60 62 65 69 69 70 73 75 77 80 -2.1 -4.5 -5.9 -9.3 -13.8 .7 .7 .7 .7 .7 -3.5 -.7 -5.9 -3.1 -7.3 -4.5 -10.6 -8.0 -15.2 -12.4 .003 .000 .000 .000 .000 -.17 -.34 -.44 -.73 -1.15 -.28 -.45 -.54 -.83 -1.26 -.05 -.24 -.34 -.62 -1.03 ACTIVE AND COLLABORATIVE LEARNING Texas Tech Selected Peers Doc-Ext NSSE 2005 Top 50% Top 10% 394 3,056 23,848 114,027 49,532 10,896 35.0 37.7 38.9 42.4 46.3 50.6 16.0 15.6 15.5 15.8 15.6 15.9 .8 .3 .1 .0 .1 .2 33.4 37.2 38.7 42.3 46.1 50.3 36.6 38.3 39.1 42.5 46.4 50.9 10 14 17 19 24 29 24 29 29 33 33 38 33 38 38 43 43 48 43 48 48 52 57 62 67 67 67 71 75 76 -2.7 -3.9 -7.4 -11.3 -15.6 .8 .8 .8 .8 .8 -4.4 -1.1 -5.5 -2.4 -9.0 -5.8 -12.8 -9.7 -17.2 -14.0 .001 .000 .000 .000 .000 -.18 -.25 -.47 -.72 -.98 -.28 -.35 -.57 -.82 -1.08 -.07 -.16 -.37 -.62 -.88 16.6 16.7 16.6 17.6 18.2 18.5 .9 .3 .1 .1 .1 .2 29.5 30.1 30.4 33.9 37.7 42.0 33.0 31.4 30.9 34.1 38.0 42.8 11 7 11 11 11 17 22 17 17 22 22 28 28 28 28 33 33 39 39 39 39 44 50 56 61 61 61 67 72 78 .5 .6 -2.8 -6.6 -11.2 .9 .9 .9 .9 .9 -1.4 -1.2 -4.6 -8.3 -12.9 2.3 2.3 -1.0 -4.9 -9.4 .608 .513 .003 .000 .000 .03 .03 -.16 -.36 -.60 -.08 -.07 -.26 -.46 -.70 .14 .14 -.06 -.27 -.51 .7 .2 .1 .0 .1 .1 23.8 26.5 28.0 27.7 30.3 33.7 26.5 27.4 28.4 27.9 30.5 34.2 7 8 10 8 11 15 16 18 19 19 22 25 25 26 27 26 30 33 32 35 36 36 38 42 47 48 50 50 52 55 -1.8 -3.1 -2.7 -5.3 -8.8 .7 .7 .7 .7 .7 -3.2 -4.4 -4.0 -6.6 -10.1 -.4 -1.7 -1.3 -3.9 -7.4 .012 .000 .000 .000 .000 -.14 -.24 -.21 -.41 -.71 -.25 -.35 -.31 -.52 -.81 -.03 -.13 -.10 -.31 -.60 .9 .4 .1 .1 .1 .2 55.4 59.2 56.5 60.0 64.3 69.1 59.1 60.6 57.0 60.3 64.6 69.8 28 31 28 31 36 42 47 47 44 47 53 58 58 61 58 61 64 69 69 72 69 72 78 81 86 89 86 89 92 97 -2.6 1.0 -4.7 -.6 .5 1.0 -1.4 2.4 -2.9 1.0 -4.8 -1.0 -7.2 .9 -9.1 -5.4 -12.2 .9 -14.0 -10.4 .012 .608 .003 .000 .000 -.14 .03 -.16 -.42 -.74 -.26 -.08 -.27 -.52 -.85 -.03 .13 -.05 -.31 -.63 STUDENT-FACULTY INTERACTION Texas Tech Selected Peers Doc-Ext NSSE 2005 Top 50% Top 10% 360 2,816 22,054 107,172 44,956 8,844 31.2 30.8 30.7 34.0 37.8 42.4 ENRICHING EDUCATIONAL EXPERIENCES Texas Tech Selected Peers Doc-Ext NSSE 2005 Top 50% Top 10% 347 2,689 21,254 103,470 55,533 10,423 25.2 27.0 28.2 27.8 30.4 33.9 12.6 12.6 12.7 12.8 12.7 12.4 SUPPORTIVE CAMPUS ENVIRONMENT Texas Tech Selected Peers Doc-Ext NSSE 2005 Top 50% Top 10% 342 2,639 20,841 101,749 46,610 8,245 57.3 59.9 56.8 60.2 64.5 69.5 17.6 18.3 17.8 18.1 17.3 16.5 Page 9 NSSE 2005 Benchmark Report Detailed Benchmark Statistics and Effect Sizes Texas Tech University Senior Students Mean Statistics N Mean SD Reference Group Comparison Statistics Distribution Statistics Conf. Interval SE Lower Upper 5 .8 .3 .1 .0 .1 .1 Percentile Distribution 25 50 75 95 Mean Diff. Conf. Interval SE Lower Upper Sig. Effect Conf. Interval size Lower Upper .9 .8 .8 .8 .8 .236 .001 .000 .000 .000 -.07 -.19 -.30 -.52 -.92 -.19 -.31 -.41 -.64 -1.04 .05 -.08 -.18 -.41 -.80 .7 2.2 -1.4 -5.1 -9.4 .208 .694 .001 .000 .000 -.07 .02 -.19 -.42 -.68 -.19 -.09 -.31 -.53 -.79 .04 .13 -.08 -.31 -.57 LEVEL OF ACADEMIC CHALLENGE Texas Tech Selected Peers Doc-Ext NSSE 2005 Top 50% Top 10% 285 3,061 21,954 104,811 46,242 9,096 52.3 53.4 55.1 56.5 59.5 64.1 13.2 14.2 13.9 14.1 13.6 12.7 50.8 52.9 54.9 56.4 59.3 63.8 53.9 53.9 55.2 56.6 59.6 64.3 29 30 32 33 37 42 44 43 46 47 50 56 52 53 55 57 60 65 61 63 65 67 69 73 74 77 78 79 81 84 -1.0 -2.7 -4.2 -7.1 -11.7 .9 .3 .1 .1 .1 .2 46.4 48.9 47.6 51.4 55.0 59.2 50.0 50.0 48.0 51.6 55.3 59.8 24 24 24 24 29 33 38 38 38 38 43 48 48 48 48 52 52 57 57 62 57 62 67 71 76 81 76 81 86 86 -1.2 1.0 -3.2 .4 .9 -1.5 -3.3 1.0 -5.2 -6.9 .9 -8.8 -11.3 1.0 -13.2 20.3 1.2 20.1 .4 20.4 .1 21.0 .1 21.1 .1 21.4 .3 37.7 39.9 40.3 44.0 49.4 56.4 42.4 41.3 40.9 44.2 49.8 57.4 11 11 11 17 17 22 28 28 28 28 33 39 39 39 39 39 50 56 50 56 56 56 67 72 78 78 78 83 89 94 -.6 -.6 -4.1 -9.6 -16.9 1.2 -3.0 1.8 1.2 -3.0 1.8 1.2 -6.5 -1.6 1.2 -12.0 -7.2 1.2 -19.3 -14.5 .639 .630 .001 .000 .000 -.03 -.03 -.19 -.45 -.79 -.15 -.15 -.31 -.57 -.90 .09 .09 -.08 -.34 -.68 .9 .3 .1 .1 .1 .2 34.0 38.7 40.8 42.0 47.7 55.6 37.7 39.9 41.2 42.2 48.0 56.3 14 14 14 14 18 28 25 27 28 29 36 46 35 39 40 42 48 57 47 50 53 55 60 67 62 69 71 73 76 82 -3.5 1.0 -5.5 -1.4 -5.2 .9 -7.0 -3.3 -6.3 .9 -8.1 -4.5 -12.0 .9 -13.8 -10.1 -20.1 1.0 -22.1 -18.1 .001 .000 .000 .000 .000 -.21 -.30 -.35 -.68 -1.23 -.33 -.40 -.45 -.79 -1.35 -.09 -.19 -.25 -.58 -1.11 18.6 1.1 18.3 .3 18.4 .1 18.5 .1 17.6 .1 17.1 .2 50.7 56.6 52.9 57.4 62.3 66.6 55.1 57.9 53.4 57.6 62.7 67.4 22 28 22 28 33 36 39 44 42 44 50 56 56 58 53 58 64 67 67 69 67 69 75 78 83 89 83 89 92 94 -4.3 -.3 -4.6 -9.6 -14.1 .000 .820 .000 .000 .000 -.24 -.01 -.25 -.54 -.82 -.36 -.14 -.37 -.66 -.95 -.11 .11 -.13 -.42 -.69 -2.8 .7 -4.3 -1.1 -5.8 -2.5 -8.7 -5.5 -13.2 -10.2 ACTIVE AND COLLABORATIVE LEARNING Texas Tech Selected Peers Doc-Ext NSSE 2005 Top 50% Top 10% 310 3,221 23,064 108,825 45,628 9,597 48.2 49.4 47.8 51.5 55.1 59.5 16.2 16.7 16.6 16.9 16.5 16.6 STUDENT-FACULTY INTERACTION Texas Tech Selected Peers Doc-Ext NSSE 2005 Top 50% Top 10% 287 3,098 22,123 105,589 42,492 7,126 40.0 40.6 40.6 44.1 49.6 56.9 ENRICHING EDUCATIONAL EXPERIENCES Texas Tech Selected Peers Doc-Ext NSSE 2005 Top 50% Top 10% 272 3,007 21,562 103,279 49,935 9,212 35.8 39.3 41.0 42.1 47.8 55.9 15.5 16.7 17.4 18.1 17.5 16.3 SUPPORTIVE CAMPUS ENVIRONMENT Texas Tech Selected Peers Doc-Ext NSSE 2005 Top 50% Top 10% 265 2,968 21,283 102,096 39,784 7,281 52.9 57.2 53.2 57.5 62.5 67.0 1.2 -6.6 -2.0 1.1 -2.5 2.0 1.1 -6.8 -2.3 1.1 -11.7 -7.5 1.2 -16.3 -11.8 Texas Tech University IPEDS: 229115 Page 10