IR report #238A - Community College of Philadelphia

advertisement
2013
Community College Survey of
Student Engagement Benchmarks of
Effective Educational Practice –
Spring 2013 Results
IR Report #238A
Office of Institutional Research
August 2013
Introduction to CCSSE
The Community College Survey of Student Engagement (CCSSE) utilizes a set of five benchmarks of
effective educational practice in community colleges. These benchmarks allow member institutions,
with missions focused on teaching, learning, and student success, to gauge and monitor their performance in areas that are central to their work. A description of the five benchmarks appears below.
Benchmarks of Effective Educational Practice
Active and Collaborative Learning
Students learn more when they are actively involved in their education and have opportunities to
think about and apply what they are learning in different settings. Through collaborating with others
to solve problems or mastering challenging content, students develop valuable skills that prepare
them to deal with the kinds of situations and problems they will encounter in the workplace, the
community, and their personal lives.
Student Effort
Students’ own behaviors contribute significantly to their learning and the likelihood that they will
successfully attain their educational goals.
Academic Challenge
Challenging intellectual and creative work is central to student learning and collegiate quality. Survey items address the nature and amount of assigned academic work, the complexity of cognitive
tasks presented to students, and the standards faculty members use to evaluate student performance.
Student-Faculty Interaction
In general, the more contact students have with their teachers, the more likely they are to learn effectively and persist toward achievement of their educational goals. Through such interactions, faculty
members become role models, mentors, and guides for continuous, lifelong learning.
Support for Learners
Students perform better and are more satisfied at colleges that are committed to their success and
cultivate positive working and social relationships among different groups on campus.
During spring semesters in 2007, 2009 and 2013, classes were randomly selected for inclusion in
CCSSE. Class participation rates were 70% in 2007; 81% in 2009; and 45% in 20131. The most recent
CCSSE results could be skewed given the low response rate.
An advantage of participating in CCSSE is that Colleges have the opportunity to make comparisons between their performance and that of similar colleges. CCSSE provides summary information for several
college groupings that are referenced in the College’s Institutional Research reports. The summary information associated with the 2013 Cohort utilizes a three-year cohort (2011 through 2013) of participating colleges. The 2013 CCSSE Cohort includes 718 institutions from 48 states and the District of Columbia, three Canadian provinces, plus Bermuda, Micronesia and the Northern Marianas. Eighty colleges, including CCP, are classified as Extra-Large Colleges since their credit students number 15,000+.
A listing of Extra-Large Colleges appears at the end of this report. A third college grouping provided
1. The late distribution of the surveys and the directive from the Faculty Federation not to participate in activities
of a voluntary nature until a faculty contract was signed may have accounted for the much lower response rate in
spring 2013.
1
by CCSSE is 2013 Top Performing Colleges. Top Performing Colleges are those that scored in the top
10 percent of the cohort by benchmark. CCSSE does not provide a list if these Colleges and comparison
information for this latter grouping of colleges is limited in scope to just benchmark information.
The Institutional Research Office issued a series of four reports in summer 2013 based on the Community College Survey of Student Engagement. These reports are as follows…
Institutional Research Report #238A
Community College Survey of Student Engagement Benchmarks of Effective Educational Practice
Spring 2013
This report explores CCP’s benchmarks of student engagement as measured by the 2013
CCSSE student responses. CCP engagement is compared throughout the report with the
2013 CCSSE Cohort and the Extra-Large Colleges group. Comparisons of CCP
engagement with 2013 Top Performing Colleges is limited to benchmark scores.
Institutional Research Report #238B
Community College Survey of Student Engagement - A Comparison of Student Responses
in Spring 2013, 2009 and 2007
As implied in the title, this report focuses on intra-institutional comparisons of student
engagement benchmarks across the three time periods the survey process was undertaken
by the College.
Institutional Research Report #238C
Community College Survey of Student Engagement Trends in Students’ Use, Satisfaction and Importance of CCP Support Services
In addition to gathering information about student engagement, the CCSSE explores
student use, satisfaction and perceived importance of 11 institutional support services.
Student responses in 2013 are compared intra-institutionally with their predecessors in
2009 and 2007 and inter-institutionally with the 2013 CCSSE Cohort and the
Extra-Large Colleges group.
Institutional Research Report #238D
Assessment of Mission Effectiveness: Development of General Education and Workforce Skills
Results Based on Spring 2013 Community College Survey of Student Engagement
The CCSSE survey also explores 15 areas related to the development of general
education and workforce skills and affective attributes. Student responses to these
items in 2013 are compared intra-institutionally with their predecessors in 2009 and
2007 and inter-institutionally with the 2013 CCSSE Cohort and the Extra-Large
Colleges group.
2
Benchmark Scores
The following table contains average scores for the five benchmarks. Scores were computed by averaging the scores on individual survey items that comprise each benchmark. Benchmark scores are standardized so that the mean for all students is 50 and the standard deviation is 25. Higher benchmark
scores indicate greater levels of effectiveness. Score Differences reflect the difference between the comparison group score and CCP’s score on the benchmark. Benchmarks that received highest grades at
CCP were Academic Challenge and Student Effort. These benchmarks also resulted in the largest differences in scores between CCP and the groups of comparison colleges. Support for Learners was a dimension of student engagement that received the lowest benchmark score at CCP (see Table 1). Across the
benchmarks, CCP’s scores were higher than the Extra Large Colleges and the 2013 CCSSE Cohort. The
College was among the Top-Performing Colleges for Academic Challenge and also scored well in the
Student Effort benchmark (see Figure 1).
Table 1
2013 Benchmark Summary Table— All Students
Figure 1
2013 CCP Benchmark with CCSSE Cohort and Top-Performing Colleges
3
Active and Collaborative Learning Benchmark
Seven items contributed to the Active and Collaborative Learning Benchmark which focused
on student collaboration and involvement in academic activities in and out of the class. CCP’s
performance for this benchmark was above it’s institutional peers. Compared with their peers at
other participating institutions, CCP students:
Participated in class discussions significantly more often (see Table 2, Item 4a)
Prepared class presentations less often (see Table 2, Item 4b)
Worked on projects or assignments with other students both in and outside of class more
often (see Table 2, Item 4f and 4g)
Tutored other students more often (see Table 2, Item 4h)
Participated in a community-based project as part of a course more often (see Table 2,
Item 4i)
Discussed their readings or class work with others outside of class more often (see Table
2, Item 4r).
.
Benchmark Scores
All Students
Community College of
Philadelphia
Extra Large
Colleges
2013 CCSSE
Cohort
52.8
49.7
50.0
Table 2
Mean Rating of Items in Active and Collaborative Learning Benchmark
** T-test (2-tailed) significant group difference
4
description
Student Effort Benchmark
Eight items contributed to the Student Effort Benchmark, which focused on class preparation and resource usage. CCP’s performance for this benchmark surpassed it’s institutional peers. Compared to
their peers, CCP students:
Prepared multiple drafts of an assignment significantly more often (see Table 3, Item 4c)
Came to class significantly better prepared (see Table 3, Item 4e)
Read more books for pleasure or personal enrichment (see Table 3, Item 6b)
Accessed tutoring services and computer labs more often (see Table 4, Item 13.1d & 13.1h)
Accessed skills labs less often (see Table 4, Item 13.1e)
In addition, CCP students’ ability to integrate information from multiple sources and the number of
hours they spent preparing for class was in line with the Cohort averages (see Table 3, Item 4d & 10a).
Benchmark Scores
All Students
Community College of
Philadelphia
Extra Large
Colleges
2013 CCSSE
Cohort
55.9
49.4
50.0
Table 3
Mean Rating of Items 4, 6, and 10 in Student Effort Benchmark
** T-test (2-tailed) significant group difference
5
Table 4
Mean Rating of Item 13 in Student Effort Benchmark
** T-test (2-tailed) significant group difference
6
Academic Challenge Benchmark
Based on responses to the ten survey items that comprise the Academic Challenge Benchmark, CCP students, on average, indicated they were sufficiently challenged across a number of dimensions. CCP had
the highest mean score for this benchmark, placing it at the top among it’s peers. Compared to students
attending peer institutions, CCP students indicated they:
Worked significantly harder to meet their instructors’ expectations (see Table 5, Item 4p)
Analyzed, synthesized, and evaluated information significantly more often (see Table 5, Item
5b, 5c, & 5d)
Applied new concepts, theories, or performed new skills more often (see Table 5, Item 5e & 5f)
Read significantly more assigned readings (see Table 6, Item 6a)
Wrote more papers (see Table 6, Item 6c)
Students at CCP were also more challenged of by their exams but felt more encouraged to study than
their peers (see Table 6, Item 7 & 9a).
Benchmark Scores
All Students
Community College of
Philadelphia
Extra Large
Colleges
2013 CCSSE
Cohort
57.8
50.0
50.0
Table 5
Mean Rating of Items 4 and 5 in Academic Challenge Benchmark
** T-test (2-tailed) significant group difference
7
Table 6
Mean Rating of Items 6, 7, and 9 in Academic Challenge Benchmark
** T-test (2-tailed) significant group difference
8
Student-Faculty Interaction Benchmark
Six survey items focusing on communication between students and faculty were used to measure the
Student-Faculty Interaction Benchmark. CCP’s performance for this benchmark surpassed it’s institutional peers. The results show that CCP students expressed an intermediate level of engagement with
faculty that was higher than their peers at other institutions. Compared to their peers, CCP students indicated they:
Contacted their instructors via email less often (see Table 7, Item 4k)
Discussed their grades or assignments with their instructors significantly more often (see Table 7,
Item 4l)
Engaged in conversations with faculty about readings or class work outside of class significantly
more often (see Table 7, Item 4n)
Received prompt feedback from faculty on their academic performance significantly more often
(see Table 7, Item 4o)
Worked with faculty on extracurricular activities more often (see Table 7, Item 4q)
On average, CCP students discussed their career plans with an instructor or advisor at or about the same
frequency as students attending other institutions (see Table 7, Item 4m).
Benchmark Scores
All Students
Community College of
Philadelphia
Extra Large
Colleges
2013 CCSSE
Cohort
53.8
48.6
50.0
Table 7
Mean Rating of Items in Student-Faculty Interaction Benchmark
** T-test (2-tailed) significant group difference
9
Support for Learners Benchmark
Seven items were included in the Support for Learners Benchmark that contained questions concerning
campus climate, academic, and student support services. CCP’s performance for this benchmark exceeded the Extra Large and overall Cohort averages; however, within all of the benchmarks, it was the
College’s lowest performing index. Compared to their peers, CCP students indicated that they received:
Less support to achieve success in college (see Table 8, Item 9b)
More encouragement to interact with students from diverse backgrounds (see Table 8, Item 9c)
About the same amount of support for their out-of-classroom obligations (family, work, etc.) (see
Table 8, Item 9d)
More social support (see Table 8, Item 9e)
Significantly more financial support (see Table 8, Item 9f)
In addition, CCP students accessed academic advising and career counseling services more often than
their peers at other institutions (see Table 8, Item 13.1a & 13.1b).
Benchmark Scores
All Students
Community College of
Philadelphia
Extra Large
Colleges
2013 CCSSE
Cohort
52.5
48.9
50.0
Table 8
Mean Rating of Items in Support for Learners Benchmark
10
2013 Comparison Group of Extra-Large Colleges (15,000+ Students)
Institution
American River College
Anne Arundel Community College
Austin Community College
Bakersfield College
Bergen Community College
Blinn College
Broward College
Chaffey College
College of DuPage
College of Lake County
College of Southern Nevada
Columbus State Community College
Community College of Allegheny County
Community College of Philadelphia
Daytona State College
De Anza College
Des Moines Area Community College
Edison State College
El Paso Community College
Florida State College at Jacksonville
Foothill College
Fresno City College
Front Range Community College
Georgia Perimeter College
Glendale Community College
Glendale Community College
Grand Rapids Community College
Grossmont College
Harper College
Henry Ford Community College
Houston Community College
Ivy Tech Community College - Central Indiana
Jefferson Community and Technical College
Johnson County Community College
Kingsborough Community College
Kirkwood Community College
LaGuardia Community College
City
Sacramento
Arnold
Austin
Bakersfield
Paramus
Brenham
Ft. Lauderdale
Rancho Cucamonga
Glen Ellyn
Grayslake
Las Vegas
Columbus
Pittsburgh
Philadelphia
Daytona Beach
Cupertino
Ankeny
Fort Myers
El Paso
Jacksonville
Los Altos Hills
Fresno
Westminster
Decatur
Glendale
Glendale
Grand Rapids
El Cajon
Palatine
Dearborn
Houston
Indianapolis
Louisville
Overland Park
Brooklyn
Cedar Rapids
Long Island City
- Continued on Next Page -
11
State
CA
MD
TX
CA
NJ
TX
FL
CA
IL
IL
NV
OH
PA
PA
FL
CA
IA
FL
TX
FL
CA
CA
CO
GA
AZ
CA
MI
CA
IL
MI
TX
IN
KY
KS
NY
IA
NY
Year of
Participation
2013
2012
2013
2011
2012
2012
2011
2013
2012
2012
2011
2013
2013
2013
2013
2012
2012
2013
2013
2013
2012
2011
2012
2011
2011
2011
2013
2012
2012
2011
2013
2011
2013
2012
2011
2013
2012
Institution
Lansing Community College
Lone Star College – CyFair
Lone Star College - North Harris
Macomb Community College
Madison Area Technical College
Mesa Community College
Metropolitan Community College
Miami Dade College
Milwaukee Area Technical College
Modesto Junior College
Monroe Community College
Montgomery College
Moraine Valley Community College
Mt. San Antonio College
Northern Virginia Community College
Northwest Vista College
Oakland Community College
Owens Community College
Ozarks Technical Community College
Palm Beach State College
Palomar College
Pasadena City College
Pima Community College
Portland Community College - Sylvania
Richland College
Riverside City College
Sacramento City College
Salt Lake Community College
San Antonio College
Santa Fe College
Santa Monica College
Seminole State College of Florida
Sinclair Community College
South Texas College
St. Petersburg College
Tarrant County College District
The Community College of Baltimore County
Tidewater Community College
Triton College
Tulsa Community College
Valencia College
Vincennes University
Wake Technical Community College
City
Lansing
Cypress
Houston
Warren
Madison
Mesa
Omaha
Miami
Milwaukee
Modesto
Rochester
Rockville
Palos Hills
Walnut
Annandale
San Antonio
Bloomfield Hills
Perrysburg
Springfield
Lake Worth
San Marcos
Pasadena
Tucson
Portland
Dallas
Riverside
Sacramento
Salt Lake City
San Antonio
Gainesville
Santa Monica
Sanford
Dayton
McAllen
St. Petersburg
Fort Worth
Baltimore
Norfolk
River Grove
Tulsa
Orlando
Vincennes
Raleigh
12
State
MI
TX
TX
MI
WI
AZ
NE
FL
WI
CA
NY
MD
IL
CA
VA
TX
MI
OH
MO
FL
CA
CA
AZ
OR
TX
CA
CA
UT
TX
FL
CA
FL
OH
TX
FL
TX
MD
VA
IL
OK
FL
IN
NC
Year of
Participation
2013
2013
2013
2013
2013
2011
2013
2012
2012
2013
2012
2012
2011
2011
2011
2013
2012
2012
2013
2011
2011
2012
2011
2011
2012
2013
2012
2012
2013
2013
2012
2013
2012
2013
2013
2013
2012
2013
2013
2013
2013
2013
2013
Download