Canada LC Profile_POST_FINAL

advertisement
Learning Communities
A review of the National Research &
evidence from Cañada College
Gregory M Stoup
Office of Planning, Research & Student Success
Cañada College
Brief background on Learning Communities
Have a long history
• first initiatives in 1960s
• Community College movement in 1980s
Little rigorous research on the effectiveness of learning communities
on academic outcomes
A body of research is emerging on the impacts of learning
communities on students at the developmental level
• The Effects of Learning Communities for Students in Developmental
Education (MDRC, July 2012)
• Learning Better Together: The Impact of Learning Communities on
Persistence of Low Income Students (Cathy Engstrom & Vincent Tinto, 2008)
MDRC Study
First large-scale randomized study
Longitudinal study of 174 Learning communities offered at 6
community colleges* involving 6,974 students
Nearly all learning communities in the study included a course in
developmental English or developmental math
Typical model studied involved linking the developmental
course with either a college level course, another
developmental course and/or a student success course
Colleges in MDRC Study: the Community College of Baltimore County, in Maryland; Hillsborough Community College, in Tampa, Fla.; Houston
Community College; Kingsborough Community College, in Brooklyn, N.Y.; Merced College, in California, and Queensborough Community College,
in Queens, N.Y. Kingsborough and Queensborough are part of the City University of New York
Components of the Learning Community Model
Degree of Implementation
Components
Basic
Midrange
Advanced
1. Linked courses and
student cohorts
Students are a mix of LC
students and students
taking the course as a
stand alone
Most (but not all)
students in the linked
courses are in the LC
2. Faculty
collaboration
Teacher teams rarely
communicate about
curriculum or students
Teacher teams
communicate periodically
throughout the semester
Teacher teams plan
before, during & after the
semester; Curriculum
tightly integrated
Courses taught as if
they were stand alone
Teachers assign at least
one joint project during
the semester
Syllabi are fully
aligned; joint projects,
joint grading rubrics;
joint assessment
3. Instructional
Practices
4. Student Support
No additional student
support is offered
Additional support
offered but not
integrated into the
classroom
Source: Effects of Learning Communities for Students in Developmental Education, page 5.
All students are in the
LC; Courses are
selected to promote
integration
Extra support fully
integrated into
classroom & often
required for students
Findings from the MDRC Study
The overall conclusion from the MDRC report is that learning
communities as typically operated in community colleges, on
average, should not be expected to produce more than a very
modest impact on credits earned (+0.5 on average) and that this
intervention, by itself, will not likely lead to higher rates of
reenrollment and completion for academically underprepared
students.
However, the evidence also suggests that a learning community
program with substantially enhanced supports for students,
00 and tightly integrated
such as ongoing or extra advising
curriculum across all courses in the LC, may lead to greater
benefits than the average learning community program*.
* This finding is generally consistent with those reported in Basic Skills as a Foundation for Student Success in California Community Colleges (The Poppy Copy).
A review of evidence on Cañada
College Learning Communities
Special thanks to Bart Scott for
outstanding data collection and
quality control
A Profile of Cañada College Learning
Communities
Some background information
• LC activity & performance difficult to track systematically
• First LC offered in Fall 2004 (Freshman Success)
• Slightly better record keeping since Fall 2008
• Small sample sizes hamper more thorough analysis
Overview of Learning Communities
(Fall 2008 – Spring 2012)
• Over this period we offered 44 courses from 14 different
departments
• In 2011/12 we offered 18 courses from 8 departments
• Growth in LC course offerings has outpaced overall college
offerings
• Significant variety of LC approaches; this is not an
homogenous group
Percent Growth in Student Headcount Since 2008/09
Percent Change from 2008/09 Level
Learning Community
200
190
180
170
160
150
140
130
120
110
100
90
80
70
60
50
Cañada College
+79%
+41%
+20%
Base Year
2008/09
+8%
+3%
+1%
2009/10
2010/11
2011/12
465
690
545
Headcount
LC
College
386
10,753
11,595
11,044
10,840
Percent Growth in Number of Sections Offered Since 2008/09
Percent Change from 2008/09 Level
Learning Community
200
190
180
170
160
150
140
130
120
110
100
90
80
70
60
50
Cañada College
+92%
+56%
+18%
Base Year
-5%
+0%
-11%
2008/09
2009/10
2010/11
2011/12
39
46
75
61
Section Count
LC
College
1,475
1,471
1,314
1,401
Learning Community offerings over last four years
Student Headcount
Dept
Course Title
2008/09
2009/10
2010/11
2011/12
ACTG
Accounting Procedures
20
ACTG
Quickbooks
20
ANTH
Indians Of North America
ASTR
Astronomy Laboratory
BUS.
Business Writing/Presentation
20
CBOT
Computer Applications, Part I
201
57
CBOT
Computer Applications, Part II
157
51
CRER
College Success
167
290
200
140
CRER
Exploring Careers & Majors
101
178
134
150
CRER
Math Success
38
ECE.
Child Development
34
26
ECE.
Child, Family, & Community
17
25
41
ECE.
Early Childhood Ed Curriculum
17
25
17
ECE.
Early Childhood Ed Principles
ECE.
Handling Behavior
13
ECE.
Infant Development
21
15
27
40
27
40
Learning Community offerings over last four years
Student Headcount
Dept
Course Title
2008/09
2009/10
2010/11
2011/12
ENGL
Basic Reading/Composition
117
219
171
142
ENGL
Writing Development
91
93
120
120
ESL
Adv. Vocabulary Development
20
35
ESL
Comp. for Non-Native Speakers
91
118
ESL
Content-Based Lang. Skills I
35
54
ESL
Intmdt. Vocabulary Development
ESL
Lang. Skills Workforce Cars. I
ESL
Listening/Speaking II
15
ESL
Writing III
22
32
ESL
Writing IV
26
35
HIST
History of Latinos in the U.S.
9
HIST
Race, Ethnicity & Immigration
HIST
U.S. History through 1877
9
41
69
26
216
80
52
63
Learning Community offerings over last four years
Student Headcount
Dept
Course Title
2008/09
LIBR
Intro. to Information Research
MATH
Elementary Algebra
14
MATH
Elementary Algebra I
37
MATH
Elementary Algebra II
15
MATH
Intermediate Algebra
12
PLSC
American Politics
28
PLSC
American Politics - Honors
1
PLSC
Calif State & Local Govt
11
READ
Academic Reading Strategies
78
READ
Reading Improvement
82
2009/10
2010/11
2011/12
96
118
141
162
147
164
121
95
26
Student Populations
(Fall 2008 – Spring 2012)
Learning Community
Cañada College
2%
1%
35%
38%
61%
63%
N = 1,874
Female
N = 28,453
Male
Not Reported
Student Populations
(Fall 2008 – Spring 2012)
Learning Community
700
32%
14000
600
500
Cañada College
26%
12000
400
22%
10000
22%
16%
8000
300
6000
200
4000
100
2000
0
0
N = 1,874
14%
N = 28,453
Less than 18 Yrs Old
18 & 19 Yrs Old
20-24 Yrs Old
25-29 Yrs Old
30-39 Yrs Old
40+ Yrs Old
Student Populations
(Fall 2008 – Spring 2012)
Cañada College
Learning Community
20000
1600
71%
1400
40%
36%
15000
1200
1000
10000
800
600
5000
400
10%
12%
200
0
0
N = 28,453
N = 1,874
Native American
Hispanic
Asian
Multi Race
Black Non-Hispanic
Filipino
Pacific Islander
White Non-Hispanic
Course Performance
(Fall 2008 – Spring 2012)
Learning Community
Cañada College Overall*
N = 1,874
N = 28,453
% receiving A grades
33%
% receiving A grades
36%
% receiving A or B grades
54%
% receiving A or B grades
54%
% receiving A, B or C grades
66%
% receiving A, B or C grades
66%
% receiving Ws
19%
% receiving Ws
15%
One benchmark for evaluating overall performance is the
college average. However, this is a crude benchmark and
doesn't properly account for the unique course taking
patterns of students in Learning Communities
* Does not include PE courses or students taking a single course during a term.
Course Performance
(Fall 2008 – Spring 2012)
Learning Community
Control Group*
N = 1,872
N = 10,993
% receiving A grades
33%
% receiving A grades
28%
% receiving A or B grades
54%
% receiving A or B grades
50%
% receiving A, B or C grades
66%
% receiving A, B or C grades
65%
% receiving Ws
19%
% receiving Ws
17%
A more appropriate benchmark might be to look at
students taking the same courses during the same terms
as those in the Learning Community but offered outside
the Learning Community format.
But ideally a benchmark should also account
for some of the student characteristics
associated with enrollment in Learning
Communities
We isolate three characteristics and control
for their effects
1. Ethnicity
2. Age
3. Unit Load
Summary of findings from
analysis of these three factors
Learning Communities are associated with slightly higher success in
terms of the % of “A” Grades awarded for:
• Hispanic students
• Students 18 or 19 Yrs Old
• Student taking less than 12 units
But, are also associated with lower levels of success ( in this case,
higher withdraw rates) for:
• African-American students
• Students 20 - 24 Yrs Old
Course Performance
(Fall 2008 – Spring 2012)
Learning Community
Control Group**
N = 1,872
% receiving A grades
33%
% receiving A grades
27%
% receiving A or B grades
54%
% receiving A or B grades
52%
% receiving A, B or C grades
66%
% receiving A, B or C grades
64%
% receiving Ws
19%
% receiving Ws
17%
So given that our Learning Communities attract different
distributions of students in terms of ethnicity,
& unit load
Expected age
Performance
and seeing that those groups succeed at controlling
different rates,
for we
ask: what performance would we expect
in a control
ethnicity,
age andgroup
unit
that had the same ethnicity, age and unit loadload
distribution as
our Learning Communities?
So much
variation
Course pass rates for 16 individual Learning Communities offered in
2010/11
Course
CBOT430
CBOT431
CRER401
CRER407
ECE201
ECE210
ECE212
ENGL826
ENGL836
ESL400
ESL837
ESL901
HIST245
LIBR100
READ826
READ836
TOTAL
LC
51%
51%
72%
62%
88%
95%
96%
61%
69%
83%
58%
58%
55%
75%
68%
66%
65%
Control
Group
66%
75%
27%
Net Change
-15%
-24%
45%
N/A
N/A
74%
73%
73%
60%
57%
73%
14%
22%
23%
1%
12%
10%
N/A
N/A
60%
-2%
N/A
N/A
N/A
N/A
38%
67%
63%
30%
-2%
1%
* Control Group is unique for each course. It’s composed of the same course offered the same term but not using the learning community format.
Persistence rates for 16 individual Learning Communities offered in
2010/11
Course
CBOT430
CBOT431
CRER401
CRER407
ECE201
ECE210
ECE212
ENGL826
ENGL836
ESL400
ESL837
ESL901
HIST245
LIBR100
READ826
READ836
TOTAL
LC
52%
60%
78%
72%
77%
65%
75%
78%
76%
83%
77%
59%
74%
78%
77%
72%
70%
Control
Group
53%
53%
73%
Net Change
-1%
6%
5%
N/A
N/A
64%
72%
75%
74%
76%
64%
13%
-7%
0%
4%
0%
19%
N/A
N/A
40%
19%
N/A
N/A
N/A
N/A
67%
81%
67%
10%
-9%
2%
* Control Group is unique for each course. It’s composed of the same course offered the same term but not using the learning community format.
A simple model. Why so much variation?
Basic Skills
Student
Learning
Community
Sequence
Completion
Learning communities have many moving parts that interact
in dynamic ways and vary from setting to setting.
Learning Community
Sequence of course
material
Learning
Synthesis of course
Community Work group
content
oversight
Basic Skills
Student
Sequence
Completion
Counseling support
Linkages to library
Coordination between
faculty & counselors
Timeliness of
feedback on progress
Classroom technology
Examples in lesson plan
Protocols for making
group assignments
Illustrative purposes only
(not actual properties of the
learning communities
researched in this study )
Case Analysis: Basic Skills
English 826 & Reading 826
Effects of Learning Communities on Sequence
Completion Rates in Basic Skills
Linked Courses in
Learning Community
ENGL 826
READ 826
CRER 401
------- Traditional Stand-Alone Courses ------
ENGL 836
READ 836
ENGL 100
Fall 2010 Cohort
Learning Community
No. of Students
Of those in the starting cohort
those that Enroll & Pass
ENGL 836 & READ 836
Of those in the starting
cohort those that Enroll
& Pass ENGL 100
LC = 60
57%
34
38%
23
53%
21
33%
13
Control Group*
No. of Students
Control = 40
*Control Group consists of students enrolling in both Engl 826 & Reading 826 courses offered outside the Learning Community format (Fall 2010)
Effects of Learning Communities on Grade
Performance in Basic Skills Courses
Example
New Aggregate Performance Metric
ENGL 100 Section A
Class size = 45 students
No. of A Grades Received = 4
No. of B Grades Received = 14
No. of C Grades Received = 18
No. of D Grades Received = 7
No. of F Grades Received = 2
ENGL 100 Section B
Course GPA
Class size = 54 students
No. of A Grades Received = 28
No. of B Grades Received = 10
No. of C Grades Received = 5
No. of D Grades Received = 8
No. of F Grades Received = 3
We pool all the final grades received by all
students in that classroom and calculate a GPA
for the course. Unlike success rates, course GPA
Success Rate = 80%
Success Rate = 80%
allows us to incorporate the effect of the
Course
GPAof= A2.24
Course
= 2.97 .
number
& B grades received
byGPA
students
Effects of Learning Communities on Grade
Performance in Basic Skills Courses
Linked Courses in
Learning Community
ENGL 826
READ 826
CRER 401
------- Traditional Stand-Alone Courses ------
ENGL 836
READ 836
ENGL 100
Fall 2010 Cohort
Learning Community
ENGL = 2.60
ENGL = 2.04
READ = 2.98
READ = 2.15
2.76
Control Group*
ENGL = 2.41
ENGL = 2.78
READ = 1.31
READ = 2.24
Fall 2010 Cohort
2.82
Salient Findings
1. The college has been offering a growing number of learning
communities over the last few years
2. Learning Communities tend to attract a slightly larger number of
Hispanic and younger students
3. Learning communities are not an homogenous group; there is wide
variety in both the models used and in student performance.
Salient Findings
4. There is some evidence that Learning Communities create an
improved “Mastery” effect. Further research needed.
5. Within the English & Reading Basic Skills domain there is some
evidence that LCs are associated with slightly higher sequence
completion rates.
6. Students in Learning Communities have slightly higher performance
rates during the semester they are offered, but experience a return
to the mean once they leave the LC.
7. Because of the wide degree of variation in performance across all
Cañada’s Leaning Communities, generalizations about the relative
success of Learning Communities is difficult to make.
DISCUSSION
ADDITIONAL
SLIDES
Course Performance by Ethnicity
(Fall 2008 – Spring 2012)
Control Group*
Learning Community
N = 1,872
Ethnicity Group
N = 10,993
Pct As
Pct ABCs
Pct Ws
Pct As
Pct ABCs
Pct Ws
Asian
45%
77%
9%
46%
80%
9%
Black - Non-Hispanic
19%
41%
39%
16%
49%
25%
Filipino
38%
74%
15%
32%
70%
15%
Hispanic
34%
67%
18%
24%
62%
18%
Multi Races
31%
62%
23%
25%
61%
20%
Pacific Islander
23%
58%
23%
20%
52%
23%
White Non-Hispanic
34%
65%
20%
35%
69%
15%
Better than Control
Worse than Control
90% confidence level
90% confidence level
Course Performance by Age Group
(Fall 2008 – Spring 2012)
Control Group*
Learning Community
N = 1,872
Age Group
N = 10,993
Pct As
Pct ABCs
Pct Ws
Pct As
Pct ABCs
Pct Ws
Less Than 18
30%
55%
20%
29%
70%
8%
18 & 19 Yrs Old
31%
69%
18%
19%
59%
18%
20-24 Yrs Old
22%
57%
27%
21%
58%
20%
25-29 Yrs Old
37%
66%
19%
34%
68%
18%
30-39 Yrs Old
37%
66%
17%
39%
72%
16%
40+ Yrs Old
42%
73%
13%
44%
74%
14%
Better than Control
Worse than Control
90% confidence level
90% confidence level
Course Performance by Unit Load
(Fall Terms Only; 2008 – 2011)
Control Group*
Learning Community
N = 1,289
Units Attempted
Pct As
Pct ABCs
N = 4,449
Pct Ws
4 or fewer Units
Pct As
Pct ABCs
Pct Ws
29%
60%
21%
4 to less than 8 Units
32%
64%
17%
28%
63%
19%
8 to less than 12 Units
33%
66%
20%
27%
64%
18%
12 to less than 16 Units
34%
69%
19%
34%
66%
18%
32%
71%
22%
16 or more Units
Better than Control
Worse than Control
90% confidence level
90% confidence level
Download