Central Washington University Assessment of Student Learning Department and Program Report

advertisement
Central Washington University
Assessment of Student Learning
Department and Program Report
Academic Year of Report: 2010/2011
Department: University Math Center
1. What outcomes were assessed this year, and why?
Department/program goals 1, 2, and 4 have annual assessment components and
thus are assessed in this report.
Goal 1:
Math 100 courses use innovative teaching strategies to create a challenging
learning environment for students.
Related Divisional Goals: AA1
Related University Goals: USG I, VI
Goal 2:
Math 100 courses successfully prepare students for further personal and
academic pursuits (including future courses in the Math 100 sequence and/or
college-level math courses).
Related Divisional Goals: AA2
Related University Goals: USG I
Goal 4:
The UMC’s Drop-in Help Lab serves a diverse student population.
Related Divisional Goals: AA1, AA6
Related University Goals: USG I, VI
2. How were they assessed?
Methods Used:
Who
Assessed:
When
Assessed:
Goal 1
student surveys &
SEOIs, analyzing effect
of significant changes in
curriculum on student
performance
instructors,
curriculum
data is compiled
each term and
analyzed
annually
Goal 2
tracking grades in future
coursework
students
annually
Goal 4
data collected from signin sheets and feedback
forms/surveys
lab delivery
effectiveness
quarterly and
annually
Criterion of Achievement:
SEOI results are consistently
positive; student surveys indicate
general approval of advising,
placement and instruction;
curriculum changes have a
positive impact on student
success
goal of 90% passing subsequent
course (either Math 100 or
college level)
lab attendance continues to
increase, a large variety of
courses are represented,
changes to delivery are made
based on student needs/feedback
where feasible
3. What was learned?
Goal 1:
SEOI Results (fall/winter)
Fall Quarter
C
AVG
Quarter
AVG
A
AVG
B
AVG
C
AVG
Quarter
AVG
Average
4.83
4.95
3.71
4.50
4.61
4.88
4.51
4.66
4.58
4.84
4.77
3.65
4.42
4.30
4.82
4.41
4.51
4.46
4.89
4.79
3.62
4.43
4.48
4.77
4.26
4.50
4.47
4.80
4.86
4.03
4.56
4.70
4.83
4.51
4.68
4.62
4.77
4.87
3.62
4.42
4.65
4.88
4.56
4.69
4.56
themselves.
4.77
4.72
3.44
4.31
4.70
4.77
4.31
4.59
4.45
Extra help was available when needed.
4.82
4.90
4.19
4.64
4.78
4.84
4.70
4.77
4.70
Course objectives were clearly stated.
4.85
4.75
3.95
4.51
4.39
4.81
4.56
4.59
4.55
The instructor gave clear explanations.
4.80
4.66
3.59
4.35
4.39
4.76
4.35
4.50
4.43
The instructor presented alternative explanations when
needed.
4.76
4.79
3.60
4.38
4.39
4.75
4.30
4.48
4.43
meaningful.
Instructor raised important questions or problems.
4.83
4.82
3.78
4.47
4.57
4.85
4.32
4.58
4.53
4.80
4.64
3.77
4.40
4.61
4.72
4.33
4.55
4.48
Appropriate examples and illustrations were used.
4.74
4.83
3.92
4.49
4.61
4.78
4.53
4.64
4.57
The instructor's speech was clear and easily understood.
4.91
4.84
3.92
4.56
4.70
4.83
4.63
4.72
4.64
Class time was used efficiently.
4.75
4.78
3.74
4.42
4.57
4.81
4.53
4.64
4.53
Instructor was interested in whether students learned.
4.86
4.88
3.96
4.57
4.74
4.82
4.55
4.70
4.63
Instructor helped develop an appreciation for the field.
4.71
4.59
3.38
4.23
4.43
4.61
4.26
4.43
4.33
Instructor applied course materials to real-world issues.
4.83
4.45
3.21
4.16
4.65
4.62
4.46
4.58
4.37
Course objectives were met.
4.80
4.73
3.94
4.49
4.65
4.81
4.59
4.68
4.59
Assigned readings and other out-of-class work were
useful.
4.63
4.51
3.61
4.25
4.52
4.46
4.12
4.37
4.31
4.92
4.82
4.00
4.58
4.74
4.78
4.44
4.65
4.61
4.75
4.64
3.91
4.43
4.70
4.59
4.37
4.55
4.49
4.83
4.79
4.10
4.57
4.65
4.76
4.54
4.65
4.61
sex, race or age.
4.92
4.27
4.59
4.59
4.78
4.86
4.79
4.81
4.70
The intellectual challenge presented to you.
4.28
4.12
3.36
3.92
4.30
4.08
3.89
4.09
4.00
course.
4.36
4.24
3.57
4.05
4.43
4.26
4.07
4.25
4.15
Your involvement (doing assignments, attending classes,
etc.).
4.56
4.58
4.09
4.41
4.61
4.61
4.54
4.59
4.50
4.80
4.59
3.42
4.27
4.43
4.54
4.25
4.41
4.34
4.86
4.78
3.61
4.41
4.45
4.70
4.33
4.49
4.45
progress.
4 I was confident in the instructor's knowledge.
5 The instructor was enthusiastic.
6 The instructor encouraged students to express
11 Answers to student questions were clear and
12
13
14
15
16
17
18
19
20
Cumulative
B
AVG
1 Instructor met class regularly and on time.
2 Class sessions were well organized.
3 The instructor provided useful feedback on student
7
8
9
10
Winter Quarter
A
AVG
21 Evaluative and grading techniques (tests, papers,
projects, etc.) were fair.
22 Amount of work was appropriate to course level and
credits.
23 Student responsibilities and requirements were clearly
stated.
24 Instructor treated students with respect, regardless of
25
26 The amount of your effort needed to succeed in this
27
28 Course as a whole was:
29 Instructor's teaching effectiveness was:
The SEOI results this year indicate a generally positive response from students
toward our courses in all aspects.
Student Surveys Re: Advising, Placement, Instruction (fall/winter/spring)
Placement approval
Undecided
Course properly
prepared student for
success in next course
Instruction approval
Fall
81%
5%
100A
Winter
70%
Spring
53%
13%
24%
Fall
73%
16%
100B
Winter
81%
Spring
73%
11%
16%
Fall
62%
17%
100C
Winter
73%
Spring
71%
15%
11%
95%
91%
82%
95%
92%
77%
58%
84%
85%
89%
78%
82%
93%
93%
94%
50%
77%
73%
The student surveys this year also indicate general approval of advising,
placement, and instruction in our courses. Our lowest results are generally in the
area of advising but most are at or above 70% approval. One notable exception
is the Math 100C courses in fall quarter. The student satisfaction in these
courses was particularly (and abnormally) low. Half of these sections were
taught by an instructor with unexpected health issues that led to an unusual
number of missed days and substitute instructors. As you will see in the passing
rates, students had a bumpy quarter. Though this was beyond our control, we
will make efforts in the future to maintain continuity in our courses as the lack of it
clearly has a negative impact. As we’ve seen in previous quarters, it is telling
that regardless of how students feel about placement and instruction, at the end
of the term they overwhelmingly feel prepared for the next course.
Curriculum Changes
We began using a new curriculum (new textbook and MathXL) in Fall 2007. The
following data describe trends in course success since 2002. Fall, winter, and
spring quarters of 2010-2011 are included for Math 100A and Math 100B. Only
fall and winter quarters of 2010-2011 are included for Math 100C (spring data is
not yet complete as of June 15). Passing in this data set requires a C or better in
the course (the requirement to move on to the next course).
Passing Rates
2002-2003
2003-2004
2004-2005
2005-2006
2006-2007
2007-2008
2008-2009
2009-2010
2010-2011
(Grade of C or Better)
100A
100B
100C
83.3%
85.8%
82.6%
88.9%
85.2%
82.2%
96.0%
91.0%
83.1%
98.0%
87.6%
75.6%
100.0%
89.7%
87.5%
98.1%
86.1%
86.9%
81.7%
72.1%
83.8%
76.5%
78.3%
67.7%
84.8%
89.8%
62.5%
Based on the chart above, success has increased during the current year, except
in 100C. However, Math 100C numbers took a hit during fall quarter when the
pass rate was only 49.4% (as noted above, there were significant discontinuity
issues with half of the instruction). During winter quarter, the pass rate was
76.3%. So while the overall number is less than we’d like, it appears we may be
back on an upswing if spring looks like winter.
Goal 2:
The following are the passing rates in subsequent courses (both Math 100 and
college level) from Fall 2002 through Summer 2010 (with Fall 2007 and on being
students using the new Math 100 curriculum).
FROM
100A
TO
100B*
20022003
85%
20032004
92%
20042005
91%
20052006
89%
20062007
84%
20072008
64%
20082009
56%
20092010
61%
100B
100C*
67%
75%
83%
93%
81%
84%
67%
57%
101
97%
98%
94%
97%
87%
90%
86%
84%
130
100%
71%
95%
76%
88%
91%
78%
63%
164
96%
97%
100%
100%
91%
79%
91%
57%
153
91%
96%
95%
88%
88%
79%
80%
79%
100C
*Passing with a grade of C or better
The results show that for last year’s students in Math 100A, there was an
upswing in future success. Math 100C students have maintained a future
success rate of around 80% for the past three years. Math 100B students have
shown a general downward trend in future success over the past few years. Due
to the low enrollments of Math 100B students in Math 130 and Math 164,
success rates swing dramatically from year to year and little significant data can
be gleaned. The transition from Math 100B to 101 seems to be holding fairly
steady around 85-90% since 2006-2007. However, the transition from Math
100B to 100C is somewhat troubling. We’ve been working to unearth a possible
grade inflation issue. The concern was that the high success rates were due in
part to students following a particular instructor from 100B to 100C rather than
our curriculum or any programmatic issues. This hypothesis appears to bear out
but future success rates from the current year (which won’t be available until
March 2012) will give a clearer picture.
Goal 4:
Lab Feedback (via suggestion/comment forms)
We received 12 comment/suggestion forms from fall lab attendees, 14 from
winter lab attendees, and 7 from spring lab attendees. All questions are rated on
a 5-point scale.
4.67
4.45
4.67
4.91
I got the help I needed.
Tutors are available when needed.
The lab location is convenient.
Tutors are friendly and helpful.
These results indicate that the lab is providing a valued service to students
when/where they need it.
Lab Attendance
Math Lab Attendance
Fall
Winter
Spring
Total
02-03
227
267
423
917
03-04
410
497
*462
907
04-05
464
470
267
1,201
05-06
446
528
528
1,502
06-07
824
850
769
2,443
07-08
866
722
830
2,418
08-09
894
960
839
2,693
09-10
895
766
693
2,354
10-11
680
776
911
2,367
*Data for Spring 2004 missing, 462 estimated attendance.
We’ve been hovering around the 2500 visit mark for about 5 years. This number
is manageable—any increase in visits would require more space (if not room
size, then at least increasing the hours it is open) and staff.
Fall 2010
Math
1
100A
100B
100C
101
102
130
153/154
164
Calc
232
250
260
264
265
272
311
331
HS Calcu
Diff Eq 376
2
2
6
9
21
2
8
2
3
4
5
6
7
8
3
4
8
4
14
6
2
1
8
26
4
5
7
4
7
7
3
5
2
4
5
4
10
25
12
22
7
20
9
18
16
20
20
1
19
20
1
4
26
25
5
25
7
4
9
10
Finals
2
6
11
9
2
1
3
1
10
8
7
11
3
11
4
2
1
1
3
4
2
1
1
4
2
1
4
1
1
3
1
1
1
1
3
1
2
1
1
1
1
1
2
TOTAL
52
67
60
81
80
Non-Math
Bus Math
Biology 213
Test Prep
Chem 181
Chem 183
Psych 302
Phys 106
Phys 111
Phil 201
Stats
IET 311
IT 374
TOTAL
1
2
3
2
4
5
1
5
0
2
1
1
Other
Unreported
3
3
63
2
1
70
1
1
64
1
2
85
2
3
86
TOTAL
1
77
61
64
8
43
44
6
7
8
9
10
Finals
1
0
1
Total
4
1
0
0
0
0
0
5
0
1
0
0
11
45
15
17
680
1
4
Total
0
48
56
34
3
82
205
9
150
1
2
10
17
11
1
5
0
2
1
637
1
1
0
0
0
1
4
2
70
1
2
79
1
1
63
10
2
45
Winter 2011
Math
100A
100B
100C
101
102
130
153/154
164
Calc
232
250
260
264
265/365
272
311
331
Diff Eq 376
1
2
3
4
5
3
1
2
3
13
29
1
17
1
1
1
1
13
22
1
7
6
4
4
3
11
42
2
10
9
3
5
4
10
34
1
17
2
6
20
27
1
16
2
3
5
3
2
2
4
6
1
11
5
1
6
6
53
7
2
5
21
8
1
5
5
4
2
8
41
9
3
7
2
4
5
13
33
19
5
19
21
1
2
1
1
2
2
1
1
2
2
2
Finals
1
1
3
3
4
6
6
1
5
Total
6
47
26
26
36
105
308
5
136
0
0
0
0
10
20
4
0
0
729
TOTAL
75
52
85
88
77
104
41
87
90
30
Non-Math
Bus Math
Biology 213
Test Prep
Chem 181
Chem 183
Geology 107
Psych 302
Phys 106
Phys 111
Phil 201
Stats
IET 311
IT 374
TOTAL
1
2
3
4
5
6
7
8
9
Finals
1
0
2
3
0
0
0
0
0
0
Total
0
0
0
2
0
3
0
0
1
0
0
0
0
6
Other
Unreported
3
3
82
4
2
58
3
90
2
3
96
1
2
80
3
107
41
4
6
97
4
1
95
30
18
23
776
TOTAL
1
1
3
1
Spring 2011
Math
1
2
3
4
5
6
7
8
9
Finals
3
2
6
3
5
40
3
3
5
8
2
2
17
7
4
7
6
2
8
3
1
8
7
1
11
7
8
6
7
31
4
4
6
3
10
30
18
35
10
46
14
46
7
37
15
67
2
4
37
5
27
16
17
19
15
11
12
3
9
3
3
1
13
5
1
1
15
2
1
6
1
3
2
3
1
1
4
2
5
1
TOTAL
80
84
82
86
103
Non-Math
Bus Math
Biology 213
Test Prep
Chem 181
Chem 183
Geology 107
Psych 302
Phys 106
Phys 111
Phil 201
Stats
IET 301
IT 374
TOTAL
1
2
3
4
0
1
0
Other
Unreported
7
1
88
7
1
93
2
100A
100B
100C
101
102
130
153/154
164
Calc
232
250
260
264
265/365
272
311
331
Diff Eq 376
TOTAL
3
2
2
3
1
103
90
114
73
50
5
6
7
8
9
Finals
0
0
0
0
0
0
0
1
2
106
3
1
107
1
2
93
4
3
121
1
4
78
2
3
89
1
84
52
Total
0
77
47
27
8
95
396
0
108
0
44
1
0
9
25
0
0
0
865
Total
0
0
0
0
0
0
0
0
0
0
0
1
0
1
28
17
911
The course breakdown of lab attendees shows that we are serving students from a
wide variety of math courses. Our total for non-math content courses is 18
attendees for the year which is about 1% of the population.
4. What will the department or program do as a result of that information?
We are pleased with the results in general. Our program seems to be functioning
fairly well and our impact on student success seems to be generally positive.
There is still some concern over the performance in Math 100, particularly in our
future success rates for 100A and 100B students. We plan to reinstitute (budget
allowing) the individual tutoring program for students in Math 100 to provide them
extra help. Changes in staffing next year may also have a significant impact in
success rates in Math 100C.
5. What did the department or program do in response to last year’s
assessment information?
To increase future success rates for Math 100A and 100B students, we ran study
group sessions for Math 100B and 100C courses. These sessions met two or
three times a week. Math 100B study sessions ran all three quarters (fall, winter,
spring) while the Math 100C study sessions began winter quarter and were
continued in the spring. Attendance was very low in fall and winter—while the
data did suggest an impact on GPA for Math 100C students who attended, the
data set was too small to make any useful conclusions. The GPA data for spring
students is not yet available.
Though budgetary concerns limited the number of meetings, we continued with
regular staff meetings for tutors to facilitate dialogue and additional training,
especially in rusty content areas. This remained important during the past year
as our CRLA certification course seems to have gone defunct and tutors have no
formal training opportunities on campus.
6. Questions or suggestions concerning Assessment of Outcomes at Central
Washington University:
None at present.
Download