a study for the Fall 2014 semester comparing my two sections of

advertisement
Comparing ENGL 102 CMA to ENGL 102 COA
Prepared by Professor Megan Schutte, CCBC
Fall 2014
1
Overview
CCBC is currently using the Blackboard learning platform, and faculty are constantly told that
student engagement and success are increased by our support of it. However, like any life-long
learner, I prefer to prove such things to myself; therefore, I voluntarily devised a study for the
Fall 2014 semester comparing my two sections of English 102 (College Composition II), which
had the same content but vastly different levels of Blackboard use. In addition to comparing
student grades (e.g. on quizzes, homework, essays, exams), I also tracked student engagement,
interest, and comfort level in the class through periodic, anonymous surveys. Since “using new
communication technologies…can help ensure that our students come to class prepared [for]
critical thinking” (Bowen 21), my goal was to learn how much—and in what capacity—I should
use Blackboard in order to best serve my students in the future.
Some Background
A debate exists in academic circles about how to best use the vast array of new technologies that
are available to professors. In the article “The Teaching Naked Cycle: Technology is a Tool, but
Psychology is the New Pedagogy” from the Spring 2014 edition of Liberal Education, José
Antonio Bowen argues that “[w]hile the use of technology in higher education will surely
increase, educators must remain focused on student learning” (18). Traditionally in my
classroom, I have been fairly resistant to new technologies. I believe that “the greatest value of a
physical [college] will continue to be its provision of face-to-face (naked) interaction between
faculty and students” (Bowen 20). However, I am aware that I need to embrace new pedagogical
methods, especially since many students prefer technology and often believe (whether correctly
or not) that they learn better through its use. At its core, though, the “first role of technology… is
to create more time for [faculty/student] interaction” (Bowen 20). However, while “[t]echnology
offers innovative tools that are shaping educational experiences for students, often in positive
and dynamic ways…it does not always foster learning” (May). Thus, professors need to focus on
“us[ing] technology in effective ways, [so] it can increase student preparation and engagement
between classes and create more time for the (naked) in-class dialogue that makes the campus
experience [worthwhile]” (Bowen 20).
My Hypothesis
I was looking to discover whether or not using Blackboard in a more intense way than the
CCBC-minimum-required use (i.e. syllabus, instructor bio, midterm and final grades) helped
with student engagement and success. My initial assumption was that it would work great for
some things, like reminding students of due dates, but not so great for others, like having them
access sources. I also assumed that certain students—the more tech-savvy and possibly the
younger ones—would be more receptive to using Blackboard and also more appreciative of a
professor using it. Because of my personal reticence to use certain technologies unless I know
that they can be effective, I worked very hard at reserving my judgment and waiting to see what
the numbers revealed.
2
Plan of Attack
Before the semester even began, I planned on teaching my two sections of English 102 with a
few differences. While all readings, assignments, resources, handouts, etc. would be the same,
the method of delivery would often be different.
The first difference was the syllabi; while both were posted on Blackboard (as is required by
CCBC), the CMA syllabus was “regular” (i.e. students were given a hard copy in class on the
first day as well), but the COA syllabus contained many imbedded links and was posted in
Blackboard only. The links included the following:
-CCBC homepage
http://www.ccbcmd.edu/index.html
-a map of the Catonsville campus
http://www.ccbcmd.edu/directory/cat/camp_map.html
-School of Liberal Arts (SOLA) homepage
http://www.ccbcmd.edu/liberal_arts/index.html
-English department homepage
http://www.ccbcmd.edu/liberal_arts/engl_program.html
-ENGL 102 Common Course Outline (CCO)
http://www.ccbcmd.edu/media/cco/engl/engl102.pdf
-Instructor Bio
(linked in Blackboard)
-assignment calculator
https://www.lib.umn.edu/apps/ac/
-CCBC bookstore homepage
http://www.bookstore.ccbcmd.edu/catonsville/
-ENGL 101 Common Course Outline
http://www.ccbcmd.edu/media/cco/engl/engl101.pdf
-CCBC library homepage
http://library.ccbcmd.edu/
-Purdue OWL MLA page
https://owl.english.purdue.edu/owl/resource/747/01/
-CCBC grading policy
http://catalog.ccbcmd.edu/content.php?catoid=16&navoid=951&hl=holidays&returnto=search#Grades_and_
Grading
-link to email me
-CCBC religious holiday policy
http://catalog.ccbcmd.edu/content.php?catoid=16&navoid=951&hl=holidays&returnto=search#Religious_Ho
lidays
-CCBC emergency closings information page
http://www.ccbcmd.edu/catalog12/publicsafety/closings.html
-Campus Alert page
http://www.ccbcmd.edu/campusalert/index.html
-CCBC plagiarism policy
http://libraryguides.ccbcmd.edu/content.php?pid=512676
-MyCCBC log in
https://myccbc.ccbcmd.edu/_layouts/ccbc/default.aspx?ReturnUrl=%2f_layouts%2fAuthenticate.aspx%3fSo
urce%3d%252F&Source=%2F
-Student Handbook
http://www.ccbcmd.edu/media/collegelife/smart_moves.pdf
-Writing Center page
http://www.ccbcmd.edu/liberal_arts/english_cat/engl-writingctr.html
3
-MLA format handout
http://lgdata.s3-website-us-east-1.amazonaws.com/docs/2139/539723/mla-_format.pdf
-final exam schedule
http://www.ccbcmd.edu/media/registration/finalexams_fall.pdf1
A few other basic differences between the sections included:
-posting homework in Blackboard (COA) in addition to on the board in class (both
sections);
-posting interesting articles and amusing grammar-related cartoons in Blackboard (COA
only);
-giving readings in Blackboard (COA) rather than a hard copy (CMA);
-giving handouts in Blackboard (COA) rather than a hard copy (CMA);
-giving rubrics in Blackboard (COA) rather than a hard copy (CMA); and
-giving more options for sources (COA) rather than requiring a specific source (CMA).
(A quick note: in order to make the comparison of the sections as clear as possible, the charts and
graphs in this report have been color coded. For the entire report, CMA will be indicated by
Magenta; COA will be indicated by Orange.)
1
I should mention that it was my intention to have some terrifically helpful links (e.g. the assignment calculator)
and some not-so-helpful (e.g. the campus map). Essentially, I knew that I would be asking students how many links
they followed, and I wanted to have a variety.
4
ENGL 101 Grades
20
19
20
18
16
13
14
12
10
8
CMA
8
COA (BB)
8
5
6
3
4
2
2
0
Day 1 enrollment
A or B
C
not at CCBC or
unknown
Number of Students with GPA within Each Grade Range
20
20
18
18
16
14
11
12
CMA
10
10
COA (BB)
8
5
6
4
4
3
4
2
1
0
0
0
0
Total
Students
3.51-4.00
(High B-A)
3.01-3.50
(B-high B)
2.01-3.00
(C-B)
1.01-2.00
(D-C)
0.00-1.00
(F-D)
5
Reading the Syllabus on Blackboard before the First Day of Class
6
6
6
5
4
4
3
3
CMA
2
2
COA (BB)
1
1
0
Read entire document
Skim
Not at all
First Homework: Enrollment and When Homework was Handed In
2122
25
17
20
12
15
10
10
6
5
0
2
0
2
1 2
3
5
0
2 2
CMA
COA (BB)
First Homework: Number of Questions Asked
2.75
3.1
3
2.5
2
1.5
1
0.5
0
CMA
COA (BB)
Average Asked (3 were required)
6
First Homework: Average Grades2 of Assignment
14
11.9
15
CMA
10
COA (BB)
5
0
Average Grade out of 15
First Homework: Number of Students Who Lost Points for Their Email and Why
7
7
7
6
6
5
5
4
4
CMA
3
COA (BB)
2
1
1
1
1
0
No greeting
2
No closing or
signature
Not following
No questions at all
directions (subject
line)
Not including bonus points or lateness penalties.
7
First Readings
12
12
10
11
9 9
8
6
6
CMA
5 5
COA (BB)
4 4
4
3
2
3
1
0
Read
textbook
all
Read
textbook
some
Did not
read
textbook
Read
handout
all
Read
handout
some
Did not
read
handout
First Quiz and First Written Homework Grades (out of 10)
9.64
10
9.04
9
8
7
8.16 8.12
7.42
7.28
7.53
7.41
6.62
6.15
6
5
CMA
4
COA (BB)
3
2
1
0
First quiz
First
First
homework homework
MLA
MLA
REVISION
First
First
homework homework
content
content
REVISION
8
CMA Comfort and Excitement:
Post-Syllabus (Week 1) Survey vs. Week 5 Survey (scale of 1-10)
9
8
7
6.44
6.71
6.78
6.07
6
Week 1
5
Week 5
4
3
2
1
0
CMA comfort
CMA excitement
COA (BB) Comfort and Excitement:
Post-Syllabus (Week 1) Survey vs. Week 5 Survey (scale of 1-10)
9
8
7.93
8.29
7.77
8
7
6
Week 1
5
Week 5
4
3
2
1
0
COA comfort
COA excitement
CMA Syllabus Reaction:
9
Post-Syllabus (Week 1) Survey vs. Week 5 Survey (scale of 1-10)
9.33
10
8.56
7.5
7.43
9
8
7
6
Week 1
5
Week 5
4
3
2
1
0
CMA Syllabus Helpful NOW
CMA Syllabus Helpful FUTURE
COA (BB) Syllabus Reaction:
Post-Syllabus (Week 1) Survey vs. Week 5 Survey (scale of 1-10)
10
9
8.54
8.38
7.86
7.71
8
7
6
Week 1
5
Week 5
4
3
2
1
0
COA Syllabus Helpful NOW
COA Syllabus Helpful FUTURE
10
COA (BB) only Number of Links (out of 25+) Followed:
Post-Syllabus (Week 1) Survey vs. Week 5 Survey
9
9
8
7
6
6
6
5
Week 1
Week 5
4
3
3
2
1
1
1
1
0
0
0-2
3-5
6-8
9+
Drama Essay Grades3 on 12-Point Scale
7.09
7
7
6.8
6.6
6.4
6.2
5.87
5.93
CMA
COA (BB)
6
5.8
5.6
5.4
5.2
Drama Essay (1st graded draft)
3
Drama Essay (after voluntary
revisions)
These grades do not include lateness penalties.
11
CMA Midterm Grades
W
10%
F
15%
A
5%
B
35%
D
10%
C
25%
COA (BB) Midterm Grades
F
15%
W
5%
A
30%
D
10%
B
20%
C
20%
Learn-Your-Drama-Essay-Grade Meetings4 by Number of Students
5
5
4.5
4
3.5
3
2.5
2
1.5
1
0.5
0
3
3
2
1
0
0
0
0
Week 1
Week 2
Week 3
Week 4
(Oct. 20-24) (Oct. 27-31) (Nov. 3-7) (Nov. 10-14
CMA
1
0
Week 5
(Nov. 1721)
0
COA (BB)
Week 6+
(Nov. 24end of
semester)
4
At this point in the semester, each class had around nineteen remaining students. However, not all of them
handed in the essay.
12
SSA Grades5 on 12-Point Scale
12
10.6
9.3
10
8
7.7
7
7.3
9
8.6
8.73
8.5
8
6.93
6.9
6
5.9
6.1
6
4
CMA
2
COA (BB)
0
Short Story Analyses Question 3 Grades
80%
70%
60%
50%
40%
30%
20%
10%
0%
71%
44%
51%
59%
57%
39%
CMA
COA (BB)
3a. Explain the literal
3b. Explain the
3c. Use and cite (inuse of the symbol in the symbolic use of the text) the source I gave
story.
symbol in the story and
you.
how it adds to the story
overall.
5
These grades do not include lateness penalties.
13
Short Story Analyses Question 1 Grades
98%
100%
78%
80%
61%
50%
60%
CMA
COA (BB)
40%
20%
0%
1a. Summarize the plot of the
short story.
1b. Follow the parameters of a
tweet.
Social Media Use6
14
14
13
1212
12
10
10
9
9
8
8
7
6
6
6
6
4
4
4
4
3
3
3
2
2
1
0
1
0
1
0
0
0
0
0
0
0
CMA
COA (BB)
6
See Appendix A for a description of and a link to each social media platform.
14
Novel Essay Grade Range by Number of Students
12
11
10
8
8
CMA
6
COA (BB)
4
3
2
2
1
1
0
0
0
0
0
A-range
B-range
C-range
D-range
F-range
Novel Essay Refutation Paragraph on 5-Point Rubric Scale by Number of Students
5
5
4.5
4
4
3.5
3 3
3
2.5
2 2
2
1.5
1
1
1 1
1
1 1
1
0.5
0
0
0 0
0
0
CMA
COA (BB)
15
Preliminary Assignment Grades7
90%
80%
85.8%
84.9% 84.3%
78.0%
89.7%
80.8%
88.6%
80.5%
76.3%
80.3% 82.0%
68.0%
70%
60.9%
59.0%
60%
50%
CMA
40%
COA (BB)
30%
20%
10%
0%
Research Paper Choices by Number of Students
4
4
3.5
3 3
3 3
3
3
2.5
2
2
1.5
1 1
1
1
1
1
0.5
CMA
0
0
COA (BB)
0
7
These grades are only for students who came back after Thanksgiving break (i.e. with a week and a half left in the
semester).
16
Research Paper Grades by Story on 12-Point Scale
10.5
11
8.5
8.33
9
6.5
6.33
7
7.67
7.25
6.83
6.75
6.27
6
4.5
5
7.33
4.25
3
CMA
COA (BB)
1
Final Exam Grades by Exam Section (CMA)
F
Part 7
C
F
Part 6
F
Part 5
D
D
C
C
B
F (0-59%)
A
D (60-69%)
C
Part 4
F
Part 3
B
D
A
C
C (70-79%)
B
B (80-89%)
A
A (90-100%)
F
Part 2
F
Part 1
0
2
D
4
6
8
C
10
B
12
A
14
16
17
Final Exam Grades by Exam Section (COA)
F
Part 7
D
F
Part 6
Part 5
F
Part 4
C
D
D
C
B
A
C
B
B
F (0-59%)
A
D (60-69%)
F
Part 3
B
D
A
C
B
C (70-79%)
B (80-89%)
A
A (90-100%)
F
Part 2
D
F
Part 1
0
2
B
4
6
A
8
10
12
14
Final Exam Grades Breakdown by Part
87.3% 86.7%
90.0%
83.1%
78.3%
80.0%
70.0%
73.3%
71.0%
63.7%
60.8%
62.6%
59.0%
58.9%
60.0%
50.3%
50.0%
48.0%
CMA
41.7%
40.0%
35.8%
COA
(BB)
30.5%
30.0%
20.0%
10.0%
0.0%
Part 1
Part 2
Part 3
Part 4
Part 5
Part 6
Part 7
Class Average
18
Final Exam Grades Breakdown by Number of Students
5
5
4.5
44
4
3.5
3
2.5
2
2
2
2
2
CMA
COA (BB)
1.5
1
1
1
11
1
1
1
0.5
0
00
0
00
0
00
0
0
Average Attendance8 Per Student
1.14
1
0.9
1.64
0.93
0.86
0.79
0.71
0.8
0.7
0.6
CMA
0.5
COA (BB)
0.4
0.3
0.2
0.1
0
Absences without
contacting me
8
Absences with
contacting me
Late or left early
Only students who returned after Thanksgiving break are tracked here.
19
Average for “various quizzes and writing assignments based on the readings (i.e.
homework), class work, participation, and miscellaneous” Portion of Grade
100%
83.5%
81.6%
90%
74.0%
80%
66.1%
70%
60%
CMA
50%
COA (BB)
40%
30%
20%
10%
0%
Readings Quizzes only
Homework (not including quizzes)
Final Course Grades9 by Number of Students
9
9
8
7
7
6
5
5
4
4
COA (BB)
4
3
3
2
2
1
CMA
1
1
0
0
A
9
B
C
D
F
These grades include all students still on the roster at the end of the semester, regardless of attendance.
20
101 vs. 10210
9
9
8
7
7
7
7
6
5
CMA 101
5
CMA 102
4
COA (BB) 101
4
3
3
COA (BB) 102
3
3
2
2
2
1
1
1
0
0
A
B
C
D
Comments about Blackboard Use
100%
90.0%
90%
80%
66.7%
70%
60%
CMA
50%
40%
COA (BB)
33.3%
30%
20%
10.0%
10%
0.0%
0.0%
0%
Use more
Usage was fine
Use less
10
The 101 grades used here were only for students who finished 102, i.e. only students who earned an A, B, C, or
D. Obviously, the only grade options for 101 were A, B, or C.
21
Download