Assessment - pICT SDSU

advertisement

Anticipated Benefits /Actual Results

Higher quality student work

Grades did improve somewhat from Spring 2006 (before the innovation) to Fall 2006 (after the innovation), but not as significantly as hoped. Table 1 compares scores on two particular assignments across the two semesters.

Assignment

Cumulative final exam

Spring 2006 avg. Fall 2006 avg.

77.16% 80.36%

Written take-home exam 83.24%

Table 1: score comparison

83.36%

More significant improvement was seen in the percentage of students earning “A” grades. Table 2 compares the percentage of “A” grades across the two semesters.

Assignment

Cumulative final exam

Spring 2006 % Fall 2006 %

17.2% 23.8%

Written take-home exam 30.2% 45.2%

Overall grade 20.7%

Table 2: percentage of “A” grades

23.8%

More productive class time

This was perhaps the biggest disappointment. The pedagogical plan required students to take the initiative and generate questions to guide the class discussions and presentations. They did very little of this. While some students responded favorably to the guided practice done in class, many did not respond so favorably to the lack of presentation in class.

Anticipated Problems /Actual Results

Technological glitches

There were indeed problems with the technology. Some students reported that the free version of

Quicktime, which the podcasts were designed to work with, did not allow them to view the lectures clearly. Some of these same students reported that they were unwilling to pay $35 for the professional version of Quicktime.

Poor attendance

Again, the results were as expected, and perhaps even worse. On a typical night, only about 50% of the class was present at the end, which was surprising considering the activity at the end was an exercise identical in format to the one to be directly graded.

Planned Changes in the Future Implementation of the Innovation

The results of the SALG were encouraging enough to try the innovation again, but there was enough negative feedback to warrant some changes in the implementation.

Clearer presentation of class expectations in the syllabus

To get students on the right track sooner, more details regarding the pedagogical plan will be added to the syllabus, along with comments from the SALG written by students who said they started doing better after following the program more closely.

Graded activities in preparation for class will be added

To provide students with more incentive to generate questions for class discussions, graded preparation quizzes in Blackboard will be required before class. The thought is that students who have lost points on quizzes are more likely to ask questions about their problem areas, perhaps because the quizzes will help them identify those areas.

More teacher initiated presentation in class

To compensate for students’ reluctance to generate questions for class, more class presentations will be prepared based on anticipated problem areas. These will go beyond the basic presentations in the podcast lectures.

Download