Bringing real children Revised

advertisement
Bringing real children into the online English curriculum: Digital case books in teacher
education
Sue Nichols
Paper for the Australian Computers in Education Conference, Adelaide 2014
Abstract
One of the challenges of teacher education has always been to create authentic connections
with the world of professional practice so that students experience the relevance of their
university learning. This challenge has taken on renewed urgency with the move to
integrating online learning into pre-service teacher education courses. The Authentic
Literacy Data Analysis project (ALDA) was established to develop and trial the use of digital
resources in the form of learner case books. These digital case books contain multiple kinds
of evidence gathered from school classrooms relating to specific children at a range of year
and ability levels. This paper describes the process of implementing ALDA in the
undergraduate English curriculum in a pilot study involving a cohort of 125 third year
students. A case-based approach using multimedia digital resources engages pre-service
educators in active decision making and bridges the gap between theory and practice.
Introduction
In order to equip graduates to practice effectively as educational practitioners, university
teacher education courses need to provide encounters with the world of practice and also
the conceptual tools with which to make sense of this world. A central dimension of
teaching is the interpretation of evidence of student learning; judgements based on such
interpretation should be informing teachers' pedagogical decision making. This paper
reports the development and integration of digital resources aimed at supporting preservice educators' interpretation of evidence.
The recently implemented National Professional Standards for Teachers makes clear that
the use of student data is an integral component of professional practice. The use of student
data is involved in “[d]ifferentiating teaching to meet the specific learning needs of students
across the full range of abilities” (AITSL 2011, p. 9). The Standards outline competencies for
Page 1
each career stage; graduate teachers are expected to “demonstrate their capacity to
interpret student assessment data to evaluate student learning and modify teaching
practice” (AITSL 2011, p. 5).
Undergraduate teacher education has for some time incorporated the concept of arguing
from evidence into courses. However it has been observed that pre-service teachers
experience difficulty with successfully undertaking analytical tasks, particularly those whose
prior academic record is not strong (Brennan & Zipin, 2006 p. 337 – 8). Bainbridge and Macy
found that pre-service educators viewed assessment as "one of their weakest areas"
(Bainbridge & Macy, 2008 p. 73). Making judgements requires independent critical thinking.
However critical thinking has often been taught in isolation from curriculum courses, which
creates a barrier to students drawing on curriculum-based materials to build their analytic
skills.
The use of digital resources to analyse student data is more prevalent in schools than in
teacher education programs. Ottenbreit-Leftwich et al (2012) surveyed both teachers and
teacher educators regarding their use of electronic resources and found that teacher
training institutions incorporated a very narrow range of uses into their programs. They
found that while 54% of school-based teachers regularly used digital resources to produce
and/or analyse student data, only 25% of teacher educators incorporated this into
programs. This points to another issue in the preparation of teachers that could be
addressed by the incorporation of digital cases using authentic student data.
Connecting with Practice in the Online Learning Environment
Professional practice is carried out in contexts which are social, embodied and situated
(Schatzki, 2001; Macklin, 2009). Most graduates of professional programs in higher
education will work in material settings where they interact with others face to face in real
time. The shift to online delivery in higher education has had many positive consequences
including enabling students in rural and remote locations to acquire a professional
qualification. However, it has also created challenges for curriculum areas in which
professional practice has strong interactive and embodied dimensions. This problem has
generated considerable activity as higher education developers have sought to develop
approaches to representing practice contexts in digital environments. These include virtual
Page 2
simulations of professional environments in which students can encounter scenarios and
practice skills (Segrave & Holt, 2003; Saltmarsh & Sutherland-Smith, 2010).
An alternative approach seeks to create rich multimedia documentations of practices
involving real-world participants in authentic contexts (Lieberman & Mace, 2010). Unlike
simulations, real-world documentations provide higher education students with access to
the experiences and perspectives of actual participants in professional practice contexts
such as (in the case of Education) learners and teachers.
Case-based reasoning (CBR) within higher education offers one solution to the problem of
connecting students to the world of professional practice (cf Kim & Hannafin, 2007;
Jonassen, Wang, Strobel & Cenusca, 2003). In this approach, problems or issues of practice
form the basis of curriculum activities which invite students to enter into professional
scenarios and practice their interpretive and decision making skills. Digital technologies are
enabling curriculum designers to create more authentic case presentations. Layering
different sources of evidence enables designers to produce rich resources. Zottman et al
(2012) provided sections of video from an English class in an online learning object that
included ‘‘perspective of the teacher’’ and ‘‘perspective of the learner’’ links to audio of
interviews. Kim and Hannafin (2007) presented cases based on exemplary lessons including
video of classroom practice, teacher reflection, work samples and planning materials.
Many CBR examples focus centrally on teaching rather than making the learner the primary
focus. However there appear to be some challenges associated with this approach including
pre-service educators' resistance to accepting an exemplary teacher's expert judgement
(Kim & Hannafin, 2007). There may be advantages in a case-based approach that focuses on
individual students as the basis of cases. Teacher in practice are required to make
professional judgements about individual students. In this project, the learner has been put
at the centre of the case and the focus is on pre-service educators making use of evidence
of learning to come to educational judgements.
The project
The Authentic Literacy Data Analysis (ALDA) involves the development of digital case books
and their integration into a pre-service teacher education course Studies in English
Teaching. The project, funded by a UniSA Teaching and Learning Development Grant, was
Page 3
piloted in 2012 with a cohort of 125 students and is currently being fully implemented with
a cohort of 500 second year students. The core ALDA team comprised two teacher
educators and a research assistant. In the online development phase, we were assisted by
two online education developers whose time was provided by the Technology Education
Learning (TEL) project within the School of Education.
The intended learning outcomes of this project were that:

Participating pre-service teachers will gain skills in the analysis of authentic student
data for the purpose of instructional decision making;

Project team members will gain skills in the development of digital resources.

The course teaching team will gain experience in the integration of authentic student
data, in digital form, into undergraduate curriculum in English.

Provide a model and pedagogical support for the development of online data packs
and resources for other curriculum areas.
The project design combines CBR’s focus on learner-centred case-based reasoning with
data-based critical analysis. The use of authentic data is central to this endeavour. The
digital case books comprised evidence from actual case study children, representing a range
of year levels and ability profiles.
Recruitment
Two primary schools accepted our invitation to collaborate in the project and a third
declined. Consent was obtained from teachers and the parents of case study children to
conduct interviews and collect literacy materials. Four year levels from each school provided
classes: Reception and Years 2, 4 and 6.
Teachers were asked to select three children representing a high, middle and low achieving
student similar to the selection method used in the Case Technologies Enhancing Literacy
Learning project (Shrader et al, 2003). Additionally, teachers were asked to ensure that both
males and females were represented and, if possible the ethnic diversity of the school was
represented.
Collecting authentic materials
Page 4
Following an initial orientation visit to each participating teacher, teams of 2-3 researchers
visited the teacher's class to collect data. Generally at least two visits and, in some cases,
three were needed. A companion paper (Neill 2014) explains this process in depth including
challenges with recording and the use of multiple hardware and software platforms.
Because the cases were based on individual students, the selection of data was student
focused. Each child was videoed reading aloud to the teacher except in year 6 classes where
this was no longer routine practice. During these read aloud sessions, teachers took a
running record, which is a form that records and analyses a child's 'miscues'. For instance, if
a child reads a different word from the one in the text this is noted.
Each child was asked to select a piece of their own writing to talk about with a researcher.
During these conversations, researchers also asked more general questions about the child's
orientation to literacy. Several examples of the child's text production were scanned or
photographed on the spot.
Each teacher was recorded speaking about the focus child. Before the recording, teachers
were reminded about the audience (pre-service educators) and asked to be explicit in
specifying the child's strengths and learning difficulties in the area of literacy. They were
invited to mention any information they considered relevant including insights into the
child's family background and parental involvement. Teachers also provided additional
materials which they felt comfortable in releasing including literacy resources and deidentified class assessment records.
Integration of digital case books
From the eight classes involved, the cases from three were selected for piloting, nine cases
in total.. At this point, various options for the integration of cases in the online learning
environment were considered. Zottman and colleagues (2012) recommend "non-linear,
multi-dimensional presentation of contents" in designing a case-based learning
environment. The digital case book format was selected for flexibility, enabling multiple
entry points and as well its compatibility with the existing course site organisation.
Each case book includes the following elements:
Page 5

Video of student reading aloud to teacher

Scanned copy of the read aloud book

Scanned copy of the reading record form completed by the teacher

Three to five work samples representing a range of tasks

Audio interview with teacher

Audio interview with child
Depending on the teacher's consent and practice, additional class level information was
provided for some classes. This included grade records and teaching resources.
For the pilot, the digital case books were published to the course site but were not explicitly
linked to other course elements such as readings. They simply replaced non-authentic
materials previously used in the case study assignment. This approach is recognised as the
most basic level of integration (Masdri, el Basri, Norton & Newsum, 2012).
The second phase currently in progress involves their integration into the course through
associated learning tasks and supporting materials.
Collecting evidence of outcomes
The second assignment for English 2, a third year course, involved students in analysing case
study material developed in the ALDA project. Students were informed of the ALDA project
and invited to make their assignments available for analysis. Analysis was conducted by a
researcher who was not on the English 2 teaching team and it was made clear to students
that the research analysis would be completely separate from their course assessment.
From a total of 125 students, 19 volunteered their assignments. This is a small percentage
therefore caution is necessary when interpreting results. Initial analysis addressed the
following questions:

Which cases did the students choose to analyse?

Which sources of evidence did students use?

How did students engage with the evidence?
Interviews were also undertaken with three teacher educators and written comments were
received from a fourth. Interview questions focused on the teacher educator's own
Page 6
response to the digital case books, the responses of their students and their view of learning
outcomes based on student assignments. Interview data was analysed thematically.
Findings: Teacher Educator Interviews
Teacher educators were very positive about the resource and in particular praised its
authenticity. The terms 'real' and 'authentic' were not used in interview questions; however
they were used by the educators to describe what they saw as a key strength of the
resource. In developing this theme, they drew comparisons between the digital case book
materials and the text book examples that are more commonly available to students.
Moira, an experienced school teacher and casual tutor, referred to a common assessment
practice, the taking of a 'running record'. This involves the teacher completing an
assessment form while a child reads aloud. In their course, students are shown exemplary
running records and demonstrations conducted in ideal circumstances. However the digital
case books showed video of teachers taking running records in the context of busy, crowded
noisy classrooms.
That’s what I think is good for our students, to see that [example of classroom
practice]. To not see the video of the perfect running record. I mean I can do that
with them. I can give them that model of how it’s meant to be but then they see
what really goes on, what will happen for them as well. Why should our students be
trying to prepare for a perfect world?
Teacher educators reported that students wanted more evidence and examples for each
child. This is despite the digital case books representing a considerable increase in the range
and quantity of evidence that had been made available for this assignment in previous
courses. In addressing this concern, teacher educators again made reference to the 'real
world' of professional practice. Margie, a senior teacher educator, reported:
[S]ome of the students would say "Well I wish I had more writing" or "I wish I had
…"; one of my responses was "This is the real world, this is what this teacher collects
and this is what we have and we analyse what we have here."
Page 7
The selection of cases was also commented on in relation to the course's scope, covering
early years to middle years of schooling. The cases covered Reception (school entry) to Year
6, however some students in the course were training to teach in pre-schools and child care
centres. Prue, an early childhood teacher educator asked:
How do the early childhood students contextualize the content in the English courses
for preschool and childcare? We need to have a set of case study materials made for
preschool age children: one child three and a half and another five years old.
Integration of the digital case books with other course resources was identified as requiring
further development. In this pilot stage, nothing changed in the course except for the
substitution of digital case books for the previous contrived materials. According to Margie,
who was teaching this course for the first time, the set texts did not provide sufficient
support for students in interpreting the child cases:
I didn’t like the [course text book] because there weren't examples and if [students]
don't see children's writing examples, they don't know what they're supposed to
look like. So that was one area where if I were to do this again, I would make sure
that the models that they have to draw on have concrete examples.
In order to use the case books effectively in class, teacher educators needed to familiarise
themselves with the various forms of evidence. This meant they had to engage in the same
kinds of interpretive thinking that their students were required to demonstrate. Moira
described how she worked across multiple sources in coming to her own understanding of
each case:
I wasn’t quite sure in the beginning. So I spent some time looking at all of them.
Listening to the teacher speak was very enlightening. It was good to have that. And
hearing the child speak about what they were doing was really helpful as well. And I
needed to look really closely at them before I expected the students to have an
understanding.
This is consistent with the finding from a similar study that using digital case-based materials
for the first time necessitated significant time for professors to "completely explore all
elements of a case" (Schrader et al 2003, p. 333).
Page 8
Findings: Student Assignments
Cases chosen
Students were required to present two case studies and could choose from three sets (Year
2, Year4, Year 6). The most popular child cases were Imogen and James in the Year 2 set.
This can be understood in relation to the program cohort which is constituted of three
specialisation groups: Early Childhood, Junior Primary/Primary and Primary Middle. The
Early Childhood group is training to work with children no older than Year 2.
Most students chose one girl and one boy for their two cases. In selecting Imogen and
James, students were also choosing more highly contrastive cases, with the third child
(Tabitha) having been identified by the teacher (in discussion with the researchers) as in the
middle rank of achievement.
Sources of evidence
Nearly all students referred to at least three different sources of evidence in coming to
judgements about students’ strengths and needs. Only one student used fewer than three
sources while five students used more than four sources.
Table 1: Examples of students' use of evidence from the digital case books
Form of
evidence
References Example
(total = 19)
Child's writing
sample
17
“Imogen’s writing is situated in the Early Writing phase of
the First Steps (2013b) continuum. This is highlighted
when she uses sound-letter knowledge to spell irregular
words- “Madurgasgu”, “biskuerts”, “sosigerill” … "
(Student 2)
Running record
form.
15
"Imogen decodes unknown words through the use of
phonemes and syllables, which is evident in her running
record, e.g. cor-ru-gated." (Student 6)
Teacher
interview about
the child (audio)
15
"For homework each night they are required to do LSCWC
for all of their spelling words for the week. On Friday the
teacher looks through their homework book, James
homework is not always completed." (Student 3)
Page 9
Interview with
child (audio)
13
"James likes to draw monsters on his iPod at home.
Expressing his ideas using technology in class in
particularly for English may help him engage more and
enjoy writing and reading process." (Student 13)
Child reading
aloud (video).
10
"When reading Tabitha lacks fluency, this maybe one of
the reasons why she isn’t gaining inferential meaning
from the text." (Student 14)
The student work samples were the most commonly referred to sources (17 students) while
the reading records and teacher interviews were also referred to by 15 students. This may
reflect the strong emphasis on teachers conducting running records which is currently the
case in the education system, and has been observed by students when on their
professional placement.
Engagement with the evidence
More detailed analysis is needed to get a clear picture of patterns in students’ approaches
to using the evidence. However, some points can be made at this stage. First, it appeared
that the multimedia presentation of evidence provided students with important clues as to
the case study child's orientation to literacy. There was evidence that students were
attending to visual and auditory information when interpreting children’s skills and
attitudes:
When asked about these interests James’ voice seemed to spark and get louder,
showing some excitement. (Student 6)
[I]t was noticed in the video of Child Two reading that she is still utilising finger
pointing to assist with her reading which may be holding back her development in
other areas.(Student 15)
Secondly, students drew on conceptual resources from their course in order to make sense
of the cases. For instance, they looked for evidence that would justify assigning children to
developmental categories based frameworks encountered in their course:
The first steps developmental continuum (2013) states that transitional writers
‘consider audience and purpose when selecting ideas and information to be included
Page
10
in texts’. Tabitha structures her recount by using words such as first, next, then, after
and finally […] (Student 5)
Jack is in the ‘developing’ phase of the English as an EALD scale, according to his
score of 6 in the student data (DECD, 2012, p.13). This level is demonstrated in Jack
constructing some written texts with confidence, such as his Aldinga Coastlines
Information Report. (Student 17)
This is consistent with Zottman et al's (2012) finding that students using digital case-based
resources demonstrated significantly greater application of concepts that a control group.
Third, being provided with multiple different sources of evidence on a child seemed to
prompt some students to exercise critical and independent thinking. Different lenses on the
child opened up different possibilities for interpretation; thus the case books did not
offering a transparent window on the child. This created the possibility of students noticing
the interpretive nature of teachers' judgements rather than treating them as authoritative.
Several questioned or even disputed the case study children's teachers based on their own
dissenting analysis of some of the data:
According to the recording the teacher states that James’ comprehension is quite
good, but looking at the running record it looks as if his comprehension is actually
quite poor. It would also seem that the teacher may have made some mistakes when
marking the running record [ … ] (Student 4)
The teacher has inferred that James will be like his brother and not be the best
student when it comes to literature. This shows me that she needs to learn turnaround pedagogies techniques and not to label him and put him in a box. (Student
18)
This finding differs from that of Kim and Hannafin (2007) who also implemented digital case
based resources into a teacher education course. They found that pre-service teachers
"engaged in detailed case analysis reluctantly" and "did not apply expert knowledge" (Kim
and Hannafin 2007 p. 167). This difference may be related to contextual factors, particularly
the overall goal with which students were presented. In the case of Kim and Hannafin's
project, the case-based materials were used in relation to a programming assignment in
Page
11
which students were required to develop their teaching plans. In the ALDA project, the
summative assignment was a case study report in which the analysis of evidence was
central.
Conclusion
In the past, curriculum courses have been viewed as theoretical while the practicum was
seen as the ‘real’ learning arena for practice. This separation created obstacles to applying
curriculum knowledge to practice. The pilot stage of the ALDA project involved the
development of digital case books and their implementation in an undergraduate teacher
education course in English teaching. Through accessing authentic multimedia
documentation of teachers and students performing and discussion literacy learning, our
pre-service educators were better able to see the relevance of content knowledge.
Evidence of student learning outcomes in this project was limited to the analysis of
assignments volunteered by a small group of students and to tutors' perceptions. However,
the digital casebooks appear to be a powerful way to integrate professional practice
scenarios into a curriculum course in teacher education. These connections were evident in
students’ use of case materials in their assignments. It was noted that students drew on
concepts encountered in the course when interpreting this data. Students used at least
three different kinds of data from the case books in coming to conclusions about the
learning strengths and needs of the focus children.
Teacher educators were pleased with students’ assignments and strongly endorsed the
authenticity of the resource which they saw as a useful complement to the contrived
exemplary materials available in textbooks. At the same time, they experienced the
necessity of spending time with the materials, considering the possibilities of interpretation.
This sensitised them to the challenges for students of working with the materials.
There are various ways of integrating authentic materials into courses. Strengths of this
approach included the focus on individual students as the basis of the case, the integration
of the cases with a summative assignment which made use of the case materials essential,
the provision of multiple forms of evidence and the use of the case book format for
Page
12
presenting case materials. Taken together, these elements encouraged a consistent focus
on the child as the subject of educators’ interpretive practices.
The next iteration of the project will incorporate a pre- and post- survey focused on
students' knowledge and confidence related to the use of learner evidence to make
instructional decisions.
References
Australian Institute for Teaching and School Leadership (2011) National Professional
Standards for Teaching, Canberra: Australian Government.
Bainbridge, J., & Macy, L. (2008). Voices: Student teachers link teacher education to
perceptions of preparedness for literacy Teaching. Teacher Education Quarterly,
35(2), 65 - 83.
Brennan, M., & Zipin, L. (2006). Meeting literacy needs of pre-service cohorts: ethical
dilemmas for socially just teacher educators. Asia-Pacific Journal of Teacher
Education, 34(3), 333 - 351.
Jonassen, D., Wang, F., Strobel, J., & Cernusca, D. (2003). Applications of a case library of
technology integration stories for teachers. Journal of Technology and Teacher
Education, 11(4), 529 - 548.
Kim, H., & Hannafin, M. (2007). Web-enhanced case-based activity in teacher education: a
case study. Instructional Science, 37, 151 - 170.
Lieberman, A., & Mace, D. P. (2010). Making practice public: Teacher learning in the 21st
century. Journal of Teacher Education, 61(1-2), 77-88.
Macklin, R. (2009). Moral judgement and practical reasoning in professional practice. In B.
Green (Ed.), Understanding and Researching Professional Practice. Rotterdam: Sense.
Masdri, M., El Basri, T., Norton, S., & Newsum, J. (2012). The digital lives of U.S. teachers: a
research synthesis and trends to watch. School Libraries Worldwide, 18(1), 70 - 86.
Ottenbreit-Leftwich, A., Brush, T., Strycker, J., Gronseth, S., Roman, T., Abaci, S. &Plucker, J.
(2012). Preparation versus practice: How do teacher education programs and
practicing teachers align in their use of technology to support teaching and learning?
Computers and Education, 90.
Saltmarsh, S., & Sutherland-Smith, W. (2010). S(t)imulating learning: pedagogy, subjectivity
and teacher education in online environments. London Review of Education, 8(1), 15–
24.
Schatzki, T. (2001). Introduction. In T. Schatzki, K. Cetina & E. Savigny (Eds.), The Practice
Turn in Contemporary Theory. Milton Park: Routledge.
Schrader, P. G., Leu, J. D. J., Kinzer, C. K., Ataya, R., Teale, W. H., Labbo, L. D., & Cammack, D.
(2003). Using Internet delivered video cases, to support pre-service teachers'
understanding of effective early literacy instruction: An exploratory study.
Instructional Science, 31(4/5), 317-340.
Page
13
Segrave, S., & Holt, D. (2003). Contemporary learning environments: designing e-learning for
education in the professions. Distance Education, 24(1), 7 - 24.
Zottmann, J. M., Goeze, A., Frank, C., Zentner, U., Fischer, F., & Schrader, J. (2012). Fostering
the analytical competency of pre-service teachers in a computer-supported casebased learning environment: a matter of perspective? Interactive Learning
Environments, 20(6), 513-532.
Page
14
Download