Testing Recall of Corrective Feedback

advertisement
TESTING RECALL OF
CORRECTIVE FEEDBACK:
AN ACTION-RESEARCH
STUDY
BY JARED TRAVIS
TEXAS TECH UNIVERSITY
CORRECTIVE FEEDBACK
DEFINED
Corrective feedback is –
• error treatment (Faneslow, 1977)
• a frequent component of in-class instruction (Lyster &
Ranta, 1997; Alwright, 1984; Norris & Ortega, 2000)
• used to correct a variety of errors in a variety of ways
(Chaudron, 1977; Lyster & Ranta, 1997)
CORRECTIVE FEEDBACK
DEFINED
Some researchers • argue against corrective feedback (Krashen, 1981, 1982;
Truscott, 2007)
• report limited effectiveness (Russell & Spada, 2006; Li,
2010)
However, corrective feedback has received tremendous
attention in L2 research.
PAST RESEARCH
Uptake ~
• Originally, uptake was what learners learned during class
(Alwright, 1984; Slimani, 1992)
• Uptake was redefined by Lyster & Ranta (1997)
•
•
If students responded to CF
If student repair occurred
• What forms of CF leads to most uptake?
•
•
Panova & Lyster (2002) showed that recast is the most
common form of CF but with limited uptake
more explicit forms of CF lead to most uptake.
PAST RESEARCH
Perception ~
• CF is not completely perceived by students.
•
Regarding corrected item types:
• Mackey, Gass & McDonough (2000) reported:
• Lexical items easily perceived (80%)
• Morphological items (13%)
•
Types of CF:
• Egi (2010) - 46% of recasts perceived
• Rassaei (2013)
• 33% recasts perceived
• 58% explicit CF perceived
PAST RESEARCH
Noticing ~
• CF enhances noticing (Li, 2010)
•
Adams (2003) using stimulated recall (video-recorded and
delayed) showed students need more than one
opportunity to notice and recall written reformulations
•
Philp (2003) using immediate recall indicated:
• short recasts are easier to recall than long recasts
• One recasted item easier to recall than multiple
recasted items
GAP IN RESEARCH
Stimulated recall and immediate recall has been used in past
studies to measure recall of CF.
But, there is no past L2 CF research that used delayed rote
recall of CF.
CURRENT STUDY
This study focuses on testing recall of corrective feedback
through action research (Alwright, 1984).
Action-research Design adapted from Calvert & Sheen (2014):
1) identifying the problem
2) initial action
3) examining the results
4) reflection and planning for further action
IDENTIFYING THE PROBLEM
Student complaints during 2014 ITA ESL summer workshop:
• CF after an oral presentation was unclear, but ...
• CF could not be recalled by the student
What happens to CF once given by a teacher?
IDENTIFYING THE PROBLEM
Research Questions:
1. After a performance, does the student recall corrective
feedback as evidenced within a feedback reflection form?
2. What are the characteristics of the recalled corrective
feedback?
3. To what extent does the student recall corrective feedback
as evidenced by the number of correct feedback items?
INITIAL ACTION
Twelve international teaching assistant (ITA) candidates
participated.
• China, Sri Lanka, Japan, Taiwan, Korea, and Mexico
• All upper-intermediate to advanced learners
• Mid 20s to mid 40s
Students were assigned audio-recorded oral presentations
as part of in-class instruction or tutoring times followed with
CF.
• 5 students participated two times
INITIAL ACTION
Feedback Reflection Form was designed for students to write
down recalled CF (Slimani, 1992)
1. Initial form asked recall of 3 items
2. Modified form asked recall of all CF items
INITIAL ACTION
(1) Seven students filled out the
feedback reflection form for
homework due the next day of
class (initial feedback form)
(3)
(2)
(4)
INITIAL ACTION
(1) Seven students filled out the
feedback reflection form for
homework due the next day of
class (initial feedback form)
(3)
(2) Three students after tutoring
completed the feedback reflection
form for homework due the next
day of class (modified feedback
form)
(4)
INITIAL ACTION
(1) Seven students filled out the
feedback reflection form for
homework due the next day of
class (initial feedback form)
(3) Seven students were given
written CF. The following day, their
recall of the written CF was tested
(modified feedback form)
(2) Three students after tutoring
completed the feedback reflection
form for homework due the next
day of class (modified feedback
form)
(4)
INITIAL ACTION
(1) Seven students filled out the
feedback reflection form for
homework due the next day of
class (initial feedback form)
(2) Three students after tutoring
completed the feedback reflection
form for homework due the next
day of class (modified feedback
form)
(3) Seven students were given
written CF. The following day, their
recall of the written CF was tested
(modified feedback form)
(4) Five students listened to the
audio-recording of a previous
presentation and completed a followup feedback reflection form as
homework (modified feedback form)
EXAMINING THE RESULTS
All CF given was transcribed in brief.
Both transcribed CF and recalled CF was charted for side-byside comparison.
17 total transcripts were compiled
• 12 individual students
• 5 participated two times
• 5 did the follow-up
EXAMINING THE RESULTS
Research Question 1.
After a performance, does the student recall corrective
feedback as evidenced within a feedback reflection form?
• Accuracies: in all instances but one, students reported at
least one item of CF.
• Inaccuracies: four types of inaccuracies were discovered in
student reports.
EXAMINING THE RESULTS
Examples of accuracies:
Teacher corrective feedback:
Student reported:
lack of prominence in answering
questions
When I answer a question from a
student, I do not use as much
prominence as I do in my teaching
EXAMINING THE RESULTS
Examples of accuracies:
Teacher corrective feedback:
Student reported:
lack of prominence in answering
questions
When I answer a question from a
student, I do not use as much
prominence as I do in my teaching
started speech paragraphs high and
ended high rather than ending low
Use high pitch when starting speech
paragraphs and low pitch when ending
the speech paragraphs
EXAMINING THE RESULTS
Examples of accuracies:
Teacher corrective feedback:
Student reported:
lack of prominence in answering
questions
When I answer a question from a
student, I do not use as much
prominence as I do in my teaching
started speech paragraphs high and
ended high rather than ending low
Use high pitch when starting speech
paragraphs and low pitch when ending
the speech paragraphs
Saying ‘gross’ instead of ‘growth’
changes meaning which is not the topic;
‘thing’ not ‘sing’
Several pronunciation mistakes, eg
thing, growth
[in follow-up]
Correct pronunciation of growth,
species, thing, etc.
EXAMINING THE RESULTS
Inaccuracies:
a) reporting incorrectly a specific error
b) reporting CF that was not ever provided
c) reporting vague remarks
d) and reporting non-CF items
EXAMINING THE RESULTS
Inaccuracies:
a) reporting incorrectly a specific error
b) reporting CF that was not ever provided
c) reporting vague remarks
d) and reporting non-CF items
EXAMINING THE RESULTS
• reporting incorrectly a specific error
Teacher corrective feedback:
Student reported:
Don’t end with an awkward pause; ask a I should have asked a teaching
question to wrap up the presentation
question in the middle of the teaching,
not after the teaching, in order to make
and keep students awake
EXAMINING THE RESULTS
• reporting incorrectly a specific error
Teacher corrective feedback:
Student reported:
Don’t end with an awkward pause; ask
a question to wrap up the presentation
I should have asked a teaching
question in the middle of the teaching,
not after the teaching, in order to make
and keep students awake
Word stress errors on ‘previously’ and
pitch and tone error on ‘unfortunately’
corrected my pronunciation like
‘previously’ and ‘unfortunately’
EXAMINING THE RESULTS
• reporting incorrectly a specific error
Teacher corrective feedback:
Student reported:
Don’t end with an awkward pause; ask
a question to wrap up the presentation
I should have asked a teaching
question in the middle of the teaching,
not after the teaching, in order to make
and keep students awake
Word stress errors on ‘previously’ and
pitch and tone error on ‘unfortunately’
corrected my pronunciation like
‘previously’ and ‘unfortunately’
Need falling tone on ‘itself’, the last
word in the list
strong prominence on ‘itself’
EXAMINING THE RESULTS
• reporting CF that was not ever provided
Teacher corrective feedback:
Student reported:
Made 14 different corrections; no
reference to pitch
not good pitch is used
EXAMINING THE RESULTS
reporting CF that was not ever provided
Teacher corrective feedback:
Student reported:
Made 14 different corrections; no
reference to pitch
not good pitch is used
Made 5 different corrections; no
reference to speech paragraphs
[in follow-up]
Need to pay attention on beginning
new paragraphs and end with a low
pitch.
EXAMINING THE RESULTS
• reporting CF that was not ever provided
Teacher corrective feedback:
Student reported:
Made 14 different corrections; no
reference to pitch
not good pitch is used
Made 5 different corrections; no
reference to speech paragraphs
[in follow-up]
Need to pay attention on beginning
new paragraphs and end with a low
pitch.
Made 11 different corrections; no
reference to transition words
I need to use transition words to move
one point to another.
EXAMINING THE RESULTS
Research Question 1.
After a performance, does the student recall corrective
feedback as evidenced within a feedback reflection form?
• Answer: students can recall some elements of corrective
feedback, but the recall test showed many inaccuracies.
EXAMINING THE RESULTS
Research Question 2.
What are the characteristics of the recalled corrective
feedback?
• Generic reports with no connection between recalled CF
and specific error
EXAMINING THE RESULTS
Teacher corrective feedback:
Student reported:
Give falling tone on this utterance
ending ‘species are’ and ‘Fungi’ needs
a falling tone if at the end of utterance.
Tones (varied)
EXAMINING THE RESULTS
Teacher corrective feedback:
Student reported:
Give falling tone on this utterance
ending ‘species are’ and ‘Fungi’ needs
a falling tone if at the end of utterance.
Tones (varied)
Make eye contact with the whole class
Eye contact
EXAMINING THE RESULTS
Teacher corrective feedback:
Student reported:
Give falling tone on this utterance
ending ‘species are’ and ‘Fungi’ needs
a falling tone if at the end of utterance.
Tones (varied)
Make eye contact with the whole class
Eye contact
Word stress by running through a few
syllables quickly
Word stress
EXAMINING THE RESULTS
Teacher corrective feedback:
Student reported:
Give falling tone on this utterance
ending ‘species are’ and ‘Fungi’ needs
a falling tone if at the end of utterance.
Tones (varied)
Make eye contact with the whole class
Eye contact
Word stress by running through a few
syllables quickly
Word stress
Follow the required Q & A cycle; no
paraphrasing or confirming answer
No paraphrasing
EXAMINING THE RESULTS
Teacher corrective feedback:
Student reported:
Give falling tone on this utterance
ending ‘species are’ and ‘Fungi’ needs
a falling tone if at the end of utterance.
Tones (varied)
Make eye contact with the whole class
Eye contact
Word stress by running through a few
syllables quickly
Word stress
Follow the required Q & A cycle; no
paraphrasing or confirming answer
No paraphrasing
At end of statement/sentence, falling
tone is needed. Give rising tone on
‘database’ since location in middle of
sentence. Corrected early rising tone
on ‘McLaughlin says’.
“[Instructor] pointed my mistake in
using tone. And he asked me to
differentiate the rising tone, falling tone
and level tone.
EXAMINING THE RESULTS
Research Question 3.
To what extent does the student recall corrective feedback as
evidenced by the number of correct feedback items?
• The total number of teacher CF items and recalled items
were tabulated in approach two and three.
• Exclusions: approach one recalled CF, approach four
(follow-up), and inaccuracies.
EXAMINING THE RESULTS
Table 1
Comparison of Corrective Feedback Items and Recalled Items
Teaching
Corrective
Student
Recalled
Context
Feedback items
Tutoring
In class
% recalled
1
7
0
0%
2
19
5
26%
3
19
2
11%
4
21
5
24%
5
11
3
27%
6
23
14
61%
7
14
5
36%
8
12
6
50%
9
9
4
44%
10
14
4
29%
REFLECTION AND PLANNING
FOR FURTHER ACTION
1. The results show that students are unable to recall large
or detailed portions of CF.
Do you as the teacher desire to use CF?
If so, consider:
•
•
•
•
explaining that CF (oral and written) is a type of instruction
the extent it is essential students pay attention to CF
if CF will be used for later application
how students need to treat that CF
REFLECTION AND PLANNING
FOR FURTHER ACTION
2. Students need to be trained to notice CF, especially the
corrective nature in response to an error.
REFLECTION AND PLANNING
FOR FURTHER ACTION
3. As part of the training of CF, maintaining a connection with
the CF and the specific error source may help with later
production.
REFLECTION AND PLANNING
FOR FURTHER ACTION
3. As part of the training of CF, maintaining a connection with
the CF and the specific error source may help with later
production.
Corrective feedback example connected to specific error source.
Teacher corrective feedback:
Give prominence on key word
‘porosity’
Student recall should not be...
need prominence
Should be ...
I need prominence on ‘porosity’. It’s
the key word.
REFLECTION AND PLANNING
FOR FURTHER ACTION
4. In light of the preceding three points of reflection, a
teacher who decides to employ CF needs to consider
requiring students record CF.
•
•
•
•
In their textbook
Their course notebook
Separate CF journal
Test recall of CF daily
QUESTIONS AND COMMENTS
THANK YOU!
Download