Yeh-uh Hsueh Chen and Mei

advertisement
Proceedings of the 3rd International Conference of Teaching and Learning (ICTL 2011)
INTI International University, Malaysia
STRENGTHENING TEACHER-LEARNER BOND
THROUGH DIFFERENTIATED ASSESSMENT
Yeh-uh Hsueh Chen1 and Mei-Ling Lee2
Chienkuo Technology University, Taiwan
(1yuhc@ctu.edu.tw, 2tulip0084@gmail.com)
ABSTRACT
Traditional one-size-fits-all tests pinpoint grading as the primary purpose. Such evaluation inevitably causes
stress that may be destructive enough to adversely widen the distance between the teacher and students (Palmer,
1998). Detrimental tension in the assessment setting often presents barriers to the development of intellectual
abilities (Shepard, 2000). To encourage learning through positive interactions in the classroom, teaching
practitioners are in need of assessment options that not only document students’ progress, provide information
for instructional decisions, but also bridge the gap between teachers and students. This qualitative study
examined teacher-learner relationship in an authentic assessment context where learner-centered tiered
performance tasks were offered in an effort to bond teachers and learners. A total of 12 participants were
interviewed, either individually or in focus groups to explore their perspectives on the assessment. Findings
indicated assessment that addresses diverse learner needs is favored over traditional tests. Self-directed choices
of tiered tasks improve test takers’ motivation, confidence, and achievement. Data also suggested that teacherlearner bond is strengthened in the learner-centered assessment while culturally-related learning styles and
beliefs about teacher and learner roles were in play.
KEYWORDS
Teacher-learner relationship, Differentiated instruction, Tiered performance tasks, Assessment, Tertiary EFL
classrooms, Qualitative study
INTRODUCTION
Traditional summative test has long been accused of widening the distance between teachers
and students (Palmer, 1998). Conventional grading systems adopt one-size-fits-all format to
generate summative judgment of student achievement that does not inform instruction (Liao,
2007; Tompkins, 2002). In a worse scenario, a conventional test context could cause stress
detrimental to learner autonomy and it eventually closes the door on long-lasting and
meaningful learning.
In Taiwan, the practice of Teaching English as a Foreign Language (EFL) suffers from
powerful influences of traditional uniform tests. According to Liao (2007), the pressure for
academic success is so intensive that more than 80 percent of EFL teachers train students for
high scores in summative tests rather than communicative competence in real life. Students
are de-motivated because their hard work does not warrant a transfer of knowledge to realworld situations and the lack of proper English proficiency in students has worried the
English educators in Taiwan.
1
Proceedings of the 3rd International Conference of Teaching and Learning (ICTL 2011)
INTI International University, Malaysia
Research has shown that language learning takes place best in an environment where
constructive interpersonal relationship and interaction are encouraged (Ma, 2005). Ito and
Chen (2007) suggested that in differentiated instruction (DI) approach language teachers are
able to take care of both students’ academic and affective needs and make optimal student
growth possible. As a humanistic approach, DI honors learning ownership by using tiered
performance tasks (TPT) to assess students at different levels. Learners are encouraged to
choose preferred task to demonstrate knowledge and ability without much stress.
As Taiwanese students are generally conditioned to uniform tests, how will they respond to
TPT that offers leveled choices in assessment? Will the students view the teacher differently
for administering the unusual assessment? How will the learner-centered assessment
influence teacher-learner relationship? This case study was conducted to examine student
responses to a final examination employing TPT, and thereby the participants’ views of
assessment as well as the teacher. Discussions about cultural influences on teacher and
learner roles arose from the findings and the implications for EFL classrooms in Asian
regions are suggested.
LITERATURE REVIEW
Assessment
There are two broad categories of assessment: summative and formative assessment. The
former, the traditional product approach, provides a summary judgment about learning
achieved after some time with the goal of informing external audiences primarily for
certification and accountability purposes. The latter, the new process approach, gathers and
uses information about students’ knowledge and performance and informs teachers to adapt
instruction to address identified deficiencies. Frohbieter et al. (2011) suggest that the primary
purpose of a formative assessment is ongoing instructional improvement. In other words,
formative assessment functions as an integral part of instruction to support and enhance
learning (Shavelson, 2006; Shepard, 2000).
Tompkins (2002) indicates that in authentic assessment teachers examine both the learning
processes and the artifacts or products that students produce. Meanwhile, students participate
in reflecting on and self-assessing their learning. Authentic assessment operates not only as a
way “to monitor and promote individual students’ learning”, but can be used “to examine and
improve teaching practices” (Shepard, 2000, p. 12). If carefully planned and well
implemented, “good assessment tasks are inter-changeable with good instructional tasks”
(Roos & Hamilton, 2004, p. 8). In this sense, formative assessment serves the purpose.
Unfortunately, current assessment systems present barriers to the development of intellectual
abilities and students’ self-esteem (Black & Wiliam, 2001). The prevailing uniform testing
fails to attain true understanding of how well students can perform. In addition, teaching to
summative tests demoralizes learners where students take little responsibility for their own
learning (Shepard, 2000). To nurture motivated life-long learners, teachers need to abandon
conventional way of assessment and develop evaluation means that encourage autonomous
learning for the pursuit of applicable skills in authentic situations.
2
Proceedings of the 3rd International Conference of Teaching and Learning (ICTL 2011)
INTI International University, Malaysia
Differentiated Instruction and Differentiated Assessment
Tomlinson and Eidson (2003) refer the term DI as “a systematic approach to planning
curriculum and instruction” (p.3) for heterogeneous student populations. In DI teacher
strategically adjusts the content, process and product of instruction, in accordance with
individual needs (Gregory & Chapman, 2002). The differentiating adjustment may be made
in various aspects, such as complexity level (e.g., knowledge, comprehension, application,
analysis, synthesis, evaluation), students’ preferred learning modalities (e.g., auditory, visual
or kinesthetic), and learner interests. Differentiating EFL educators interacts with students as
a facilitator, role model, resource, and nurturer, while students find meaning in what they do
through purposeful activity and reflection, and are provided access to the skills and
knowledge with which to fulfill their goals (Chen, 2007).
“While learning tasks need to be differentiated, so do assessment strategies”, asserted
Gregory and Chapman (2002, p. 55). One of the formative differentiating assessment
practices often employed in DI is the strategy of tiered performance tasks (TPT). TPT are
evaluation task options designed to accommodate diverse educational needs of individual
learner and stretch students’ understanding and skills. In EFL, TPT are employed to
encourage demonstration of different dimensions in learning: facts, concepts, principles,
attitudes, and skills. Nunley (2006) claims that systematic use of differentiated assessment
strategies supports high motivation and leads to learner autonomy, as relieving stress from
tests among students.
Differentiated instruction promotes language learning ownership through an encouraging
teacher-learner relationship (Ito & Chen, 2007). When the teaching atmosphere is
harmonious, alleviating foreign language anxiety, the students feel comfortable and secure.
Only then can the students have the confidence to explore in language learning and autonomy
develops. A teacher-learner relationship that sustains the collaboration of a responsive teacher
and engaging students is crucial to optimal foreign language learning.
Needed Reforms to EFL in Taiwan
In Taiwan, teacher-centered instruction dominates the EFL field considerably due to the
potent influences of uniform paper-and-pen examination (Nunan, 2003). Drilled by tests and
quizzes, students often give up learning or pass standardized tests without the needed
communicative competence (Chen, 2007). Reform advocates believe that to improve the
quality of English education in Taiwan, more learner-responsive instruction and formative
assessment should be brought into daily practice (Dai, 2003; Liao, 2007). Specifically, by
taking differentiating approach, an EFL teacher relates to the students constructively, is
motivated to make necessary changes in classroom practice, thus can be the key to student
language learning.
3
Proceedings of the 3rd International Conference of Teaching and Learning (ICTL 2011)
INTI International University, Malaysia
METHODOLOGY
This case study examined the educational implications that a learner-centered assessment
may bring in terms of teacher-learner relationship. The study is exploratory in nature,
investigating teacher-learner relationship as reflected in the participants’ responses to TPT, a
differentiating assessment practice. In the final examination under study, the students had to
perform at least two projects; the third one was only needed if the students wanted to work
for bonus points. The tasks were differentiated in three complexity levels, basic, intermediate,
and advanced, each worth different point values and designed to facilitate demonstration of
knowledge, comprehension, and application of materials taught in the semester,. The students
were free to make their choices of tasks and target a desired score range.
Through purposeful sampling, 12 freshmen studying in the Department of Applied Foreign
Languages (AFL) at a technology university in central Taiwan participated in the study. The
informants came from a class with 48 students and were recruited based on their academic
standings in and gender distribution of the class. There were four males and eight females, all
were 18-19 years of age. The informants were invited to either one of the three individual
interviews or one of the two focus groups, arranged to seek diverse representation of student
levels, interests, and gender. An interview protocol and a moderator’s guide were prepared to
ensure the same basic topics were explored in each interview. Other data gathering
techniques included field observations, videotaping, and artifact collection. Triangulation and
member check on verbatim transcriptions of the interviews were conducted for validity. The
process of sorting data into meaningful interpretation involves coding, categorizing and
theme-searching.
FINDINGS AND DISCUSSIONS
In the following discussion, some selected participant comments were tabulated and still
some incorporated into text to provide a smooth flow of the findings through the insiders’
voices.
Responses to TPT: Confusion to Recognition to Appreciation
For all participants, this assessment was undoubtedly innovative. Its unconventional format
drew from the participants a chain of reactions from confusion to recognition, and finally to
appreciation. Indeed, the format was quite complex to understand for most students at the
initial contact. To tackle the bewilderment, the instructor, Ms. Lin, provided extra time twice
before the examination to clarify questions about requirements, point distribution scheme,
and scoring criteria. Her idea was that students would want to achieve more when they have a
clear understanding of what they need to do (Shepard, 2000).
Recognition of assessment features rose after the initial shock had quelled. The most
noticeable change in this examination lay in the offering of TPT for students to choose from.
The participants realized those task choices actually attended to their individual readiness
levels and fed in the sense of ownership. Several participants admitted feeling in control
when making their own choices. Cheryl reflected, “On second thought, I think Ms. Lin was
actually giving us the chance to make choices. She respects us. I feel great about it, about
being respected.”
4
Proceedings of the 3rd International Conference of Teaching and Learning (ICTL 2011)
INTI International University, Malaysia
Being able to aim at a preferred score was the most appreciated merit of the assessment. After
all, score is always a great concern for students and the participants in this study were no
exception. Transparent success criteria triggered hidden ambitions when the participants
decided what tasks to perform to target their preferred score range. On the whole, choosing
projects to manipulate scores provided the participants a satisfying ownership in the
evaluation of their learning. Lily spoke with a bright smile, “I think it is really nice because
[Ms. Lin] gave us the choices. This is the part I am really pleased with....It’s democratic that
we can make our own decisions!”
In order to attain the target score, the participants had to stretch their ability. This enhanced
confidence and improved English skills. Best of all, the participants enjoyed more ownership
in the evaluation process. From a passive knowledge receiver the participants grew to an
enthusiastic learner who took charge of one’s own learning objectives. However, there was
also negativity towards the assessment. In general, the participants complained about
demanding tasks, even though they eventually experienced improved English competence. As
there were many other tests to deal with during the final examination week, the participants
worried about insufficient time to prepare. Other down sides of the assessment included
scheduling difficulties, and long assessment process.
Table 1. Participant responses to TPT.
Category
Key
Participant Comments
confusion
format changes
Dick: “?”
May: “We have never seen something like that [the all-in-English task
descriptions and requirements]. We couldn’t understand it in the
beginning.”
recognition
leveled tasks
Ken: “it takes everybody’s ability level into consideration, so learning is
propped up”
appreciation
clear criteria
Lily: “Ms. Lin had told us scoring criteria.... Each task is allowed a
certain number of points. She has shown us the rubric.”
Jenny: “We are not restricted with only one kind of question. We can
make our own choices.”
Sandra: “I can target an acceptable score for myself.”
Cheryl: “On second thought, I think Ms. Lin was actually giving us the
chance to make choices. She respects us. I feel great about it,
about being respected.”
choices of tasks
target scores
feeling respected
gains
enhanced confidence to
engage in challenges
better English skills
more learning ownership
complaints
Alex: “Mike and I decided to step out of fixed patterns and engage in
new tasks for a try.”
Jenny “it’s different this time, it’s somewhat more challenging and
therefore brings about improvement…I had to work harder and
spent more time, but the time was well spent.”
Robin: “I assumed greater responsibility for the presentations than
before.”
Lily: “I think it is really nice because [Ms. Lin] gave us the choices. This
is the part I am really pleased with....It’s democratic that we can
make our own decisions!”
scheduling difficulties
Cheryl: “It’s so hard, so complicated!”
Sandra: “I did three basic-level tasks because we had only limited time
to prepare for the finals.… It’s easier to do basic-level ones, so
I could save time for the other tests.”
Jo: “It was tough to organize presentations for 48 people.”
long process
Robin: “It takes too much time to complete the whole thing.”
demanding requirements
insufficient preparation time
5
Proceedings of the 3rd International Conference of Teaching and Learning (ICTL 2011)
INTI International University, Malaysia
Learners’ Views of the Teacher
While the participants appreciated the new assessment practice, no one recalled what
rationale Ms. Lin provided behind it. They could only guess why she invested additional time
to administer such a different assessment and increased her own workload. Some examples of
the suppositions are listed in Table 2.
Table 2. Learners’ views of the teacher.
Category
Key
Participant Comments
Conjectured
teacher
intentions
To encourage learning
Jo:
I think she wanted us to try a different way to see if we would work
harder.
To inform teaching
Robin: She wants to know our abilities better….In the past, she just threw
out something for us to respond to, but this time we have to make our own
decisions.
Ken: This is a great idea…it helps the teacher to make decisions
concerning the whole class.
To address individual needs
Lily: I think Ms. Lin did it considering that each student is at a different
level; the level range in our class is pretty big.
Sandra: Probably she doesn’t want to limit us within the range she sets,
so we can decide the way we want. Students’ feelings and opinions are
considered.
to offer learning ownership
Dick: She wishes that we will do it the way we like….to do what we want,
to perform in our own way. Maybe it will bring out a better result.
As shown in the table, Jo guessed from a good student’s view point. She associated
examination with working hard, and thought Ms. Lin expected them to work harder. Robin
and Ken thought about the assessment format; they guessed the format change had something
to do with what Ms. Lin wanted to get from the examination for her future instruction. The
leveled performance tasks were not easy to forget, and Lily and Sandra felt it was Ms. Lin’s
good intention to attend to student needs. As for Dick, learning ownership was offered to help
them perform better. All in all, the participants believed the new design of assessment was
guided by the instructor’s intention to motivate learning, to get a better understanding of
students’ levels for instructional improvement, to help student achieve their best potential,
and to foster learner autonomy.
Teacher-Learner Relationship in the Assessment
Given the participants’ positive comments related to Ms. Lin, it is clear that they had
established a healthy relationship with each other. The participants articulated their trust in
the instructor’s willingness to address students’ needs. Seeing that the assessment had a
complicated format and additional requirements for them, the participants understood that the
changes meant heavier workload for the instructor, too. This was evidenced in Lily’s words:
“…pronunciation weighed 20%, and content weighed 40%. For content, we had to email her
the scripts and she would grade them based on the dialogue and grammar before the
presentation. Then, she gave us scores based on the pronunciation and performance during
the presentation.” Obviously, the instructor took the challenge along with her students and
put herself in a more equitable position to the students, as Lily said: “It is democratic.” For
this the participants believed that the instructor was with them and therefore accepted and
appreciated the new form of assessment. It seems that acceptance and appreciation of the
assessment arose from the participants’ trust in the instructor and in turn reinforced the
teacher-learner bond.
6
Proceedings of the 3rd International Conference of Teaching and Learning (ICTL 2011)
INTI International University, Malaysia
Although welcome by most, learning ownership initiated inner struggle in certain participant.
Preferring more guidance from the instructor, Cheryl indicated the need of external
assistance. She stated, “If the teacher offers many choices, the test does not force us to work
hard…. So, we all need some pressure to grow; pressure inspires our potential because
adversity produces growth.” Then, she voiced the typical mindset of Asian students, “as
students we cannot go up against [the teacher’s] decision, so we will have to change
ourselves to meet the teacher’s objectives.” In addition, it seemed that Cheryl held doubts
about students’ ability in executing learning ownership, as she added that it would be great if
choices came with challenges slightly above the students’ current levels and aimed at
learning goals preset by the instructor.
Overall, in this first encounter with TPT, the participants acknowledged the differentiated
assessment practice. They generally considered the experience constructive. Findings
indicated positive results such as motivation in taking challenges, improved English skills,
heightened self confidences, and better sense of ownership. The participants recognized TPT
as an authentic form of evaluation and would welcome such assessment in the future. The
exciting experience with TPT and a positive teacher-learner relationship mutually contributed
to each other.
IMPLICATONS AND SUGGESTIONS
As evidenced in the interviews, the successful implementation of TPT relied on a healthy
teacher-learner bond. When exploring deeper into this teacher-learner relationship, some
deep-rooted cultural influences on teacher/learner roles surfaced.
Research pointed out involving learners in the learning process is inevitably constrained by
cultural related learning styles and beliefs (Lee, 2005; Littlejohn, 1983). Lee found that
culturally derived beliefs and a perceived inability to learn independently of some Asian
learners could impede students from adopting an autonomous learning approach. Asian
students tend to regard teachers as expert figures and remain dependent. Littlejohn suggested
probably the greatest limitation in applying notions of learner control is the learners
themselves. Many English Learners in Taiwan may need to be supported and shown how to
become self-aware and to reshape concept about assessment. Consequently, the teacher plays
a crucial role in bringing learners into a more central role in making educational decisions.
With the support of a solid teacher-learner relationship and a gradual approach toward
relinquishing the teacher’s dominant role, a meaningful and fulfilling learning voyage of
learners’ choice is likely to be realized.
7
Proceedings of the 3rd International Conference of Teaching and Learning (ICTL 2011)
INTI International University, Malaysia
REFERENCES
Black, P.J. & Wiliam, D. (2001). Inside the black box: Raising standards through classroom
assessment. London, UK: King’s College London School of Education. [British Educational
Research Association short final draft]. Retrieved September 10, 2007, from:
http://ditc.missouri.edu/docs/blackBox.pdf.
Chen, Y.-U. H. (2007). Exploring the Assessment Aspect of Differentiated Instruction:
College EFL Learners’ Perspectives on Tiered Performance Tasks (Doctoral dissertation,
University of New Orleans, 2007). Dissertation Abstracts International, (UMI publication
number 3226932)
Dai, W.-Y. [戴維揚] (2003). 多元智慧與英語文教學 [Multiple intelligences and English
language teaching]. Taipei, Taiwan: Shi-Da Publishing Co.
Frohbieter, G., Greenwald, E., Stecher, B. & Schwartz, H. (2011). Knowing and doing: What
teachers learn from formative assessment and how they use the information. (CRESST
Report 802). Los Angeles, CA: University of California, National Center for Research on
Evaluation, Standards, and Student Testing (CRESST).
Gregory, G. H., & Chapman, C. (2002). Differentiated instruction strategies: One size
doesn’t fit all. Thousand Oaks, CA: Corwin.
Ito, N., & Chen, Y.-U. H. (2007). Differentiated Instruction to Alleviate Foreign Language
Anxiety. Paper presented at The 41st Annual TESOL Convention/Graduate Student Forum,
Seattle, Washington, USA. March 19-24, 2007.
Lee, M.-S. (2005). The mismatch between students’ and teacher’s beliefs about learner
autonomy. The Proceedings of the Fourteenth International Symposium on English Teaching,
2, 146-156.
Liao, H.-C. (2007). Effects of cooperative learning on motivation, learning strategy
utilization, and grammar achievement of English language learners in Taiwan (Doctoral
dissertation, University of New Orleans, 2005). Dissertation Abstracts International, 67(07),
2498A. (ISBN 9780542781056) (UMI publication number 3226932)
Littlejohn, A. P. (1983). Increasing learner involvement in course management. TESOL
Quarterly, 17(4), 595-608.
Ma, Y.-H. (2005). Students’ perceptions of learning activities in EFL college conversation
class. The Proceedings of the 14th International Symposium on English Teaching, 1, 497505.
Nunley, K. F. (2006). Differentiating the high school classroom: Solution strategies for 18
common obstacles. Thousand Oaks, CA: Corwin.
Nunan, D. (2003). The impact of English as a global language on educational policies and
practices in the Asia-Pacific region. TESOL Quarterly, 37(4), 589-613.
8
Proceedings of the 3rd International Conference of Teaching and Learning (ICTL 2011)
INTI International University, Malaysia
Palmer, P. J. (1998). The courage to teach: Exploring the inner landscape of a teacher’s life.
San Francisco: CA: Jossey-Bass.
Roos, B., & Hamilton, D. (2004). Toward constructivist assessment. Paper presented at the
Annual Conference of the Nordisk Forening for Pedagogisk Forskning (NFPF), Reykjavik,
10-14 March, 2004.
Shavelson, R. J. (2006). On the integration of formative assessment in teaching and learning:
Implications for new pathways in teacher education. In F. K. Oser, F. Achtenhagen, & U.
Renold (Eds.), Competence Oriented Teacher Training: Old research demands and new
pathways (pp. 63-78). Rotterdam, The Netherlands: Sense Publishers.
Shepard, L. A. (2000). The role of assessment in a learning culture. Educational Researcher,
29(7), 4-14.
Tomlinson, C.A., & Eidson, C. C. (2003). Differentiation in practice: A resource guide for
differentiating curriculum. Alexandria, VA: Association for Supervision and Curriculum
Development.
Tompkins, G. E. (2002). Language arts: Content and teaching strategies (5th ed.). Upper
Saddle River, NJ: Merrill.
9
Download