+
Effects of Reflective ePortfolio on Students
Overseas Exchange Learning Experience
Kwok Chi Wai, Ron; Cheung Hok Ling, Hokling;
Chen Yingjun, Josephine; Lau Tania, Yuenkei;
Bandyopadhyay Rupa; Wong Man Chun, Anthony
City University of Hong Kong
Table of Content
•
•
•
•
•
•
•
•
Curriculum Design
Reflective ePortfolio
Research Model
Examples of ePortfolio for Exchange
Measurements
Current Status
Limitations
Potential Implications
Curriculum Design
• Exchange Experience Assessment I (IS4935a)
• Exchange Experience Assessment II (IS4935b)
Enable students to bridge their study overseas on the
exchange programme with their learning experience in Hong
Kong. It will challenge them in terms of what they have
learned or not learned overseas, and how they learned it.
Students should emerge from this short course with a
heightened sense of appreciation for cultural differences, and
the impact that these differences can have on interpersonal
work relations, as well as intercultural relations at the
organisational level.
Course Intended Learning Outcomes
• Describe the role of communication in culture and overcome
communication barriers
• Recognize cultural variables and explain how they shape our
social and work interactions
• Identify and critically evaluate communication norms, rituals,
and taboos of students’ cultures and other cultures they have
been exposed to during their study programme
• Develop successful strategies to overcome cultural barriers
and demonstrate their usefulness
• Compare and contrast the use of IT in universities
/organizations in Hong Kong with the counterparts overseas
The Use of Reflective ePortfolio
• In the course, students were required to
document their exchange experiences with
the use of the reflective ePortfolio
• Training on reflection & Technical training on
ePortfolio were provided
• Design & provision of ePortfolio template
http://sites.google.com/site/mylearningportf
oliotemplate/
Google Sites
Peers review &
comments
Student’s ePortfolio
Student
Profile
Summary
Self-Assessment
form
View students’ ePortfolios
in Google Sites
Showcase
Monthly
exchange
experience
Performance
Instructors
Assessment
Gather self-assessment on CILOs from students
Grade Online
Instructor
Teacher’s interactions
Wiki in Blackboard
Peers review &
comments
Wiki
Student’s ePortfolio
Student
Profile
Wiki
Summary
Self-Assessment
form
View students’ ePortfolios
in Google Sites
Blackboard Test
Showcase
Monthly
exchange
experience
Performance
Instructors
Assessment
Grade Offline
Gather self-assessment on CILOs from students
Instructor
Teacher’s interactions
The ePortfolio Template
The ePortfolio Template
http://sites.google.com/site/exchangeexperienceassessmenti/
Elements of Reflective ePortfolio
Metaphors to aid reflection
1. Use the mirror to prompt reflection about yourself
2. Go deeper and analyse the details of an event, task or
experience
3. What choices lie ahead?
4. Consider alternatives
5. Consider how you can best evidence your claims?
6. Look for connections and relationships
Cheung & Dean 2009
Examples of Student ePortfolio: Profile
Summary
Showcase (1)
Showcase (2)
Research Model: The Impact of Reflective ePortfolio on
Students’ Overseas Exchange Learning Experience
Outcomes
Satisfaction with the
Exchange
Experience
Engagement (Usage)
+
Individual
Engagement
Preparation for
Future Exchange
+
+
Collaborative
Engagement
Satisfaction with the
Reflective ePortfolio
+
+
Perceived
Achievement of
Learning
Actual
Achievement of
Learning
Independent Variable:
Reflective ePortfolio Engagement (Usage)
• Individual Engagement
– Actual usage of the Reflective ePortfolio on:
•
•
•
•
•
•
Constructing profile
Goals setting and planning
Identifying learning outcomes and requirements
Recording achievements and experiences
Selecting and use of evidences
Reflecting on learning experiences
• Collaborative Engagement
– Actual usage of the Reflective ePortfolio on:
• Receiving and Giving feedbacks
• Providing and Obtaining support
• Introduce friends Met in exchange studies
Outcomes
• Satisfaction with the Exchange Experience
– Overall satisfaction level of students on their last exchange experience
• Preparation for Future Exchange
– Perceptions of students on how Reflective ePortfolio could help them better
plan and prepare for future overseas exchange programme
• Satisfaction with the Reflective ePortfolio
– Overall satisfaction level of students on their use of the Reflective ePortfolio
throughout their exchange programme
• Perceived Achievement of Learning
– Perceptions of students on the achievement of their personal
goal/development and learning outcomes in the exchange programme
• Actual Achievement of Learning
– A performance indicator of students on the exchange assessment course. This
is the actual achievement of the intended learning outcome of the course.
Letter grade that students obtained from their course.
Operationalization
Outcomes
Satisfaction with the
Exchange
Experience
Engagement (Usage)
+
Individual
Engagement
Preparation for
Future Exchange
+
+
Collaborative
Engagement
Satisfaction with the
Reflective ePortfolio
+
+
Perceived
Achievement of
Learning
Actual
Achievement of
Learning
Questionnaire Items : Individual Engagement
Please determine the extend to which you agree with the following sentences
(1=strong disagree, 3=neutral , 5 = strongly agree)
I used the ePortfolio frequently to:
1. construct my own profile (Self-Identity)
2. develop my own values and beliefs (Self-Identity)
3. describe my goals and aspiration clearly (Goal setting & Planning)
4. plans to achieve goals (Goal setting & Planning)
5. document my achievements (Record of achievements)
6. update my achievements from time to time (Record of achievements)
7. select appropriate materials to be recorded (selection and use of evidence)
8. select appropriate materials to be demonstrated (selection and use of evidence)
9. reflect on how the exchange experience has affected my values and beliefs (Reflection)
10. observe the differences in behaviors, attitudes and cultures (Reflection)
11. Recognize the requirements and standards to the exchange program (Identified outcome &
requirements)
12. Aware of the course intended learning outcomes and expectations (identified outcomes
and requirements)
Questionnaire Items : Collaborative Engagement
Please determine the extend to which you agree with the following sentences
(1=strong disagree, 3=neutral , 5 = strongly agree)
I used the ePortfolio frequently to:
1. share my experiences with my classmates and/or teachers
2. provide feedbacks and comments on the experiences of my fellow
classmates
3. read feedbacks and comments made from my fellow classmates
4. build better relationship with my fellow classmates
5. Introduce new friends met in the exchange studies
Questionnaire Items : Outcomes
• Satisfaction with the Exchange Experience
1.
2.
3.
I enjoyed my exchange experience.
I was actively involved in my overseas/Mainland exchange programme.
My exchange experience was successful
• Preparation of Future Exchange
1.
2.
The ePortfolio helped me better prepare for the future exchange program.
The ePortfolio helped me better plan for the future exchange program.
• Satisfaction with the Reflective ePortfolio
1.
2.
3.
The ePortfolio’s content structure: Profile-Summary-Showcase-Qualifications (PSSQ),
was a good framework to structure my ePortfolio for the exchange program
The ePortfolio development experience added value to my exchange programme.
The ePortfolio helped me better prepared for the exchange programme.
• Perceived Achievement of Learning
1.
2.
3.
I achieved the intended learning outcomes of the exchange programme.
I achieved my own goals of the exchange programme.
I realized the importance of life-long learning during the exchange study.
Actual Achievement of Learning
• Individual Assignment (90%)
• Build up profile;
• Create a theme of the ePortfolio;
• Document the expectations and goals of the exchange;
the accomplishments and learning outcomes;
• Document the exchange experiences including at least
THREE actual work/incidents with evidences;
• Self assess and reflect the performance according to the
Course Intended Learning Outcomes (CILOs);
• Online Discussion (10%)
• give constructive comments to peers’ ePortfolios
Current Status
• Validation of Measurement Instrument
• Initial Results on the Achievement of
ePortfolio Workshop
Validation of Measurement Instrument
• Card Sorting (Moore & Benbasat, 1991)
• Pilot Testing
Construct (Predictor)
Alpha Construct (Outcome)
Individual Engagement
Satisfaction with the Exchange Experience
Collaborative Engagement
Preparation for Future Exchange
Alpha
Satisfaction with the Reflective ePortfolio
Perceived Achievement of Learning
Actual Achievement of Learning
NA
Achievement of ePortfolio Workshop
80%
72%
68%
70%
60%
48%
50%
Strongly Agree
40%
Agree
36%
Neutral
30%
Disagree
28%
Strongly Disagree
24%
20%
16%
10%
4%
4%
0%
0%
0%
0%
0%
0%
0%
At the end of this workshop, you are able
You are able to add selected
You are able to make reflections on your
to adopt templates to start creating your artifacts/evidence for showcasing your
learning and development in this
ePortfolio
learning achievements
exchange programme
Students’ Perception
80%
60%
56%
72%
70%
50%
60%
40%
50%
32%
Strongly Agree
Very useful
30%
Useful
40%
Agree
Neutral
Average
Poor
Disagree
30%
Strongly Disagree
No comment
20%
20%
20%
12%
10%
10%
0%
0%
0%
How useful do you expect a learning ePortfolio to be?
8%
0%
0%
0%
To what extent do you agree with the statement "using
ePortfolios prompts me to reflect on my learning goals and
course ILOs"?
Quality of the Workshop
60%
60%
52%
52%
52%
50%
50%
44%
44%
40%
40%
36%
Very useful
Strongly Agree
30%
Useful
30%
Agree
Average
Neutral
Disagree
Poor
20%
Very Poor
Strongly Disagree
20%
12%
10%
10%
4%
4%
0%
0%
0%
0%
0%
0%
0%
0%
The workshop activities have helped In this workshop, the speakers have
you master the essential skills for
presented information and
creating ePortfolios
responded to questions in an
informative, appropriate and
satisfactory manner
In general, how useful was this workshop for you?
Limitation: Technical problems encountered
Google China Incident
•
•
•
•
ePortfolio Workshop
2010
19 Jan
CityU VPN
CityU GApps
Paper Portfolio
Bb Wiki
Tried and discussed
different kind of solutions
10 Mar
Google
China Incident
11 – 16 Mar
Released the Bb Wiki
to students
16 Mar
Agreed to use
Blackboard Wiki
30 Mar
9 Apr, 30 Apr & 30May
ePortfolio submission
deadline
2011
Potential Implications for Educators
• From Student Externalization to Combination
• From Individual Peer-Reflective learning to
Peer-Reflective Based Experiential Learning
• From Local Support Network to Distributed
Support Network
• From Self-Monitoring Evaluative Learning to
Peer-Assisted and Supportive learning
Potential Implications for Instructors
• Changing Role from Assessor to Facilitator
• Enhance intimacy relationship between instructors
and students
• Closing the loop for continuous improvement of
course quality by providing better advice to students
going for exchange
• Provide timely feedback and meet urgent needs of
students through interactive feedback
• Assess achievement of learning goals and expected
learning progress
Potential Implications for Designers
• Facebook Approach
– Incorporating Facebook design approach in the
user interface to record the frequency of updates
• Show Status
– Show Status of feedbacks that have been given
and received by students
• Make Friends
– Allow sharing the ePortfolios with friends in the
exchange university
Comments and Suggestions