ERGA 2014: Scaffolding research skill development and assessment across the honours year
Said Al-Sarawi, School of EEE, The University of Adelaide
Enviorn.
reasonability
Sust. Design
& Develop.
Social &
cultural
Leader
manager
Science &
Engineering
Engineer
Competent
Communicate
Team player
Sys.
Approach
to Design
Ethical
Respon.
Function
effectively
Life-long
learning
Define,
formulate
and Sol.
Learning Skills
Flexible
Learning
Relevant
Assessment
Problem
Solving
Skills
Graduating
an
Engineer
Communication
Skills
Research
Skills
Staff
Commitment
Curriculum
Design
Technology
AQF
Skills for
Life-long
learning
Educational
Strategies
External
forces
Student
number
New breed of
Graduates
Why Research Skills
Explicit
Problem
Solving
skills
Good
Communication
skills
Explicit
list of
skills
Flexible
learning
Curriculum
Requirements
Flexible
teaching
Strong emphasis
on reasoning,
thinking &
knowledge
Autonomy
development
History of RSD in EEE
2006
• RSD Case Study - 1st Cohort Honours Project Supervision and
Assessment
2007
• RSD Case Study – 1st Cohort of Master Assessment
2009
• RSD School wide Honours capstone Assessment
2010
• Positive outcomes were identified
• Annual tweaking is required
• Good level of backing/support is needed
2012
• Initiated Program Level RSD
• Medical Science began mirroring EEE RSD Honour Assessment
2013
• Proposed 7 Majors with RSD embedded at program level
2014
• School Approved these Majors
2015
• Awaiting University approval
Example of RSD Rubric - Honours
Table 1: Final Year Project Assessment Matrix of final performance - Only the first two facets are shown. Also note that the
columns’ heading has been replaced grade.
Research Process
A. Students embark
on inquiry* and so
determine a need for
knowledge /
understanding (10%)
B. Students
find/generate
needed information /
data / ideas using
appropriate approach
/ method (20%)
Specific
Attribute
F
P
C
D
HD
Fails to satisfy
the minimum
requirements
Satisfies the
minimum
requirements
A very high
standard of work
which
demonstrates
originality and
insight
Outstanding or
exceptional work
in terms of
understanding,
interpretation and
presentation
Objectives
stated
Unclear or
inappropriate
Clear but lacks
focus
Demonstrates a
high level of
understanding
and presentation
and a degree of
originality and
insight
Clear and focused
Clear, focused and
innovative
Context of
project:
background and
relevant works
Technical
challenges
Not
described/surve
yed/ analysis
Minimally
described/surveye
d/ analysis
Satisfactorily
described/survey
ed. Some analysis
Informative, wellresearched &
analyzed
Vaguely
specified
Clearly identified
Clearly identified
and explained
Clearly identified,
explained in
context
References and
citations
Minimal use of
or
inappropriate
sources
Few appropriate
sources
Several
appropriate
sources
Numerous
appropriate
sources
Clear, focused,
innovative, open
inquiry
Comprehensive,
extensively researched &
analyzed
Clearly identified,
explained in
context and
justified
Numerous
appropriate and
wide range of
sources
Example of RSD Rubric - Masters
Some Responders’ feedback
How relevant are research skills in your current work?
“very relevant. My work involves a lot of research and
finding information from different …,”
“I think they're fairly relevant and they have a broad
spectrum to do with facets,”
“Quite relevant. I need it for being able to analyse …
the gap…”
RSD for Honours: Issues and Lessons
Significant investment in
effort for School staff
Transition arrangements must
be communicated to students
and staff members alike
New for many students
Especially “core” personnel e.g. course coordinators,
champion
Staff training on assessment principles would particularly be
useful
Increases quantity, and subsequently, the demand for
feedback
Interpretation issues for descriptions
Acceptance issues can arise
Among staff members: considered a waste of time
Inhomogeneous application across the course
Impact with regards to workload, supervision, feedback, … etc
Evaluation should be
integrated
Embedded throughout the year
Utilise RSD Community
Lots of resources and support exist, always worth
having a look.
Student interviews? Other reflections?