Link to presentation - Transforming Assessment

advertisement
Professional development for university
academics in a changing context
Geoffrey Crisp
HERDSA President
ALTC National Fellow
Life Impact The University of Adelaide
Adelaide Australia
Slide 2
Life Impact The University of Adelaide
Adelaide, Australia
Slide 3
Life Impact The University of Adelaide
University of Adelaide
Slide 4
Life Impact The University of Adelaide
Higher Education context
• David Gosling article in SEDA’s (Staff and Educational
Development Association) Educational Development
on Post Graduate Certificates in Higher Education
(PgCerts) become mandatory for many new university
academics in the UK
• UK particularly proactive in having policies requiring
completion of a PgCert for tenure
• Australian universities would have a mandatory
professional development requirement for new
academics but only a small number have made
completion of the PgCert a requirement for tenure
Slide 5
Life Impact The University of Adelaide
Higher Education context
• Australian universities usually provide free or
subsidised access to PgCerts to a limited number of
their own academics
• Mandatory professional development for new
academics, in the Netherlands, Norway, Sweden,
Japan and Sri Lanka; whereas other countries, such
as the USA, have been reluctant to move down this
path
• In the USA, more significant emphasis is placed on
the professional development of Graduate Teaching
Assistants (GTAs) rather than newly appointed
faculty
Slide 6
Life Impact The University of Adelaide
Higher Education context
• Move towards embedding mandatory professional
development for faculty probably more to do with
government regulatory requirements, rather than a
recognition of the inherent merits of PgCert programs
• Nature of PgCert programs can vary between
countries and between institutions
• In UK SEDA plays a key role in maintaining
standards around these programs through a formal
recognition process
• Professional Development Framework provides
recognition for the programs of UK universities
Slide 7
Life Impact The University of Adelaide
Higher Education context
• Move to mandating professional training in
educational practice through PgCerts is a recognition
that completing a PhD in a core discipline and
undertaking discipline-based research is not
necessarily the most appropriate training for teaching
• The issue of standards and the quality of teaching in
universities is a controversial topic
• How is teaching quality measured in universities and
what would an acceptable standard of educational
practice look like in each discipline?
Slide 8
Life Impact The University of Adelaide
Higher Education context
• In Australia, the Australian Learning and Teaching
Council (ALTC) has project to define academic
standards in the disciplines in preparation for the
work of the Tertiary Education Quality and Standards
Agency
• ALTC has already sponsored a major project on
Teaching Quality Indicators and the project proposed
a set of indicators for recognising and rewarding
quality teaching
Slide 9
Life Impact The University of Adelaide
Higher Education context
• Student feedback used as a proxy measure of
teaching quality
• Some institutions have reworded their policy on
student feedback to emphasise they measure
students’ perceptions or experiences rather than
evaluation
• What improves the student experience?
Slide 10
Life Impact The University of Adelaide
What type of pedagogical learning space?
Laurentius de Voltolina 14th century lecture
The Yorck Project: 10.000 Meisterwerke der Malerei. DVD-ROM, 2002. ISBN 3936122202
Slide 11
Life Impact The University of Adelaide
Learning spaces
Slide 12
Life Impact The University of Adelaide
Queen’s University, Kingston CA
Beamish-Munro Hall, Queen's University
Integrated Learning Centre
http://livebuilding.queensu.ca
Slide 13
Life Impact The University of Adelaide
Classroom techniques for feedback
Slide 14
Life Impact The University of Adelaide
http://www.tltgroup.org/Facilities/Activities-TOC.htm
• enable ready use of computing/connectivity
• enable learner or teacher to discover, import and display
information easily, including the ability for a student in a
large class to interact with the presentation
• enable participants to interact with each other
Slide 15
Life Impact The University of Adelaide
http://www.tltgroup.org/Facilities/Activities-TOC.htm
• enable teacher to record patterns in student thinking in
order to adjust instruction
• enable participants to review previous classroom
communication
• enable the use of outside experts
• enable students to use one another as learning
resources
Slide 16
Life Impact The University of Adelaide
Authentic learning and assessment
http://www.nasaimages.org/luna/servlet/detail/nasaNAS~9~9~58363~162207:
Slide 17
Life Impact The University of Adelaide
Peer Review of teaching
• Peer evaluation has become more popular, but
mostly for formative purposes
• The main issues still preventing use of summative
peer review include training for peer reviewers and
the workload issues for both reviewer and reviewed
http://www.adelaide.edu.au/clpd/peerreview
Slide 18
Life Impact The University of Adelaide
Peer review and promotion
Internal Peer Review
Interactions
with students
Scholarship
Educational
Practice
Curriculum
Design
Assessment
Leadership
Administration
Evaluation
Slide 19
Life Impact The University of Adelaide
Peer review and promotion
Interactions
with students
Scholarship
Educational
Practice
Curriculum
Design
Assessment
External Peer Review
Leadership
Administration
Evaluation
Slide 20
Life Impact The University of Adelaide
Peer observation form
Slide 21
21
Life Impact The University of Adelaide
Purpose of higher education institutions
• Williams and Filippakou (2010) have posited that mass
higher education has moved away from the historical
role of fostering the “symbolic capital associated with
elite membership” towards a more pluralistic view
where institutional missions are varied
• newer universities embraced the diversity
agenda from their inception
http://4.bp.blogspot.com/_hBiBaUg_1rA/SJTQE0ymK7I/AAAAAAAABxI/OIKhMiaaQ2E/s400/confusing_signs2.jpg
Slide 22
Life Impact The University of Adelaide
Purpose of higher education institutions
Academics have played both active and passive
parts in this evolutionary journey, depending on their
discipline and particular institutional history
http://media.economist.com/images/20050910/3705SU1.jpgTitle
Slide 23
Life Impact The University of Adelaide
Purpose of higher education institutions
• In UK recently the trend has been for more diversification
with the Russell Group of institutions dominating the Who’s
Who list
• one occupation group that significantly broadened its
educational base was politicians
– this will likely have a significant impact
on university priorities and student
recruitment practices over time as
political representatives from diverse
backgrounds begin to influence
government policy and funding for
higher education
http://blog.newsweek.com/blogs/current/archive/20
08/04/20/catfighting-from-on-high.aspx
Slide 24
Life Impact The University of Adelaide
Are conceptions about the purpose of universities
different in different countries?
• Cheung and Chan (2010) have used Hofstede’s cultural
dimensions to examine whether there were any quantitative
differences between geographic regions in their use of
education as a response to the demands of an increasingly
competitive global economy
• Power Distance Index (PDI, related to human inequality),
Individualism (IDV, relationship between the individual and
the collective), Masculinity (MAS) and the Uncertainty
Avoidance Index (UAI, level of tolerance for uncertainty,
ambiguity and unstructured situations within a society)
Slide 25
Life Impact The University of Adelaide
Hofstede correlations from Cheung and Chan (2010)
Table Hofstede correlations from Cheung and Chan (2010)
Country
University
education
score 04
Knowledge
transfer
score 04
University
education
score 08
Knowledge
transfer
score 08
PDI
IDV
MAS
UAI
Australia
7.61
6.08
6.83
5.78
36
90
61
51
Japan
3.73
4.99
4.18
5.01
54
46
95
92
Hong
Kong
5.49
5.49
5.96
5.96
68
65
57
29
New
Zealand
6.16
5
7.07
5.02
22
79
58
49
South
Africa
5.52
4.55
4.55
3.29
49
65
63
49
United
Kingdom
5.02
4.21
5.62
4.96
35
89
66
35
United
States
7.55
6.92
7.54
6.56
40
91
62
46
Slide 26
Life Impact The University of Adelaide
Are conceptions about the purpose of universities
different in different countries?
• Cheung and Chan (2010) concluded that dimensions such
as university education and knowledge transfer could be
significantly explained by a combination of Hofstede’s PDI
and UAI dimensions
• Power Distance Index (PDI, related to human inequality)
• Avoidance Index (UAI, level of tolerance for uncertainty
ambiguity and unstructured situations within a society)
Slide 27
Life Impact The University of Adelaide
Are conceptions about the purpose of universities
different in different countries?
• there was an overall negative relationship between PDI and
university education and knowledge transfer in relation to
impact on national competitiveness
• regions where there was less inequality and more tolerance
for ambiguity (as defined by Hofstede) had higher impact
factors for university education and
knowledge transfer in relation to national
competiveness
http://ddeubel.edublogs.org/2008/12/10/top-5-warning-signs-the-teacher-isnt-yeta-teacher/
Slide 28
Life Impact The University of Adelaide
Academic practice
• in Australia, the recent Bradley review of higher
education indicated that universities should be
engaging in activities that promote a “civil and just
society”
• proposed that increasing the overall participation rate
in higher education would be in the public good, as
well as assisting in economic development
Slide 29
Life Impact The University of Adelaide
Academic practice
• individual faculty have little control over who is
allowed to come to their university
• individual faculty can have a profound effect on the
success rate of students once they are enrolled in
universities
• issue for faculty development programs is how
will it assist faculty to achieve
productive outcomes for
students when participation is
on a wider scale?
Slide 30
Life Impact The University of Adelaide
Role for Faculty development?
• should academic practice, as reified in the discipline
context, be aligned with national agendas and
priorities?
• do the scholarly activities we undertake as faculty
members reflect the role of universities being for the
public good or do they reflect a privileging of that role
being for the enhancement of the individual?
Slide 31
Life Impact The University of Adelaide
Professional Organisations in Australia
• Higher Education Research and Development Society of
Australasia (HERDSA)
http://www.herdsa.org.au/
• Council of Australian Directors of Academic Development
(CADAD)
http://www.cadad.edu.au/
• Australasian Council on Open, Distance and E-Learning
(ACODE)
http://www.acode.edu.au/
• Australian Learning and Teaching Council (ALTC)
http://www.altc.edu.au/
Slide 32
Life Impact The University of Adelaide
Role for HERDSA
• HERDSA is a scholarly society for people committed
to the advancement of higher and tertiary education. It
promotes the development of higher education policy,
practice and the study of teaching and learning.
Slide 33
Life Impact The University of Adelaide
Benchmarking Faculty Development Centres
•
•
•
•
•
•
Slide 34
CADAD project – adopted for University of Adelaide
Engagement with our Centre Staff
Modifying for local context
Self-audit
External partners
Practical purposes
34
Life Impact The University of Adelaide
Engagement with our Centre Staff
• Preliminary meeting to discuss why we should be
involved
• Half-day workshop session to discuss concerns and
come to common understanding
• Centre areas start filling in their sections
• Documenting concerns, confusions
• Change document in response to feedback
• Another half-day workshop session to finalise
document
• Centre areas complete their sections
16/03/2016
Slide
35
35
Life Impact The University of Adelaide
KEY PERFORMANCE INDICATORS FOR ACADEMIC DEVELOPMENT UNITS
UNIVERSITY OF ADELAIDE CLPD VERSION 2007-2009
INTRODUCTION
Domains
Sub-domains
1. Strategy, Policy 1.1 Strategic Advice
and Governance
1.2 Strategic Planning
1.3 Governance
1.4 Policy Development and
Implementation
1.5 Strategic Initiatives
2. Quality of
Learning and
Teaching
3.
2.1 Standards
KPIs
Page
Advice to senior staff about the operating
6
environment for learning and teaching
Advice and support for development of the
8
learning and teaching elements of strategic plans
Contributions to institutional governance
9
Advice and support for development and
10
implementation of policy, procedures, guidelines
and systems related to learning and teaching
(compliance issues)
Contributions to institutional learning and teaching
11
initiatives (other than external funding and
publications)
Advice and support for maintaining and improving
12
learning and teaching standards
Advice and support for evaluation and
13
improvement of learning and teaching
2.2 Evaluation and Improvement
(Facilitating the collection of data about
effectiveness of learning and teaching)
2.3 Student Feedback (How feedback was Advice and support for student feedback on
used to improve learning and teaching)
teaching and courses (CLPD assisting Schools in
using feedback data)
2.4 Peer Review
Advice and support for peer review of teaching
2.5 Curriculum Review
Advice and support for review of courses
Scholarship of 3.1 Grants and Awards
Advice and support for development of internal
Teaching and
and external grant and award applications
Learning
(assisting others to gain grants and awards)
3.2 Significant Projects and Research into Advice and support for significant projects and
Learning and Teaching
research into learning and teaching with Faculty
staff (external and internal grants)
16/03/2016
Slide
36
14
15
16
17
18
36
Life Impact The University of Adelaide
KEY PERFORMANCE INDICATORS FOR ACADEMIC DEVELOPMENT UNITS
UNIVERSITY OF ADELAIDE CLPD VERSION 2007-2009
INTRODUCTION
Domains
1. Strategy,
Policy and
Governance
16/03/2016
Slide
37
Sub-domains
KPIs
Page
1.1 Strategic Advice
Advice to senior staff about the operating
environment for learning and teaching
6
1.2 Strategic Planning
Advice and support for development of
the learning and teaching elements of
strategic plans
8
1.3 Governance
Contributions to institutional governance
9
1.4 Policy Development and Advice and support for development and
Implementation
implementation of policy, procedures,
guidelines and systems related to
learning and teaching (compliance
issues)
10
1.5 Strategic Initiatives
11
Contributions to institutional learning and
teaching initiatives (other than external
funding and publications)
Life Impact The University of Adelaide
37
Self-audit
• Good opportunity for internal review of practices
• Identify gaps in services or engagement
Slide 38
38
Life Impact The University of Adelaide
DOMAINS, SUB-DOMAINS, KEY PERFORMANCE INDICATORS AND BENCHMARKS FOR CLPD UNIVERSITY
OF ADELAIDE FOR PERIOD 2007-2009
DOMAIN 1: STRATEGY, POLICY AND GOVERNANCE
Sub-domain 1.1: Strategic Advice
KPI: Advice to senior staff about the operating environment for learning and teaching
Measure
Level of
provision
Quality of
provision
Benchmark
Benchmar
(Sector expectation)
k Met
a.
Provision of current, timely advice on:
a.
interpretation of government policies,
funding, initiatives, practices and
b.
interpretations across the sector
(external)
b.
Provision of current, timely advice on
c.
learning and teaching strategy at
institutional, faculty and school levels
(internal)
c.
Timely provision and/or review of draft
submissions to government (external)
60% of senior staff satisfied or very
% broad a.
satisfied with quality of provision
agreement
b.
c.
Target or KPI
Target or
(University expectation)
KPI Met
Advice provided to DVC(A), PVC(L&Q) a.
[CLPD 2]
b.
Advice provided to DVC(A), PVC(L&Q), c.
Executive Deans, Heads of School
[CLPD 2]
Advice provided to DVC(A), PVC(L&Q)
[CLPD 2]
100% of senior staff satisfied or very
satisfied with quality of provision
70% of surveyed staff satisfied or very
satisfied with quality of provision
100% of senior staff satisfied or very
satisfied with quality of provision
% broad
agreement
Evidence
a.Director attended and reported on meetings for: Bologna process and Diploma Supplement; Australian Graduation Statement;
formation of Carrick Institute and Learning and Teaching Performance Fund, Review of Australian Higher Education (Bradley
Review), formation of CADAD, South Australian Certificate of Education, Australasian Survey of Student Engagement (AUSSE),
UniTEST.
b.CLPD Annual Report lists Centre staff as members of the following Committees
(http://www.adelaide.edu.au/clpd/about/download/CLPD_AnRpt08.pdf):
Within University of Adelaide - Academic Board, Assessment Monitoring Committee, Assessment Policy Development Committee,
Associate Deans Learning and Teaching Committee, AUQA Steering Committee, Committee for Learning and Teaching Awards,
Consultant to SSABSA, Copyright Steering Committee, Copyright Working Party, DVC&VP(A) Health, Safety and Wellbeing
Committee, E-Assessment Guidelines Working Party, Early Career Task Force (ECTF), Faculty of Engineering, Computer &
Mathematical, Sciences Learning, Teaching & Curriculum Committee, Faculty of Professions Learning and Teaching Committee,
Future Research Leaders Working Party, Gender Equity & Diversity Committee, Grading Working Party, Health, Safety and
Welfare Committee – Central, Faculty of Humanities & Social Sciences Education Committee, Internationalisation Committee,
Mathematics Learning Service Advisory Group, Open Day Committee, Organisational and Staff Development Committee (OSDC),
Pre-enrolment English Program Advisory Committee, Staff Survey Oversight Working Party, Student Affairs Committee, Survey
Framework Working Party, Teaching Tools Committee, Technology in Education Committee (TEC), University Learning and
LifeUniversity
Impact Postgraduate
The University
of Adelaide
Slide 39
Teaching
Committee (ULTC), ULTC Working Party on Learning and Teaching Themes,
Coursework
Committee
DOMAINS, SUB-DOMAINS, KEY PERFORMANCE INDICATORS AND BENCHMARKS FOR CLPD UNIVERSITY
OF ADELAIDE FOR PERIOD 2007-2009
DOMAIN 1: STRATEGY, POLICY AND GOVERNANCE
Sub-domain 1.1: Strategic Advice
KPI: Advice to senior staff about the operating environment for learning and teaching
Measur
Benchmark
Benchmar
Target or KPI
Target or
e
(Sector expectation)
k Met
(University expectation)
KPI Met
Level of a. Provision of current, timely
a. Advice provided to
a.
provisio
advice on: interpretation of
DVC(A), PVC(L&Q) [CLPD b.
n
government policies, funding,
2]
c.
initiatives, practices and
b. Advice provided to
interpretations across the
DVC(A), PVC(L&Q),
sector (external)
Executive Deans, Heads of
b. Provision of current, timely
School [CLPD 2]
advice on learning and
teaching strategy at
institutional, faculty and
school levels (internal)
Quality 60% of senior staff satisfied or
of
very satisfied with quality of
provisio provision
n
% broad a. 100% of senior staff
agreement
satisfied or very satisfied
with quality of provision
b. 70% of surveyed staff
satisfied or very satisfied
with quality of provision
% broad
agreement
Evidence
a.Director attended and reported on meetings for: Bologna process and Diploma Supplement;
Australian Graduation Statement; formation of Carrick Institute and Learning and Teaching
Performance Fund, Review of Australian Higher Education (Bradley Review), formation of CADAD,
South Australian Certificate of Education, Australasian Survey of Student Engagement (AUSSE),
UniTEST.
Life Impact The University of Adelaide
Slide 40
Practical purposes
• Your own staff need to see a point in the activity
• It should lead to internal improvements
Slide 41
41
Life Impact The University of Adelaide
どうも有難う御座いました
Slide 42
Life Impact The University of Adelaide
Download