CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
Sustaining Educational Change with Quality Assurance
March 26-28, 2013
SINGAPORE
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
What is Quality?
Who should it be done for?
What can be done?...
The product is the best combination
of price and features
What should be done?...
The product has something
that other similar products do
not have that add value
Meets customer/learners satisfaction
What is
Quality?
How should
it be done?...
Conforming to design,
specifications, or
requirements.
Having no defects
Quality: A self-sustaining relationship between management, staff
and students that leads to all students realising their potential.
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
What is
Quality Assurance?
- A process which stipulates how a production (service)
should take place and to what standards
- A process which guarantees customers that a product
(service) will meet standards consistently (Roger Ellis)
- Prevention of problems through planned and systematic
activities (John S. Oakland)
- Doing the right things right
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
Polytechnic Quality Assurance Framework (PQAF)
Purpose:
• Consistent quality in the education
and training offered by SP
• Continuous self-learning and quality
enhancement and development
within the polytechnics and across
the polytechnic sector
• Graduates that we produce stay
relevant to the needs of industry
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
Areas of Focus for Quality Assurance
1: Governance & Leadership
2: Strategic Planning
3: Management and Administration
4: Academic Quality Assurance
5: Continual Improvement
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
AREA OF FOCUS 1:
GOVERNANCE & LEADERSHIP
Establish the framework for
the leadership system and its
commitment to achieve its
vision and how to meet its
mission
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
AREA OF FOCUS 2:
STRATEGIC PLANNING
Develop and set long-term and
short-term plan to provide valueadd educational services to all
stakeholders
Monitor, measure and evaluate
Key Performance Indicators with
targets
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
AREA OF FOCUS 3:
MANAGEMENT & ADMINISTRATION
Establish a framework
to manage operation
and resources
effectively and
efficiently to meet its
vision and mission
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
AREA OF FOCUS 4:
ACADEMIC QUALITY ASSURANCE
Set up processes to
ensure that courses
offered are of high
quality to meet the
needs and expectation
of students and industry
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
AREA OF FOCUS 5:
CONTINUAL IMPROVEMENT
Establish framework to initiate continual
improvement to its policies, processes and
procedures for good governance.
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
Academic Quality Management System (AQMS)
Course Identification
Design & Development
Curriculum
Delivery
System
Course
Delivery
Key
Processes
Assessment
System
Student
Assessment
Staff Development Plan (PDS)
OUTCOME:
Student Performance
Curriculum
Development
System
OUTCOME:
Student Learning
Need
Analysis
OUTCOME:
Curriculum
AQMS
Evaluation
System
Course
Evaluation
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
Academic Quality
Design and Development
1. Develop design and development process
for all courses
2. Develop procedures to address all aspects
of the design and development process
3. Approving process for the outcomes and
recommendations of all course including
refinement made to the review process
4. Regularly reviews the design and
development process for continual
improvement
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
Academic Quality
Course Delivery
1. Develop a course delivery process to ensure that
delivery is based on approved learning outcomes
2. Develop a monitoring process to
ensure that all courses are
delivered to its intended learning
outcomes
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
Academic Quality
Student Assessment
1. Develop an course assessment process to ensure
that the assessment principles, processes, methods
and practice are aligned with the learning outcomes
and contents
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
Academic Quality
Course Evaluation
1. Develop a review process to
review the curriculum for all
courses
2. Develop a procedure to involve
industry, professional and
academic experts and staff
during the curriculum review.
3. Regularly reviews the course
review process for continual
improvement
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
Provision of quality education: Interaction between 3 elements of
educational program design, quality assurance and program accreditation
ENGINEERING
PROGRAM DESIGN
QUALITY
EDUCATION
QUALITY
ASSURANCE
PROGRAM
ACCREDITATION
Adapted from Hanrahan, H., “Towards Consensus Global
Standards for Quality Assurance of Engineering Programmes”, in
Engineering Education Quality Assurance: A Global Perspective,
Patil A.S. and Gray, P.J. (Eds.), Springer, 2009.
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
SOURCE:
The CDIO Syllabus v2.0. An Updated Statement of Goals for Engineering Education, Proceedings of the
7th International CDIO Conference, Technical University of Denmark, Copenhagen, June 20 – 23, 2011
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
Engineering Accreditation Board
Accreditation Manual (April 2008)
The programme should ensure that graduates are able to:
a)
b)
c)
d)
e)
f)
g)
h)
i)
j)
apply knowledge of mathematics, science and engineering;
design and conduct experiments, analyse, interpret data and synthesise valid conclusions;
design a system, component, or process, and synthesise solutions to achieve desired needs;
identify, formulate, research through relevant literature review, and solve engineering problems
reaching substantiated conclusions;
use the techniques, skills, and modern engineering tools necessary for engineering practice
with appropriate considerations for public health and safety, cultural, societal, and
environmental constraints;
communicate effectively;
recognize the need for, and have the ability to engage in life-long learning;
understand the impact of engineering solutions in a societal context and to be able to respond
effectively to the needs for sustainable development;
function effectively within multi-disciplinary teams and understand the fundamental precepts of
effective project management;
understand professional, ethical and moral responsibility.
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
Mapping of
CDIO Standards
into SP Quality
Management
System
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
Academic Quality Management System (AQMS)
Course Identification
Design & Development
Curriculum
Delivery
System
Course
Delivery
Key
Processes
Assessment
System
Student
Assessment
Staff Development Plan (PDS)
OUTCOME:
Student Performance
Curriculum
Development
System
OUTCOME:
Student Learning
Need
Analysis
OUTCOME:
Curriculum
AQMS
Evaluation
System
Course
Evaluation
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
Institutional Mission
Program Goals
(Std 1)
Faculty
Development
(Std 9, Std 10)
Program
Objectives
and
Outcomes
(Std 2)
Learning
Assessment
(Std 11)
Program
Evaluation
(Std 12)
Learning
Environment
(Std 6)
Curriculum
(Std 3, Std 4)
Teaching and
Learning
(Std 5, Std 7, Std 8)
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
The 12 CDIO Standards
1.
CDIO as Context
Adoption of the principle that product and system lifecycle development and deployment are the context
for engineering education
2.
CDIO Syllabus Outcomes
Specific, detailed learning outcomes for personal, interpersonal, and product and system building skills,
consistent with program goals and validated by program stakeholders
3.
Integrated Curriculum
A curriculum designed with mutually supporting disciplinary subjects, with an explicit plan to integrate
personal, interpersonal, and product and system building skills
4.
Introduction to Engineering
An introductory course that provides the framework for engineering practice in product and system
building, and introduces essential personal and interpersonal skills
5.
Design-Implement Experiences
A curriculum that includes two or more design-implement experiences, including one at a basic level and
one at an advanced level
6.
Engineering Workspaces
Workspaces and laboratories that support and encourage hands-on learning of product and system
building, disciplinary knowledge, and social learning
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
The 12 CDIO Standards – cont’d
7.
Integrated Learning Experiences
Integrated learning experiences that lead to the acquisition of disciplinary knowledge, as well as
personal, interpersonal, and product and system building skills
8.
Active Learning
Teaching and learning based on active experiential learning methods
9.
Enhancement of Faculty CDIO Skills
Actions that enhance faculty competence in personal, interpersonal, and product and system building
skills
10.
Enhancement of Faculty Teaching Skills
Actions that enhance faculty competence in providing integrated learning experiences, in using active
experiential learning methods, and in assessing student learning
11.
CDIO Skills Assessment
Assessment of student learning in personal, interpersonal, and product and system building skills, as
well as in disciplinary knowledge
12.
CDIO Program Evaluation
A system that evaluates programs against these 12 standards, and provides feedback to students,
faculty, and other stakeholders for the purposes of continuous improvement
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
Both AQMS and
CDIO are based
on the same
PDCA cycle of
quality assurance
 10 of the 12
CDIO Standards
can be mapped
directly to the
requirements of
the AQMS
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
People Developer Standard (PDS)
The PDS is a mark conferred by a government agency
in Singapore, which, through a certification process,
gives recognition to organizations that invest in their
people and have a comprehensive system to manage
effective professional development
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
SP Framework & Description
Need Analysis
Curriculum Development
System
1
CDIO as Context
2
CDIO Syllabus Outcomes
3
Integrated Curriculum
4
Introduction to Engineering
5
Design-Implement Experiences
6
CDIO Workspaces
8
Active Learning
Outcome: Student Learning
7
Integrated Learning Experiences
Assessment System
Outcome: Student
Performance
11
CDIO Skills Assessment
Evaluation System
12
CDIO Program Evaluation
9
Enhancement of Faculty CDIO Skills
10
Enhancement of Faculty Teaching Competence
Outcome: Curriculum
AQMS
PDS
CDIO Standards
Curriculum Delivery System
Capability Building
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
PDS: SP Learning and Development Framework
Corporate
Goals &
Objectives
CLS
SMT
Cluster / School
Plans, Scorecard
Cat ‘A’
Diploma Action
Plans
Utilization of
Feedback
from Review
Reviewed and
Approved by
Management
Learning
Initiatives
Cat ‘B’
Staff &
RO
Learning Effectiveness Review
Evaluation
Implementation
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
Re-designed DCHE
Curriculum using CDIO
Mathematics
& Sciences
Advanced
Modules
CDIO SKILLS
INTEGRATED PROCESS + PRODUCT
DESIGN
CONCEIV
DESIGN
IMPLEMENT
OPERATE
E
Chemical
Engineering
Core Modules
Free
Electives
Sustainability
-focused
Innovative
Chemical
Products
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
Review
existing
coverage of
CDIO Skills
Design
Activities &
Assessment
CDIO
Skill
Revise
and redesign
“The world moves, and ideas that were good once are not always good.”
Review
Feedback
Reflection
Changes, New
Developments
– Dwight Eisenhower
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
Nov: CDIO
Conference
Apr: New
DCHE CDIO
Curriculum
2006
Feb: SP@60
2009-2014
2008
Gap Analysis 1
2011
2009
2010
2007
Feb:
Adopt
CDIO
Nov: SP 3.0
Beyond 2014
Apr: Revised
DCHE CDIO
Sequential
Curriculum
2013
2012
Self-Evaluation 1
May: IChemE
Re-accreditation
(Old Criteria)
Gap Analysis 2
Self-Evaluation 2
Mar: IChemE Reaccreditation
(Outcome-based)
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
Outcome of CDIO SelfEvaluation (Round 2)
Educational Initiatives
DCHE
CURRICULU
M
QUALITY
EDUCATIO
N
AQMS /
ISO9001:2008
(CDIO Standards)
QUALITY
ASSURANC
E
(The DCHE CDIO Way)
Holistic
Education
GRADUATE
ATTRIBUTE
S
UK IChemE
Accreditation
(CDIO Syllabus)
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
CDIO
Self-Evaluation
in
Chemical
Engineering
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
CDIO Self-Evaluation Criteria used in 2012
5
Evidence related to the standard is regularly reviewed and used to make
improvements
4
There is documented evidence of the full implementation and impact of
the standard across program components and constituents
3
Implementation of the plan to address the standard is underway across
the program components and constituents
2
There is a plan in place to address the standard
1
There is an awareness of need to adopt the standard and a process is in
place to address it
0
There is no documented plan or activity related to the standard
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
Rubrics for each
of 12 Standards
Source:
Examples of Evidence of
Compliance with the CDIO
Standards v 2.0
(8 December 2010)
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
CDIO
Outcome of Self-Evaluation
Rating
Proposed Action Plan
Standard
2008
2012
1
3
5
Regularly communicate the “CDIO-way” of teaching and learning to all
stakeholders, especially students
2
3
4
Continue with “cluster review” of related modules, continue to refine all
written syllabi to ensure clarity of learning outcome
3
3
4
Review sequential model Course Structure for more effective integration,
as well as knowledge and skill transfer
To introduce more problem-based learning (PBL) into selected core
module(s), multi-disciplinary assignments; and review activities to
promote transfer of skills across modules and year of study
4
3
4
Continue to monitor understanding of chemical engineering and interest
in the field among new cohort of Year 1 students
4
Tweak existing activities, especially at basic-level to continue to pique
student interests in the field; review advanced-level assessment scheme
to integrate design thinking, ethics, SD, etc
3
Continue to seek management support for new workspace – this is
perhaps the most challenging part of the continuous improvement process
yet; review and rationalize existing space
5
6
3
3
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
CDIO
Standard
Outcome of Self-Evaluation
Rating
2008
2012
7
3
4
8
3
4
9
3
4
10
3
4
Proposed Action Plan
Review if possible to use same case study/scenario for different
modules, and built on prior learning in earlier modules
Enhance learning experience via out-of-classroom activities during
education of sustainable development using “appropriate technology”
To expand into tutorials with more discussion, role play or
presentation; and lectures for example by using Concept Questions,
or Think-Pair-Share, etc
Conduct training needs analysis; identify training opportunities for
lecturers to undergo training related to teaching and assessing new
skills, e.g. reflective practice, lifelong learning, ethics, etc
11
2
3
Explore use of suitable survey instruments to assess some of the
identified new skills, e.g. how to handle ambiguity
Explore how to assess transferability of knowledge and skills across
modules and year of study
12
2
3
Fine-tune the integration of CDIO Self-evaluation process into the
AQMS-PDS Framework as part of continuous improvement
Corporate & School
Scorecard, DCHE
Work Plan
Environmental Scan
SWOT Analysis
Stakeholder Input
and Feedback
DCHE Course Management Team (CMT)
INITIATIVES
REVAMP
FEEDBACK
REVIEW
Core Module 2
Core Module 1
CLUSTER OF
MODULES
REVIEW
Core Module 3
MODULE
REVIEW
Knowledge and Skills Need
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
(One-Off)
CONTINUOUS IMPROVEMENT
CT Course
Briefing:
Course
Management
HE, CDIO, DT
(CM, AM)
Briefing on
Module(s)
(MC, AM)
“Standard”
Workshops
HE , CDIO
Other Training
Courses,
Workshops
CT-AR
TEACHING
Module
Review
Module Development
Formulate
Action
Plan(s)
Execute
Action
Plan(s)
Additional
Training
(if necessary)
Skill Map and Training Records
Source:
SUSTAINING CDIO CAPABILITY – PROFESSIONAL DEVELOPMENT FOR ENGINEERING FACULTY, Sin-Moh Cheah
& Mark Nivan Singh, Proceedings of the 7th International CDIO Conference 2011; June 20-23, Copenhagen, Denmark
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
Continual Improvement
Action Plans – proposed
or completed captured in
e-Module Review
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
CDIO and
IChemE
Accreditation
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
IChemE UK Accreditation Guidance Revision: (Mar 08)
“Decisions on whether a programme is accredited, and at what
level, will be taken solely on the basis of achievement of learning
outcomes against defined standards.”
“The learning outcomes specified in this Guidance comprise a
package which is distinctive to chemical engineering, and which
can be regarded as a minimum necessary requirement for
IChemE accreditation.”
Six Focus Areas:
(1) Maths & Science, (2) Core Chemical Engineering, (3) Engineering Practice,
(4) Design & Design Practice, (5) Embedded Learning (Sustainability & SHE),
(6) Embedded Learning (General Transferable Skills)
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
General Transferable Skills (IChemE, UK)
General Learning Outcomes:
Students graduating from an accredited
programme in chemical engineering …
must have developed and demonstrate
ability to integrate transferable skills
(such as communications, time
management, team working, interpersonal, effective use of IT including
information retrieval skills) that will be
of value in a wide range of situations
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
IChemE Learning Outcomes
A
Underpinning mathematics and science
Of sufficient depth and breadth to underpin their chemical engineering education, to enable appreciation of its scientific and engineering context,
and to support their understanding of future developments
Core chemical engineering (including core process safety)
Handle advanced problems in fluids and solids formation and processing
Apply chemical engineering methods to the analysis of complex systems within a structured approach to safety, health and sustainability
B
Engineering practice
C
Design and design practice
D
Essential embedded learning: sustainability, ethics, SHE
E
Essential embedded learning: transferable skills
Understand the ways in which chemical engineering knowledge can be applied in practice, for example in: operations and management; projects;
providing services or consultancy; developing new technology.
Define a problem and identify constraints
Design solutions according to customer and user needs
Use creativity and innovation in a practical context
Ensure fitness for purpose (including operation, maintenance, reliability etc)
Adapt designs to meet their new purposes or applications
Acquire the knowledge and ability to handle broader implications of work as a chemical engineer. These include sustainability aspects; safety,
health, environmental and other professional issues including ethics; commercial and economic considerations etc
Develop general skills that will be of value in a wide range of business situations. These include development of abilities within problem solving,
communication, effective working with others, effective use of IT, persuasive report writing, information retrieval, presentational skills, project
planning, self learning, performance improvement, awareness of the benefits of continuing professional development etc.
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
SP-CDIO Syllabus
Part 1 Technical
Knowledge & Reasoning
Part 2 Personal and
Professional Skills and
Attributes
Part 3 Interpersonal
Skills: Teamwork and
Communication
Part 4
Conceiving, Designing,
Implementing and
Operating Systems in the
Enterprise and Societal
Context
Topic in CDIO Syllabus
IChemE LO
1.1
Knowledge of Underlying Sciences
1.2
Core Engineering Fundamental Knowledge
1.3
Advanced Engineering Fundamental Knowledge
2.1
Engineering Reasoning and Problem Solving
E
2.2
Experimentation and Knowledge Discovery
E
2.3
Systems Thinking
C
2.4
Personal Skills and Attitudes
C, E
2.5
Professional Skills and Attitudes
D, E
3.1
Teamwork
C, E
3.2
Communication
C, E
4.1
External and Societal Context
C, D
4.2
Enterprise and Business Context
4.3
Conceiving and Engineering Systems
4.4
Designing
4.5
Implementing
B, D
4.6
Operating
B, D
A
B
B, C, D, E
C
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
Use CDIO Standards to drive continual improvement,
identify areas of improvement and skill gap, formulate
action plans, track progress, evaluate results
Use CDIO Syllabus to achieve desired graduate attributes
(Holistic Education, Accreditation, etc)
WORK DONE: Capture in e-Module Review as per
existing practice according to our AQMS
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
The Last Word …. Critical Success Factor
Building Faculty
Capability: CDIO
Standards 9, 10
Pedagogy
Teaching,
Learning Unit
(T&L)
Capability
Curriculum
Training
Needs Analysis
Source:
SUSTAINING CDIO CAPABILITY – PROFESSIONAL DEVELOPMENT FOR ENGINEERING FACULTY, Sin-Moh Cheah
& Mark Nivan Singh, Proceedings of the 7th International CDIO Conference 2011; June 20-23, Copenhagen, Denmark
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders
THANK YOU
ENQUIRY: smheah@sp.edu.sg