School Of Architecture
And The
Built Environment
Civil Engineering Division
5th International CDIO Conference
Assessment of Student CDIO Skills
by
Ng Geok Ling
8 June 2009
Content
• The challenge
• Quick Overview of CDIO Implementation in CE division
• Process of integrating CDIO syllabus into module syllabus
–
–
–
–
Stage 1 : Define and Identify CDIO skills
Stage 2 : Integrate CDIO Skills into Curriculum
Stage 3 : Develop Assessment Rubrics
Stage 4 : Curriculum Evaluation
• Conclusion
• Q&A
School Of ABE
Civil Engineering Division
The Challenge
• 2 years ago
• Implemented but not clearly documented
• To reflect the integration of CDIO skills
into the existing module syllabus
• To develop an outcome assessment to
assess CDIO skills
School Of ABE
Civil Engineering Division
CDIO Implementation in CE
Stage 1:
Define and
Identify CDIO
skills
Stage 2:
Integrate
CDIO Skills
into
Curriculum
Stage 3:
Develop
Assessment
Rubrics
Stage 4:
Curriculum
Evaluation
Improvement
to teaching
and learning
and
curriculum
School Of ABE
Civil Engineering Division
Stage 1: Define and Identify CDIO skills
Proficiency Levels (1 to 5)
Survey on Proficiency Levels of 13 CDIO skills
in acad year 07-08
5.0
4.0
3.0
2.0
1.0
0.0
CDIO Skills 2.1
2.3
Civil Staff AVE [23 attempts]
2.3
2.4
2.5
3.1
3.2
4.1
4.2
4.3
4.4
4.5
4.6
2.0
2.4
3.5
3.1
3.5
3.3
2.6
2.4
2.3
2.6
2.7
3.0
4.0
3.3
2.8
3.4
3.0
3.3
3.6
2.0
1.8
3.1
3.4
2.3
2.2
Alumni - (01 to 05) [36 attempts] 3.0
2.7
3.4
3.5
3.3
3.7
3.5
2.8
3.0
3.2
2.9
2.8
3.3
2.8
2.8
2.8
3.6
3.5
3.7
3.5
2.8
2.6
2.6
2.8
2.9
3.1
MIT Faculty AVE
Industry 2008 [32 attempts]
•
•
•
•
2.2
Obtained expected PL from the industry
Students are technologist not engineer
Therefore, higher expectation in implementation and operation
Expected skills needed in a module to be entered into ITU table
School Of ABE
Civil Engineering Division
ITU table
• I – Introduce but not assess
• T – teach and assess
• U – Utilise, may or may not be assess
• Overall picture of CDIO skills for the course can be seen
School Of ABE
Civil Engineering Division
CDIO Implementation in CE
Stage 1:
Define and
Identify CDIO
skills
Stage 2:
Integrate
CDIO Skills
into
Curriculum
Stage 3:
Develop
Assessment
Rubrics
Stage 4:
Curriculum
Evaluation
Improvement
to teaching
and learning
and
curriculum
School Of ABE
Civil Engineering Division
Stage 2: Integrate CDIO Skills into
Curriculum
• Example : BE750Y CAD Studio
• 1st year module in DCEM
• Supporting module to BE751Y BTM with
capstone project and Intro to Civil Engineering
School Of ABE
Civil Engineering Division
Step 1- Means of Assessment
• Refer to your means of assessment as written in the
module syllabus
School Of ABE
Civil Engineering Division
Step 2 – Assessment Component
Breakdown
• Breakdown the individual assessment
component (as in SAS format) appropriately
according to your module needs
School Of ABE
Civil Engineering Division
Step 3 – KSA Weightage Breakdown
•
•
•
•
Formulate a table with the CDIO skills you have selected (refer to ITU table)
and the assessment components
CA and LAB assessment weightage spread across each CDIO skill (1 to 4)
Minimum weightage for each skill to be 5%
All Tests (TST1,2&3) which are formative assessment are only assigned to
technical skills
School Of ABE
Civil Engineering Division
Revised Table of Specification
Current
Bloom
CDIO skill 2 & 3
School Of ABE
Civil Engineering Division
Step 4 – Table of Specification in
Module syllabus
KSA Weightage Table
• Transfer the
total weightage
in each row
from KSA
weightage table
Table of Specification
School Of ABE
Civil Engineering Division
CDIO Implementation in CE
Stage 1:
Define and
Identify CDIO
skills
Stage 2:
Integrate
CDIO Skills
into
Curriculum
Stage 3:
Develop
Assessment
Rubrics
Stage 4:
Curriculum
Evaluation
Improvement
to teaching
and learning
and
curriculum
School Of ABE
Civil Engineering Division
Stage 3 – Develop Assessment Rubric
•
Assessment criteria for technical
content
–
up to module team to define
according to the module learning
outcome
100/25% x 10%
= 40 marks
School Of ABE
Civil Engineering Division
Assessment Template – CA1
Marks auto-calculate = ( 25 / 5 ) x 1 = 5
Scale of 5
• Student is graded as:
1-poor, 2-Fair, 3-Good, 4-Very Good and 5-Excellent
• in the column under skill
• Lecturers refer to criteria table for the detail attributes under each skill
School Of ABE
Civil Engineering Division
CDIO Implementation in CE
Stage 1:
Define and
Identify CDIO
skills
Stage 2:
Integrate
CDIO Skills
into
Curriculum
Stage 3:
Develop
Assessment
Rubrics
Stage 4:
Curriculum
Evaluation
Improvement
to teaching
and learning
and
curriculum
School Of ABE
Civil Engineering Division
Stage 4: Curriculum Evaluation
• Most important in the process
• Use assessment results for improvement
• Ratings of CDIO skill for the course cannot be obtained
as not all module have implemented stage 3
• Example: at module level, 2 groups of 47 students
• Not conclusive until more data are collected from all
groups doing the same modules
School Of ABE
Civil Engineering Division
Conclusion
• Helps in develop and manage curriculum integration with
CDIO skills
• Good reference to develop the process of outcome
assessment using rubrics
• To achieve the expected proficiency level progressively
over the 3 years of study
• Defining 3 levels of expected PL in progress
School Of ABE
Civil Engineering Division
Thank You
Q&A
www.sp.edu.sg
Singapore Polytechnic
500 Dover Road
Singapore 139651
tel. +65 6775 1133
fax.+65 6870 6189
School Of ABE
Civil Engineering Division