ABET Accreditation Process Chemical Engineering Department Prof. Emad Ali ABET Stands for Accreditation Board for Engineering and Technology ABET is a U.S. Institution Professor Musaed N. J. Al-Awad ABET EC 2000 Emphasis on Skills: – Communication – Lifelong learning – Multi-disciplinary – Teamwork – Ethics and Profession Emphasis on Design Course Emphasis on learning NOT teaching ABET EC-2000 Define objectives of program Determine measurable program outcomes required to achieve program objectives Design curriculum to achieve program outcomes; map program outcomes to course objectives. Measure student achievement of outcomes via assignments in courses Feedback and Continuous Improvement Outcome-Based Assessment Intended Outcomes Action Process Output (outcomes) Feedback Measurement/ Comparison Outcome-Based Assessment (Outcome-based, learning focused, continuous feedback/improvement) CHE Vision & Mission Vision The department of chemical engineering aims at contributing to the nation’s development and improving the welfare of the society, through preparing professional chemical engineers and conducting theoretical and applied researches. Mission The chemical engineering department strives at providing rigorous and dynamic education to students in the various chemical engineering fields, serving local communities, contributing to the progress of the chemical engineering profession and leading in innovative applied research. CHE Educational Objectives Educate the students in the fundamental principles of science and chemical engineering, and provide them with modern experimental and computational skills. Help the students to develop the ability to use chemical engineering education to tackle problems of practical importance to society while taking into consideration ethical, safety, economical and environmental factors. Provide students, through broad education, with necessary skills required for effective communication, team work and to be a productive and ethically conscience members of the professional community and society. Provide the students with industrial training to facilitate their integration into professional life. Objectives Guidelines Program objectives should be related to university mission Program objectives should be related to College of Engineering mission Program objectives must be developed with constituents Records of development process must be available to the team on site Objectives Guidelines …. Program objectives must be evaluated for three important characteristics – Have we and our constituents set the right objectives for ourselves? – Is the curriculum appropriate? – Are we accomplishing our objectives? This is a long term process Evaluation data must be collected and analyzed by the faculty Results used for Improvement Industrial Advisory Council Usually industrial leaders – May include government leaders – May include other educators – Chaired by one of the industrial members Meet once or twice a year with the faculty and administration Team may want to meet with this group ABET Outcomes (a) knowledge of mathematics, science, and engineering (b) design and conduct experiments, analyze data (c) design a system, component, or process (d) function on multi-disciplinary teams (e) identify, formulate, and solve engineering problems (f) understanding of professional and ethical responsibility (g) communicate effectively (h) broad education (i) recognition and engagement in life-long learning (j) knowledge of contemporary issues (k) Use of modern engineering tools CHE Program Outcomes O1.Knowledge in the fundamentals of mathematics, chemistry and physics. O7.Design Project tailored to their interests or to their professional goals. O2.Knowledge in the major areas of chemical engineering: O8.Work effectively alone or as a part of multi-disciplinary teams. O3.Formulate and solve practical chemical engineering problems. O9.Write correct and coherent technical reports and make effective oral presentations. O4.Select the appropriate numerical methods and use computers to solve chemical eng problems. O10.Appreciate the ethics of the chemical eng profession and its importance on local and global scales. O5.Design, run safely, gather and analyze experimental data relevant to chemical eng problems. O6.Design a process considering, ethical, safety, economical and environmental factors O11.Knowledge of contemporary issues related to chemical eng or to other engineering or science fields. O12.Self learning skills to ensure life long learning. CHE-ABET Outcome Map a O1 O2 O3 O4 O5 O6 O7 O8 O9 O10 O11 O12 b c d e f g h i j k Outcomes – Objectives Map Outcome\Objective 1 2 O1 ● ● O2 ● ● ● O3 ● ● ● O4 ● ● O5 ● ● ● ● ● O6 3 ● O7 O8 4 ● ● ● ● O9 O10 ● ● O11 ● ● ● O12 ● ● ● Course-Outcome Map CHE 499 CHE 498 CHE 441 CHE 432 2 CHE 426 1 2 CHE 423 d 1 1 1 1 CHE 422 3 3 3 1 CHE 421 CHE 413 CHE 411 CHE 405 CHE 404 CHE 403 CHE 402 CHE 401 2 c x x 2 3 3 2 2 3 1 1 1 1 3 3 1 2 x x 1 1 2 2 2 2 2 1 1 Outcomes 2 2 2 2 2 2 2 3 3 3 2 2 2 1 1 1 1 1 3 3 2 2 x x 1 2 2 3 3 f g 1 h 1 i 1 j 1 1 1 1 2 k CHE 331 CHE 323 CHE 321 CHE 316 CHE 314 CHE 313 3 2 1 2 3 2 3 3 3 3 2 2 1 3 3 2 2 2 3 3 1 b e CHE 312 CHE 309 CHE 308 CHE 307 CHE 304 CHE 302 CHE 202 CHE 201 Courses a 2 2 2 x x 1 1 3 3 x x 3 3 x x 1 2 2 2 2 2 2 2 2 3 2 2 x x 2 2 2 1 1 1 x x 3 1 3 3 Assessment: Measures of Student Learning Outcomes Direct Tests Rubrics Portfolios Capstone projects Field supervisor ratings Employer ratings Special student achievement, prize, publication, presentation Archival records Oral exams Behavioral observation Indirect Course grades Surveys Focus Groups Student self ratings Course evaluations Graduate school admissions National standard exams External reviewer Assessment Tools Course Course Assessment Report Student Course Evaluation Course Portfolio Oral Presentation Course Grades Program Faculty Survey Alumni Survey Employer Survey Assessment Rubrics External Advisor Assessment Guidelines Outcomes must be assessed – Your choice as to what methods – Surveys alone are insufficient – Student surveys are insufficient – Methods must show that all required outcomes acquired by all students to some extent Assessment Guidelines – Grades are insufficient unless all outcomes assigned to a course are assessed on at least one examination – Need more than one assessment method – Faculty are the most important assessors – Design courses important here. Most outcomes can be assessed here. Responsibilities of Course Instructors Establish course objectives Map course objectives to program outcomes Prepare the Course portfolio each semester Measure student achievement via assignments each semester Assess course outcomes and produce Course performance memo Apply or Allow for Course Evaluation survey annually Complete Faculty survey annually Adjust lectures and lab organization to reasonably address the course outcomes (periodically) Design exams and other assignments in an outcomesbased fashion (periodically) Course Portfolio Contents Course title and number. Course syllabus Course notes and/or outlines Student work: homework, quizzes, examination and projects. Lab reports Statement/questions for each assignment Student Final Grades and distribution Course performance report Problems Course Portfolio Contents Course Performance Report Industrial Advisory Board Employer Survey Direct Assessment Skills: Ethics, Multi-disciplinary, lifelong Course Binder status 2005-2006II C 441 C 432 C 426 C 423 C 422 C 421 C 413 C 411 C 405 C 404 C 403 C 402 C 401 C 331 C 323 C 316 C 314 C 313 C 312 C 309 C 308 C 307 C 304 C 302 C 202 C 201 Course Binder Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y N Y N N Y Y Y HW Q N N N N N N N Y Y Y N N N Y Y Y N Y N N N N N N N N HW A N N N N N N N Y Y Y N N N Y Y Y N Y N N N N N N N N Midterm N N N N N N N Y Y Y N N N Y N N N N N N N N N Final Y Exam Q Final Y Exam A Report N Y` Y N Y N Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y N Y N Y N N Y N Y N N N Y Y Y Y Y Y Y Y N Y N N N N N N N N N N N N N N N N N N N N N N N N N Course Binder Content 2006-2007I C 441 C 432 C 426 C 423 C 422 C 421 C 413 C 411 C 405 C 404 C 403 C 402 C 401 C 331 C 323 C 316 C 314 C 313 C 312 C 309 C 308 C 307 C 304 C 302 C 202 C 201 Course Binder Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y HW Q Y Y Y Y Y Y N Y Y Y Y Y Y Y Y - HW A Y Y Y Y Y Y Y Y Y Y Y Y Y Y Y Midterm Y Y Y Y Y Y Y Y Y Y Y N Y N Final Y Exam Q Final Y Exam A Report N Y Y N Y Y Y Y Y Y Y N Y Y Y N Y Y Y Y N Y Y N Y Y Y N Y N Y N N -N Y -N Y N Y N Y N N Y Y Y Y N Y N Y N N N - -N Y -N Y N N N Y N N N Y - -N Y -N Y N N N Y N N N Y - -N Y -N Y N N N Y N N Y Y N N N N N N N N N N N N N N N N N N N N N N N N N Course Binder Status 2006-2007II Not available 2007-2008I Not available 2007-2008II Not available 2008-2009I Depends on you Course Performance Report, KAU Our Course Report Course Performance Report … Course Outcome Weights C441 C432 C426 C423 C422 C421 C413 C411 C405 C404 C403 C402 C401 C331 C323 C321 C316 C314 C313 C312 C309 C308 C307 C304 C302 C202 C201 Outcomes A 60 60 11 50 60 40 43 23 43 30 29 50 14 75 43 12 12 50 21 30 14 13 13 50 30 33 B 15 10 18 18 21 10 C 33 20 14 8 14 29 29 25 21 30 14 40 13 13 25 10 22 D 11 12 12 E 40 40 22 50 40 40 29 23 43 30 29 50 29 25 14 6 6 25 21 30 29 40 13 13 25 20 22 F 12 12 13 13 G 14 18 18 13 13 H 8 13 13 11 I 8 12 12 J 8 10 14 29 13 13 K 22 8 20 29 43 12 12 0 14 10 14 20 13 13 30 11 Course Performance Report … Direct embedded method Outcome Addressed a b Course objectives related to the outcomes 1,4,8 1,2,5,6 Methods or tools used to assess the outcome HW#1, Q2 EX2, Q1(a) Assessment Results outcome Score (out of 5) a 3.4 b 2.7 Course performance report … Indirect embedded method che 201 Che201 A score 60 38.7 comment OK Achievement level outcome Target 70 Tool 60 score 50 40 B 0 0.0 NA C 0 0.0 NA D 0 0.0 NA E 40 25.8 Warn F 0 0.0 NA G 0 0.0 NA H 0 0.0 NA I 0 0.0 J 0 0.0 NA Score/target<40% K 0 0.0 NA 0.0/0.0 sum 100 64.5 NA 30 20 10 0 A B C D E F G H I J K Outcomes Score/target>60% ok 40%<score/target<60% warn NA alarm What is Rubric? Rubrics offer the Instructor an opportunity to assess the student's understanding of a scientific topic by levels of performance on certain criteria Rubrics can be designed such that they track a student’s performance across several courses or learning experiences and show improvements in performance over time rather than in a single instance How to design a Rubric faculty must first identify the key elements (criteria) of a work or performance, and then develop the standards that discriminate between poor and excellent accomplishments on those key elements. Why use rubrics A carefully designed rubric: 1. Focuses instruction by identifying the key elements and minimum standards of a skill, knowledge, or attitude; 2. Helps the instructor provide feedback that is focused and meaningful; 3. Characterize the desired results in a relatively objective manner by clearly describing expectations; 4. Operationalizes performance standards such that students know in advance what is expected of them; 5. Rubrics, when given in advance and used constantly, develop self-assessment competence in students; 6. Can be developed with the involvement of students, helping them understand the issue in greater depth. Rubrics continued What to use? We developed Rubrics for evaluating: 1. Design Project 2. Data analysis, Experiment Design 3. Written Communication 4. Oral Communication 5. Ethics, Life-long learning and Teamwork Rubric Example Written Communication Assessment Rubric course No Date Student Reviewer Topic Unacceptable Marginal Acceptable (Weight) 0 1 2 3 Sequence of Work is hard to information is follow as there is difficult to follow. No very little continuity. apparent structure or Purpose of work is continuity. stated, but does not Purpose of work is assist in following not clearly stated. work. Information is presented in a logical manner, which is easily followed. Purpose of work is clearly stated assists the structure of work. Information is presented in a logical, interesting way, which is easy to follow. Purpose is clearly stated and explains the structure of work. No grasp of Uncomfortable with information. Clearly content. Only basic no knowledge of concepts are subject matter.No demonstrated and questions are interpreted. answered. No interpretation made. Work is illegible, Mostly consistent format changes format. Figures and throughout, e.g. font tables are legible, type, size etc Figures but not convincing. and tables are sloppy and fail to provide intended information. Numerous spelling Several spelling and and grammatical grammatical errors. errors. At ease with content and able to elaborate and explain to some degree. Demonstration of full knowledge of the subject with explanations and elaboration. No referencing system used. Minor inadequacies in references. Consistent referencing system. Organization & Style Content & Knowledge Format & Aesthetics Spelling & Grammar References OVERALL PERFORMANC E POINTS REQUIRED Unacceptable 4-0 Inadequate list of references or references in text. Inconsistent or illogical referencing system. Marginal 7-5 Exceptional Format is generally Format is consistent consistent including throughout including heading styles and heading styles and captions. Figures and captions. Figures and tables are neatly tables are presented done and provide logically and intended information. reinforce the text. Minor misspellings Negligible and/or grammatical misspellings and/or errors. grammatical errors. Acceptable 11-8 Points ` Reference section complete and comprehensive. Consistent and logical referencing system. Exceptional 15-12 TOTAL