By Salih Duffuaa: Professor of Industrial & Systems Engineering February 28th, 2011. 1 ABET History Process and Criteria Abet criteria Program educational objectives: guidelines & examples Program learning outcomes: guidelines & examples Performance Indicators Assessment Tools / Methods Difference Between PEO and Outcomes Assessment Available Resources Preparation for Accreditation. Closing Remarks 2 ABET was established in 1932 as the Engineers' Council for Professional Development (ECPD) by seven engineering societies. ECPD was originally founded to provide a "joint program for upbuilding engineering as a profession". However, it almost immediately began developing as an accreditation agency, evaluating its first engineering program in 1936 and its first engineering technology program in 1946. ECPD changed its name to Accreditation Board for Engineering and Technology (ABET) in 1980, and changed it again to ABET, Inc. in 2005. 3 ABET is a federation of 30 professional and technical societies (ABET member societies) representing the fields of applied science, computing, engineering, and technology. These societies own and operate the organization. ABET Federations members include IEEE, ASCE, … and many societies. 4 There are several type of accreditation. Institution , program. Meets the criteria set by accrediting body. Quality assurance Yard stick for improvement. 5 Accreditation is a non-governmental, peerreview process that assures the quality of the postsecondary education students receive. Types of accreditation: Institutional accreditation evaluates overall institutional quality. One form of institutional accreditation is regional accreditation of colleges and universities. Specialized accreditation examines specific programs of study, rather than an institution as a whole. Specific programs (e.g. Engineering) are often evaluated through specialized accreditation such as ABET. 6 Accreditation gives colleges and universities a structured mechanism to assess, evaluate, and improve the quality of their programs. Accreditation helps students and their parents choose quality college programs. Accreditation enables employers to recruit graduates they know are well-prepared. Accreditation is used by registration, licensure, and certification boards to screen applicants. 7 Accreditation of engineering programs is voluntary. Programs without previous accreditation can apply for accreditation as long as they have produced at least one program graduate. The request for accreditation is initiated by the institution seeking accreditation. Accreditation is given to individual programs within an institution rather than to the institution as a whole. 8 Accredited programs must request re-evaluation every six years to retain accreditation;. If the accreditation criteria are not satisfied, additional evaluations may be required within the six-year interval. The first step in securing or retaining ABET accreditation is for an institution to request an evaluation of its program(s) by January 31 of the year in which accreditation is being sought. 9 Applied Science Accreditation Commission (ASAC) . Computing Accreditation Commission (CAC) . Engineering Accreditation Commission (EAC) . Technology Accreditation Commission (TAC) 10 “The ABET Criteria for Accrediting Engineering Programs is based upon what students learn in the course of their program of studies as opposed to what they are presented in a curriculum. Consequently, institutions are required to have educational objectives and to make use of outcomes assessment techniques to determine the degree to which program objectives and outcomes are being attained. The assessment, in turn, is used in an ongoing process of improving student learning through enhancements to the program.” 11 2. Learning 1. Teaching 3. Assessing 4. Improvement “The ultimate goal of outcomes assessment is the improvement of teaching and learning” 12 Criterion Criterion Criterion Criterion Criterion Criterion Criterion Criterion Criterion 1. 2. 3. 4. 5. 6. 7. 8. 9. Students Program Educational Objectives Program Outcomes Continuous Improvement Curriculum Faculty Facilities Support Program Criteria 13 The institution must evaluate, advise, and monitor students. The institution must have and enforce policies for transfer students validation of courses taken for credit elsewhere The institution must have and enforce procedures to assure that all students meet program requirements 14 statements that describe the expected accomplishments of graduates during the first few years following graduation Unique to the program and institution Consistent in all publications 15 Each program must have Detailed published educational objectives Process based on needs of constituencies in which objectives are determined and periodically evaluated A curriculum and processes that prepare students for achievement of the objectives A system of on-going evaluation that demonstrates achievement and uses results to improve the effectiveness of the program 16 Prepare graduates who will have successful careers, and become leaders, in industry and the public sector Prepare graduates who will appropriately apply acquired knowledge, work well in team, effectively communicate ideas and technical information, and continue to gain knowledge Prepare graduates who will continue professional development and will pursue continuing education opportunities relevant to their careers 17 Graduates will be prepared to take the lead in recognizing engineering problems in their organizations and designing solutions. Graduates will be capable of operating effectively in today's dynamic, heterogeneous organizations . Graduates will be prepared to contribute as ethical and responsible members of society. 18 Program outcomes: Statements that describe what students are expected to know and be able to do by the time of graduation The achievement of outcomes indicates that the student is equipped to achieve the program educational objectives ABET designated (a-k) included in some way 19 Programs must demonstrate their graduates have outcomes “a to k” Programs must have an assessment process with documented results Evidence that the results of the assessment process are applied to the further development and improvement of the program. 20 a. b. c. d. e. f. g. h. i. j. k. l. The graduates of the program should be able to: apply knowledge of mathematics, science, and engineering; design and conduct experiments, as well as analyze and interpret data; design and improve integrated systems of people, materials, information, facilities, and technology; function as a member of a multi-disciplinary team; identify, formulate, and solve industrial and Systems engineering problems; understand and respect professional and ethical responsibilities; communicate effectively both orally and in writing; understand the impact of engineering solutions in a global and societal contexts; recognize the need for life-long learning, and an ability to engage in it; have a knowledge of contemporary issues; use up to dated techniques, skills and tools of Industrial and Systems Engineering throughout their professional careers Each program must show evidence of action to improve the program. The action should based on information such as results of criteria 1 and 2. 22 Faculty must assure that the curriculum devotes adequate attention and time to each component, consistent with objectives of the program and institution One year of math and sciences. One and half year of engineering topics. Preparation for engineering practice Major design experience Subject areas appropriate to engineering 23 Demonstrate that the faculty: Have the competencies to cover all of the curricular areas of the program Is of sufficient number to accommodate student-faculty interaction, advising and counseling, service activities, professional development, and interaction with practitioners and employers, as required by Criterion 5 24 Classrooms, laboratories, and associated equipment must be adequate to accomplish program objectives and provide an atmosphere conducive to learning Opportunities to learn the use of modern engineering tools Computing/information infrastructure to support scholarly activities of the students and faculty and the educational objectives of the institution 25 Institutional support, financial resources, and constructive leadership must be adequate to assure quality and continuity of the program Attract, retain, and provide for professional development of a well-qualified faculty Resources to acquire, maintain, and operate equipment and facilities Adequate support personnel Support of quality-improvement efforts 26 Each program must satisfy applicable Program Criteria Curricular topics Faculty qualifications Current Program Criteria are on the ABET server (www.abet.org) Must satisfy all Program Criteria implied by title of program 27 Deficiency: assigned to any criterion that is totally or largely unmet Weakness: criterion is met to some meaningful extent, but compliance is insufficient to fully satisfy requirements Concern: criterion is fully met, but there is potential for non-compliance in the near future Observation: general commentary possibly related to criteria. 28 Create the right organization for ABET Develop program Objectives and outcomes. Develop process for outcome assessment. Prepare Self-Study Report (SER). Prepare demonstration material. Internal checks Call for a mock visit. Prepare for ABET team visit. Develop the infrastructure to support the accreditation through out. 29 1. 2. 3. 4. 5. 6. All constituents should be involved in identifying PEO Numbers of PEO should be manageable (4-5) PEO should be aligned with mission of university PEO should be measurable PEO should be assessed periodically using constituents PEO should be evaluated periodically to continuously improve the program 30 Prepare graduates who will be successful in electrical engineering-related careers and other diverse career paths Prepare graduates to be leaders Prepare graduates to be good citizens of the society Prepare graduates to pursue advanced degree, if so desired Prepare graduates to be life long learners Prepare graduates to be entrepreneurs 31 Program Learning Outcomes – The following questions should be answered when developing outcomes: Are outcomes clearly defined? Does each learning outcome have few performance indicators? Did we develop rubrics using performance indicators? Are outcomes aligned with objectives? Are outcomes numbers manageable? Are ABET outcomes a through k included? 32 (a) an ability to apply knowledge of mathematics, science, and engineering (b) an ability to design and conduct experiments, as well as to analyze and interpret data (c) an ability to design a system, component, or process to meet desired needs within realistic constraints such as economic, environmental, social, political, ethical, health and safety, manufacturability, and sustainability (d) an ability to function on multidisciplinary teams (e) an ability to identify, formulate, and solve engineering problems (f) an understanding of professional and ethical responsibility (g) an ability to communicate effectively (h) the broad education necessary to understand the impact of engineering solutions in a global, economic, environmental, and societal context (i) a recognition of the need for, and an ability to engage in life-long learning (j) a knowledge of contemporary issues (k) an ability to use the techniques, skills, and modern engineering tools necessary for engineering practice (l-n) Outcome based on Program Criteria Program outcomes are outcomes (a) through (k) plus any additional outcomes that may be articulated by the program. Program outcomes must foster attainment of program educational objectives. 33 Task 1: Review Program Educational Objectives (PEO) Task 2: Review Program Learning Outcomes Task 3: Align Learning outcomes with PEO Task 4: Present to Constituents Task 5: Get Approval & Publish Task 6: Mapping Course Outcomes to Program Outcomes Task 7: Develop Performance Indicators Task 8: Identify Assessment Tools/Methods Task 9: Develop Assessment Plan Task 10: Data Collection and Evaluation Task 11: Closing the Loop 34 Program outcomes must foster attainment of program educational objectives Link outcomes with PEO All Learning Outcomes may or may not link to all/any PEO Program Learning Outcomes PEO (a) 1 X 2 (b) (c) (d) X X X 3 (e) (f) (g) X X X 4 5 X X X (h) (i) X X (j) (k) X X X 35 Main Stakeholders/Constituents Faculty through Department Council Employers through Industrial Advisory Committee Students through various Professional Groups or Student Societies etc. Others: Administration Alumni Other Graduate Schools Recruiters Employers 36 Get Approval Final form of the Program Educational Objectives and Learning Outcomes should be approved by the Department Council Keep record in “ABET File” Keep minutes of meeting Publish at: Department Websiteof constituent’s involvement and Council General Catalog Bulletin Boards etc approval as evidence in record. 37 38 Outcome (a): Ability to apply knowledge of mathematics……… 1. Applies mathematics principles to obtain solutions. Uses principles of sciences and engineering in solving engineering problems. Combines scientific and engineering principles to formulate models of processes and systems. Combines mathematics principles to formulate models of processes and systems. 2. 3. 4. 39 Performance Criteria Unsatisfactory 1 Developing 2 Satisfactory 3 Exemplary 4 Collects some basic information – most relates to the topic Collects a great deal of information – all relates to the topic Perform nearly all duties. Perform all duties of assigned team role. Score Contribute Research & gather informati on. Does not collect any information that relates to the topic. Collects very little information – some relates to the topic. Take Responsibility Fulfill team role’s duties. Shear equally Does not perform any duties of assigned team role. Always relies on others to do the work. Perform very little duties. Rarely does the assigned work – often needs reminding. Usually does the assigned work – rarely needs reminding. Always does the assigned work – without having to be reminded. Value Other’s Viewpoints Listen to other teammate s. Is always talking – never allows anyone else to speak. Usually doing most of the talking – rarely allows others to speak. Listens, but sometimes talk too much. Listen and speaks a fair amount Average 40 Questionnaires and written surveys (Alumni and employer surveys) Senior exit surveys and interviews Student course evaluations Grades ** Focus groups conducted by trained moderator Students internship evaluations (if based on opinion) 41 Selection of Courses Data Collection Cycle Identify Data To be Collected 42 43 Course Number Program Outcome Course Title EE 200 EE 201 EE 203 EE 205 EE 207 EE 303 Digital Logic Circuit Design Electrical Circuits I Electronics I Electrical Circuits II Signals & Systems Electronics II Probabilistic Methods in EE 315 Electrical Eng. EE 340 Electromagnetics EE 360 Electric Energy Engineering EE 370 EE 380 EE 390 EE 399 EE 411 Communication Engineering I Control Engineerng1 Digital System Engineering Summer Training Program Senior Design Project a P P P P P P P P P P P P P b P P P P P P P P P P c P P P P P P d P P P P P P P P P e P P P P P P P P P P P P P P f P P g P P h i P P P P P P P P P P P P P P P P P j k P P P P l m P P P P P P P P P P P P P P P 44 For Program Learning Outcomes Students Course Evaluation using rubric Student Course Portfolios Grades Performance Appraisal Senior exit surveys and interviews Locally developed exams For Program Educational Objectives Alumni Survey Employers Survey Industrial Advisory Board’s Feedback Placement Data 45 46 47 Evaluation centers on the evidence provided that supports achievement of each of the criterion ◦ ◦ ◦ ◦ ◦ ◦ Self-Study Transcripts Display materials Facility tour Interviews Additional materials provided by program 48 Examine course materials Examine assessment materials Interview program head, faculty members, staff, and students Tour facilities Visit supporting areas Verify/clarify/remove strengths and shortcomings from initial evaluation Identify additional strengths and shortcomings Work with Team to finalize evaluation and recommend preliminary accreditation action 49 Strength – stands above the norm Concern – program currently satisfies criterion, policy, or procedure, however potential exists for the situation to change such that the criterion, policy, procedure may not be satisfied Weakness – program lacks strength of compliance with criterion, policy, or procedure Deficiency – program does not satisfy criterion, policy, or procedure 50 51