ABET Accreditation Department of Computer Science The University of Texas at Dallas ABET Accreditation, Fall 2011 1 Two Programs to be Accredited • Bachelor of Science in Computer Science (BSCS) – Dr. Lorraine Parker (Team Chair) – Dr. Michael Quinn (Program Evaluator) • Bachelor of Science in Software Engineering (BSSE) – Dr. Lawrence Butkus (Team Chair) – Monish Jain (Program Evaluator) ABET Accreditation, Fall 2011 2 ABET Requirements 1. The institution must have a mission statement • Mission statements of University, School and Department 2. Each program (to be accredited) must have: – Program Educational Objectives (PEOs) • Broad statements that describe what students of the program are expected to attain within a few years of their graduation – Student Outcomes (SOs) • Describe what students are expected to know and be able to do by the time of their graduation ABET Accreditation, Fall 2011 3 ABET Requirements (Contd.) 3. Program Educational Objectives: a. There is a documented process for periodically evaluating the extent to which PEOs are being attained b. There is a documented process for periodic review and revision of PEOs 4. Student Outcomes: a. There is a documented process for periodically evaluating the extent to which SOs are being attained b. There is a documented process for periodic review and revision of SOs (only BSCS program) ABET Accreditation, Fall 2011 4 ABET Requirements (Contd.) 5. Continuous Improvement: a. Results of evaluations must be systematically utilized as inputs for continuous improvements of the program b. Some of the input must be objective ABET Accreditation, Fall 2011 5 Department Mission Statement The mission of the Department of Computer Science is to prepare undergraduate and graduate students for productive careers in industry, academia, and government by providing an outstanding environment for teaching, learning, and research in the theory and applications of computing. The Department places high priority on establishing and maintaining innovative research programs to enhance its education quality and make it an important regional, national and international resource center for discovering, integrating and applying new knowledge and technologies. ABET Accreditation, Fall 2011 6 BSCS: Programming Educational Objectives (PEOs) 1. Graduates should have a successful, long-lived, computer science based career path. 2. Graduates should meet the needs of industry or academia. 3. Graduates should contribute to, and/or lead, computer science based teams. 4. Graduates should actively pursue continuing learning. Drafted by a school wide committee and approved by faculty in Spring 2010 7/12/2016 7 BSSE: Programming Educational Objectives (PEOs) 1. Graduates should have a successful, long-lived, software engineering based career path. 2. Graduates should meet the needs of industry or academia. 3. Graduates should contribute to, and/or lead, software engineering based teams. 4. Graduates should actively pursue continuing learning. Drafted by a school wide committee and approved by faculty in Spring 2010 7/12/2016 8 Assessing PEOs • We use three ways to evaluate the extent of attainment of PEOs regularly: a. Alumni survey b. Employer survey c. IAB survey • Alumni and employer surveys are conducted once every two years by the Office of Assessment • IAB survey is conducted every year by the department head • Assessed with respect to two dimensions: – Importance: Is the PEO important? – Attainment: Is the PEO being achieved? ABET Accreditation, Fall 2011 9 Assessing BSCS PEOs: Is PEO Important? Program Educational Objective Have a successful, long-lived, computer science based career path Meet the needs of industry or academia Contribute to, and/or lead, computer science based teams Actively pursue continuing learning Unable to answer 0 0.00% Strongly disagree 1 1.02% Disagree Agree Strongly agree 7 7.14% 42 42.86% 48 48.98% Unable to answer/Disagree: 8.16% Agree: 91.84% 0 0 3 0.00% 0.00% 3.06% Unable to answer/Disagree: 3.06% 0 0 3 0.00% 0.00% 3.06% Unable to answer/Disagree: 3.06% 0 0 3 0.00% 0.00% 3.06% Unable to answer/Disagree: 3.06% 41 54 41.84% 55.10% Agree: 96.94% 39 56 39.80% 57.14% Agree: 96.94% 33 62 33.67% 63.27% Agree: 96.94% ABET Accreditation, Fall 2011 10 Assessing BSCS PEOs: Is PEO being Attained? Program Educational Objective Have a successful, long-lived, computer science based career path Meet the needs of industry or academia Contribute to, and/or lead, computer science based teams Actively pursue continuing learning Unable to answer Strongly disagree Disagree 3 11 1 3.03% 11.11% 1.01% Unable to answer/Disagree: 15.15% 4 19 1 4.04% 19.19% 1.01% Unable to answer/Disagree: 24.24% 2 17 1 2.02% 17.17% 1.01% Unable to answer/Disagree: 20.20% 2 10 1 2.02% 10.10% 1.01% Unable to answer/Disagree: 13.13% ABET Accreditation, Fall 2011 Agree Strongly agree 29 55 55.56% 29.29% Agree: 84.85% 25 50 50.51% 25.25% Agree: 75.76% 27 52 52.53% 27.27% Agree: 79.80% 32 54 54.55% 32.32% Agree: 86.87% 11 Assessing BSSE PEOs: Is PEO Important? Program Educational Objective Have a successful, long-lived, software engineering based career path Meet the needs of industry or academia Contribute to, and/or lead, software engineering based teams Actively pursue continuing learning Unable to answer 0 0.00% Strongly disagree 0 0.00% Disagree Agree Strongly agree 2 5.88% 18 52.94% 14 41.18% Unable to answer/Disagree: 5.88% Agree: 94.12% 0 0 1 0.00% 0.00% 2.94% Unable to answer/Disagree: 2.94% 0 0 1 0.00% 0.00% 2.94% Unable to answer/Disagree: 2.94% 0 0 3 0.00% 0.00% 8.82% Unable to answer/Disagree: 8.82% 13 20 38.24% 58.82% Agree: 97.06% 14 19 41.18% 55.88% Agree: 97.06% 13 18 38.24% 52.94% Agree: 91.18% ABET Accreditation, Fall 2011 12 Assessing BSSE PEOs: Is PEO being Attained? Program Educational Objective Have a successful, long-lived, software engineering based career path Meet the needs of industry or academia Contribute to, and/or lead, software engineering based teams Actively pursue continuing learning Unable to answer Strongly disagree Disagree 0 1 1 0.00% 2.94% 2.94% Unable to answer/Disagree: 5.88% 0 3 1 0.00% 8.82% 2.94% Unable to answer/Disagree: 11.76% 0 3 1 0.00% 8.82% 2.94% Unable to answer/Disagree: 11.76% 0 5 1 0.00% 14.71% 2.94% Unable to answer/Disagree: 17.65% ABET Accreditation, Fall 2011 Agree Strongly agree 10 22 64.71% 29.41% Agree: 94.12% 8 22 64.71% 23.53% Agree: 88.24% 10 20 58.82% 29.42% Agree: 88.24% 9 19 55.88% 26.47% Agree: 82.35% 13 Process for Revising PEOs Mission Statements · Instituition · School · Department Administration and ABET Coordinator Undergraduate Curriculum Committee Review Department Faculty Review Feedback from Constituencies · Alumni · Industry (IAB and Employers) · Graduate Programs Revised Program Educational Objectives ABET Accreditation, Fall 2011 14 BSCS: Student Outcomes (SOs) a) An ability to apply knowledge of computing and mathematics appropriate to the discipline. b) An ability to analyze a problem, and identify and define the computing requirements appropriate to its solution. c) An ability to design, implement and evaluate a computer-based system, process, component, or program to meet desired needs. d) An ability to function effectively on teams to accomplish a common goal. e) An understanding of professional, ethical, legal, security, and social issues and responsibilities. 7/12/2016 15 BSCS: Student Outcomes (SOs) (Contd.) f) An ability to communicate effectively with a range of audiences. g) An ability to analyze the local and global impact of computing on individuals, organizations and society. h) Recognition of the need for, and an ability to engage in, continuing professional development. i) An ability to use current techniques, skills, and tools necessary for computing practices. j) An ability to apply mathematical foundations, algorithmic principles, and computer science theory in the modeling and design of computer-based systems in a way that demonstrates comprehension of the tradeoffs involved in design choices. 7/12/2016 16 BSCS: Student Outcomes (SOs) (Contd.) k) An ability to apply design and development principles in the construction of software systems of varying complexity. Defined by ABET CAC committee and adopted by faculty in Spring 2010 7/12/2016 17 BSSE: Student Outcomes (SOs) a) An ability to apply knowledge of mathematics, science, and engineering. b) An ability to design and conduct experiments, as well as to analyze and interpret data c) An ability to design a system, component, or process to meet desired needs within realistic constraints such as economic, environmental, social, political, ethical, health and safety, manufacturability, and sustainability. d) An ability to function on multidisciplinary teams. e) An ability to identify, formulate, and solve engineering problems. f) An understanding of professional and ethical responsibility. 7/12/2016 18 BSSE: Student Outcomes (SOs) (Contd.) g) An ability to communicate effectively. h) The broad education necessary to understand the impact of engineering solutions in a global, economic, environmental, and societal context. i) A recognition of the need for, and an ability to engage in life-long learning. j) A knowledge of contemporary issues. k) An ability to use the techniques, skills, and modern engineering tools necessary for engineering practice. Defined by ABET EAC committee and adopted by faculty in Spring 2010 7/12/2016 19 Assessing Student Outcomes (SOs) • We use two ways to evaluate the extent of attainment of SOs regularly: a. Using course learning outcomes (CLOs): • Course assessment sheets are filled by instructors every semester – • Instructor objectively assesses each CLO of the course SOs are evaluated using course assessment data once every three years by the department b. Senior exit survey: conducted every year by the Office of Assessment ABET Accreditation, Fall 2011 20 Using Course Learning Outcomes to Assess SOs • Each student outcome is broken into one or more performance criteria – A performance criterion indicates a concrete action that a student should be able to perform • A student outcome is evaluated using assessment data for its performance criteria ABET Accreditation, Fall 2011 21 Performance Criteria: Example • Student outcome (d) for BSCS: – An ability to function effectively on teams to accomplish a common goal • Performance Criteria: 1. Produce research information for team 2. Share work meaningfully with other team members and adapt as needed 3. Complete assigned tasks in a timely manner ABET Accreditation, Fall 2011 22 Assessing a Performance Criterion: Example • Share work meaningfully with other team members and adapt as needed • Assessed using three courses: – CS/SE 3354: Software Engineering » CLO 7: Ability to establish and participate in an ethical software development team – ECS 3390: Professional and Technical Communication » CLO 5: Ability to collaborate in a team to research, plan, and present information – CS 4485: Computer Science Project » CLO 4: Ability to work in a team and contribute to a team software design project » CLO 5: Ability to work in a team and contribute to the production of an enterprise software product ABET Accreditation, Fall 2011 23 Process for Revising SOs Program Educational Objectives Administration and ABET Coordinator Results of Assessment Processes · Program Educational Objectives · Student Outcomes Undergraduate Curriculum Committee Review Feedback from Constituencies · Faculty · Students Department Faculty Review Revised Student Outcomes ABET Accreditation, Fall 2011 24 Continuous Improvement Process • Course update forms are filled by course coordinators every Spring semester – Feedback from instructors about any issues with the course and/or the program • The undergraduate curriculum committee and the program head periodically review and propose program improvements to the faculty: – Course update forms – Results of evaluation of PEOs and SOs – Feedback from other constituencies (e.g., IAB, administration) • Faculty approves any changes to the program ABET Accreditation, Fall 2011 25 Continuous Improvement Process Courses Curriculum Infrastructure and Facilities Advising Feedback from Constituencies · Student · Alumni · Industry/Government/Academia · Graduate Programs · Faculty Faculty as a Whole Individual Faculty Undergraduate Curriculum Committee ABET Accreditation, Fall 2011 Administration and ABET Coordinator 26 Summary of Changes Made to the Program • BSCS Only: Added CS 4485: Computer Science Project (Senior Design) as a required course • BSSE Only: Added new application domain (Information Assurance) and updated courses in existing application domains • Added CS/SE 3376: C/C++ Programming in a UNIX Environment as a required course • Created separate programming sequence for non-majors ABET Accreditation, Fall 2011 27 Summary of Changes Made to the Program (Contd.) • Scaled up the tutoring program (more student graders) • Re-aligned discrete mathematics courses • Re-aligned prerequisite structure: – CS 2305 is now a prerequisite or co-requisite to CS 2336 • Added Senior Design Day every semester • Added ECS 1200: Introduction to Engineering and Computer Science (freshman experience) as a required course ABET Accreditation, Fall 2011 28 Summary of Changes Made to the Program (Contd.) • Revised PEOs and SOs for both programs • Changed assessment methodology: – Use vector-based approach (four categories) instead of score-based approach – Use performance criteria to assess student outcomes ABET Accreditation, Fall 2011 29 Planned Changes to the Program • Revise programming sequence • Review and revise contents of two courses: – CS/SE 3340: Computer Architecture – CS 4341: Digital Logic and Computer Design courses • Add a required course on assembly language programming • Add an elective course on implementation of algorithms ABET Accreditation, Fall 2011 30