ABET Accreditation
Department of Computer Science
The University of Texas at Dallas
ABET Accreditation, Fall 2011
1
Two Programs to be Accredited
• Bachelor of Science in Computer Science
(BSCS)
– Dr. Lorraine Parker (Team Chair)
– Dr. Michael Quinn (Program Evaluator)
• Bachelor of Science in Software Engineering
(BSSE)
– Dr. Lawrence Butkus (Team Chair)
– Monish Jain (Program Evaluator)
ABET Accreditation, Fall 2011
2
ABET Requirements
1. The institution must have a mission statement
•
Mission statements of University, School and
Department
2. Each program (to be accredited) must have:
– Program Educational Objectives (PEOs)
• Broad statements that describe what students of the
program are expected to attain within a few years of their
graduation
– Student Outcomes (SOs)
• Describe what students are expected to know and be able to
do by the time of their graduation
ABET Accreditation, Fall 2011
3
ABET Requirements (Contd.)
3. Program Educational Objectives:
a. There is a documented process for periodically
evaluating the extent to which PEOs are being attained
b. There is a documented process for periodic review and
revision of PEOs
4. Student Outcomes:
a. There is a documented process for periodically
evaluating the extent to which SOs are being attained
b. There is a documented process for periodic review and
revision of SOs (only BSCS program)
ABET Accreditation, Fall 2011
4
ABET Requirements (Contd.)
5. Continuous Improvement:
a. Results of evaluations must be systematically
utilized as inputs for continuous improvements
of the program
b. Some of the input must be objective
ABET Accreditation, Fall 2011
5
Department Mission Statement
The mission of the Department of Computer Science is to
prepare undergraduate and graduate students for
productive careers in industry, academia, and
government by providing an outstanding environment for
teaching, learning, and research in the theory and
applications of computing. The Department places high
priority on establishing and maintaining innovative
research programs to enhance its education quality and
make it an important regional, national and international
resource center for discovering, integrating and applying
new knowledge and technologies.
ABET Accreditation, Fall 2011
6
BSCS: Programming Educational
Objectives (PEOs)
1. Graduates should have a successful, long-lived, computer
science based career path.
2. Graduates should meet the needs of industry or
academia.
3. Graduates should contribute to, and/or lead, computer
science based teams.
4. Graduates should actively pursue continuing learning.
Drafted by a school wide committee and approved by faculty
in Spring 2010
7/12/2016
7
BSSE: Programming Educational
Objectives (PEOs)
1. Graduates should have a successful, long-lived, software
engineering based career path.
2. Graduates should meet the needs of industry or
academia.
3. Graduates should contribute to, and/or lead, software
engineering based teams.
4. Graduates should actively pursue continuing learning.
Drafted by a school wide committee and approved by faculty
in Spring 2010
7/12/2016
8
Assessing PEOs
• We use three ways to evaluate the extent of
attainment of PEOs regularly:
a. Alumni survey
b. Employer survey
c. IAB survey
• Alumni and employer surveys are conducted once
every two years by the Office of Assessment
• IAB survey is conducted every year by the department
head
• Assessed with respect to two dimensions:
– Importance: Is the PEO important?
– Attainment: Is the PEO being achieved?
ABET Accreditation, Fall 2011
9
Assessing BSCS PEOs: Is PEO
Important?
Program Educational
Objective
Have a successful, long-lived,
computer science based
career path
Meet the needs of industry or
academia
Contribute to, and/or lead,
computer science based teams
Actively pursue continuing
learning
Unable to
answer
0
0.00%
Strongly
disagree
1
1.02%
Disagree
Agree
Strongly
agree
7
7.14%
42
42.86%
48
48.98%
Unable to answer/Disagree: 8.16%
Agree: 91.84%
0
0
3
0.00%
0.00%
3.06%
Unable to answer/Disagree: 3.06%
0
0
3
0.00%
0.00%
3.06%
Unable to answer/Disagree: 3.06%
0
0
3
0.00%
0.00%
3.06%
Unable to answer/Disagree: 3.06%
41
54
41.84% 55.10%
Agree: 96.94%
39
56
39.80% 57.14%
Agree: 96.94%
33
62
33.67% 63.27%
Agree: 96.94%
ABET Accreditation, Fall 2011
10
Assessing BSCS PEOs: Is PEO being
Attained?
Program Educational
Objective
Have a successful, long-lived,
computer science based
career path
Meet the needs of industry or
academia
Contribute to, and/or lead,
computer science based teams
Actively pursue continuing
learning
Unable to
answer
Strongly
disagree
Disagree
3
11
1
3.03%
11.11%
1.01%
Unable to answer/Disagree: 15.15%
4
19
1
4.04%
19.19%
1.01%
Unable to answer/Disagree: 24.24%
2
17
1
2.02%
17.17%
1.01%
Unable to answer/Disagree: 20.20%
2
10
1
2.02%
10.10%
1.01%
Unable to answer/Disagree: 13.13%
ABET Accreditation, Fall 2011
Agree
Strongly
agree
29
55
55.56% 29.29%
Agree: 84.85%
25
50
50.51% 25.25%
Agree: 75.76%
27
52
52.53% 27.27%
Agree: 79.80%
32
54
54.55% 32.32%
Agree: 86.87%
11
Assessing BSSE PEOs: Is PEO
Important?
Program Educational
Objective
Have a successful, long-lived,
software engineering based
career path
Meet the needs of industry or
academia
Contribute to, and/or lead,
software engineering based
teams
Actively pursue continuing
learning
Unable to
answer
0
0.00%
Strongly
disagree
0
0.00%
Disagree
Agree
Strongly
agree
2
5.88%
18
52.94%
14
41.18%
Unable to answer/Disagree: 5.88%
Agree: 94.12%
0
0
1
0.00%
0.00%
2.94%
Unable to answer/Disagree: 2.94%
0
0
1
0.00%
0.00%
2.94%
Unable to answer/Disagree: 2.94%
0
0
3
0.00%
0.00%
8.82%
Unable to answer/Disagree: 8.82%
13
20
38.24% 58.82%
Agree: 97.06%
14
19
41.18% 55.88%
Agree: 97.06%
13
18
38.24% 52.94%
Agree: 91.18%
ABET Accreditation, Fall 2011
12
Assessing BSSE PEOs: Is PEO being
Attained?
Program Educational
Objective
Have a successful, long-lived,
software engineering based
career path
Meet the needs of industry or
academia
Contribute to, and/or lead,
software engineering based
teams
Actively pursue continuing
learning
Unable to
answer
Strongly
disagree
Disagree
0
1
1
0.00%
2.94%
2.94%
Unable to answer/Disagree: 5.88%
0
3
1
0.00%
8.82%
2.94%
Unable to answer/Disagree: 11.76%
0
3
1
0.00%
8.82%
2.94%
Unable to answer/Disagree: 11.76%
0
5
1
0.00%
14.71%
2.94%
Unable to answer/Disagree: 17.65%
ABET Accreditation, Fall 2011
Agree
Strongly
agree
10
22
64.71% 29.41%
Agree: 94.12%
8
22
64.71% 23.53%
Agree: 88.24%
10
20
58.82% 29.42%
Agree: 88.24%
9
19
55.88% 26.47%
Agree: 82.35%
13
Process for Revising PEOs
Mission Statements
· Instituition
· School
· Department
Administration
and ABET
Coordinator
Undergraduate
Curriculum
Committee
Review
Department
Faculty Review
Feedback from Constituencies
· Alumni
· Industry (IAB and Employers)
· Graduate Programs
Revised
Program
Educational
Objectives
ABET Accreditation, Fall 2011
14
BSCS: Student Outcomes (SOs)
a)
An ability to apply knowledge of computing and mathematics
appropriate to the discipline.
b)
An ability to analyze a problem, and identify and define the
computing requirements appropriate to its solution.
c)
An ability to design, implement and evaluate a computer-based
system, process, component, or program to meet desired needs.
d)
An ability to function effectively on teams to accomplish a
common goal.
e)
An understanding of professional, ethical, legal, security, and
social issues and responsibilities.
7/12/2016
15
BSCS: Student Outcomes (SOs)
(Contd.)
f)
An ability to communicate effectively with a range of audiences.
g)
An ability to analyze the local and global impact of computing on
individuals, organizations and society.
h)
Recognition of the need for, and an ability to engage in, continuing
professional development.
i)
An ability to use current techniques, skills, and tools necessary for
computing practices.
j)
An ability to apply mathematical foundations, algorithmic
principles, and computer science theory in the modeling and
design of computer-based systems in a way that demonstrates
comprehension of the tradeoffs involved in design choices.
7/12/2016
16
BSCS: Student Outcomes (SOs)
(Contd.)
k)
An ability to apply design and development principles in the
construction of software systems of varying complexity.
Defined by ABET CAC committee and adopted by faculty in Spring 2010
7/12/2016
17
BSSE: Student Outcomes (SOs)
a) An ability to apply knowledge of mathematics, science, and
engineering.
b) An ability to design and conduct experiments, as well as to analyze and
interpret data
c) An ability to design a system, component, or process to meet desired
needs within realistic constraints such as economic, environmental,
social, political, ethical, health and safety, manufacturability, and
sustainability.
d) An ability to function on multidisciplinary teams.
e) An ability to identify, formulate, and solve engineering problems.
f) An understanding of professional and ethical responsibility.
7/12/2016
18
BSSE: Student Outcomes (SOs)
(Contd.)
g) An ability to communicate effectively.
h) The broad education necessary to understand the impact of
engineering solutions in a global, economic, environmental, and
societal context.
i)
A recognition of the need for, and an ability to engage in life-long
learning.
j)
A knowledge of contemporary issues.
k) An ability to use the techniques, skills, and modern engineering
tools necessary for engineering practice.
Defined by ABET EAC committee and adopted by faculty in Spring 2010
7/12/2016
19
Assessing Student Outcomes (SOs)
• We use two ways to evaluate the extent of
attainment of SOs regularly:
a. Using course learning outcomes (CLOs):
•
Course assessment sheets are filled by instructors
every semester
–
•
Instructor objectively assesses each CLO of the course
SOs are evaluated using course assessment data once
every three years by the department
b. Senior exit survey: conducted every year by the
Office of Assessment
ABET Accreditation, Fall 2011
20
Using Course Learning Outcomes to
Assess SOs
• Each student outcome is broken into one or
more performance criteria
– A performance criterion indicates a concrete
action that a student should be able to perform
• A student outcome is evaluated using
assessment data for its performance criteria
ABET Accreditation, Fall 2011
21
Performance Criteria: Example
• Student outcome (d) for BSCS:
– An ability to function effectively on teams to
accomplish a common goal
• Performance Criteria:
1. Produce research information for team
2. Share work meaningfully with other team
members and adapt as needed
3. Complete assigned tasks in a timely manner
ABET Accreditation, Fall 2011
22
Assessing a Performance Criterion:
Example
• Share work meaningfully with other team members and
adapt as needed
• Assessed using three courses:
– CS/SE 3354: Software Engineering
» CLO 7: Ability to establish and participate in an ethical software
development team
– ECS 3390: Professional and Technical Communication
» CLO 5: Ability to collaborate in a team to research, plan, and
present information
– CS 4485: Computer Science Project
» CLO 4: Ability to work in a team and contribute to a team
software design project
» CLO 5: Ability to work in a team and contribute to the production
of an enterprise software product
ABET Accreditation, Fall 2011
23
Process for Revising SOs
Program
Educational
Objectives
Administration
and ABET
Coordinator
Results of Assessment Processes
· Program Educational
Objectives
· Student Outcomes
Undergraduate
Curriculum
Committee
Review
Feedback from Constituencies
· Faculty
· Students
Department
Faculty Review
Revised Student
Outcomes
ABET Accreditation, Fall 2011
24
Continuous Improvement Process
• Course update forms are filled by course coordinators
every Spring semester
– Feedback from instructors about any issues with the
course and/or the program
• The undergraduate curriculum committee and the
program head periodically review and propose
program improvements to the faculty:
– Course update forms
– Results of evaluation of PEOs and SOs
– Feedback from other constituencies (e.g., IAB,
administration)
• Faculty approves any changes to the program
ABET Accreditation, Fall 2011
25
Continuous Improvement Process
Courses
Curriculum
Infrastructure
and
Facilities
Advising
Feedback from Constituencies
· Student
· Alumni
· Industry/Government/Academia
· Graduate Programs
· Faculty
Faculty as a
Whole
Individual
Faculty
Undergraduate
Curriculum
Committee
ABET Accreditation, Fall 2011
Administration
and
ABET Coordinator
26
Summary of Changes Made to the
Program
• BSCS Only: Added CS 4485: Computer Science
Project (Senior Design) as a required course
• BSSE Only: Added new application domain
(Information Assurance) and updated courses in
existing application domains
• Added CS/SE 3376: C/C++ Programming in a UNIX
Environment as a required course
• Created separate programming sequence for
non-majors
ABET Accreditation, Fall 2011
27
Summary of Changes Made to the
Program (Contd.)
• Scaled up the tutoring program (more student
graders)
• Re-aligned discrete mathematics courses
• Re-aligned prerequisite structure:
– CS 2305 is now a prerequisite or co-requisite to CS
2336
• Added Senior Design Day every semester
• Added ECS 1200: Introduction to Engineering and
Computer Science (freshman experience) as a
required course
ABET Accreditation, Fall 2011
28
Summary of Changes Made to the
Program (Contd.)
• Revised PEOs and SOs for both programs
• Changed assessment methodology:
– Use vector-based approach (four categories)
instead of score-based approach
– Use performance criteria to assess student
outcomes
ABET Accreditation, Fall 2011
29
Planned Changes to the Program
• Revise programming sequence
• Review and revise contents of two courses:
– CS/SE 3340: Computer Architecture
– CS 4341: Digital Logic and Computer Design
courses
• Add a required course on assembly language
programming
• Add an elective course on implementation of
algorithms
ABET Accreditation, Fall 2011
30