2015-16 ACADEMIC ASSESSMENT & PLANNING RECORD Bachelor of Science in Information Technology I. Mission College of Hospitality and Technology Leadership Mission Statement: The College of Hospitality and Technology Leadership at the University of South Florida Sarasota-Manatee provides an intellectual, collaborative, ethical, inclusive learning environment for students pursuing leadership positions in hospitality and technology and graduating leaders for these industries to serve citizens of Florida, the U.S., and the world. Bachelor of Science in Information Technology Mission Statement: The Bachelor of Science in Information Technology in the College of Hospitality and Technology Leadership at the University of South Florida Sarasota-Manatee provides high quality educational opportunities for students interested in pursuing careers in the broad range of fields that support our computer/informationbased society and economy. Additionally, the goal is to utilize the resources of the program to provide service to society; and to emphasize to students the need for lifelong learning, to have ethical conduct, and an understanding of the diverse social context in which Information Technology is practiced. II. Program Educational Objectives and Student Outcomes I. Technical Knowledge and Skills: Technical knowledge and skill sets (computational and analytic) needed for success in careers related to Information Technology. a. An ability to apply knowledge of computing and mathematics appropriate to the discipline. b. An ability to use current techniques, skills, and tools necessary for computing practice. c. An ability to use and apply current technical concepts and practices in the core information technologies. d. An understanding of best practices and standards and their application. 1 II. Professional Ethics: An understanding of professional ethics in the development and application of Information Technology. a. An understanding of professional, ethical, legal, security and social issues and responsibilities. III. Computer Processes and Systems: Design and develop computer processes and systems of advanced complexity. a. An ability to design, implement, and evaluate a computer-based system, process, component, or program to meet desired needs. b. An ability to effectively integrate IT-based solutions into the user environment. c. An ability to assist in the creation of an effective project plan. IV. Critical Thinking: Assess the potential value of new technologies and see possibly beneficial applications. a. An ability to analyze a problem, and identify and define the computing requirements appropriate to its solution. b. An ability to analyze the local and global impact of computing on individuals, organizations, and society. c. Recognition of the need for and an ability to engage in continuing professional development. d. An ability to identify and analyze user needs and take them into account in the selection, creation, evaluation and administration of computer-based systems. V. Communication: Conduct computer research, organize a structured presentation (oral and written), and deliver it in a way that communicates to novice users as well as computer experts. a. An ability to function effectively on teams to accomplish a common goal b. An ability to communicate effectively with a range of audiences 2 III. Means of Assessing the Student Outcomes Embedded Computing and Mathematics Examination (COP 3375, Data Structures and Algorithms Assessment): In the data structures and algorithms course, COP 3375, students are required to solve problems by breaking these into smaller modules, solving these individually, and then synthesizing the solution to the original problem. The process involves critical thinking in understanding the problem and how to break it into smaller piece-parts and solve these. The entire effort involves programming the modules in Python and executing the code for a successful solution. (See Section IV, Student Outcomes 1a). Professional Ethics Case Study Presentation (CIS 4253, Information Technology Ethics Assessment): In the information technology ethics course, CIS 4253, assessment is done via the following two actions: - Students give oral presentations utilizing PowerPoint. - Students are given quizzes on five different topics, and assessed for their understanding and adherence to a code of ethics. Evaluation is based on a faculty-developed rubric. The rubric is also used on 6 sample cases chosen at random. (See Section IV, Student Outcomes 2a). Program Design Team Project (COP 3515, Program Design Team Assessment): In the program design course, COP 3515, students are required to work on a progressive team project spanning the entire semester, integrating new concepts and processes as these are learned. Students learn how team responsibilities are distributed to allow it to function as an orchestrated unit. Collectively students learn how to tackle and design solutions to big problems taking a top-down iterative approach using the UML modelling toolset. Students present the project and a report at the end of the semester. (See Section IV, Student Outcomes 4a, 4d, 5a, 5b). Capstone Project (CIS 4935, Senior Project / Approved Internship Capstone Assessment): In the senior project / approved internship capstone course, CIS 4935, students are required to complete a real-world project for a business or industry sponsor. The project requires each student to demonstrate technical knowledge, as well as computational and analytic skills. Consisting of four stages, students are required to complete the following: - Present an overview of the project or internship, focusing on why the project was needs, and how the problem was resolved. Challenges encountered and how these were overcome are also included in the presentation. (See Section IV, Student Outcomes 3a-3c, 4b, 4c, 4d, 5b). A demo of the final solution is also given (if applicable). (See Section IV, Student Outcomes 1b-1d). Students document the entire experience in a 4-6 page report, (See Section IV, Student Outcomes 3a-3c, 4b, 4c, 4d, 5b), and Capstone Examination (CIS 4935, Senior Project / Approved Internship Capstone Assessment): - Take a test to assess how well the objectives and five learning outcomes were met. (Note: this test is currently going through development). (See Section IV, Student Outcomes 1b-1d, 4a). 3 In addition to being graded by the professor, the project is externally evaluated for evidence of technical knowledge and skill sets by a team of faculty using an agreed-upon scoring rubric based on the educational objectives. Graduation Survey - Given to all students upon the completion of their degree. Graduates are asked to select the degree to which they agree or disagree with the following statements: “My critical thinking skills have improved,” “My writing skills improved,” and “My oral communication skills improved.” Scale: Strongly Disagree, Disagree, Neutral, Agree, Strongly Agree. (See Section IV, Student Outcomes 4a-4d, 5a, 5b). 4 IV. Assessment Results ACADEMIC PROGRAM: BS in Information Technology CIP Code: 11.0103 I. Technical Knowledge and Skills: Technical knowledge and skill sets (computational and analytic) needed for success in careers related to Information Technology. II. Professional Ethics: An understanding of professional ethics in the development and application of Information Technology. Program Educational III. Computer Processes and Systems: Design and develop computer processes and systems of advanced complexity. Objectives: IV. Critical Thinking: Assess the potential value of new technologies and see possibly beneficial applications. V. Communication: Conduct computer research, organize a structured presentation (oral and written), and deliver it in a way that communicates to novice users as well as computer experts. Student Outcomes Objective Means of Assessing Target 1a. An ability to apply knowledge of computing and mathematics appropriate to the discipline. I Embedded Computing and Mathematics Examination COP 3375 Students will average at least 75% correct. 1b. An ability to use current techniques, skills, and tools necessary for computing practice. I Capstone Examination CIS 4935 Students will average at least 75% correct. 1c. An ability to use and apply current technical concepts and practices in the core information technologies. I Capstone Examination CIS 4935 Students will average at least 75% correct. 1d. An understanding of best practices and standards and their application. I Capstone Examination CIS 4935 Students will average at least 75% correct. 2a. An understanding of professional, ethical, legal, security and social issues and responsibilities. II Professional Ethics Case Study Presentation with Slides CIS 4253 Average score of all student performances is at least (3.0) “Satisfactory.” Summary Assessment Results 5 Student Outcomes Objective Means of Assessing 3a. An ability to design, implement, and evaluate a computer-based system, process, component, or program to meet desired needs. III Capstone Project CIS 4935 Average score of all student performances is at least (3.0) “Satisfactory.” 3b. An ability to effectively integrate IT-based solutions into the user environment. III Capstone Project CIS 4935 3c. An ability to assist in the creation of an effective project plan. III Capstone Project CIS 4935 4a. An ability to analyze a problem, and identify and define the computing requirements appropriate to its solution. IV Capstone Project Critical Thinking assessment indicator Average score of all student performances is at least (3.0) “Satisfactory.” Average score of all student performances is at least (3.0) “Satisfactory.” Average score of all student performances is at least (3.0) “Satisfactory.” Average score of all student performances is at least (3.0) “Satisfactory.” Of students responding, 75% will agree or strongly agree with the following statement: “My critical thinking skills improved”. Average score of all student performances is at least (3.0) “Satisfactory.” Of students responding, 75% will agree or strongly agree with the following statement: “My critical thinking skills improved”. Average score of all student performances is at least (3.0) “Satisfactory.” Program Design Team Project Evaluation COP 3515 Graduation Survey Critical Thinking Skills 4b. An ability to analyze the local and global impact of computing on individuals, organizations, and society. IV Capstone Project Critical Thinking assessment indicator CIS4935 Graduation Survey Critical Thinking Skills 4c. Recognition of the need for and an ability to engage in continuing professional development. IV Capstone Project Critical Thinking assessment indicator CIS4935 Target Summary Assessment Results 6 Student Outcomes 4d. An ability to identify and analyze user needs and take them into account in the selection, creation, evaluation and administration of computer-based systems. Objective IV Means of Assessing Target Graduation Survey Critical Thinking Skills Of students responding, 75% will agree or strongly agree with the following statement: “My critical thinking skills improved”. Average score of all student performances is at least (3.0) “Satisfactory.” Capstone Project Critical Thinking assessment indicator CIS4935 Program Design Team Project Evaluation COP 3515 Graduation Survey Critical Thinking Skills 5a. An ability to function effectively on teams to accomplish a common goal V Program Design Team Project Evaluation COP 3515 Graduation Survey Oral Communication Skills 5b. An ability to communicate effectively (oral and written) with a range of audiences V Capstone Project CIS 4935 Program Design Team Project Evaluation COP 3515 Graduation Survey Writing Skills Summary Assessment Results Average score of all student performances is at least (3.0) “Satisfactory.” Of students responding, 75% will agree or strongly agree with the following statement: “My critical thinking skills improved”. Average score of all student performances is at least (3.0) “Satisfactory.” Of students responding, 75% will agree or strongly agree with the following statement: “My oral communication skills improved.” Average score of all student performances is at least (3.0) “Satisfactory.” Average score of all student performances is at least (3.0) “Satisfactory.” Of students responding, 75% will agree or strongly agree with the following statements: “My writing skills improved”, “My oral communication skills improved.” 7 V. Analysis of Results and Planned Changes Technical Knowledge and Skills: Technical knowledge and skill sets (computational and analytic) needed for success in careers related to Information Technology. Faculty Comments: Curricula Changes: Changes to the Assessment Process: Professional Ethics: An understanding of professional ethics in the development and application of Information Technology. Faculty Comments: Curricula Changes: Changes to the Assessment Process: Computer Processes and Systems: Design and develop computer processes and systems of advanced complexity. Faculty Comments: Curricula Changes: Changes to the Assessment Process: Critical Thinking: Assess the potential value of new technologies and see possibly beneficial applications. Faculty Comments: Curricula Changes: Changes to the Assessment Process: Communication: Conduct computer research, organize a structured presentation (oral and written), and deliver it in a way that communicates to novice users as well as computer experts. Faculty Comments: Curricula Changes: Changes to the Assessment Process: 8 VI. Dean’s Comments: (Dr. James Curran) 9