Assessment institute Department of Engineering Technology ET 110 – Electric Circuit Analysis Spring 2016 6/8/16 INTRODUCTION ET 110 – “Electrical Circuit Analysis” is a circuit and power analysis of direct current “dc” circuitries for engineering technology students. The course is designed for first year students in Electrical or Computer Engineering Technology program. It introduces students to theory and principles of circuit analysis such as series, parallel, and seriesparallel dc circuit; application of network theorems (Thevenin’s theorem, Norton’s theorem, and maximum power transfer) and circuit methods of analysis (mesh and nodal analysis, and source transformation) to solve dc circuits; dc power analysis; capacitance and inductance principles and applications. The course includes three hours of laboratory work, and in order to pass the course, a passing grade must be obtained in both the lecture and the laboratory components of the course. The assessment project This assessment project focuses on the lecture final exam that students have to take at the end of the Spring 2016 semester. There are 5 sessions of ET 110 course, and two sessions are participating on the assessment concluding a total of 56 students being assessed for the semester of Spring 2016. Both of the participated sessions will have the same amount of questions and topics, but different problem number. The final exam is graded base on how well students apply their engineering technology knowledge and problem solving skills to analyze and solve dc circuits. This grade is based on “Engineering Technology Knowledge and Problem Solving Skills Scoring Rubric” (see Appendix 1A, 1B, 1C, and 1D). Each rubric scores students ability to analyze and solve a dc circuit as Excellent (4), Good (3), Average (2), and Poor (1). The final exam has 7 selected problem solving questions (with 22 subquestions) developed according to Bloom’s Taxonomy Hierarchy Level 1 (Knowledge), Level 2 (Comprehensive), and Level 4 (Analysis) (See Appendix 3A). Those questions evaluate student’s knowledge on circuit analysis under dc condition. The final exam is individual, and all 7 questions are used to evaluate one specific rubric outcome (See Appendix 3A). The main objective of the final exam is to test on how well students understand the language of circuit analysis and how they apply them to select the proper and more feasible method of analysis to solve a problem, and how well they use engineering technology mathematics to formulate and answer dc electrical circuits. Once the data are collected and evaluated, the results of this assessment project is used to analyze the reasons why students are not fully achieving their learning goals in their major courses such as ET 110 – Electric Circuit Analysis. The analysis is going to help instructor to find a way to improve teaching methodology and out of school supporting materials used to develop each learning goal. These improvements will apply for the following semester, Fall 2016, and we will expect to have an increment on the percent of students with a passing grade of Good or Excellent on the final exam. Student learning outcomes The learning outcomes for this project are listed on Table 1 - Engineering Technology Knowledge and Problem Solving Skills Outcomes (see Appendix 1). Each learning outcome focus on Table 2 - General Education Outcomes (see Appendix 2). To assess each student learning outcomes, 4 rubrics (1A, 1B, 1C, and 1D) are created based on the learning outcome from Table 1. Each rubric has a specific performance indicator for each course outcomes, and a brief description of the activity and scoring used to evaluate student work on that specific outcome (See Appendix 1A, 1B, 1C, and 1D). Each specific outcome is designed to analyze how well students develop their conceptual theory and critical decision maker knowledge throughout their academic semester, and how proficient they use and apply them in a field of engineering technology. A student who scores an Excellent on a specific indicator implies that he/she has developed a well understanding on the problem solving and analytical skills that he/she needs to analyze electric circuits through his/her engineering technology career. On the other hand, a student who scores a Poor on a specific indicator implies that he/she was not able to achieve the necessary knowledge to identify, analyze, and evaluate an electric circuit problem. Results Data Analysis All students are taking the final exams with their respective lecture instructor. Each lecture instructor has to grade each student’s exam, fill up the Assessment Excel file (See Appendix 3A) and each assessment rubrics. All results are organized into one Assessment Analysis Sheet (Excel file) with the list of all students and the following info: The student’s name, the question number and brief description, the rubric that the question is being assessed, Bloom’s Taxonomy Level of Difficulty, the percent of correct answer per question, and the counts of each rubrics’ score (See Appendix 3A) Once the results are collected, the questions are organized by the increasing percent of correct answer. From the range, a simple analysis is applied to the question with the lowest percent of correct answer. Having the question number with the lowest percent, a list is made, List 1, with the name of students who scored Poor on that particular (See Appendix 4). After it, the final exam of each student from List 1 is analyzed. The analysis is divided into two categories: general and specific analysis. The general analysis describes the clearness of the question and the Bloom’s Taxonomy Level. The specific analysis evaluates the student understanding on the question: the organization of procedure used to solve the problem, the employment of the most feasible method of analysis used to solve the problem, the portion of the question that was answered in a given time, and if the answer is written with the proper engineering notation and significant digits (See Appendix 5). The last step of data and result analysis is to find if the department and the course offer the adequate supporting materials for students to achieve their major academic goals. For this analysis I use the “Squared Matrix of Analysis”. This Squared matrix has two types of materials for analysis: The result of Specific Analysis and the list of the Supporting Materials offer by the course and department (See Appendix 6). Having the list of these two materials, the matrix combines all possible relationship between Specific Analysis and Supporting Materials. From the combination, a list of all possibilities is obtained, and in conjunction with the final exam result, we can analyze the reasons why students are having difficulties to achieve their academic goals. The results of this squared matrix are used to propose new teaching methodology to improve student performance in circuit analysis. The suggest materials will be implemented by the following semester, Fall 2016. On Fall 2016, I am projecting to apply the same or similar assessment hopefully to all ET 110 sessions, and again data will be collected and analyzed. The goal for Fall 2016 analysis will be: 1. To increment the percent of students scoring Good and Excellent 2. To improve students understanding in the language of circuit analysis and proper application of engineering technology math to formulate and solve a dc circuit. 3. To improve students critical thinking in selecting the correct and most feasible method of analysis to solve and/or build electronic circuits. Assessment timeline Date Spring 2016 1st and 2nd week of February 1st week of April Last week of May 1st week of June Action Fall 2016 1st and 2nd week of September Invite ET 110 lecture instructor to participate in assessment 1st week of October Last week of December 1st week of January 2017 February - April 2017 Distribute assessment material to participated ET 110 lecture instructor Collect assessment material and results of final exam. Organize and analyze collected data and result. Present result and report of data. Propose actions for improvement. Preparation to publish paper Assessment results For the spring 2016 semester, data and result of the final exam of two sessions of ET110 courses were used for assessment. The total number of assessed students was 56, 38 students from session C13B and 18 students from session G24. The result reveals that most students have difficulties in analysis a complex circuit using mesh analysis. The two lowest percent of students who answered the question correctly were questions about method of circuit analysis using mesh analysis: 9% and 26% of the students answered question 2C and 2B, respectively, correctly. The questions were to find the current (2C, Bloom’s taxonomy level of Comprehensive) and voltage (2B, Bloom’s taxonomy level of Knowledge) through each resistor using the mesh current. On the other hand, 89% of the students were able to analyze and solve for a series-parallel circuit, which have a Bloom’s taxonomy level of Comprehensive (See Appendix 3B). Using the results in Appendix 3B, a detail analysis was made to the question with the lowest percent of students who answered it correctly, which was question 2C. This result shows that students who could not answer question 2C have difficulties in applying the respective circuit analysis theory to solve for the problem. Based on it, I am planning to organize and improve some supporting materials for the course and apply them for next semester, fall 2016. Some of the materials include tutoring service offer by the department, homework assignments, educational videos, and offline learning materials. The main objective of these improvements is to assist students in their academic learning process on circuit analysis, and so, improve students’ critical thinking in selecting the most feasible method of analysis to solve and/or build electronic circuits. Appendix 1 – Table 1 (Engineering Technology Knowledge and Problem Solving Skills Outcomes Table 1 - Engineering Technology Knowledge and Problem Solving Skills Outcomes Specific General ET 110 – Introduction to Circuit Analysis Course Outcome Performance Education Indicator Objective 1A 4 Commitment to quality, timeliness, and continuous improvement. 1B 2, 3, 9 Understand the theory and principals of circuit analysis, and be proficient in the use of engineering technology mathematics to formulate and solve problems. 1C 2, 5, 6 Have the ability to conduct system analysis and choose the most feasible solution to solve and/or build an electrical circuit. 1D 2, 5, 6 Be capable to apply standard engineering technology procedure and protocol to analyze a given system. Appendix 1A – Specific Performance Indicator Rubric 1A Appendix 1B – Specific Performance Indicator Rubric 1B Appendix 1C – Specific Performance Indicator Rubric 1C Appendix 1D – Specific Performance Indicator 1D Appendix 2 – Table 2 (General Education Outcomes) 1 2 3 4 5 6 7 8 9 10 Table 2 – General Education Outcomes Communicate effectively through reading, writing, listening and speaking Use analytical reasoning to identify issues or problems and evaluate evidence in order to informed decisions Reason quantitatively and mathematically as required in their fields of interest and in everyday life Use information management and technology skills effectively for academic research and lifelong learning Integrate knowledge and skills in their program of study Differentiate and make informed decisions about issues based on multiple value systems Work collaboratively in diverse groups directed at accomplishing learning objectives Use historical or social sciences perspectives to examine formation of ideas, human behavior, social institutions, or social processes Employ concepts and methods of the natural and physical sciences to make informed judgments Apply aesthetic and intellectual criteria in the evaluation or creation of works in the humanities or the arts Appendix 3A – Assessment Analysis Sheet Appendix 3B – Assessment Analysis Sheet (with results) Appendix 4 – List 1 – Students who scored “Poor” for question # 2C Appendix 5 – Detail Analysis for question with the highest percent of Poor answers Appendix 6 – Squared Matrix of Data Analysis Specific Analysis 1. Organization of procedure used to solve the problem:__% 2. Employment of the most feasible method of analysis used to solve the problem:__% 3. Portion of the question that was answered in a given time:__% 4. Answer is written with the proper engineering notation and significant digits: ___% Supporting Course Material A. Tutoring Service: available date and quality of tutors B. Course materials: Homework, textbook reading, quiz C. Online learning services: blackboard, online videos. D. Offline learning materials: Circuit Challenge Cross Matrix Results 1.A. Is there any tutoring services that help studentswith organization and procedure to solve engineering technology problems? 1.A 1.B. Is there any course materials that help students with organization and procedure to solve engineering technology problems? 1.C. Is there any online learning services that help students with organization and procedure to solve engineering technology problems? 1.D. Is there any offline learning services that help students with organization and procedure to solve engineering technology problems? 2.A. Is there any tutoring services that help studentsto apply the most feasible method of analysis to solve an engineering technology problem? 2.B. Is there any course materials that help students to apply the most feasible method of analysis to solve an engineering technology problem? 1.B 1.C 1.D 2.A 2.B 2.C. Is there any online learning services that help students to apply the most feasible method of analysis to solve an engineering technology problem? 2.D. Is there any offline learning services that help students to apply the most feasible method of analysis to solve an engineering technology problem? 3.A. Is there any tutoring services that help studentsto answer engineering technology question in a given time? 2.D 3.B. Is there any course materials that help students to answer engineering technology question in a given time? 3.B 3.C. Is there any online learning services that help students to answer engineering technology question in a given time? 3.D Is there any offline learning services that help students to answer engineering technology question in a given time? 4.A. Is there any tutoring services that help students to answer engineering technology question with a proper notation and significant digits? 4.B. Is there any course materials that help students to answer engineering technology question with a proper notation and significant digits? 4.C. Is there any online learning services that help students to answer engineering technology question with a proper notation and significant digits? 4.D. Is there any offline learning services that help students to answer engineering technology question with a proper notation and significant digits? 2.C 3.A 3.C 3.D 4.A 4.B 4.C 4.D