Associate of Applied Business in Accounting Performance Indicator 1. Student Learning Results Performance Measure (Competency) Description of Measurement Instrument to include Formative, summative, internal, external, or comparative. Results from the 2007 Department Assessment Test for AC114 Accounting I based on Goal #3 and Objective #8 for the department.The minimum competency set for this goal by the department is 72%. Formative and Internal Results from AC216 Intermediate Accounting II from fall 2008 based on Goal #8 and Objective #26. Formative and Internal The minimum competency set for this goal by the department is 72%. Definition Analysis of Results Areas of Analysis and Success Action Taken 13 students 6 received 100% 4 ranged from 90%98% 3 students received an 80% or below. Class average was a 90%. Test results will continue to be closely monitored. We are recommending more tutoring services for more students; having more pop quizzes Results of Action Taken (occurs in the following year) We went from a 4 credit hr. class to a 5 credit hr,; do more on-hands work; have employed online e-learning applications with instant feedback Insert Graph of Resulting Trends for 3-5 Years (please graph all available data up to five years) 95% 90% 85% 2007 80% 2008 75% 2009 70% 65% AC114 Question #1 – 75% average Question #2 – 95% average Question #3 – 90% average Question #4 – 85% average Question #5 – 90% average Question #6 – 80% average Question #7 – 80% average Question #8 – 54% average Question #9 – 59% average Test results will continue to be closely monitored. We are recommending more tutoring services for more students; having more pop quizzes Went from 3 intermediate classes to 2 classes and extended these classes from 4 credit hrs. to 5 credit hrs.; started using elearning with instant feedback. 95% 90% 85% 2007 80% 2008 75% 70% AC216 Associate of Applied Business in Agribusiness Marketing / Management Technology Performance Indicator 1. Student Learning Results Performance Measure (Competency) Description of Measurement Instrument to include Formative, summative, internal, external, or comparative. Students in AG106 will achieve an average score greater than 75% on the end assessment. A minimum 20% increase will be seen between the beginning assessment and the end assessment. The test was a formative internal pre test second day of class and the same test the final day of class. Comparative. Students in AG211 received an assessment on the important characteristics required in agriculture. This measurement focused on the idea of centralization of the food system. Students will achieve an average score greater than 75% on the end assessment. A minimum 20% increase will be seen between the beginning The test was a formative internal pre test second day of class and the same test the final day of class. Comparative. Definition Analysis of Results Areas of Success Analysis and Action Taken A double of average score. Student scores increased. Will continue to try to improve on these assessment results by furthering focusing on the concepts that students have difficulty understanding. Will continue to further focusing on the concept of centralization in the food system so that students have an increased understanding. Results of Action Taken (occurs in the following year) AG 106 was changed to improve the key concept of the framework of agriculture marketing. The class is now more on the how and why of agricultural marketing and the effect it has to agricultural business. We discuss and use examples of different commodity markets. AG211 was changed to improve the key concept of the changes that are taking place in the livestock industry. These changes have an effect on how these markets are evolving for the farmers, agribusinesses, and the consumers. Students need to know this evolution is much different from the livestock industry 20 years ago. Insert Graph of Resulting Trends for 3-5 Years (please graph all available data up to five years) 100% 80% Fall 2009 Beginning 60% 40% Fall 2009 End 20% 0% AG106 100% 80% 60% 40% 20% 0% % Students Correct 2009 Fall Begin ning 2009 Fall End assessment and the end assessment. Associate of Applied Business in Automotive Management / Automotive Aftermarket Management Performance Indicator 1. Student Learning Results Performance Measure (Competency) Final Project 80% of the students will demonstrate proficiency in applying the SWOT analysis to the Automotive Market. On the paperflow project in MA127 students will demonstrate an 80% or higher on three different scenarios. Description of Measurement Instrument to include Formative, summative, internal, external, or comparative. Summative Formative, internal. Definition Analysis of Results Areas of Success Analysis and Action Taken Students properly applying a SWOT analysis to a real world market instead of a textbook situation. All four average scores were higher than the standard of 80%. Results of Action Taken (occurs in the following year) The department will continue to closely monitor future outcomes related to applying the SWOT analysis to the automotive market. The changes made for 2009 will continue to be used because of the increase in scores. Due to the slight decrease in the class average, the department will continue to closely monitor future outcomes related to paperflow projects. The scores will be monitored for another year before additional changes are made to the activity. Insert Graph of Resulting Trends for 3-5 Years (please graph all available data up to five years) 150% 100% 2008 50% 2009 0% SWOT Analysis Score 90% 90% 89% 89% 2009 88% 2010 88% 87% Average Score Associate of Applied Business in Business Administration Performance Indicator 1. Student Learning Results Performance Measure (Competency) G1: Students will demonstrate an understanding of the planning function of management by: O1: Applying the decision-making process. Description of Measurement Instrument to include Formative, summative, internal, external, or comparative. Formative Internal Average score on final course project addressing differing leadership styles of leaders from two distinct time periods. Data collected during BU100 Survey of Business Leaders. Definition Analysis of Results Areas of Analysis and Success Action Taken The department defines ‘acceptable’ performance as a 72% or above to avoid academic issues. Despite this, continued improvement in all student learning outcomes must always be the goal. Improvement was not noted. Many students lost points related to grammatical and/or punctuation errors. Results of Action Taken (occurs in the following year) After review, it was determined, given the department rotation sheets, many students may not have taken the proper English composition courses prior to attempting BU100 and its research paper. If the research paper is kept as a requirement, more information is needed to assist students in completing the necessary requirements as it relates to grammatical and/or punctuation issues. Insert Graph of Resulting Trends for 3-5 Years (please graph all available data up to five years) 73% 72% 72% 71% 2008 71% 2009 70% 70% 69% BU100 G1: Students will demonstrate an understanding of the planning function of management by: O1: Applying the decision-making process. O2: Discriminating between the types of problems, decisions, biases, errors and decision-making styles that exist in organizations and managers. O3: Recalling the terminology and definitions associated with planning and decision making. O4: Practicing the techniques for decision-making. G2: Students will demonstrate an understanding of the organizing function of management by: O4: Analyzing, interpreting and implementing organizational structure variables to the human resource management process Formative Internal Average score on all homework assignments related to decision-making and the multiple legal issues of business. Data collected during BU115 Contract Law. Formative Internal Average score on multiple choice test questions (N = 15) specifically related to organizational structure. Data collected during MA121 Principles of Management. The department defines ‘acceptable’ performance as a 72% or above to avoid academic issues. Despite this, continued improvement in all student learning outcomes must always be the goal. Although improvement was not noted, both sections of the course remained well above the university’s guideline for acceptable performance. Test results are analyzed by the instructor, and reviewed during the class following the scheduled test. After each test, questions are re-written based on students’ in-class feedback. 84% 83% 82% 81% 2008 80% 2009 79% 78% BU115 A practice assignment was scheduled so students would better understand how to implement the final project requirements. The instructor provided written feedback to each student. The department defines ‘acceptable’ performance as a 72% or above to avoid academic issues. Despite this, continued improvement in all student learning outcomes must always be the goal. All test items missed by a majority of students in any class section are reviewed for correct wording, relevancy, accuracy, etc. Questions that pass these standards and continue to troublesome for students are specifically addressed during lecture and via homework assignments. Given these results, more care will be taken specifically related to organizational structural definitions, variables, etc. in order to see the average continue to increase. 70% 69% 68% 67% 2008 66% 2009 65% 64% MA121 Associate of Applied Business in Information Technology, Digital Multimedia Design Concentration Performance Indicator 1. Student Learning Results Performance Measure (Competency) DG1: Students will demonstrate an understanding of application software used in multimedia by: DO1: Recognizing the foundational and functional applications in multimedia software, To be measured I n the DM118 final exam. The Department has set a minimum competency for this area to be 75%. Description of Measurement Instrument to include Formative, summative, internal, external, or comparative. Faculty-designed examination. Formative Definition Analysis of Results Areas of Success Analysis and Action Taken Students answering question #96 – 84.6% correct Students answering question #18 – 84.6% correct Average for all questions: 84.6% in 2009. The Department will reconsider teaching approaches to the material in order to increase the scores. Results of Action Taken (occurs in the following year) More time was dedicated to these specific learning outcomes. Homework was changed to allow repetition in this area. Insert Graph of Resulting Trends for 3-5 Years (please graph all available data up to five years) 2009 100% 80% 60% 40% 20% 0% G1, O1 Results 2009 Faculty-designed DG2: Students will examination. demonstrate an Formative understanding of all the design concepts in relation to digital multimedia by: DO4: Describing various styles used within digital multimedia Students answering question #89 – 96.2% correct Students answering question #90 – 84.6% correct Average for all questions: 90.4% in 2009 The Department will reconsider teaching approaches to the material in order to increase the scores. We added an extra project that addressed this specific issue. To be measured in the DM118 final exam. 100% 80% 60% 2009 40% To be measured in the DM118 final exam. The Department has set a minimum competency for this area to be 75%. Faculty-designed DG2: Students will examination. demonstrate an Formative understanding of all the design concepts in relation to digital multimedia by: DO5: Identifying the visua limits imposed by media restrictions for print and web use 2009 20% 0% G2, O4 Results Students answering question #10 – 100% correct Students answering question #16 – 84.6% correct Average for all questions: 92.3% in 2009 The Department will reconsider teaching approaches to the material in order to increase the scores. Class was given a group project to find and discuss these limitations. 2009 100% 80% 60% 40% 20% The Department has set a minimum competency for this area to be __ %. 0% G2, O5 Results 2009 Associate of Applied Business in Information Technology, Microsoft Networking Technology Concentration Performance Indicator 1. Student Learning Results Performance Measure (Competency) Description of Measurement Instrument to include Formative, summative, internal, external, or comparative. MN298 final exam will be used as a measurement tool. Demonstration of students’ understanding of controlling access to resources and auditing access to resources is measured by this final exam. The standard set by the Department is that on average students will receive a 75% or greater on this assessment. Faculty-designed examination. Formative Definition Analysis of Results Areas of Success Analysis and Action Taken Students overall average was 78% in 2009. Out of 13 students, 7 scored above 75% The Department is reconsidering teaching approaches to the material in order to increase the scores. Results of Action Taken (occurs in the following year) More hands-on exercises or labs will be implemented to insure student competency in this area. Insert Graph of Resulting Trends for 3-5 Years (please graph all available data up to five years) 86% 84% 82% 2008 80% 2009 78% 76% 74% MN 298 MN299 final exam will be used as a measurement tool. Demonstration of students’ understanding of designing a network infrastructure that meets business requirements is measured by this final exam. The standard set by the Department is that on average students will receive a 75% or greater on this assessment. Faculty-designed examination. Formative Students overall average was 83% in 2009. Out of 13 students, 9 scored above 75% The Department is reconsidering teaching approaches to the material in order to increase the scores. More examples of business needs analysis will be covered in class. 82% 81% 80% 2008 79% 2009 78% 77% 76% MN299 Associate of Applied Business in Information Technology, Network Security Concentration Performance Indicator 1. Student Learning Results Performance Measure (Competency) Description of Measurement Instrument to include Formative, summative, internal, external, or comparative. NS259 final exam will be used as a measurement tool. Demonstration of students’ understanding of installation, configuration, and administration of firewalls on a computer system is measured by this final exam. The standard set by the Department is that on average students will receive a 75% or greater on this assessment. NS147 final exam will be used for the measurement tool. Demonstration of students’ understanding of subnetting is measured by the final exam. The standard set by the Department is that on average students will receive a 75% or greater on this assessment. Faculty-designed examination. Formative Definition Analysis of Results Areas of Success Analysis and Action Taken Students overall average was 78% in 2009. Out of 11 students, 6 scored above 75% The Department is reconsidering teaching approaches to the material in order to increase the scores. More hands-on exercises involving various hardware devices is of highest importance. Results of Action Taken (occurs in the following year) We will be using hardware devices in future classes. Insert Graph of Resulting Trends for 3-5 Years (please graph all available data up to five years) 86% 84% 82% 2008 80% 2009 78% 76% 74% NS259 Faculty-designed examination. Formative Students overall average was 81% in 2009. Out of 11 students, 8 scored above 75% The Department is reconsidering teaching approaches to the material in order to increase the scores. More examples of subnetting will be covered in class. 82% 81% 81% 80% 2008 80% 2009 79% 79% 78% NS147 Associate of Applied Business in Legal Office Management Performance Indicator 1. Student Learning Results Performance Measure (Competency) KY 146 final exam – keyboarding portion Description of Measurement Instrument to include Formative, summative, internal, external, or comparative. Faculty-designed examination Formative The Department is working towards an average score of 80%. OP 276 final exam Office procedures portion The Department is working towards an average score of 80%. Faculty-designed examination Formative Definition Analysis of Results Areas of Analysis and Success Action Taken Average grades increased in Spring 2010, but there was a decrease from 2009. In 2008, students scored 89% on average which is above the standard set by the Department; however, this average fell to below the standard in 2009. The Department plans to change the current approach to teaching the material. The Department plans to change the current approach to teaching the material. Results of Action Taken (occurs in the following year) Insert Graph of Resulting Trends for 3-5 Years (please graph all available data up to five years) A reorganization of material was implemented so all letters, memos, reports and tables are taught individual sections, which was changed from the front of the book to the back – lesson to lesson. 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% KY146 Exam Records management rules are now reviewed. 90% 2009 Winter 2010 Spring 2010 85% 2008 80% 2009 75% 70% OP276 Associate of Applied Business in Marketing Performance Indicator 1. Student Learning Results Performance Measure (Competency) G2: Students will demonstrate an understanding of the pricing function of marketing by: O7: Recalling the terminology and definitions associated with the pricing function of marketing. G2: Students will demonstrate an understanding of the pricing function of marketing by: O7: Recalling the terminology and definitions associated with the pricing function of marketing. Description of Measurement Instrument to include Formative, summative, internal, external, or comparative. Formative Internal Average score on select test questions specifically related to the Pricing function. Data collected during MT120 Advertising. Formative Internal Average score on multiple choice test questions (N = 27) specifically related to the Pricing function. Data collected during MT220 Marketing 1. Definition Analysis of Results Areas of Analysis and Success Action Taken The department defines ‘acceptable’ performance as a 72% or above to avoid academic issues. Despite this, continued improvement in all student learning outcomes must always be the goal. The department defines ‘acceptable’ performance as a 72% or above to avoid academic issues. Despite this, continued improvement in all student learning outcomes must always be the goal. Results of Action Taken (occurs in the following year) Insert Graph of Resulting Trends for 3-5 Years (please graph all available data up to five years) All test items missed by a majority of students in any class section are reviewed for correct wording, relevancy, accuracy, etc. Questions that pass these standards and continue to troublesome for students are specifically addressed during lecture and via homework assignments. The department determined the former advertising text was written at a level higher than appropriate for a 100-level, freshman course. The new text maintains the course description but allows for the study of advertising in a new and hopefully interesting way. 120% All test items missed by a majority of students in any class section are reviewed for correct wording, relevancy, accuracy, etc. Questions that pass these standards and continue to troublesome for students are specifically addressed during Questions that pass these standards and continue to be troublesome for students are specifically addressed during lecture, via homework assignments, and acknowledged during the exam review session. 100% 100% 80% 60% 2008 40% 2009 20% 0% MT120 80% 60% 2008 40% 2009 20% 0% MT220 lecture and via homework assignments. Associate of Applied Business in Medical Office Management Performance Indicator 1. Student Learning Results Performance Measure (Competency) KY 146 final exam – keyboarding portion Description of Measurement Instrument to include Formative, summative, internal, external, or comparative. Faculty-designed examination Formative The Department is working towards an average score of 80%. OP 149 final exam – Records Management portion The Department is working towards an average score of 80%. Faculty-designed examination Formative Definition Analysis of Results Areas of Success Analysis and Action Taken Average grades increased in Spring 2010, but there was a decrease from 2009. Students scored 64% and72% on average which is below the standard set by the Department. The Department plans to change the current approach to teaching the material. The Department plans to change the current approach to teaching the material. Results of Action Taken (occurs in the following year) Insert Graph of Resulting Trends for 3-5 Years (please graph all available data up to five years) A reorganization of material was implemented so all letters, memos, reports and tables are taught individual sections, which was changed from the front of the book to the back – lesson to lesson. 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% KY146 Exam We are now spending more time in class on the simulation jobs. Also, the final exam has been changed to mirror the simulation jobs which is a handson test instead of multiple choice and matching. 74% 72% 70% 68% 66% 64% 62% 60% 2009 Winter 2010 Spring 2010 2008 2009 OP149 Associate of Applied Business in Office Management Performance Indicator 1. Student Learning Results Performance Measure (Competency) KY 146 final exam – keyboarding portion Description of Measurement Instrument to include Formative, summative, internal, external, or comparative. Faculty-designed examination Formative The Department is working towards an average score of 80%. OP 149 final exam – Records Management portion The Department is working towards an average score of 80%. Faculty-designed examination Formative Definition Analysis of Results Areas of Analysis and Success Action Taken Average grades increased in Spring 2010, but there was a decrease from 2009. Students scored 64% and72% on average which is below the standard set by the Department. The Department plans to change the current approach to teaching the material. The Department plans to change the current approach to teaching the material. Results of Action Taken (occurs in the following year) Insert Graph of Resulting Trends for 35 Years (please graph all available data up to five years) A reorganization of material was implemented so all letters, memos, reports and tables are taught individual sections, which was changed from the front of the book to the back – lesson to lesson. 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% KY146 Exam We are now spending more time in class on the simulation jobs. Also, the final exam has been changed to mirror the simulation jobs which is a hands-on test instead of multiple choice and matching. 74% 72% 70% 68% 66% 64% 62% 60% 2009 Winter 2010 Spring 2010 2008 2009 OP149 Associate of Applied Business in Word Processing / Administrative Support Performance Indicator 1. Student Learning Results Performance Measure (Competency) KY 146 final exam – keyboarding portion Description of Measurement Instrument to include Formative, summative, internal, external, or comparative. Faculty-designed examination Formative The Department is working towards an average score of 80%. OP 149 final exam – Records Management portion The Department is working towards an average score of 80%. Faculty-designed examination Formative Definition Analysis of Results Areas of Analysis and Success Action Taken Average grades increased in Spring 2010, but there was a decrease from 2009. Students scored 64% and72% on average which is below the standard set by the Department. The Department plans to change the current approach to teaching the material. The Department plans to change the current approach to teaching the material. Results of Action Insert Graph of Taken (occurs in Resulting Trends for 3the following 5 Years (please graph year) all available data up to five years) A reorganization of material was implemented so all letters, memos, reports and tables are taught individual sections, which was changed from the front of the book to the back – lesson to lesson 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% KY146 Exam We are now spending more time in class on the simulation jobs. Also, the final exam has been changed to mirror the simulation jobs which is a hands-on test instead of multiple choice and matching. 74% 72% 70% 68% 66% 64% 62% 60% 2009 Winter 2010 Spring 2010 2008 2009 OP149 General Information for the College of Business pertaining to all accredited programs. Performance Indicator 1. Student Learning Results Definition A student learning outcome is one that measures a specific competency attainment. Examples of a direct assessment (evidence) of student learning attainment that might be used include: capstone performance, third-party examination, faculty-designed examination, professional performance, licensure examination). To help students succeed, community colleges must both assess skills and remediate deficiencies before students take more than 25 percent of the credits in business programs. Add these to the description of the measurement instrument in column two: Formative – An assessment conducted during the student’s education. Summative – An assessment conducted at the end of the student’s education. Internal – An assessment instrument that was developed within the business unit. External – An assessment instrument that was developed outside the business unit. Comparative – Compare results between classes, between online and on ground classes, Between professors, between programs, between campuses, or compare to external results such as results from the U.S. Department of Education Research and Statistics, or results from a vendor providing comparable data. Performance Measure (Competency) Writing Skills – CAAP Essay Writing Test Students will perform at or above the national average. Description of Measurement Instrument to include Formative, summative, internal, external, or comparative. Students in UN292 Portfolio Capstone complete the CAAP Essay test in order to obtain normative comparable scores for writing. Summative, External, Comparative Analysis of Results Areas of Analysis and Success Action Taken The majority of students completing the CAAP essay writing test in 2007 scored within the middle-range categories of 3 (adequate) and 4 (competent). The assessment newsletter, “Closing the Loop,” highlighted to faculty that, “UNOH students struggle to clearly state the purpose and thoroughly develop content and evidence. CAAP scoring indicates the need for more elaboration and explanation as well as improved mechanics, Results of Action Taken (occurs in the following year) Insert Graph of Resulting Trends for 3-5 Years (please graph all available data up to five years) Scores on the test did improve. 2007 and 2008 CAAP Essay Writing Results (Scores range from 1.00-6.00) UNOH student averages increased by 8.09% based on national norms. Percentile based on national norms: 2007: 59.29% 2008: 67.31% usage, or sentence structure. Critical Thinking Skills – CAAP Critical Thinking Test Students will perform at or above the national average. Students in UN292 Portfolio Capstone complete the CAAP Critical Thinking test in order to obtain normative comparable scores for critical thinking. Scores range from 40 (low) to 80 (high) for this test. Students have an average of 59.14 for 2007. More activities devoted to critical thinking were added to individual courses. Faculty also are attending more training sessions on critical thinking topics. 5 4.5 4 3.5 3 2.5 2 1.5 1 0.5 0 Scores on the test did improve, although not drastically. Percentile based on national norms: 2007: 32.86% 2008: 35.52% Summative, External, Comparative Mathematics Skills – CAAP Mathematics Test Students will perform at or above the national average. Students in UN292 Portfolio Capstone complete the CAAP Mathematics test in order to obtain normative comparable scores for writing. Summative, External, Comparative Scores range from 40 (low) to 80 (high) for this test. Students have an average of 54.6 for 2007. Lower level math had the lowest score and percentile based on national norms for all of the CAAP tests completed; however, when all subjects are compared to national norms, baccalaureate level math results are much higher than the other scores. Faculty were asked what could be done to There was a decrease in the math scores from 2007 to 2008, although it was only a slight decrease. Percentile based on national norms: 2007: 27% 2008: 25.42% 2007 2008 2007 and 2008 CAAP Critical Thinking Results (Scores range from 40-80) 80 70 60 50 40 30 20 10 0 2007 2008 2007and 2008 CAAP Mathematics Results (Scores range from 40-80) increase math abilities in the associate degree level? 70 60 50 40 30 2007 20 2008 10 0