Motlow State Community College Program Student Learning Outcomes Use of Assessment Results Spring Semester 2009 Program Title: General Education, University Parallel Major Course: MATH 1530 – Elementary Statistics This course satisfies the mathematics requirements for the following emphases under the University Parallel major: agriculture, art, biology, criminal justice administration, English, environmental science, general studies, geography, health & physical education, history, honors scholar, mass communications, political science, pre-law, pre-nursing, pre-physical therapy, preveterinary medicine, recreation, social science, social work, sociology, speech & theatre. This course is an introduction to probability and statistics without calculus. Topics covered include sampling, frequency distribution, elementary probability, hypothesis testing, linear regression and correlation, analysis of variance and non-parametric statistics. Expected Student Learning Outcome: After completing MATH 1530, students will use mathematics to: a. Solve problems and determine if the solutions are reasonable. b. Model real world behaviors and apply mathematical concepts to the solution of real-life problems. c. Make meaningful connections between mathematics and other disciplines. d. Use technology for mathematical reasoning and problem solving. e. Apply mathematical and/or basic statistical reasoning to analyze data and graphs. Performance Measure(s): A pre-test was administered either the first or second day of class and the post-test containing exactly the same questions were embedded in tests just prior to the final or as a part of the final. (This detail was left to the discretion of the individual instructor.) The questions included the following topics: frequency distribution, probability, measures of central tendency, measures of dispersion, Central Limit Theorem, normal distribution, confidence intervals, hypothesis testing, and linear regression. Effectiveness Standard: Effectiveness is determined according to the following two measures: 1. The post-test average score will be at least 20 percentage points higher than the pretest average score. 2. Each item will have at least 50% correct responses. 1 Assessment Results: 1. Assessment results showed a 45 percentage point gain from pre-test to post-test, as the average of the pre-test scores was 22 and the average of the post-tests was 67. 2. Post-test data from item analysis, however, indicate that more than 23 of the 44 students (i.e. more than 50%) responded incorrectly the problems 2, 4, and 5. Results of the pre-test were as follows: (44 students) Expected Student Learning Outcome a a b b c c d d e e Question number Number Missed 1 2 3 4 5 6 7 8 9 10 29 39 39 33 40 36 39 20 37 31 Number Correct % missed 15 5 5 11 4 8 5 24 7 13 66% 89% 89% 75% 91% 82% 89% 45% 84% 70% % correct 34% 11% 11% 25% 9% 18% 11% 55% 16% 30% Results of the post-test were as follows: Expected Student Learning Outcome Question number Number Missed Number Correct % missed % correct a a b b c c d d e e 1 2 3 4 5 6 7 8 9 10 6 23 7 25 24 21 21 6 10 3 38 21 37 19 20 23 23 38 34 41 14% 52% 16% 57% 55% 48% 48% 14% 23% 7% 86% 48% 84% 43% 45% 52% 52% 86% 77% 93% Change in percentage points from preto posttest 52 37 73 18 36 34 41 31 61 63 Forty-four (44) students took both the pre-test and the post-test. The average of the pre-test scores was 22% and the average of the post-test scores was 67%. Assessment results showed a 45 percentage point gain from pre-test to post-test, thus meeting the effectiveness standard 2 that the post-test average score be at least 20 percentage points higher than the pre-test average score. The effectiveness standard that each item will have at least 50% correct responses on the posttest was not met by problems 2, 4, and 5. The student learning outcome for Question 2, is “a. Solve problems and determine if the solutions are reasonable.” The student learning outcome for question 4 is “b. Model real world behaviors and apply mathematical concepts to the solution of real-life problems.” The student learning outcome for question 5 is “c. Make meaningful connections between mathematics and other disciplines.” Use of Assessment Results: The initial teaching of the items identified in the item analysis as needing improvement occurs in this course; therefore, faculty will place emphasis on the areas with greater than 22 incorrect responses so that when MATH 1530 is assessed in spring 2011, according to the assessment cycle, results should indicate gains have been made in student learning. Questions 2, 3, 5, 6, 7, and 9 were missed by 80% or more of the students who took the pre-test. On the post test question 2 was missed by 52%, question 3 by 16%, question 5 by 55%, question 6 by 48 %, question 7 by 48% and question 9 by only 23% of the students. Each of these questions had a gain of at least 34 percentage points, with question 3 showing an exceptional gain of 73 percentage points. In looking at the post-test percentages, it is obvious that work needs to be done in several areas. Faculty will meet and discuss what needs to be done to address these problem areas so that when MATH 1530 is assessed in spring 2011, according to the assessment cycle, gains will be made in student learning. 3