Department: Chemistry Course: Chemistry 127 (Introductory College Chemistry) Curriculum or Curricula: HS1, LA1 PART I. STUDENT LEARNING OBJECTIVES TABLE 1. EDUCATIONAL CONTEXT This course is the first semester of a two semester sequence. The first semester is intended to provide students with basic knowledge of modern theory of general chemistry; while the second semester introduces organic chemistry. The course covers the most essential topics of general chemistry for health professions. Topics include elements and compounds; chemical bonding and chemical reactions; properties of solutions and chemical equilibrium; acid-base chemistry; physical states and gas laws; intra and inter – molecular forces. TABLE 2. CURRICULAR OBJECTIVES Note: Include in this table curriculum-specific objectives that meet Educational Goals 1 and 2: Curricular objectives addressed by this course: 1. Meet requirements for successful transfer/acceptance into a into the junior year of a baccalaureate program in Nursing, Dietetics, Nutrition, diagnostic medical imaging and other health related programs ( LA1, HS1) 2. Demonstrate mastery of mathematics and science required for transfer to the junior year in a baccalaureate program in Nursing or a related program. (LA1, HS1) 3. Demonstrate an understanding of the principles of chemistry and how they are fundamental to all living systems. (HS1) 4. Reason quantitatively and mathematically as required in their fields of interest and in everyday life. (LA1) 5. Use analytical reasoning to identify issues or problems and evaluate evidence in order to make informed decision. (LA1) 6. Communicate effectively through reading, writing, listening and speaking. (LA1) 7. Employ concepts and methods of the natural and physical sciences to make informed judgments. (LA1) 8. Integrate knowledge and skills in their program of study. (LA1) 9. Work collaboratively in diverse groups directed at accomplishing learning objectives. (LA1) TABLE 3. GENERAL EDUCATION OBJECTIVES Gen ed objective’s ID number from list (1-10) General educational objectives addressed by this course: Select from preceding list. 1. Communicate effectively through reading, writing, listening and speaking Use analytical reasoning to identify issues or problems and evaluate evidence in order to make informed decisions Reason quantitatively and mathematically as required in their fields of interest and in everyday life 2. 3. 5. 7. Integrate knowledge and skills in their program of study Work collaboratively in diverse groups directed at accomplishing learning objectives 1(14) 9. Employ concepts and methods of the natural and physical sciences to make informed judgments TABLE 4: COURSE OBJECTIVES AND STUDENT LEARNING OUTCOMES Course objectives Learning outcomes To develop both an understanding and a working knowledge of the theoretical and descriptive concepts of chemistry (for example chemical formulas, systematic nomenclature) used in the elucidation of the complex chemistry of the body. a. Students will understand and apply the concepts of chemical bonding to interpret molecular and structural formulas of covalent compounds, as well as ionic formulas for ionic compounds. b. Students will be familiar with systematic chemical nomenclature of compounds, and with common names used in health-related fields. c. Students will utilize knowledge of chemical bonding and formulas to write and balance chemical equations, with an emphasis on health-related reactions (respiration, photosynthesis, neutralization etc.). d. Students will apply the concepts of solution chemistry with an emphasis on acid-base reactions in biological systems. e. Students will apply basic knowledge of the gas laws to understand inhalation, exhalation, the administering of “oxygen” to patients, osmosis and dialysis. a. Students will perform basic unit conversions using dimensional analysis, including problems on temperature, pressure and density. b. Students will use the concepts of a mole and molar mass to perform calculations on the percent composition of compounds, and calculations on basic reaction stoichiometry, including percent yield. c. Students will apply the concepts of the basic gas laws, including the law of partial pressure, to problems on gases. d. Students will interpret mathematically common units and scales of concentration, such as parts per million, parts per billion, molarity, pH, and percentage for solutions and gaseous mixtures. a. Students will formulate an objective to solve an experimental problem. b. Students will apply the scientific method to acquire, process and report scientific data. c. Students will use basic chemistry laboratory techniques in solving experimental problems. d. Students will formulate a conclusion based on experimental results. e. Students will develop oral and written communication skills in scientific reporting format. 1. 2. To develop the abilities to solve both qualitative and quantitative problems in chemistry and health related fields. To learn fundamental experimental techniques used in health related chemistry and to effectively communicate experimental findings using writing. 3. PART II. ASSIGNMENT DESIGN: ALIGNING OUTCOMES, ACTIVITIES, AND ASSESSMENT TOOLS TABLE 5: OBJECTIVES ADDRESSED IN ASSESSMENT ASSIGNMENT Course Objective(s) selected for assessment: (select from Table 4) 1. To develop both an understanding and a working knowledge of the theoretical and descriptive concepts of chemistry (for example chemical formulas, systematic nomenclature) used in the elucidation of the complex chemistry of the body. 2. To develop the abilities to solve both qualitative and quantitative problems in chemistry and health related fields. 2(14) Curricular Objective(s) selected for assessment: (select from Table 2) 3. Demonstrate an understanding of the principles of chemistry and how they are fundamental to all living systems. (HS1) 4. Reason quantitatively and mathematically as required in their fields of interest and in everyday life. (LA1) 5. Use analytical reasoning to identify issues or problems and evaluate evidence in order to make informed decision. (LA1) 7. Employ concepts and methods of the natural and physical sciences to make informed judgments. (LA1) 8. Integrate knowledge and skills in their program of study. (LA1) General Education Objective(s) addressed in this assessment: (select from Table 3) 2. Use analytical reasoning to identify issues or problems and evaluate evidence in order to make informed decisions 3. Reason quantitatively and mathematically as required in their fields of interest and in everyday life 5. Integrate knowledge and skills in their program of study In the first row of Table 6 that follows, describe the assignment that has been selected/designed for this project. In writing the description, keep in mind the course objective(s), curricular objective(s) and the general education objective(s) identified above, The assignment should be conceived as an instructional unit to be completed in one class session (such as a lab) or over several class sessions. Since any one assignment is actually a complex activity, it is likely to require that students demonstrate several types of knowledge and/or thinking processes. Also in Table 6 (see the sample that follows), please a) identify the three to four most important student learning outcomes (1-4) you expect from this assignment b) describe the types of activities (a – d) students will be involved with for the assignment, and c) list the type(s) of assessment tool(s) (A-D) you plan to use to evaluate each of the student outcomes. (Classroom assessment tools may include paper and pencil tests, performance assessments, oral questions, portfolios, and other options.) Note: Copies of the actual assignments (written as they will be presented to the students) should be gathered in an Assessment Portfolio for this course. TABLE 6: ASSIGNMENT, OUTCOMES, ACTIVITIES, AND ASSESSMENT TOOLS Briefly describe the assignment that will be assessed: Departmental Assessment Questions for Introductory College Chemistry Students will answer five standardized questions as part of their final examination. All questions have been selected to assess particular learning outcomes for Introductory College Chemistry. The questions emphasize fundamental principles and theory of chemistry, the use of analytical and quantitative reasoning, and applying this knowledge in the context of health sciences and everyday life. The questions are health-related and require students to demonstrate mastery of basic gas laws, dimensional analysis, molar mass, and the units of concentration.The questions are multiple choice and were designed to identify common errors. 3(14) Desired student learning outcomes for the assignment (Students will…) List in parentheses the Curricular Objective(s) and/or General Education Objective(s) (1-10) associated with these desired learning outcomes for the assignment. 1. Students will perform basic unit conversions using dimensional analysis, including problems on temperature, pressure and density. (Curricular Objectives 4, 5, 7 & 8, Table 5; Gen Ed Objectives 2, 3, & 5, Table 3) 2. Students will understand and apply the concepts of chemical bonding to interpret molecular and structural formulas of covalent compounds, as well as ionic formulas for ionic compounds. (Curricular Objectives 3, 4, & 7, Table 5; Gen Ed Objective 3, Table 3) 3. Students will be familiar with systematic chemical nomenclature of compounds, and with common names used in health-related fields. (Curricular Objectives 3 & 8, Table 5; Gen Ed Objective 5) 4. Students will use the concepts of a mole and molar mass to perform calculations on the percent composition of compounds, and calculations on basic reaction stoichiometry, including percent yield. (Curricular Objectives 4, 5 & 8, Table 5; Gen Ed Objectives 2, 3, & 5, Table 3) 5. Students will apply the concepts of the basic gas laws, including the law of partial pressure, to problems on gases. (Curricular Objectives 3, 4, 5, 7 & 8, Table 5; Gen Ed Objectives 2, 3, & 5, Table 3) 6. Students will interpret mathematically common units and scales of concentration, such as parts per million, parts per billion, molarity, pH, and percentage for solutions and gaseous mixtures. (Curricular Objectives 3, 4, 5, 7 & 8, Table 5; Gen Ed Objectives 2, 3, & 5, Table 3) Briefly describe the range of activities student will engage in for this assignment. What assessment tools will be used to measure how well students have met each learning outcome? (Note: a single assessment tool may be used to measure multiple learning outcomes; some learning outcomes may be measured using multiple assessment tools.) a. Students will attend lecture and participate in discussion of relevant topics, including dimensional analysis, interpretation of units, stoichiometric calculations, gas laws, and other fundamental chemical concepts. b. Students will participate in problemsolving exercises in class and in homework assignments, which may include online exercises. c. Students will perform laboratory experiments, collect data, and perform calculations that use quantitative concepts described above. d. As part of their overall evaluation for the course, students will answer five multiplechoice questions designed to test the learning outcomes described at left. A. Five multiple-choice questions designed by the course coordinators to assess the desired student learning outcomes (see far left) will be administered as part of the students’ overall evaluation. The students’ responses will be analyzed according the standards described in Table 7. PART III. ASSESSMENT STANDARDS (RUBRICS) TABLE 7: ASSESSMENT STANDARDS (RUBRICS) Brief description of assignment: (Copy from Table 6 above) Departmental Assessment Questions for Introductory College Chemistry Students will answer five standardized questions as part of their final examination. All questions have been selected to assess particular learning outcomes for Introductory College Chemistry. The questions emphasize fundamental principles and theory of chemistry, the use of analytical and quantitative reasoning, and applying this knowledge in the context of health sciences and everyday life. The questions are health-related and require students to demonstrate mastery of basic gas laws, dimensional analysis, molar mass, and the units of concentration. The questions are multiple choice and were designed to identify common 4(14) errors. Desired student learning outcomes from the assignment: (Copy from Column 1, Table 6 above; include Educational Goals and/or General Education Objectives addressed) Assessment measures for each learning outcome: (Copy from Column 3,Table 6 above) Standards for student performance: Describe the standards or rubrics for measuring student achievement of each outcome in the assignment. Give the percentage of the class that is expected to meet these outcomes If needed, attach copy(s) of rubrics. 1. Students will perform basic unit A. Five multiple-choice questions designed by the course coordinators to assess the desired student learning outcomes (see far left) will be administered as part of the students’ overall evaluation. The students’ responses will be analyzed according the standards described in Table 7. All questions for assessment of students in Introduction to College Chemistry require students to apply chemical concepts and reasoning from the course. Most of the questions also require a one- or two-step calculation after the student has identified the relevant concept. conversions using dimensional analysis, including problems on temperature, pressure and density. (Curricular Objectives 4, 5, 7 & 8, Table 5; Gen Ed Objectives 2, 3, & 5, Table 3) 2. Students will understand and apply the concepts of chemical bonding to interpret molecular and structural formulas of covalent compounds, as well as ionic formulas for ionic compounds. (Curricular Objectives 3, 4, & 7, Table 5; Gen Ed Objective 3, Table 3) 3. Students will be familiar with systematic chemical nomenclature of compounds, and with common names used in health-related fields. (Curricular Objectives 3 & 8, Table 5; Gen Ed Objective 5, Table 3) 4. Students will use the concepts of a mole and molar mass to perform calculations on the percent composition of compounds, and calculations on basic reaction stoichiometry, including percent yield. (Curricular Objectives 4, 5 & 8, Table 5; Gen Ed Objectives 2, 3, & 5, Table 3) 5. Students will apply the concepts of the basic gas laws, including the law of partial pressure, to problems on gases. (Curricular Objectives 3, 4, 5, 7 & 8, Table 5; Gen Ed Objectives 2, 3, & 5, Table 3) 6. Students will interpret mathematically common units and scales of concentration, such as parts per million, parts per billion, molarity, pH, and percentage for solutions and gaseous mixtures. (Curricular Objectives 3, 4, 5, 7 & 8, Table 5; Gen Ed Objectives 2, 3, & 5, Table 3) The projected outcomes for each question and for the class average follow below. Question 1: Relevant concept(s): Unit conversion Expected Percent Correct: 50% Question 2: Relevant concept(s): Molar mass Expected Percent Correct: 60% Question 3: Relevant concept(s): Partial pressures of gases Expected Percent Correct: 70% Question 4: Relevant concept(s): Solution concentration Expected Percent Correct: 40% Question 5: Relevant concept(s): pH of solutions Expected Percent Correct: 80% Standards for measuring and interpreting student performance Question 1: Relevant concept(s): Unit conversion and the metric system 5(14) A correct response indicates that the student is able to perform basic unit conversions using dimensional analysis (the factor-label method). An incorrect response indicates that the student did not grasp (1) the pattern of prefixes commonly used in the metric system, (2) the relative size of the units at hand, or (3) the proper use of the factor-label method. Question 2: Relevant concept(s): Molar mass of chemical compounds A correct response indicates that the student is able to use the molar mass of a compound as the conversion factor between mass in grams and quantity of matter in moles. An incorrect response indicates that the student did not grasp (1) the interpretation of a chemical formula, (2) the correct calculation of molar mass, or (3) the proper use of molar mass as a conversion factor. Question 3: Relevant concept(s): Additivity of partial pressures of gases A correct response indicates that the student understands that the partial pressures of individual gases sum to the total pressure of a mixture. An incorrect response indicates that the student (1) did not grasp the additive nature of partial pressures, or (2) did not correctly distinguish the parts from the whole in the data. Question 4: Relevant concept(s): Units of solution concentration A correct response indicates that the student is able to perform calculations that relate the concentration and volume of a solution to the quantity of dissolved solute; the student also is able to interpret units of concentration commonly used in the health sciences. An incorrect response indicates that the student did not grasp (1) the use of percentage as a unit of concentration, or (2) the application of the factor-label method to solution concentrations. Question 5: Relevant concept(s): The concept of pH for acidic and basic solutions A correct response indicates that the student is able to interpret pH values as measurements of the acidity or basicity of physiological fluids. An incorrect response indicates that the student did not comprehend (1) the use of pH as a measure of the concentration of an acid or a base, or (2) the inverse relationship between acidity and basicity. PART IV. ASSESSMENT RESULTS TABLE 8: SUMMARY OF ASSESSMENT RESULTS Use the following table to report the student results on the assessment. If you prefer, you may report outcomes using the rubric(s), or other graphical representation. Include a comparison of the outcomes you expected (from Table 7, Column 3) with the actual results. NOTE: A number of the pilot assessments did not include expected success rates so there is no comparison of expected and actual outcomes in some of the examples below. However, projecting outcomes is an important part of the assessment process; comparison between expected and actual outcomes helps set benchmarks for student performance. Six examples follow. TABLE 8A: CH 127 Assessment Results for Fall 2014, N= 315 students Question 1 Student Response Interpretation of response Correct The student is able to perform basic unit conversions using dimensional analysis (the 6(14) Incorrect The student did not grasp (1) the pattern of prefixes commonly used in the metric system, (2) the relative size of the units Number of Students Actual Percent Expected Percent Question 2 Student Response Interpretation of response Number of Students Actual Percent Expected Percent Question 3 Student Response Interpretation of response Number of Students Actual Percent Expected Percent Question 4 Student Response Interpretation of response Number of Students Actual Percent Expected Percent factor-label method) and to at hand, (3) the proper use of the factordemonstrate an understanding label method, or (4) the use of numbers of numbers expressed in in exponential notation. exponential notation. 126 189 40 60 50 50 Correct The student is able to use the molar mass of a compound as the conversion factor between mass in grams and quantity of matter in moles. Incorrect The student did not grasp (1) the interpretation of a chemical formula, (2) the correct calculation of molar mass, or (3) the proper use of molar mass as a conversion factor. 202 64 60 113 36 40 Correct Incorrect The student understands that The student (1) did not grasp the the partial pressures of additive nature of partial pressures, or individual gases sum to the (2) did not correctly distinguish the parts total pressure of a mixture. from the whole in the data. 252 80 70 63 20 30 Correct The student is able to perform calculations that relate the concentration and volume of a solution to the quantity of dissolved solute; the student also is able to interpret units of concentration commonly used in the health sciences. 158 50 40 Incorrect Question 5 7(14) The student did not grasp (1) the use of percentage as a unit of concentration, or (2) the application of the factor-label method to solution concentrations. 157 50 60 Student Response Interpretation of response Number of Students Actual Percent Expected Percent Correct Incorrect The student did not comprehend (1) the The student is able to interpret use of pH as a measure of the pH values as measurements of concentration of an acid or a base, or (2) the acidity or basicity of the inverse relationship between acidity physiological fluids. and basicity. 198 117 63 37 80 20 TABLE 8C: CH 127 Assessment Results for Spring 2015, N= 238 students Question 1 Student Response Interpretation of response Number of Students Actual Percent Expected Percent Question 2 Student Response Interpretation of response Number of Students Actual Percent Expected Percent Question 3 Student Response Interpretation of response Number of Students Actual Percent Correct The student is able to perform basic unit conversions using dimensional analysis (the factor-label method) and to demonstrate an understanding of numbers expressed in exponential notation. 71 30 50 Incorrect The student did not grasp (1) the pattern of prefixes commonly used in the metric system, (2) the relative size of the units at hand, (3) the proper use of the factorlabel method, or (4) the use of numbers in exponential notation. Correct The student is able to use the molar mass of a compound as the conversion factor between mass in grams and quantity of matter in moles. Incorrect The student did not grasp (1) the interpretation of a chemical formula, (2) the correct calculation of molar mass, or (3) the proper use of molar mass as a conversion factor. 143 60 60 95 40 40 167 70 50 Correct Incorrect The student understands that The student (1) did not grasp the the partial pressures of additive nature of partial pressures, or individual gases sum to the (2) did not correctly distinguish the parts total pressure of a mixture. from the whole in the data. 183 77 55 23 8(14) Expected Percent Question 4 Student Response Interpretation of response Number of Students Actual Percent Expected Percent Question 5 Student Response Interpretation of response Number of Students Actual Percent Expected Percent 70 30 Correct The student is able to perform calculations that relate the concentration and volume of a solution to the quantity of dissolved solute; the student also is able to interpret units of concentration commonly used in the health sciences. 107 45 40 Incorrect The student did not grasp (1) the use of percentage as a unit of concentration, or (2) the application of the factor-label method to solution concentrations. 131 55 60 Correct Incorrect The student did not comprehend (1) the The student is able to interpret use of pH as a measure of the pH values as measurements of concentration of an acid or a base, or (2) the acidity or basicity of the inverse relationship between acidity physiological fluids. and basicity. 167 71 70 30 80 20 TABLE 8D: SUMMARY OF ASSESSMENT RESULTS Desired student learning outcomes: (Copy from, Column 1,Table 6 above; include Educational Goals and/or General Education Objectives addressed) 1. Students will perform basic unit conversions using dimensional analysis, including problems on temperature, pressure and density. (Curricular Objectives 4, 5, 7 & 8, Table 5; Gen Ed Objectives 2, 3, & 5, Table 3) 2. Students will understand and apply the concepts of chemical bonding to interpret molecular and structural formulas of covalent compounds, as well as ionic formulas for ionic compounds. (Curricular Objectives 3, 4, & 7, Table 5; Gen Ed Objective 3, Student achievement: Describe the group achievement of each desired outcome and the knowledge and cognitive processes demonstrated. Learning outcome #1 was assessed in question # 1. On learning outcome #1: In Fall 2014: 126 students out of 315 (40%) answered correctly. This result was 10% below the expectation of 50%. In Spring 2015: 71 students out of 238 (30%) answered correctly. This result was 20% below the expectation of 50%. The following process / knowledge / abilities were demonstrated: • remember and analyze factual knowledge • analyze and evaluate procedural knowledge Learning outcome #2 was assessed in question # 2. On learning outcome #2: In Fall 2014: 202 students out of 315 (64%) answered correctly. This result was 4% above the expectation of 60%. In Spring 2015 : 143 students out of 238 (60%) answered correctly. This result was equal to the expectation of 60%. The following process / knowledge / abilities were demonstrated: 9(14) Table 3) 3. Students will be familiar with systematic chemical nomenclature of compounds, and with common names used in health-related fields. (Curricular Objectives 3 & 8, Table 5; Gen Ed Objective 5) 4. Students will use the concepts of a mole and molar mass to perform calculations on the percent composition of compounds, and calculations on basic reaction stoichiometry, including percent yield. (Curricular Objectives 4, 5 & 8, Table 5; Gen Ed Objectives 2, 3, & 5, Table 3) 5. Students will apply the concepts of the basic gas laws, including the law of partial pressure, to problems on gases. (Curricular Objectives 3, 4, 5, 7 & 8, Table 5; Gen Ed Objectives 2, 3, & 5, Table 3) 6. Students will interpret mathematically common units and scales of concentration, such as parts per million, parts per billion, molarity, pH, and percentage for solutions and gaseous mixtures. (Curricular Objectives 3, 4, 5, 7 & 8, Table 5; Gen Ed Objectives 2, 3, & 5Table 3) • remember and analyze conceptual knowledge • analyze and evaluate procedural knowledge Learning outcome #3 was assessed in Question #4. On learning outcome #3: In Fall 2014: 158 students out of 315 (50%) answered correctly. This result was 10% above the expectation of 40%. In Spring 2015: 107 students out of 238 (45%) answered correctly. This result was 5% above the expectation of 40%. The following process / knowledge / abilities were demonstrated: • remember and analyze factual knowledge • analyze and evaluate procedural knowledge Learning outcome #4 was assessed in question # 2. On learning outcome #4: In Fall 2014: 126 students out of 202 (64%) answered correctly. This result was 4% above the expectation of 60%. In Spring 2015: 143 students out of 238 (60%) answered correctly. This result was equal to the expectation of 60%. The following process / knowledge / abilities were demonstrated: • remember and analyze conceptual knowledge • analyze and evaluate procedural knowledge Learning outcome #5 was assessed in question # 3. On learning outcome #5: In Fall 2014: 252 students out of 315 (80%) answered correctly. This result was 10% above the expectation of 70%. In Spring 2015: 183 students out of 238 (77%) answered correctly. This result was 7% above the expectation of 70%. The following process / knowledge / abilities were demonstrated: • remember and analyze conceptual knowledge • analyze and evaluate procedural knowledge Learning outcome #6 was assessed in Question # 4. On learning outcome #6 assessed in question # 4: In Fall 2014: 158 students out of 315 (50%) answered correctly. This result was 10% above the expectation of 40%. In Spring 2015: 107 students out of 338 (45%) answered correctly. This result was 5% above the expectation of 40%. Learning outcome #6 was also assessed in Question #5. On learning outcome #6 assessed in question # 5: In Fall 2014: 198 students out of 315 (63%) answered correctly. This result was 17% below the expectation of 80%. In Spring 2015: 167 students out of 238 (70%) answered correctly. This result was 10% below the expectation of 80%. The following process / knowledge / abilities were demonstrated: • remember and analyze factual knowledge • analyze and evaluate procedural knowledge OVERALL PERFORMANCE FALL 2014: 5 QUESTIONS ANSWERED CORRECTLY - 100% GRADE: 35 STUDENTS OUT OF 315 = 11 % 4 QUESTIONS ANSWERED CORRECTLY - 80% GRADE: 77 STUDENTS OUT OF 315 = 24% 3 QUESTIONS ANSWERED CORRECTLY – 60% GRADE: 97 STUDENTS OUT OF 315 = 31% 10(14) 2 QUESTIONS ANSWERED CORRECTLY – 40% GRADE: 67 STUDENTS OUT OF 315 = 21 % 1 QUESTION ANSWERED CORRECTLY – 20% GRADE: 26 STUDENTS OUT OF 315 = 8 % 0 QUESTIONS ANSWERED CORRECTLY – 0% GRADE: 13 STUDENTS OUT OF 315 = 4 % OVERALL PERFORMANCE SPRING 2015: 5 QUESTIONS ANSWERED CORRECTLY - 100% GRADE: 17 STUDENTS OUT OF 238 = 7 % 4 QUESTIONS ANSWERED CORRECTLY - 80% GRADE: 60 STUDENTS OUT OF 238 = 25 % 3 QUESTIONS ANSWERED CORRECTLY – 60% GRADE: 73 STUDENTS OUT OF 238 = 31 % 2 QUESTIONS ANSWERED CORRECTLY – 40% GRADE: 47 STUDENTS OUT OF 238 = 20 % 1 QUESTION ANSWERED CORRECTLY – 20% GRADE: 31 STUDENTS OUT OF 238 = 13 % 0 QUESTIONS ANSWERED CORRECTLY – 0% GRADE: 10 STUDENTS OUT OF 238 = 4 % Student Cohort Cohort Size Average Correct Pre (random guessing) N/A 1.3 Post N/A 3.0 Spring 2011 152 2.8 Spring 2012 221 3.0 Fall 2012 217 3.1 Spring 2013 191 2.9 Fall 2013 311 2.8 Fall 2014 314 3.0 Spring 2015 238 2.8 11(14) Figure 1: Summary of assessment results for each and expected results before taking the course (Pre) and expected results after completion (Post). Lighter colored boxes indicate a greater number of correct answers out of five. RESULTS AND CONCLUSIONS: • • • • Students consistently score at or very near the coordinators' a priori expected of 3/5 on the assessment quiz. The share of students performing highly (80% or 100%) appears to be growing, albeit gradually, with subsequent rounds of assessment. The share of students performing poorly (0% or 20%) is also consistently higher than expected, and this subgroup skews average performance downward. Underperformance on questions 1 (units) and 5 (pH) also pulls down the average score, so we shall have to continue including a pre-semester note to instructors about students' difficulty with these concepts. TABLE 9. EVALUATION AND RESULTING ACTION PLAN A. Analysis and interpretation of assessment results: What does this show about what and how the students learned? Seven semesters' data for the assessment of Introductory General Chemistry show remarkable consistency, both in total score on the quiz and in performance on individual questions. Overall performance has met the a priori expectations of course-coordinators in most semesters, and only narrowly fell below expectations in the other three: In Spring 2011, Fall 2013, and Spring 2015, average performance was lower than expected to by a small but a statistically significant degree. As there appears to be a noisy trend over time for an ever greater share of the students to score perfect or near perfect scores, it is clear that an over-representation relative to expectations of low scores (0 or 1 out of 5) lowers overall performance. Consistent with previous results, the two questions where students are most likely to miss expectations were Question 1, which assesses challenging core-concept of unitconversion, and Question 5, which assesses a topic that comes late in the semester (pH). Further details follow. A correct response to Question 1 (medium difficulty) indicates that the student is able to perform basic unit conversions using dimensional analysis (the factor-label method). Approximately 50% of students were expected to answer correctly; 40% and 30% did so in the Fall of 2014 and Spring of 2015, respectively. A correct response to Question 2 (medium difficulty) indicates that the student is able to use the molar mass of a compound as the conversion factor between mass in grams and quantity of matter in moles. Approximately 60% of students were expected to answer correctly; 64% and 60% did so in the Fall of 2014 and Spring of 2015, respectively. A correct response to Question 3 (low difficulty) indicates that the student understands that the partial pressures of individual gases sum to the total pressure of a mixture. Approximately 70% of students were expected to answer correctly; 80% and 70% did so in the Fall of 2014 and Spring of 2015, respectively. A correct response to Question 4 (high difficulty) indicates that the student is able to perform calculations that relate the concentration and volume of a solution to the quantity of dissolved solute; the student also is able to interpret units of concentration commonly used in the health sciences. Approximately 40% of 12(14) students were expected to answer correctly; 50% and 45% did so in the Fall of 2014 and Spring of 2015, respectively. A correct response to Question 5 (low difficulty) indicates that the student is able to interpret pH values as measurements of the acidity or basicity of physiological fluids. Approximately 80% of students were expected to answer correctly, but only 63% and 70% did so in the Fall of 2014 and Spring of 2015, respectively. • • • • As a group students consistently score at or near the expected overall average. Students continue to struggle mastering conversion of units as addressed by Question 1. The share of students earning low scores (0%-20%) remains higher than a priori expectations. The share of students earning high scores (80%-100 %) appears to be growing over time. B. Evaluation of the assessment process: What do the results suggest about how well the assignment and the assessment process worked both to help students learn and to show what they have learned? Having noted in past reports that the size and student demographics in Summer terms differs greatly from that in Fall and Spring terms, this report only considers those semesters. sModest improvement in overall performance in the first few semesters after assessment began appears now to have been statistical noise. Despite some evidence of a growing share of students earning high scores, assessment consistently shows that too many students finish the course with a weak understanding of several key concepts. To improve the performance of the whole group, we must reach this subgroup. C. Resulting action plan: Based on A and B, what changes, if any, do you anticipate making? • The course coordinators send the following e-mail to all instructors (laboratory and lecture) of Chemistry 127 at the beginning of each semester. Hello CH-127 Instructors--Welcome back! For the last several terms the Chemistry Department has implemented a short assessment quiz to test students' understanding of a few core principles in CH-127. As part of the assessment, the coordinators of CH-127 must share the results among instructors. Please consider the following findings (mostly good!) as you plan your course this semester: -Overall, students meet the Department's expectations; they demonstrate adequate understanding of the central concepts of general chemistry, including dimensional analysis, molar mass, gas laws, the chemistry of solutions, and acid-base equilibria. In many areas, students often exceed expectations. -Students' performance has been largely consistent over the last few semesters, with gradual improvements since assessment began. Not too surprisingly, we found that summer students generally outperform students during the normal school year. We also found some areas that require improvement: -Many students cannot correctly convert units, particularly if a question requires them to use scientific 13(14) notation or the vocabulary of the metric system. This difficult skill is central to CH-127. All of us spend what may feel like too much time early in the term on dimensional analysis and conversion of units, but we need to drill even more. Students whose program requires additional chemistry, physics, or math will especially benefit. -As a group, Fall and Spring students show a weak understanding of concepts that typically come late in the course: kinetics, equilibria, acids-base reactions, and nuclear activity. We appreciate that time often does not allow thorough treatment of these topics. However, because acid-base reactions are critical in biochemistry and other health-related fields, we ask all instructors to introduce at least the fundamental ideas of acids and bases, such as the meaning of the pH-scale. Thank you, Derek Bruzewicz, Sharon Lall-Ramnarine, Irina Rutenburg, and Paul Sideris One course coordinator has been collaborating with another instructor of General Chemistry and a professor in the Department of Mathematics and Computer Science to test two methods for assisting students in applying mathematics to chemical problems: a three-day, pre-semester “boot-camp” in mathematical problem-solving, and an hour-long weekly instructor-guided session in problem-solving that emphasizes mathematics and metacognition. 14(14)