CSU General Chemistry Course Redesign Project 1. Preface - Why do we want to Redesign our General Chemistry Courses? 2. Defining the Problem - Characteristics of Unsuccessful Students in General Chemistry 3. Directing Students into the Appropriate Courses - Placement Exams 4. Meeting the Needs of Unprepared Students in a Preparatory Chemistry Course 5. Improving the Student Learning Experience in General Chemistry Lectures that engage more student learning Increasing the efficiency and effectiveness of Laboratory time Online tools to make student homework more effective Supplemental instruction to address student challenges 6. Team Members’ Course Redesign Plans to Enhance Student Learning 7. Efficiency Improvements and Cost Savings 1. Preface - Why do we want to Redesign our General Chemistry Courses? Because of the high D/F/W rates in General Chemistry and its critical role in many science and technology programs, CSU provosts suggested General Chemistry for a multi-campus project in Course Redesign. In terms of cost savings, General Chemistry is an appealing target because of the large enrolments. However, we also note that these courses are often the most efficient courses in terms of cost per FTE within Chemistry. Adding emphasis to the need for improvements in General Chemistry success is the role of this course in the preparation of professionals in science, technology, engineering, and math (STEM) fields. General Chemistry is a requirement for biology, chemistry, physics, and earth science majors and for most engineering majors. Technology majors also require this course or a similarly-structured course. The need for trained professionals in these fields has been well documented [e.g., in the Nation at Risk website] The fact that General Chemistry is a required course for all Single-Subject credentials in math and all of the sciences is also significant[e.g, see this website on Science Teaching and California's Future]. Students who are frustrated by their experience in General Chemistry are not likely to build enthusiasm for the content and the applications of the sciences in general and are thus less willing to consider a career in teaching in these critical fields. In contrast, a General Chemistry course which models good pedagogy along with passion for the topics or applications is likely to increase the numbers of students who might enter these fields of consider teaching as a career choice. 1/16 The Redesign Team included the following CSU faculty: Karno Ng (San Marcos), Richard A. Paselk (Humboldt), James Postma (Chico), Herbert Silber (SJSU) and Ray Trautman (SFSU) Simone Aloisio (Channel Islands), Susan Crawford (Sacramento), Danika LeDuc (East Bay), Taebohm Oh (Northridge), Lihung (Angel) Pu (Dominguez Hills). The team engaged in individual research and design work, collaboration in a web-based project workspace, weekly phone conferences, and two on-site meetings. We decided upon the following principles for redesigning courses in General Chemistry: A placement test (or equivalent) should be used to select students into the appropriate course based upon student background and capabilities. A Chemistry Preparatory course should be designed for those students with no or weak backgrounds in chemistry and/or “chemistry skills”. Chemistry is different from many other introductory courses in that each section is not a separate entity, but rather subsequent sections are built up from the concepts already learned. The following approaches were identified as offering the most promise for enhancing student learning and optimizing resources: Lecture time should be used to engage students in the course content, to emphasize key points and complex concepts, and to challenge student misconceptions. For course concepts which are difficult for students to visualize (atomic structure, etc), there is evidence that appropriate computer animation programs and other tools can enhance students’ understanding. Courses which include online homework assignments (there are multiple choices available) can provide cost-effective feedback on student understanding. The assignments must count for some course credit (5-10% suggested) to encourage students make a serious effort on the homework. Team members concluded that significant hands-on lab time is required for students to succeed in applying general chemistry concepts. However, some pre-lab work can be carried out via computer-aided instruction to optimize resource usage and student time in lab facilities. The use of supplemental instruction (Academic Enhancement Workshops) is strongly encouraged as it has been shown to increase student grades and improve retention in chemistry and in science programs more generally. We will also study the benefits of these course redesigns for potential cost savings, via larger class sections with more interactive learning, more efficient use of lab facilities, and reducing section offerings by decreasing the need for students to repeat the courses. As our individual course redesign plans illustrate, each school and/or faculty member can combine these recommendations to enhance student performance in the introductory chemistry courses (and improve retention and success in subsequent chemistry courses. 2/16 2. Defining the Problem: Challenges Students Encounter in General Chemistry The redesign team did not consider a revision of the lower-division chemistry curriculum or changes in the contents of the general chemistry courses. Instructors should be aware that the American Chemical Society’s (ACS) guidelines for professional development1 define the purpose of the introductory or general chemistry course work for those students pursuing a degree in chemistry as preparation for the foundation course work. The ACS divides the chemistry curriculum for the certified major into three categories: the introductory chemistry experience, foundation course work that provides breadth and rigorous in-depth course work that builds on the foundation. The introduction ensures that students know basic concepts such as stoichiometry, states of matter, atomic structure, molecular structure and bonding, thermodynamics, equilibria, and kinetics. The challenge of improving the success rate in General Chemistry is significant because there are a wide range of reasons for failure and a large number of students that are described by these traits, in some cases with multiple entries. There is also some diversity in the organizational structure of the lower division Chemistry courses across campuses (more information on this webpage with summary of different structures). Given the diverse nature of the CSU student population, a broad-spectrum approach to reaching this audience is essential. And since many of the root causes of these traits lie in the students’ K-12 training or environmental factors, the “fixes” for these problems will not eliminate the problem for future students. A listing of the key challenges follows, categorized by theme. Then we describe some typical Student Personas, which show how multiple learner challenges can interact to present obstacles to student success. Student Preparation – Chemistry A number of our incoming students do not have the prerequisite knowledge expected from studying chemistry in high school. In some cases, they did not take chemistry in high school, or a long time has passed since their high school chemistry courses; other students had low course grades in high school chemistry. All of these students should not expect to do well in university-level chemistry courses without extra work. Other students may not realize that their preparation for university-level chemistry is inadequate. Some did not take the right High School course (UC Area (d) Course), e.g., they may have taken an Integrated Science course which was weak in chemistry content. We also regularly encounter students who received good grades in high school chemistry but still have gaps in their knowledge – for a highly sequential subject such as Chemistry, gaps in the foundation must be filled in with extra work before students can succeed. Student Preparation – Math Mathematics knowledge and skills are critical for success in university-level chemistry. In addition to challenges similar to all those cited above for prerequisite chemistry knowledge, students frequently lack specific mathematics skills such as the ability to translate chemistry “story problems” into practical mathematics or a lack of capability for multi-step mathematics manipulations. This underlying mathematics knowledge is seldom included in the content of introductory chemistry courses, and it can be difficult to determine students’ readiness in the necessary mathematics beforehand. 3/16 Specific Challenges of the Material General Chemistry is very often the first course which requires a high degree of intellectual integration and analytical ability. While there is still some raw memorization required – and students may have gotten through their high school chemistry based on ability to memorize – it is also critical that students engage with abstractions and systematically think through multi-step processes. Many students are unprepared for the demands of a precise vocabulary (“whatever”) or are challenged by the need to think in visual and geometric/space-related ways. The cumulative nature of the chemistry course content requires that students master material and build on it throughout the course, in contrast to some of their other introductory courses structured around relatively independent topics. Consequently, shortcomings in student study habits and work management skills, especially those typical of first-generation students in higher education2, have particularly damaging effects early in the course: poor lecture and lab attendance or failure to study independently outside of scheduled class time in the initial weeks can put students too far behind to catch up. Interruptions due to external work or family commitments can magnify these problems, as can cultural factors related to asking for help or understanding instructors’ speech. Students who struggle to succeed in General Chemistry typically encounter several interacting challenges. Here are some of the personas that we developed to capture common patterns of challenges (although few campuses encounter all of these): Persona – Biology Major Ben/Briana Does well in anatomy and physiology; good at memorizing raw facts Poor math manipulative skills and poor math sense; i.e. is as likely to divide by 1000 as multiply by 1000 in converting mL to L. Struggles with multi-concept settings, such as limiting reactant, calorimetry, Bohr Formula energy/wavelength calculations Not motivated: no link between biology and chemistry other than the requirement. Persona – Typical Tina/Tim Comes to lecture but notes are sketchy; usually only writes what is on the board. Studies by reading the chapters over 2-3 times; highlights important concepts. Completes homework by working in a study group but cannot work alone. Studies 20-30 minutes every other day like her roommates (who are humanities, education, or social science major. Persona – International Student Ivan/Ingrid Has had the first 6-8 weeks of General Chemistry in his “high school” course. Reads English fairly well but audio understanding skills are poor. Doesn’t come to class most days because he/she doesn’t get much out of lecture. Works in study group with other international students; homework is always done well, but cannot do identical problems on the exam. 4/16 Lab attendance is sporadic, but is unaware of grading consequence. Questions exam grading relative to other students, rather than to the solution key. Persona – Engineering student Edward/Edwina Is taking calculus (and or Physics) and chemistry Has always done well in math and science courses Has trouble finding enough time for all of the coursework (with demands of other classes or socializing or both.) Never had to work this hard in high school Crams for exams and “pulls all-nighters” to study beforehand. Makes a lot of small but significant mistakes on exams. Does well on concrete subjects like stoichiometry, heat calculations Struggles with abstract topics, such as atomic orbitals, hybridization Persona – Environmental Science Major Ellen/Edgar Generally poor math preparation and skills Does poorly on analytical sections: stoichiometry, heat calculations Struggles with abstract topics: orbitals, hybrids, heat, energy Struggles with motivation Likes to be outdoors; chemistry isn’t (at this level) Persona – Exercise Physiology Major Erik/Erica Interested in getting into chiropractic or physical therapy school Needs grades of “A” or ”B” in chemistry Did not take significant amounts of math & science in high school Has difficulty with motivation since chemistry and career seem distantly related (but chiropractic and PT schools use chemistry for “weeding out” purposes) Persona – Single Parent Pat More mature in age and academically than traditional first year students Clear career goals: has been in the workforce and needs a better paying job Demands of life create a very rigid study schedule Usually keeps up well, but no extra time when exams or projects are due Very susceptible to interruptions, such as personal illness, ill children, childcare disruptions, family issues Persona – Repeating Robert/Roberta Starts course well; turns in homework early on; misses class regularly When course returns to the previous stop-out point, performance dives. Generally has not dealt with causes of previous poor performance. Has not scheduled adequate time for the course when it reaches the stopping-out point and more effort is needed. 5/16 3. Directing Students into the Appropriate Courses - Placement Exams As noted in the previous chapter, many (but not all) of the students who struggle with General Chemistry do so because of inadequate preparation for the course. If this shortfall is in the areas of mathematics or chemistry (high school Algebra II and high school chemistry are prerequisite courses for General Chemistry) then a placement or advising exam would be a useful tool for redirecting students to an appropriate preparation path and improve the “efficiency” of the General Chemistry course. To be most useful, the administration of this exam should be as unobtrusive as possible and timely for appropriate redirection, as necessary. We envision placement exams playing an important role as advising tools. At this time we are not planning to use a placement exam to rule students out of General Chemistry, because of the many non-cognitive and attitudinal factors which influence student success in this course3. We also concluded that none of the extant placement tests had demonstrated success as a diagnostic tool to identify gaps in student knowledge for remediation4 (although as noted in our web workspace we are pursuing further investigation of the evolving ALEKS tools for Chemistry). A placement exam which would be useful in helping students to predict their probable success in General Chemistry would have the following attributes: 1. Short and concise, < ½ hour administration time 2. An on-line format 3. The exam could be administered and scored prior to each semester and students could be well-advised prior to registration deadlines. 4. Low- or no-cost for the test 5. No cultural or gender bias (beyond those inherent in General Chemistry success) 6. High reliability (>80%) for D-F-W avoidance CSU Experience with placement exams: The Toledo Examination (1998) is a 60-item, 55-minute examination with math and high school-level chemistry questions. The California Chemistry Diagnostic Test (2006) is a 44-question, 45-minute exam developed by University of California faculty. The paperbased nature of these exams and the time requirements typically limit the use of these instruments to the first week of class, usually the first lab meting of the semester. This means that in practice any placement advice cannot be offered until the second week of classes (at the earliest). Both are available from the American Chemical Society Exams Institute (http://www4.uwm.edu//chemexams/materials/exams.cfm). Both of these have been used by several CSU chemistry departments: Toledo: Northridge, Dominguez Hills, and Sacramento; California: Fullerton. 6/16 Several campuses have created their own placement exams: Humboldt, Long Beach. None have definitive studies of the predictive power of the exams, but Sacramento State has worked on such a study this past year and hopes to report its findings shortly. No one has an on-line version of an exam, but all acknowledge the usefulness of such a format for timeliness and cost-savings. One campus has begun to use EPT and ELM scores for placement advice, but has not yet studied the issues or outcomes systematically. Project results and ongoing work: The team proposed the following Investigation on Placement Exams/Instruments, to be led by Jim Postma (CSU Chico): 1. Work with CSU Chico Institutional Research and the information database to evaluate ELM and EPT scores (or SAT/ACT) as a predictor of D/W/F grades in General Chemistry (CHEM 111) and General Chemistry for the Applied Sciences (CHEM 107.) 2. Invite other CSU campuses to initiate a similar study of existing information as predictors of success in General Chemistry. We have indications of interest from Simone Aloisio (CSUCI), Susan Crawford (CSUS), Angel Pu (CSUDH) and Danika LeDuc (CSUEB) for this collaboration. 3. Obtain data and analyses from Susan Crawford (CSUS) about Sacramento State’s experiences with the Toledo Exam (ACS). Compare notes with Northridge and Dominguez Hills. 4. Follow up with Fullerton and San Bernardino about their experiences and analyses of the California Chemistry Diagnostic Test. 5. Explore whether ALEKS or other commercial systems have a test module that could serve as the basis of an on-line placement exam. 6. Explore the use of an existing online placement test such as the one used at the University of Iowa5. 7. Research the efforts of University of Iowa, Wisconsin – Madison, Arizona State, and Maryland – Eastern Shore regarding placement exams. (All have had significant General Chemistry course redesign projects.) Compare/contrast with literature and CSU results. 8. Pilot test a placement exam in the fall of 2008 and an online version in spring 2009. 9. Ray Trautman of SFSU plans to pilot test the OWL Prep Chem online course in Spring 2009 as a complement to placement tests. [link to ppt on Owl Prep Chem] 4. Meeting the Needs of Unprepared Students - a Preparatory Chemistry Course For those students who have a weak algebra or chemistry background, several campuses have developed a Pre-General Chemistry Course. The students who should take this course are those with weak mathematics skills, those who did not take chemistry in high school, or those who had their last chemistry course several years before attempting the first course in General Chemistry. The major advantage is that students who are not prepared for the General Chemistry course, and who normally fail or withdraw, are able to establish a foundation for success through the preparatory chemistry course (without 7/16 the detrimental effects of a course failure/withdrawal on their GPA or program duration). A credit course for Preparatory Chemistry also avoids the problems of voluntary extra work based on a diagnostic, which typically does not attract the students most in need: “students of high prior achievement and ability perform better than their achievement scores would predict. However, weaker or less motivated students did not respond to the voluntary offerings in the same numbers as the stronger or more motivated students.6” The topics CSU campuses have found useful include the following: • Measurement of chemical and physical properties • Chemical calculations and graphing • Chemical nomenclature and trends of the Periodic Table • Predicting and balancing formulae and reactions • Chemistry on the atomic scale • Gas behavior and laws • Solution chemistry, acids and bases, and redox. These topics are taught at an elementary level, sufficient for the student to remember terms, definitions and simple calculations, especially in stoichiometry. Nomenclature, ions and the balancing of equations are important components of this course. The course can be taught with two lectures and one activity/recitation section each week using active learning techniques. Weekly quizzes and exams are often necessary to keep the students working on schedule. Students who engage effectively in the preparatory chemistry course have been shown to subsequently be successful in General Chemistry7 To facilitate the transition for students who register in the initial General Chemistry course and find they need to drop it in favor of the preparatory chemistry course, the prep course should be scheduled at the same time as one of the General Chemistry sections. If the campus has a short period for formal course drops, adding a mechanism to transition from the general chemistry into the more suitable prep course after the formal drop period can go a long way to saving the student one semester in time to graduation. This course should not be used for credit as part of a science major, or for a course requiring high school chemistry as a prerequisite. This course yields traditional letter grades and a minimum grade is typically necessary to go on in Chemistry, although students getting the minimum will often have trouble with the more advanced material. Examples of current CSU Preparatory Chemistry courses: San Jose State, CSU Northridge. CSU Dominguez Hills. Project results and ongoing work: Team members plan to investigate and pilot test new preparatory Chemistry courses: Rich Paselk (HSU), Susan Crawford (CSUS). Ray Trautman of SFSU plans to pilot test the OWL Prep Chem online course in Spring 2009. 8/16 5. Ways to Improve the Student Learning Experience in General Chemistry One important conceptual distinction needs to be made between individual teaching techniques and an instructional strategy. A teaching technique is a discrete, specific teaching activity. Lecturing, laboratory work, problem-solving in small groups: all of these are teaching techniques. An instructional strategy, on the other hand, is a set of learning activities, arranged in a particular sequence so that the energy for learning increases and accumulates as students go through the sequence. L. Dee Fink, A Self-Directed Guide to Designing Courses for Significant Learning. p. 27 (see also L. Dee Fink, Creating Significant Learning Experiences in College Classrooms, San Francisco: Jossey-Bass, 2003). The most effective Course Redesigns, those that enhance student learning and optimize resource use, combine research-based instructional strategies with enhancements to individual teaching techniques to produce a significant gain in students’ conceptual and attitudinal development8. In some of the sections that follow, it will be evident how our redesigns impact the overall instructional approach, e.g., introducing Supplemental Instruction sessions with undergraduate learning assistants as a follow-up to lecture time. In other sections, the fit with other course components into a coherent instructional approach is implicit, e.g., enhancing lectures to be more interactive will be used differently in an instructional approach where lectures are an initial introduction to concepts versus a Just-in-Time-Teaching approach (website) where lecture time follows up on student work9. Some redesign components, such as Process Oriented Guided Inquiry Learning, can be used either as holistic course approaches or as techniques in specific lectures. Team members will be experimenting with the following teaching techniques and instructional approaches, to enhance student learning and optimize resource use: Apply interactive lecture methods to enhance student engagement while allowing increased sections sizes; Optimize time in hands-on labs through pre-lab activities; Use online homework and tutorial tools to provide more cost-effective feedback on student work and individualized mastery learning; Provide supplemental instruction led by undergraduate student assistants, to insure students connect with instructional staff in sections with large enrolments. A. Lectures that engage student learning Effective teaching consists of engaging students, monitoring their thinking, and providing feedback. Given the reality that student-faculty interaction at most universities is going to be dominated by time together in the classroom, this means the teacher must make this happen first and foremost in the classroom10. Lecturing can be a very efficient way to transmit information quickly, but students aren't always ready to absorb it. As noted above, well-designed lectures work best if they fit 9/16 into a larger instructional approach with effective lead-in and follow-up student activities. In that context, engaging lectures focus student time on interacting with specific aspects of the course content, rather on receiving content from the instructor. Making lectures interactive draws students into the lecture by engaging them in working with the material through short individual, pair, or small-group activities. For course redesigns which optimize resource use, interactive lectures can “make large sections seem small”11. Interactive lectures can accommodate the diverse nature of the General Chemistry student audience through non-traditional modes of enhancing engagement in lectures. For example, research has shown that students who passively observe demonstrations in class understand the underlying concepts no better than students who do not see the demonstration at all12. Students who predict the demonstration outcome before seeing it, however, display significantly greater understanding. Similarly, simulations used in class (and out of class as part of online homework) can support student understanding by providing visualizations of complex concepts. However, the simulation must engage students in appropriate cognitive activities: “simulations can be highly engaging and educationally effective, but only if the student’s interaction with the simulation is directed by the student’s own questioning”13 Most recently, Classroom Response Systems ["clickers"] have proven to be an effective tool for interactive lectures when used to engage students in applying and reflecting on their own conceptual understandings. Examples of effective use of Classroom Response Systems and a summary of research on how they can support learning are included on the Classroom Response Systems webpage for this project. One example of an enhancement to traditional lecturing is the Process Oriented Guided Inquiry Learning (POGIL) approach. POGIL (website) is a teaching technique that teaches content and key process skills (such as analytical thinking) simultaneously. A POGIL classroom or lab consists of students working in small groups on specially designed guided inquiry learning modules. These learning modules provide students with data or information followed by leading questions designed to guide them toward formulation of their own valid conclusions. The instructor serves as facilitator for the group discussion. POGIL can be adopted for use in a classroom either as a teaching technique or as part of a larger instructional approach. POGIL can also be used as a source of exercises for an on-line component. An example of use at CSUSM is described in our project workspace, which also contains references on research demonstrating the effectiveness of POGIL with General Chemistry students. Project results and ongoing work: Rich Paselk (HSU) and Susan Crawford (CSUS) plan to study the use of Classroom Response Systems to engage students in deeper learning. Angel Pu will continue her experiments to use Classroom Response Systems in her general chemistry at CSUDH (more information on her webpage). 10/16 B. Increasing the efficiency and effectiveness of laboratory time In investigating the role and design of laboratory work, we need to keep in mind that the lab sometimes works in parallel with classroom activities and sometimes deals with other important educational issues for chemistry and the other sciences that are not addressed in lecture. We believe there is compelling evidence of the necessity for significant handson time in laboratory sessions, including the following outcomes for students: Lab safety and hazardous waste handling/disposal are taught in lab. These topics need the participatory learning and reinforcement that laboratory work provides. Industry surveys and feedback from employers identify these topics as vital for STEM graduates. We find that our current students have less hands-on engagement with the “real” world than previous generations, e.g. they are less likely to have engaged in activities such as automotive repair, cooking from scratch, etc. where they could experience measurement and the properties of substances etc. They thus have an even greater need to be exposed to such experiences. We believe that laboratory work serves as a reality check, where students can see how chemistry concepts are grounded in the reality of how things behave in the world. Exemplary practice from within the CSU and elsewhere demonstrates that student laboratory experience can be made more efficient and effective in the following ways: 1. Insure that students are well-prepared for the lab and understand the key concepts that are involved in the experiment. Use pre-lab on-line quizzes, asking specific questions about the procedures of the experiment in the pre-lab quiz (e.g. what is the name of the acid that is going to be used in the experiment?, etc.) More on Pre-Lab quizzes from CSU San Marcos. Highlight important procedures that require special attention at the pre-lab lecture. 2. Students should know the goal of the experiment and how to analyze data collected in the experiment in order to achieve the goal, e.g., finding the concentration of acetic acid in commercially used vinegar. Have students use sample data to illustrate the analysis through an on-line pre-lab exercise. 3. Help students to see how the concepts and theory learned in the lecture are applied in the lab to solve everyday life issues. Co-ordinate the experiment order with the order of the topics covered in the lecture. This way, the concepts learned in the lecture can be reinforced in a timely manner in the lab. Design experiments that are closely related to everyday life issues. 11/16 Project results and ongoing work:: Members of the team plan to test new approaches to improve the effectiveness and/or efficiency of lab time: Karno Ng (CSUSM), Angel Pu (CSUDH), Susan Crawford (CSUS). Rich Paselk (HSU) also plans to redesign aspects of the Discussions sessions introduced in 2007-08 to replace some lab time. We have more information on our webpage for Making Labs More Effective. C. Online tools to make student homework more effective Careful integration of online homework into the general chemistry curriculum may result in significant decrease in the DWF rate, significant increase in student learning outcomes, and better utilization of both faculty and student time. Most online homework systems are mastery learning systems, in which students can repeat assignments, without penalty, until they get the correct answer. Questions are typically algorithmically generated, with both numerical and content variations, and individualized to a student. Most systems provide instant feedback, and several provide tutor-like support to students, for example, by giving specific feedback to incorrect responses, providing hints to solve a problem, offering Socratic sub-problems, and using animations and simulations to engage the student in the learning process. Our students typically evaluate online homework very positively: They indicate that it helps structure their study habits, helps them learn chemistry, and that the instantaneous feedback is particularly useful. Evaluation of student performance is also positive: Students who complete online homework assignments earn higher exam scores than students who do not participate in online homework, and a recent study suggests that students’ long-term knowledge of chemistry is enhanced by online homework activities14 . Project results and ongoing work: Team members will be investigating, initiating or enhancing Online Homework as part of the ongoing work in the project: Simone Aloisio (CSUCI), Danika LeDuc (CSUEB), Rich Paselk (HSU), Karno Ng (CSUSM). We have more information and an extensive comparison of tools on our webpage: Online Homework (and also Coordinating discussions sessions with on-line learning modules ). D. Supplemental instruction to address student challenges Both SFSU and SJSU have been using Supplemental Instruction in the form of Academic Excellence Workshops (AEW) in Chemistry for many years with demonstrable success. These workshops follow a format originally designed to enhance success for minority students calculus at UC Berkeley15, numerous CSU campuses provide similar program oriented to special groups16. Extending the Academic Excellence Workshops to other atrisk students has proven to be effective in improving student achievement, retention and degree attainment. At SJSU students in these workshops average one-half to a full letter grade difference in chemistry compared to those students not taking the workshops (with 12/16 similar results for calculus and physics courses). According to studies conducted at SFSU17, the observed grade difference is not due to the top students selecting to enroll in the course: the AEW students tend to initially have lower grade point averages and scores on diagnostic exams. Supplemental instruction has some of the benefits of lab sections (smaller size, greater student-student and student-instructor interaction, active learning, and a more informal, relaxed setting), but with a focus on problem solving, specific conceptual bottlenecks or misconceptions, and peer-to-peer teaching. Lectures can go up to the size of the largest classrooms, whereas workshops are limited to 25 students or less. The workshops are not used to do assigned homework: they are “peer cooperative learning programs that embed study strategy practice”18. Additional problems are provided by the workshop leader. Students work in groups on the problems, discuss them using active learning, and often go to the board for a discussion involving the whole workshop. Practical issues: Status: At SJSU, we have to make the workshops a formal course (2 units, CR/NC grades based upon attendance only). Without it being a formal course, the University will not assign rooms. In addition, for some of our minority students taking the workshop as a formal course means that their parents allow them to participate. Otherwise, some students must go home right after their classes end to assist with the family business or other activities. Grading: The student requirements in the chemistry workshops are to attend greater than 70% of them and to be an active participant. Staffing: SFSU often has faculty running the workshops, whereas SJSU has undergraduates or graduates running the workshops. The workshops only succeed if the course instructor agrees to provide information to the workshop leader. Fringe benefits for faculty include a reduction in students attending office hours. The workshop leaders at SJSU are often students who recently had CHEM 1A or CHEM 1B and earned grades of B or better. Our experience suggests that for many struggling students the support of a fellow student ‘survivor’ is particular valuable. Minimal training is required for past workshop participants to become the peer leader. Otherwise, a half-day or full day training session is required. Project results and ongoing work: Team members will be investigating, initiating or enhancing Supplemental Instruction as part of the ongoing work in the project: Simone Aloisio (CSUCI), Angel Pu (CSUDH), Danika LeDuc (CSUEB), Rich Paselk (HSU). E. Improving instruction on specific topics: our team mandate was to investigate redesigns with impacts at the ‘whole course’ level. There is also a substantial body of knowledge and resources about improving learning outcomes at the level of specific topics, which we were not able to consider in depth. We recommend that future multicampus course redesign initiatives incorporate specific roles for topic-level redesign. 13/16 6. Example Individual Course Redesign Plans Simone Aloisio’s course redesign plan at CSUCI includes experiments with new placement tests to correlate with student success in the course, pilot tests of online tutorial/homework to study the impacts, and an investigation of the effects of the (currently optional) supplemental instruction offered to students. Webpage Jim Postma’s redesign activities at CSU Chico are focused on leading the placement exam project outlined above, and on extending the results of the course design project into the parallel course General Chemistry for the Applied Sciences. Webpage Lihung (Angel) Pu's redesign plan for her course at CSUDH focuses on developing a placement exam that can more effectively identify readiness for general chemistry, adding more resources to support students’ study skills and enhancing student success by using mandatory supplemental instruction and on-line pre-lab quizzes. Webpage Danika LeDuc's redesign plan for her course at CSUEB focuses on initiating and/or increasing use of online homework, laboratory notebooks, on-line pre-lab modules. The plan also adds resources to support students, e.g., supplemental instruction, and diagnostics and schedule changes to direct students into a prep chem course. Webpage Rich Paselk’s redesign plan at Humboldt State plans to explore the use of on-line homework and tutorial work (ALEKS), a supplemental workshop modeled on the SJSU success and the use of Classroom Response Systems to engage students interactively in lectures. Rich will also be redesigning the Discussions sessions, which were introduced in 2007-2008 to improve student learning and reduce costs. Webpage Susan Crawford’s outline of course redesign plans for General Chemistry at Sacramento State [Webpage] includes the following: Analyze diagnostic test data from the past 5 years in an attempt to identify how effective the current diagnostic test is in predicting success, and improve the effectiveness of the test as a diagnostic tool based on the results; Formalize ideas to convert from two labs per week to one lab + one discussion, similar to Humboldt State, with a target implementation of Fall 2009; Seek external funding to support development of a standard preparatory chemistry course for feeder community colleges and a senior-level high school ACE course; Assess the use of Class Response Systems to engage students in deeper learning. Ray Trautman at SFSU plans to pilot-test OWL's ChemPrep, a self-paced online preparatory course for general chemistry, in Spring 2009. Webpage Herb Silber at SJSU will introduce online homework into the Chem 1A course in Fall 09. Karno Ng’s redesign plans for her course as CSU San Marcos include deploying an assessment test at the beginning of the semester (considering ALEKS for Chemistry and the assessment test used at SJSU), introducing online homework Mastering Chemistry associated with the course textbook, and joint work with Angel Pu of CSUDH to investigate online pre-lab tutorials. Webpage 14/16 7. Efficiency Improvements and Cost Savings The team examined the Cost Reduction Strategies and Case Studies in General Chemistry from the National Center for Academic Transformation. Cost savings from Transforming Course Design involve either Reducing costs per section or Reducing the number of sections offered. Many of these cost reductions had already been implemented in the CSU. Reducing costs per section is typically achieved in the following ways, all of which were considered as part of our team’s work: Reduce the cost of instructional time through personnel changes Not applicable: our mandate was to redesign courses that we ourselves teach. Reduce the cost of instructional assistants No opportunities were identified to replace graduate students with undergrads Extensive use of undergraduate learning assistants is included in the plans for Supplemental Instruction, as outlined above in Chapter 5 Section D. Reduce capital costs (facilities, equipment, etc.) Reduce laboratory work: As noted in Chapter 5 Section B, hands-on laboratory work has significant benefits for students beyond the grades they achieve, and is frequently identified by students as a source of engagement and satisfaction. We will investigate a mix of hands-on lab work with selected computer-based aids, in a collaborative project to be conducted by Angel Pu (CSU Dominguez Hills) and Karno Ng (CSU San Marcos). Webpage Reduce the amount of time in particular types of classroom facilities: this might also be a source of savings, either through avoiding the costs of adding classrooms to accommodate enrolment or through creating new opportunities to optimize section size by increasing availability of large classrooms). Team members decided to postpone further investigation of this alternative, pending results from projects by the Developmental Math team and our own other efforts to enhance student learning within and outside of lectures. Reducing the number of sections offered is typically achieved as follows: Increasing the number of students in course sections; Many of the NCAT Course Redesign projects in Chemistry applied this approach, which can be effective when accompanied by enhanced teaching and learning designs. Most of the team members reported that their General Chemistry courses were already held in the largest available classrooms. Decreasing the number of students who need to repeat the course. This approach is being followed in course redesigns by all team members. Given the rate of D/F/W’s typical of this course, there appear to be substantial savings possible. More information is available on this webpage. We also noted that some Course Redesign approaches examined above have potential to generate additional FTES counts at the Department or College level, and some have the potential to decrease FTES unless new students are enrolled in courses where fewer students need to repeat the course (e.g., see this cost analysis of AEW at SJSU). 15/16 Other Efficiency Improvements: A number of the online tutorials/homework outlined above can generate efficiencies in instructor and student time, e.g., by providing feedback to students on assignments where time for people to mark the work would be prohibitive, and by automatically monitoring student time on task and alerting instructors of pending problems early in the term. References 1 Programs Undergraduate Professional Education in Chemistry. ACS Guidelines and Evaluation Procedures for Bachelor’s Degree. American Chemical Society, Spring 2008. 2 Collier, P.J. and D. L. Morgan, ‘‘Is that paper really due today?’’: differences in first-generation and traditional college students’ understandings of faculty expectations, 2008, Higher Education vol. 55, pp.25–446. 3 House, J.D., Noncognitive predictors of achievement in introductory college chemistry, Research in Higher Education, Volume 36, Number 4 / August, 1995, pp. 473-490. 4 E.g., Russell, Arlene A. "A Rationally Designed General Chemistry Diagnostic Test," J. Chem. Educ. 1994, 71, 314-317; McFate, Craig; Olmsted, John A. III. "Assessing Student Preparation through Placement Tests," J. Chem. Educ.1999, 76, 562-565; Pienta, N.J.; Thorp, H.H.; Panoff, R.M.; Gotwals, R.R. Jr.; Hirst, H.P. “A Web-Based, Calculator Skills Tutorial and Self-Test for General Chemistry Students,” Chemical Educator, 2001, 6 (5), 365-69. 5 Pienta, Norbert J., A Placement Examination and Mathematics Tutorial for General Chemistry, Journal of Chemical Education, 2003, vol. 80, Issue 11, p.1244-47. preprint available at http://genchem.chem.uiowa.edu/chemed/research/placement%20exam%20msc20955.pdf; more on the diagnostic test is available at http://genchem.chem.uiowa.edu/courses/placement/. 6 Botch, Beatrice; Day, Roberta O.; Vining, William J.; Stewart, Barbara; Rath, Kenneth; Peterfreund, Alan; Hart, David. Journal of Chemical Education,. 2007, vol. 84, Issue 5, p. 547-560. 7 Chambers, Kent Alan (2005). Improving performance in first year chemistry. Doctoral dissertation, Texas Tech University. Available electronically from http : / /hdl .handle .net /2346 /1127 . 8 Pollock, S.J., "Transferring transformations: Learning gains, student attitudes, and the impact of multiple instructors in large lecture classes.", PERC Proceedings 2005. (2006). 9 Slunt, K.M.and L. C. Giancarlo, Student-Centered Learning: A Comparison of Two Different Methods of Instruction, 2004, Journal of Chemical Education v. 81, n. 7, p. 985-988. 10 Wieman,C., Why Not Try a Scientific Approach to Science Education?, Change, Sept-Oct, 2007. p. 9-15. 11 Wenzel, T.J., The lecture as a learning device, 1999, Analytical Chemistry, v71, p817A-819A . 12 Crouch, C.H., A. P. Fagen, J. P. Callan and E. Mazur, Classroom demonstrations: Learning tools or entertainment?, 2004, American Journal of Physics, V. 72, N. 6, pp. 835-838. 13 Adams, W. K., S. Reid, R. LeMaster, S. B. McKagan, K. K. Perkins and C. E. Wieman Study of Educational Simulations Part I - Engagement and Learning”, 2008, Journal of Interactive Learning Research, In Press. 14 Barbera, J. and C. E. Wieman , "Effect of a Dynamic Learning Tutorial on Undergraduate Students' Understanding of Heat and the First Law of Thermodynamics" The Chemical Educator, (submitted, 2008). 15 Uri Treisman. (1992). Studying students studying calculus: A look at the lives of minority mathematicians , College Mathematics Journal, 23, 362-372. 16 E.g., see Mills, Susan. (1999) Academic Excellence Workshops in Chemistry and Physics (Doctoral Dissertation), Claremont Graduate University, Claremont, CA. (A longitudinal study of Cal Poly Pomona students in Chemistry and Physics workshops). 17 Peterfreund, A., K. Rath, S. Xenos, and F. Bayliss "The Impact of Supplemental Instruction on Students in STEM Courses: Results from San Francisco State University", 2008, Journal of College Student Retention, Volume 9, Issue 4, pp.487 - 503 18 Arendale, D.R., Pathways of Persistence: A Review of Postsecondary Peer Cooperative Learning Programs, chapter in Best Practices for Access and Retention in Higher Education, I. M. Duranczyk, J. L. Higbee and D. B. Lundell (eds.), 2004, Center for Research on Developmental Education and Urban Literacy, University of Minnesota, Minneapolis, MN. pp. 27-40. 16/16