Department of Chemistry University of Colorado 2010-2011 Outcomes Assessment report: Department Overview: The Department of Chemistry offers both the B.S. and M.S. degrees in chemistry. Students at the B.S. level have the option of obtaining an American Chemical Society Certified degree. Previously, earning the ACS degree certification involved taking just one additional class beyond the basic B.S. degree requirements. Beginning in the 2010-2011 academic year, the ACS requirements changed and require that students complete several courses beyond the normal BS curriculum to also receive ACS degree certification. During the 2010-2011 academic year (including summer 2010) there were on average 114 students who were declared majors at the undergraduate level and 18 enrolled graduate students. A total of 22 students were granted B.S. degrees (12 of these were ACS Certified) and 3 students were granted M.S. degrees. Undergraduate Program Outcomes: Outcomes assessment for Chemistry majors is carried out at several points in the curriculum, using different vehicles of assessment. The classes in which assessments are typically implemented are Honors Organic Chemistry Laboratory II, Instrumental Chemistry Laboratory, Physical Chemistry II and Physical Chemistry Laboratory. The department also typically assesses the outcomes from Organic Chemistry II lecture. The Organic Chemistry II lecture has a mixed enrollment (majors and nonmajors), but is generally the entry point for students into the upper division chemistry courses. These are all courses that are required of every chemistry major (with the exception of a few transfer students). All of the assessments are meant to determine some aspect of the degree to which our students, individually and as a group, meet the identified Departmental outcomes goals: 1. Students can recognize and define a general chemical problem in any of several sub-disciplines of chemistry and can design and carry out at least one significant experiment which addresses the problem, competently reporting their experimental results in oral and written form, adhering to proper chemical conventions. 2. Students possess an adequate knowledge base in several sub-disciplines of chemistry as determined by the American Chemical Society. 3. Students can rely on this knowledge base to link more than one chemical principle to solve problems both qualitatively and quantitatively. The degree of attainment of goals one and three is assessed in the three laboratory classes. Our success in achieving goal two is determined both through graded performance in the lecture classes and by correlating these from time to time with performances on nationally standardized discipline-specific exams prepared by the American Chemical Society. This year the projects were carried out and evaluated in the Organic Chemistry and the Physical Chemistry Laboratory. The ACS exams were required of all students in the Organic Chemistry II and Physical Chemistry. The means of assessment, student results, faculty analyses and departmental responses to these assessments are described below. Assessment through Laboratory Projects Fall 2010, Honors Organic Chemistry II Laboratory (CHEM 3498, Prof. Doug Dyckes): Seven students completed the Fall 2010 section of CHEM 3498. Six of these students were chemistry majors; one was a biology major. The final set of grades was two A-, one B+, one B, one B-, one C+ and one C. Overall this was the weakest average performance in several years. The small class size, and the fact that virtually all of these students had delayed taking the class (four were in their final semester), make it difficult to generalize from the overall performances, except, possibly, for one thing: we need to make a more concerted effort to get as many students as possible to enroll in this class as soon as they are eligible. Many of these students were several semesters removed from their last previous organic chemistry class. Grading was based on five extended written reports (55% of grade), two oral presentations (a preliminary project report to the class, and a final project report to the Department, 20% of grade), laboratory performance (15% of grade), and participation in the recitation (10% of grade). The heavy weighting on the written reports reflects one of the major aims of the course: that students should be able to present and interpret heir research results in an understandable, defensible form, using proper English. Each report is written in the format of the Journal of Organic Chemistry, the lead American Chemical Society journal of this sub-discipline. A grading rubric for each report (increasingly stringent) was posted for the students at least two weeks before the due date. The grade was reported as a set of scores, one for each of the areas described in the rubric. Extensive comments on each area of weakness (and on areas of strength) were provided. Students were given the option to rewrite and resubmit their first four reports, with the aim that this would help them improve their writing skills. The grade for the resubmitted report was averaged with the original grade for that report. The final report, which was based on the group research project, was not eligible for resubmission. The average grade for the final report was 87/100 (range 77 to 96). This is well above the average for the first submissions of the first four reports ( about than 81/100), confirming that writing skills for the class improved significantly during the semester. These grades are on a par with previous semesters taught by this instructor, indicating that satisfactory writing remains a successful outcome of the class. Anchor papers representing several performance levels for the final reports are available. The final seminar presentations of the class, made before an audience including more than half of the chemistry faculty, represent the first opportunity for most of our majors to make an oral presentation of their work. The students were required to give a brief group presentation of their progress, roughly half way through the research project portion of the class. They were given a grade (5% of the final grade) and feedback on how to improve their performances. At the final seminar they were subjected to vigorous questioning by the faculty, and by some of their fellow students. Each group presentation, and the contribution of each individual, was graded by three members of the faculty (one organic chemist, one biochemist and one analytical chemist) in addition to the course instructor, all using the standard Department presentation grading rubric, which had been given to the students in advance of their progress presentations. Each student’s final presentation grade was based on a simple average of the four faculty grades. The average grade for the final presentations was 79/100 (range: 77 to 81). This was several points lower than in previous semesters, with a narrower range. The highest scores were in the organization, presentation time-frame and evaluation of the work completed. This indicates that the groups put a major effort into preparing their presentations. The lowest scores were in placing the work presented in context and in answering questions related to their conclusions. There are fewer occasions for the students in this class to make oral presentations, and only one opportunity to be critiqued, and this may be the reason for lesser gains in their presentational skills relative to their writing skills. An increase in informal class discussions (leading to more confidence in speaking before peers) and in group problem solving (aiding the students in thinking on their feet) may be warranted. The final projects themselves were designed to foster the Department goal of enabling students to define a chemical problem and to design, carry out and report experiments addressing the solution of that problem. This course represents the first real research experience for most chemistry majors, and in this case the definition of the problem is partly defined. To wit: each student group (three or four students, selected by lot) is asked to synthesize a set of related molecules. The exact set is left for the group to choose, and the means of synthesis must also be selected by the group. Only restrictions on starting materials, certain methods deemed too dangerous, and a group budget are provided as boundary conditions. Once the synthesis is complete, the students must design an experiment that measures and compares the chemical properties of the related molecules that they have synthesized. Again, only the general property, for example the rate of decomposition in the presence of a strong base, is defined for the group. They must choose the specific reaction type, the reaction conditions, and the means of measuring the reaction outcome. In this process, most of the goals of problem definition and solution presented above are encountered by the students. As in the past the experience stimulating, and felt they had learned a great deal. Spring 2011 Honors Organic Chemistry II Laboratory (CHEM 3498, Prof. Scott Reed): The Honors Organic Chemistry II Laboratory provides one point of assessment for the department, and is specifically used to determining whether our students are meeting the goals of Outcome 3, stated below: “Outcome 3: Students can recognize and define a general chemical problem in any of several subdisciplines of chemistry and can design and carry out at least one significant experiment which addresses the problem, competently reporting their experimental results in oral and written form, adhering to proper chemical conventions.” The Honors Organic Chemistry II Laboratory course is required of all Chemistry majors. In the spring of 2011 a total of six students enrolled in the Honors Organic Chemistry II Laboratory. All were chemistry majors. Five students completed the class. A substantial portion of their grades was based on assessment of the students final project reports and presentations at the end of the semester. The students were assigned to two groups to complete research projects. Each group was given a brief problem to solve that involved both synthesis and the measurement of a reaction property. Each group was required to present their results twice within the class and finally as a seminar to which the Department as a whole. In addition, each student had to write an individual final paper that presented the entire project and evaluated the results. This report was written in the style of The Journal of Organic Chemistry. The students were provided with a rubric for evaluation of seminars in advance of both the in-class and final presentations. They were informed that the criteria in the rubric would be those upon which the presentations would be graded. The groups were thus able to structure and practice their seminars well in advance. Eight faculty members from the Department of Chemistry viewed and scored the final presentations. Results of the presentations: The individual grades of the evaluators correlated well for all students. The scores of all of the students were averaged in each category to obtain group and class averages. On the individual level, three of the students received consistently high scores on their presentations skills. Two students had mixed scores but still averaged in the proficient range. The final two students were perceived as being minimally proficient in their presentation skills. Results of the written reports: Each student turned in a separate final report on the group project. Only the experimental section of this report could be written collaboratively. The breakdown of the grades for written reports was roughly parallel to the oral presentations with two exceptions. One student from the lowest (oral) score set and one from the middle group both did consistently better on their written grades. A language barrier likely contributed to the discrepancy between their written and oral abilities. Results of the class overall: This group of students, as judged by the instructor, was average in laboratory technique and in the ability to carry out laboratory procedures successfully. A few of the students were very proficient in their oral and written presentation skills and overall raised the level of the group work. All of the students worked well in the group projects, with no major conflicts arising. The class appears to be meeting Objective 3, although weaker students are able to complete the course without a very solid technical writing ability. This instructor plans to clarify the grading rubric used for assessing the technical writing abilities of students in the future. Fall 2010 Physical Chemistry Laboratory (CHEM 4518, Prof. Mark Anderson): During the fall 2010 semester, the physical chemistry laboratory had 23 students enrolled, distributed between 3 sections. The students were randomly divided into groups of 2 or 3 to work together on the experiments. The students completed the exercises and recorded their experimental data, observations and a detailed discussion of their results in a laboratory notebook. The notebooks were graded using a rubric designed for the course that was provided to the students at the beginning of the semester. Experiments conducted during this semester of the course focused on thermodynamic and kinetic aspects of chemical systems. Because of the number of students and the availability of instrumentation/equipment in the laboratory, the course is structured so that 6 experiments are conducted by each group of students. Students have 2 weeks to complete their analysis and write-up of their experimental results. Conducting an independent research project, as is done in the Honors Organic Chemistry laboratory, is difficult in this course because of the lack of equipment. During the fall of 2010, students spent two weeks conducting the heat of combustion experiment – the first week calibrating the measurement, and the second week measuring the heat of combustion of some structurally related molecules. The students then wrote a report in ACS journal format in which they identified trends in their data and discussed the role of molecular structure in determining the heat of combustion of compounds. The reports were written by the groups with each student contributing to the report. Students were graded as a group on the manuscript. This process addressed Objectives 1 and 3 – specifically addressing the ability of students to link chemical principles. The student manuscripts ranged (from the instructors rating) from very good (72/80 and 71/80 pts) to below expectations (34/80 and 44/80 pts). The lowest scores in the class were from students who (1) English was not their first language, or (2) had not yet taken the Honors Organic Chemistry laboratory. The average score was 57.3 points with a standard deviation of 12.3 pts. The numerical scores were based on the students’ logical structuring of scientific arguments; and the ability of the students’ to communicate in a written document what they did in the laboratory, the ability to place the work in the context of the historical literature, and the significance of the experiments. An average score of 57.3 (~71%) indicates that the average manuscript was acceptable but not outstanding. Only two students were evaluated to be highly proficient, and 7 were above proficiency (out of 22 who completed the course), 5 were below proficient, and the remaining students were proficient. This result was surprising because the students should have written a manuscript previously in the Honors Organic Laboratory and we anticipated a larger fraction of the students to be above proficient (and no one at below proficient); however, as is the case in other courses, students often take courses out of sequence and don’t meet the prerequisites. Because some fraction of the students don’t meet the prerequisites, they were unprepared for the detail and depth that was being asked of them when writing a scientific manuscript. The manuscript portion of this course has been conducted, with minor changes, for 3 semesters now. The results have been mixed. There is a strong correlation between students who have completed the Honors Organic Chemistry II laboratory prior to enrolling in this course (which is the normal sequence) and the success in completing the manuscript well. The issue of sequencing courses will be addressed as the department restructures the course advising beginning in 2011. Assessment through Standardized Examination Organic Chemistry II (CHEM 3421, Prof. Vanessa Fishback) 14 students finished Chem 3421 during the summer 2010 term and took the American Chemical Society (ACS) standardized organic chemistry exam 2008 edition as their final exam. The ACS organic chemistry exam covers both semesters of organic chemistry and is an excellent gage of student comprehension and skills in the subject. The average score was 50th percentile with a median of 42nd percentile. One student scored at the 90th percentile or higher. During the spring 2011 semester 109 students completed organic chemistry II. 79 students were in a morning section. Of these 40 took the ACS standardized organic chemistry exam 2004 edition with an average of 63rd percentile and a median of 64th percentile. 11 students scored at the 90th percentile or higher. 39 students took the ACS 2008 edition exam. The average and median was 52nd percentile indicating that there could be a difficulty discrepancy between the two exams. The evening section of 30 completing students contained a higher portion of post-baccalaureate pre-professional health students than the day section resulting in an 81st percentile average score on the ACS 2004 organic chemistry exam with 14 students scoring at the 90th or higher percentile. Our students consistently score on average higher than the national average indicating the robustness of our instructional program in organic chemistry. Physical Chemistry Lecture (CHEM 4511, 4521, Prof. Hai Lin): The ACS Physical Chemistry exam has been administered to students as the final exam in the Physical Chemistry course. Following what we did for 2010, we used the 2006 Combined Semesters Exam for 2011. We used the same set of 60 problems as last year, which were randomly picked from the total 120 problems. The 60 problems spread in four sections that the lecture had covered: Thermodynamics (20), Quantum Theory (30), Kinetics (5), and Statistical Thermodynamics (5), where the number of problems in each section is given in the parentheses. The students had two hours to complete the exam, as instructed by the ACS exam guideline. The mean and median raw scores for the 2010-2011 class of 26 students were 34.5 and 35, somewhat lower than those for the 2009-10 class of 21 students (37.0 and 36.0, respectively). Because the national norm is not available, we used in the present analysis the 2006 Comprehensive Exam norm as reference, for which the mean and median are 32.03 and 31.1, respectively. The average percentile for the 2010-2011 class of 26 students were 61st, which is lower than that for the 2009-10 class of 21 students (68th). This was close to the outcome in previous years, where the 2001 Comprehensive Exam was used. The fractions of students above 50th were 73%, above 75th 27%, and above 90th 12%. While those data are slightly worse than those of 2009-2010 class, they were again similar to what we have seen in previous years. See the following Table for more details. Academic year Mean Fraction of Students Above Given Percentiles year(# students) avg. Percentile >50th >75th >90th nd Using 2001 Comprehensive Exam (Mean Percentile about 52 ) 2001-02 (14) 48th 43% 29% 0% 2002-03 (12) 49th 33% 33% 25% th 2003-04 (18) 48 44% 22% 0% 2005-06 (11) 71st 64% 55% 18% 2006-07 (16) 69th 56% 50% 31% st 2007-08 (21) 61 57% 33% 19% 2008-09 (18) 70th 78% 56% 28% Cumulative (110) 58th 55% 40% 17% Using Adapted 2006 Combined Semesters Exam (Mean Percentile about 52nd) 2009-10 (21) 68th 81% 38% 24% st 2010-11 (26) 61 73% 27% 12% Cumulative (47) 65th 77% 32% 18% The Physical Chemistry ACS exam has been used as the sole final exam in our Physical Chemistry II class for 7 of the last 8 years. In this case both semesters of the class are taught by the same instructor each year. Virtually all of the students completing the Physical Chemistry II in any year have also taken Physical Chemistry I the previous semester. Students know from the outset of the semester that the ACS exam will be used as their final exam. The results on this national examination indicate that UCD chemistry majors are performing at a level that exceeds the national average. Results and feedback loop of the undergraduate program assessment The results of these assessments have led us to identify two major areas for improvement: curriculum and facilities. The Honors Organic Laboratory curriculum and the nature of the final project have been developed over nearly a decade. The laboratory class is designed to be taken concurrently with the Honors Organic lecture. Unfortunately, restrictions on laboratory space have made it impossible to offer the class to all of the students taking the lecture class each spring. This factor changes the nature of learning in the laboratory class, which has been designed to include a large complement of “just in time” learning, in advance of the formal presentation of many lecture topics. We are changing the emphasis of the course because many students do not take the laboratory at the same time as the lecture; rather, they take it after completion of the lecture class instead. More time should be spent on the use of the chemical literature and project design, and less on de novo laboratory learning experiences. It will be interesting to see, as we do this, whether there are significant shifts in the type of performances of students both in the laboratory and in the lecture classes. The department must do a better job of emphasizing the sequencing of the course curriculum to students, and at rigorously applying course prerequisites. This became clear this year based on the difficulty that many students who did not meet course prerequisites had with courses they were enrolled in. This will be a point of emphasis with department advising, and we will emphasize to faculty the need to check that students meet the prerequisites for courses. As a result of this, the department has reorganized its advising – adding additional faculty as student advisors. We also have discussed, but have not yet implemented, the requirement that students speak with an advisor before they are allowed to register for courses. The department decided to collect one additional year of data to determine if this step is necessary, or if the last year was anomalous. The Physical Chemistry Laboratory curriculum has been affected by increasing enrollment and the pressures this places on the Instrumentation being used in the course. This has been alleviated somewhat by increasing the number of sections of the laboratory offered (3 sections). Students cannot complete each of the preliminary experimental modules simultaneously, so the work was staggered. This means that the lecture component of the course is not in sequence with the experiment that each of the students in the course are conducting. All laboratory classes were affected by aspects of Department facilities that go beyond laboratory availability. The Honors Organic Laboratory and Physical Chemistry laboratory requires the use of the Department’s NMR spectrometer on a regular basis. Now that we have moved into the new Science building and we have an NMR instrument dedicated to the teaching laboratories, this problem (identified previously, and one of the outcomes from previous assessment feedback loops was to try to obtain an instrument dedicated to teaching. This was accomplished through donation) has been solved; however, these are complex instruments that need regular maintenance. During the fall 2010, the Physical Chemistry laboratory, for example, had to simply provide data to students because the NMR instrument was not functioning at the time these experiments were scheduled. The department now has a 50%-time instrumentation specialist who devotes significant portions of this time on instrument repair and set-up (as opposed to faculty doing this, as was done up until January 2011). Students must still undergo extensive training to use the instrument (identified as a problem previously). The department hires an upper division student to serve this role. This solves the training problem; however, it requires that a new person be identified and hired annually. The advanced laboratory courses have dedicated, local instrumentation in their physical space; however, much of this equipment is aging and there simply is not enough redundancy of individual instruments to allow multiple groups of students to conduct the same experiments simultaneously. These laboratories have been able to upgrade instruments through the CLAS equipment grant program; but, this local grant program is not growing as fast as enrollment in these courses and the department’s teaching instrumentation is lagging behind the needs based on student enrollment. We will need to identify alternate methods for upgrading and maintaining the teaching instrumentation. Contacts between department faculty and local technology companies have resulted in some major instrumentation being donated to the department (e.g. the 300 MHz NMR that is dedicated to teaching). We need to continue to leverage these connections to upgrade our instrumentation. We also must be more aggressive in pursuing federal grant programs for instrumentation. Acquiring new instrumentation will allow the department to introduce new experiments to the upper division laboratories. To this end, the department hired (to begin in the Fall of 2011) a full-time upper-division laboratory instructor. This instructor will allow the department to update the experiments. Despite these limitations, these laboratory courses gave the students independent problem solving experiences that addressed outcomes goals 1 and 3. Overall students demonstrated an ability to recognize general chemistry problems and design experiments that addressed an important question. The experiences also had students relate concepts in different areas of chemistry, and to use the chemical literature to relate their experiments to work conducted by others. Student proficiency was determined by evaluation of written and oral presentations, and was found to be overall proficient. We believe that the learning gains of students, however, will be greater with better (and appropriate) student preparation that is based on students meeting the defined course prerequisites. We also believe that broader emphasis on scientific writing in the curriculum will better prepare students for these upper division laboratories. To this end, the department implemented Honors General Chemistry laboratory sections during 2010-2011. These sections have greater expectations of the students, and introduce them to a more vigorous problem solving, and more in-depth writing than was previously expected of students in lower division courses. Student feedback from senior exit interviews over the last 3 years shows that students appreciate the open-ended problem solving, research projects associated with the Honors Organic laboratory. Faculty frustrations, however, with the success of the student projects and the quality of the presentations suggests that changes should be implemented to the curriculum. Some changes, discussed above, are beginning to be implemented – namely disconnecting the lecture from the laboratory since not all students take the courses simultaneous. Another change, discussed by the department during AY 20092010 that was implemented during AY 2010-2011, was to create a Honors General Chemistry lecture and laboratory sequence. These courses are taught at a higher level than the normal sections, and will require permission to be enrolled in (based on departmental requirements). Beginning in fall of 2011, the department will also begin teaching Honors sections of organic I lecture. We anticipate that, given the open-ended and higher level laboratory exercises that students are exposed to in the honors general chemistry laboratory, the student performance in the Honors Organic II laboratory and upper division laboratories will improve. We hope that this will help students (1) connect what they are learning in more meaningful ways, (2) give them experience thinking as scientist and explaining their thought process; and (3) prepare them better to have greater success in the Honors Organic laboratory and other upper division laboratory research project/presentation. With the implementation of honors Organic I and II during 2011-2012, the department no longer requires chemistry majors to take the Honors sections (recognizing that not all of our majors are strong enough academically to succeed in an honors section). This adds new curriculum pressures to the “regular” sections of organic as we strive to meet the needs of chemistry majors and students majoring in a life-science. In addition, enrollment in organic chemistry lecture sections has increased dramatically over the last 5 years. The faculty of the department has developed a plan to create Honors, majors, and non-majors sections of organic chemistry lecture to meet these diverse needs. To implement this plan several actions must occur: (1) additional faculty must be hired, and (2) the enrollment caps of the organic chemistry courses must be set at a reasonable number (80). The need for lower enrollment sections is supported by student performance on standardized exams. While scores on the ACS organic chemistry exam averaged over all the sections are near the national average, scores in the smaller enrollment sections exceeds the national average. We believe that this is due to the greater attention that the smaller lecture can spend on reaction mechanisms and on assessing individual understanding of organic chemistry by short answer and written exams, quizzes, and homework. Large (130+ lecture sections) do not have the lecture support (e.g. TA) to assign routine homework, nor to give written exams. It is through the written exam and homework that students can develop their understanding of how organic chemical interact and combine during chemical reactions. Decreasing the size of lectures will facilitate the department moving back to a more interactive lecture setting. The plan submitted by the faculty to implement the different Organic Chemistry tracks (Honors, Majors, and nonmajors) will be implemented beginning in fall 2012 (assuming the department is able to hire new faculty). Additional feedback from student exit interviews suggests that students would like a more robust biochemistry curriculum. To this end, the department has appointed an ad hoc committee to develop a curriculum for a biochemistry option. If the department is able to add additional faculty with a scholarship interest in biochemistry, the plan is to begin the role out this new option during the fall semester of 2012. As the department Graduate Program Outcomes The Master’s program in chemistry has a friendly admissions policy; that is, it recommends but does not require the GRE. The total enrollment in the program typically varies between 20 and 30 students, many of whom are local and part-time. There are two options for obtaining a Master’s degree: Plan I, the thesis option; and Plan II, the course work emphasis option. The most recent significant changes in the program took effect in January 2007, with the institution of four core courses in analytical, inorganic, organic, and physical chemistry. Thesis students are required to complete at least three of the core courses and earn a total of at least 30 credits for their Master’s degree. The students in the course work emphasis are required to complete all four of the core courses and earn a total of at least 33 credits for their degree. These changes were made to assure that all students completing the Master’s degree would have a broad background in the basic areas of chemistry. The program is designed so that full-time students could finish in two years, but our parttime students take longer, some up to five years. During 2010-2011, only 3 students graduated with a MS in chemistry, and all 3 completed the course-work option. Graduate Program Outcomes goals: Outcome 1: Students possess an understanding of the basic concepts of the fundamental areas of chemistry (physical, analytical, inorganic, and organic) significantly beyond their baseline knowledge* and possess an extended understanding of one or more of these subdisciplines. Outcome 2: Students can effectively carry out a research project assimilating knowledge along the way, effectively report their experimental results in oral and written form, adhering to proper chemical conventions and develop the ability to use this knowledge to address new scientific questions Background Assessment The program requires diagnostic tests of all students entering from other universities, using the American Chemical Society standardized exams in inorganic, organic, physical, and analytical chemistry. This addresses outcomes goal 1. UC Denver BS-MS students and recent graduates (i.e., those who graduated within one year from the time of admission) are exempt from an exam provided that they obtained B or better grades in the upper-divisional undergraduate courses in the exam area. Students can take each exam twice and must score at the 33rd percentile level or higher to qualify. Passing the qualifying exam in any area qualifies students to take graduate courses in that area. Students who fail a qualifying exam are required to take an upper-divisional undergraduate course in the area and pass the course with a B or better grade in order to qualify. The following table summarizes the passing rates on the diagnostic exams or remedial courses taken by students who entered the program from other universities during the past 3 years (see above): 1st Attempt at Exam 2nd Attempt at Exam Remedial Course 28% 65% 62% The passing rate is defined as the number of exams/courses passed as a percentage of the total number of exams/courses taken. Although the passing bar is set relatively low at the 33rd percentile, the passing rate for the first attempt at an exam is low. This indicates that many students were not well prepared when they entered the program. Nonetheless, the rates improve considerably when students get to attempt an exam a second time or take a remedial undergraduate course. Among the least prepared are certain international students. Because the program does not require the GRE and may even waive the TOEFL, it is hard to evaluate the backgrounds of those students in English and chemistry. In the future, we will likely install additional requirements for international applicants even though this may drive away some potential graduate students. Performance Assessment The program requires a minimum grade of B– to pass any core course, and a minimum grade of C to pass any other graduate course. In addition, students must maintain a cumulative GPA of 3.0 or better in graduate coursework; or they will be placed on academic probation. CHEM 5111, Advanced Analytical Chemistry (Prof. Yong Liu) Advanced Analytical Chemistry (CHEM 5111) is an extension of an undergraduate course in instrumental analysis that focuses on more advanced methods. Unlike typical approach to the teaching of undergraduate instrumental analysis, which focuses on instrumentation and instrument design, in this graduate course we concentrate on the subject from the point of view of instrumental methods of chemical analysis. The course provides a survey of practices and techniques in chemical analysis of spectroscopy, separation, mass spectrometry and microscopy. The course briefly reviews theoretical background of each instrumental method and general principles of instrumentation. The course emphasizes the utility and actual applications of each method discussed. The course also briefly discusses the interpretation of instrument output. In addition, this course addresses instrumental techniques usually not covered in a typical undergraduate course in instrumental analysis such as photoluminescence and surface characterization techniques. The major objectives of the course include that after taking the course students have an idea of what the various instrumental methods are capable of doing and how to select the right tool to solve a problem or make a measurement and develop skills of searching for and reading literature, thinking critically, and organizing and presenting results. Assessment was based on the combination of in-class participation discussion (25%), mid-term exam (25%), final exam (25%) and term paper writing (25%), where the relative weight of each approach was given in parentheses. The exams were largely composed of short answer questions, which required the students to have comprehensive understanding of course materials. The term paper provided the students an opportunity to demonstrate that the key course objective had been met. The students can select any topic related to their research projects or to other areas of personal interest (provided there is a clear link with the class materials). The final grades of the 13 students enrolled include 6 As (A and A), 6 Bs (B+, B, and B-) and 1 C. The performance showed the majority of the students had good understanding of course material and were able to provide critical evaluation of research papers and present results effectively. Though overall course objectives were seemingly met, there were two students struggling in the exams and failing to provide acceptable term papers. The problems probably resulted from their insufficient knowledge in instrumental analysis at undergraduate level and lack of training of reading and writing scientific papers Results and feedback loop of the graduate program assessment As the department prepares to go through the third cycle of the graduate courses (beginning fall 2011), the effectiveness of the changed curriculum is becoming clearer. It is clear that the greater emphasis in all the graduate core courses on communicating has been a positive outcome. Even though many students struggle to reach the standard that is expected, written and oral communication is improving. Because courses are offered every other year, there will always be a mix of advanced students and beginning students in each course. We have not yet, but will in the future, conduct the assessment by comparing the outcomes of these 2 groups of students within the same course as a way of determining the overall effectiveness of this emphasis throughout the core graduate chemistry curriculum. A chemical literature course has been designed, but has not yet been submitted through the curriculum approval process. As suggested above, this course may be a necessary addition to the curriculum to meet the goals of objective 2. A challenge with this is finding the time and resources to teach an additional graduate course on a regular schedule given the small numbers of students in our graduate program. In addition, the department does not offer enough graduate courses at regular intervals to meet the needs of the students. In a typical semester, the department will only offer 1 graduate course. The department periodically supplements this one course with a special topics course – but these typically have a very low enrollment and are always in danger of not meeting the enrollment requirements to run during the semester. In addition to the literature course, the department has discussed offering 1-credit courses (designed to last 5 weeks) as a way of increasing our graduate offerings. A pilot course is being offered during the summer of 2011 to determine the effectiveness of such courses. This will be a point of discussion for AY 2011-2012 and will be part of our feedback process (e.g. evaluating the effectiveness of 1-credit courses as a way of expanding our graduate curriculum). Our graduate program has been of a service nature for the most part, accommodating students who want further education and making them better. For that matter, it has been successful. 2010-2011 is a typical year in that only 3 students graduated with a MS in chemistry, and all three completed the course-work option. While providing a service to local students, the course-work option does not contribute significantly to the research agenda of the department. For the program to raise its research profile in terms of publishing more papers in referred journals and attracting more external funding, and being a more attractive destination for full-time graduate students there is a need to provide better financial support. Right now the program does not offer tuition waver or competitive TA/RA stipends that one finds in a standard Ph.D. program in chemistry. The major form of financial aid available to our graduate students is teaching assistantship. We would like to establish that a full-time graduate student will be guaranteed 5 sections to teach over the course of the year (e.g., 2 sections each term, plus one in the summer; or 3 sections in the fall and 2 in the spring; etc.). If this is the case, then a $17000 TA stipend is reasonable, and if we could figure out a way to pay for tuition, then the financial aid package would be much better than it is now.