Program Assessment Plan American University CAS: Chemistry - BS CAS: Chemistry - BS Contact Person for Douglas Fox Assessment: Primary Department: Chemistry Does 2014 report reflect No changes in your LOs? : Are there any changes in your No assessment method?: Learning Outcome: Problem Solving Use basic concepts of Chemistry (e.g. laws and theories governing electron or molecular behavior, scientific method, problem solving ability) to solve new or unknown problems. Outcome Year: 2012 or prior 2012-2013 2013-2014 2014-2015 Start Date: 04/01/2009 Outcome Status: Active Learning Outcome Assessment Plan Assessment Method Target Schedule/Cycle Active Performance on ACS standardized tests and GRE chemistry test. 50% in the 80th percentile. Data tabulated yearly in departmental database and assessed every 4 years (2012/13-Year 4) in department meeting. No Measure Type: Quiz/ Exam Student alumni and employer questionnaires. Measure Type: Alumni Feedback Questionnaires sent every 4 years by Score 4/5 on "Completion of this degree directly contributed to the student's success." departmental chair and assessed every 4 No general knowledge listed for question, years (2015/16 - Year 7) in departmental meeting. "Which topic did you find most (least) helpful in your current employment?" Ability to field questions at departmental, school-wide, regional, and nationwide research 80% of students correctly answer 50% of conference. audience questions without supervisor assistance. Measure Type: Average 3/5 on question H of presentation Presentation assessment score sheet (v3). Quality of discussion in writing assignments. Measure Type: Written Assignment 12/02/2014 11:42 AM 80% or better on discussion sections of written research or advanced laboratory reports. Score 4/5 on question D of the student presentation assessment sheet (v3). Favorable review from ACS program accreditation process. Generated by TracDat a product of Nuventive. Yes Data tabulated yearly in departmental Yes database and assessed every 4 years (2013/14 - Year 5) in departmental meeting. Data collected every year and assessed every Yes four years in departmental meetings. Page 1 of 5 Assessment Plan Assessment Method Target Schedule/Cycle Active Student Evaluation of Teaching and Laboratory Questionnaires. At least 5.5. of 7 on Student Evaluations of Teaching, #103 (good understanding of concepts) and #106 (apply principles to new situations). Data tabulated yearly in departmental database and assessed every 4 years (2014/15 Year 6) using a 2-year rolling average in departmental meeting. One question will be on an annual rotation between 103, 107, 106, and 116. Yes Average score of 70% for (bio)chemistry majors in CHEM110 and CHEM210; 75% for students in CHEM410 and CHEM460; and 80% for undergraduates in CHEM510, CHEM540, and CHEM550. Data tabulated every two years in Yes departmental database and assessed every 4 years (2016/17 - Year 8) in departmental meetings. Measure Type: Survey Performance on exam questions tagged as "applied principles" from selected chemistry courses. Measure Type: Quiz/ Exam Related Action Steps * Supporting Assessment: Exam Questions Description: Although overall exam performance is not helpful for assessing specific learning outcomes, it was noted that specific questions on many professors' exams directly relate to one of the LOs. This was highlighted during the GenEd outcomes and assessment review conducted by the department. Over the next two years (2013 2015), faculty will review their exams to note if there are questions that directly assess one or more of the learning outcomes. * Supporting Assessment: Research Proposal Description: The advanced labs were restructured into two 2-semester labs: one on biomaterial design (required for both chemistry and biochemistry majors) and one on polymer composite design (required for only chemistry majors). At the start of the 2nd semester, students are required to propose their own experiment to conduct during the semester, which will answer some unknown question about the experimental system. Learning Outcome: Research Literature Ability to obtain and evaluate scientific information from the library or Web and effectively communicate the findings in oral and written format. Outcome Year: 2012 or prior 2012-2013 2013-2014 2014-2015 Start Date: 04/01/2009 Outcome Status: Active Learning Outcome Assessment Plan Assessment Method Target Student alumni and employer questionnaires. Measure Type: Alumni Feedback Score 4/5 on "How well did your research at Questionnaires sent every 4 years by AU help train you in your current job?" departmental chair and assessed every 4 years (2015/16 - Year 7) in departmental meeting. Adequately referenced work at departmental, school-wide, regional, and nationwide research conference. Measure Type: Presentation 100% of chemistry majors present research Data tabulated yearly in departmental Yes (poster or oral) at least once at any level. database and assessed every 4 years Average 4/5 on item E of presentation (2013/14 - Year 5) in departmental meeting. assessment score sheet (v3). 12/02/2014 11:42 AM Generated by TracDat a product of Nuventive. Schedule/Cycle Page 2 of 5 Active Yes Assessment Plan Assessment Method Target Schedule/Cycle Quality of reading and writing assignments. Average score of 4/5 on item E of student assessment scoresheet (v3). Favorable review from ACS program assessment. Data collected every year and assessed at Yes faculty meetings every four years (2013/14 Year 5). Measure Type: Written Assignment Active Related Action Steps * Supporting Assessment: Laboratory Reports Description: The advanced labs were restructured into two 2-semester labs: one on biomaterial design (required for both chemistry and biochemistry majors) and one on polymer composite design (required for only chemistry majors). Students are required to write research reports during each semester, complete with an introduction and literature citations. Learning Outcome: Data Analysis Ability to evaluate and quantify data; develop quantitative literacy and formulate scientific conclusions that are effectively communicated in oral and written formats. Outcome Year: 2012 or prior 2012-2013 2013-2014 2014-2015 Start Date: 04/01/2009 Outcome Status: Active Learning Outcome Assessment Plan Assessment Method Target Student alumni and employer questionnaires. Measure Type: Alumni Feedback Score 4/5 on "How well did the chemistry Questionnaires sent every 4 years by department help train you to use the analyze departmental chair and assessed every 4 years (2015/16 - Year 7) in departmental data in your current position?" meeting. Participation and excellence in departmental, school-wide, regional, and nationwide research conference. Measure Type: Presentation 100% of chemistry majors present research Data tabulated yearly in departmental Yes (poster or oral) at least once at any level. database and assessed every 4 years Average 4/5 on items B, C, and G of (2013/14 - Year 5) in departmental meeting. presentation assessment score sheet (v3). Student Evaluation of Teaching and Laboratory Questionnaires. At least 5.5. of 7 on Student Evaluation of Teaching, items #107 (identify and analyze problems) and #116 (quantitative reasoning skills). Measure Type: Survey Examination of Advanced Laboratory sequence on-line notebooks. Measure Type: Written Assignment 12/02/2014 11:42 AM Schedule/Cycle Data tabulated yearly in departmental database and assessed every 4 years (2014/15 - Year 6) using a 2-year rolling average in departmental meeting. One question will be on an annual rotation between103, 107, 106, and 116. Active Yes Yes Reduce the need to discount data due to poor Laboratory course instruction methods will No procedure for 80% of the class. be assessed every 4 years (2011/12 - Year 3) by instructors assigned to CHEM-571, CHEM-572, CHEM-581, CHEM-582. Generated by TracDat a product of Nuventive. Page 3 of 5 Assessment Plan Assessment Method Target Review of preliminary calculations in advanced laboratory sequences. Reduce the need to discount data due to poor Data will be tabulated every semester and procedure for 80% of the class. will be assessed every 4 years (2016/17 Year 8) by Dr. Costanzi, Dr. Fox, Dr. Hartings, and Dr. Miller. Yes Average 4/5 on items B & C on student presentation scoresheet (v3). Favorable review from ACS program accreditation. Yes Measure Type: Other Evaluation of the Results and Conclusions sections of written laboratory reports. Measure Type: Written Assignment Laboratory Practicals given in each course with a laboratory portion. Practicals will assess both techniques and analysis by both visual inspection and written answers. Measure Type: Quiz/ Exam Schedule/Cycle Reports will be examined every 4 years (2013/14 - Year 5) in departmental meetings. Active 75% for chemistry majors in CHEM210 and Results tabulated yearly and assessed every Yes CHEM322; 85% for students in CHEM572 four years (2015/16 - Year 7) at faculty and CHEM582. meetings. Related Courses - CHEM-571 - Exper Biological Chemistry I - CHEM-572 - Exper Biological Chemistry II Related Action Steps * Supporting Assessment: Laboratory Reports Description: The advanced labs were restructured into two 2-semester labs: one on biomaterial design (required for both chemistry and biochemistry majors) and one on polymer composite design (required for only chemistry majors). In each semester, students are required to present their data, analyze error, and relate findings to theory. Learning Outcome: Conduct Experiments Operate, interpret, and present data obtained safely via hands-on experimentation in the lab and using sophisticated instrumentation (such as NMR). Outcome Year: 2012 or prior 2012-2013 2013-2014 2014-2015 Start Date: 04/01/2009 Outcome Status: Active Learning Outcome Assessment Plan Assessment Method Target Schedule/Cycle Active Student alumni and employer questionnaires. Score 4/5 on "Score 4/5 on "How well did the chemistry department help train you to use the major chemical instruments that you are using in your current position?" Questionnaires sent every 4 years by departmental chair and assessed every 4 years (2015/16 - Year 7) in departmental meeting. Yes Average 4/5 on item B of presentation assessment score sheet (v3). Data tabulated yearly in departmental Yes database and assessed every 4 years (2013/14 - Year 5) in departmental meeting. Measure Type: Alumni Feedback Excellence in presenting results at departmental, school-wide, regional, and nationwide research conferences. Measure Type: Presentation 12/02/2014 11:42 AM Generated by TracDat a product of Nuventive. Page 4 of 5 Assessment Plan Assessment Method Target Examination of Advanced Laboratory sequence on-line notebooks. Reduce the need to discount data due to poor Laboratory course instruction methods will No procedure for 80% of the class. be assessed every 4 years (2011/12 - Year 3) by instructors assigned to CHEM-571, CHEM-572, CHEM-581, CHEM-582. Measure Type: Written Assignment Data tabulated yearly in departmental database and assessed every two years (2016/17 - Year 8) by Advanced Lab Faculty. Lab Course Sequence Questionnaire Measure Type: Survey Reproducibility of experimental data term-to-term by other students Measure Type: Performance Performance on Laboratory Practicals in 2nd semester of chemistry laboratories. Measure Type: Quiz/ Exam Observation of safe practices in the laboratory. Measure Type: Performance Schedule/Cycle 80% of data collected by students is reproducible by other students or faculty repeating their experiment by following procedures in their notebooks. Active Yes Data examined yearly and results are Yes assessed every two years (2014/15 - Year 6) by Dr. Costanzi, Dr. Fox, Dr. Hartings, and Dr. Miller. 75% for chemistry majors in CHEM210 and Results tabulated yearly and assessed every Yes CHEM322; 85% for students in CHEM572 four years (2015/16 - Year 7) at faculty and CHEM582. meetings. No points deducted from laboratory courses Points and violations will be noted Yes due to safety violations. continuously and will be discussed yearly at No safety violations observed during faculty meetings. random laboratory safety checks. Related Courses - CHEM-571 - Exper Biological Chemistry I - CHEM-572 - Exper Biological Chemistry II Related Action Steps * Supporting Assessment: Independent Research Description: The advanced labs were restructured into two 2-semester labs: one on biomaterial design (required for both chemistry and biochemistry majors) and one on polymer composite design (required for only chemistry majors). Students must conduct experiments that their proposed at the start of the 2nd semester. Faculty do not tell them what to do; they only ensure safe conduct and ask leading questions to guide student initiatives. * Supporting Assessment: Laboratory Practical Description: The use of a laboratory practical was favorably discussed with the General Chemistry supervisor. Plans are under way to initiate this process. This may be expanded to Organic and Advanced labs in future years. 12/02/2014 11:42 AM Generated by TracDat a product of Nuventive. Page 5 of 5