Developing Engineering Education Publications through Teaching and Service Activities Kevin Dahm, Rowan University Tuesday, November 10, 2015 Evolution of a Journal Publication Grant Proposal Project Publish Results Two challenge-based laboratories for introducing undergraduate students to biomaterials Jennifer Vernengo and Kevin Dahm, 2012 Education for Chemical Engineers Elements of Paper Introduction/Lit Review on the importance of biomaterials Background/Lit Review on the pedagogical rationale for using laboratory-based projects Project descriptions Scenarios Materials Procedures Grading Assessments Pre/Post quizzes Mapping of quiz questions to ABET outcomes Final Exam questions, control vs. experimental Jennifer Vernengo Joined Rowan in Fall 2009 Technical expertise in Biomaterials Two initial teaching assignments: Freshman Engineering Clinic- project-based interdisciplinary introduction to engineering Senior/Graduate elective course in own area of specialization Biomaterials Laboratories Freshman Engineering Clinic: Students make bioactive ceramics and measure their toughness Introduction to Biomedical Materials: Literature review project incorporated into first offering Open-ended laboratory project on hydrogels developed for subsequent offerings Elements of Paper Introduction/Lit Review on the importance of biomaterials Background/Lit Review on the pedagogical rationale for using laboratory-based projects Project descriptions Scenarios Materials Procedures Grading Assessments Pre/Post quizzes Mapping of quiz questions to ABET outcomes Final Exam questions, control vs. experimental Elements of Paper Introduction/Lit Review on the importance of biomaterials Background/Lit Review on the pedagogical rationale for using laboratory-based projects Project descriptions Scenarios Materials Procedures Grading Assessments Pre/Post quizzes Mapping of quiz questions to ABET outcomes Final Exam questions, control vs. experimental Elements of Paper Introduction/Lit Review on the importance of biomaterials Background/Lit Review on the pedagogical rationale for using laboratory-based projects Project descriptions Scenarios Materials Procedures Grading Assessments Pre/Post quizzes Mapping of quiz questions to ABET outcomes Final Exam questions, control vs. experimental Final Exams as Assessment Instrument Two cohorts Lit review project on hydrogels Lab project on hydrogels Two common final exam problems One on hydrogels One control question Solutions from both cohorts given to Kevin with no identifying information except a number. Kevin evaluates solutions without knowing which cohort each individual is in Rubric for Evaluation of Final Exam Solutions 4 3 2 1 Shows clear understanding by mentioning two or more variables specific those discussed for PVA hydrogels, such as polymer concentration, number and duration of freeze thaw cycles, molecular weight, etc Student was able to identify only one variable specific to PVA Student did not mention any variables Student specific to displayed no PVA, but knowledge of mentioned hydrogels and general ways how to design of varying them polymer properties Student understands general concepts on Student identified mechanics of properties of elastomeric elastomeric materials, especially materials (flexibility those natural and extensibility) elastomers found in the body Leaves out some minor aspects of elastomeric tissue mechanics Has difficulty in discerning Has displayed between no knowledge elastomers in this area and other materials Student identified process involved in making polyvinyl alcohol (PVA) hydrogels and was able to apply to new scenario, cardiac tissue engineering Assessment Results Cohort # students Lit Review Laboratory 17 18 Avg. Rating HYDROGEL 3.17 3.70 Avg. Rating CONTROL 3.63 3.54 Competition between student groups in the protein production challenge Brian Lefebvre, Loren Connell and Kevin Dahm, 2009 Elective in Bioprocess Engineering created by new faculty member 2005 course involved a literature review project 2006/2007 offerings incorporated the “Protein Production Challenge” Baseball Stadium Design: Teaching Engineering Economics and Technical Communication in a MultiDisciplinary Setting K. Dahm and J. Newell, 2001 Sophomore Engineering Clinic: teamtaught interdisciplinary course on technical communication and engineering design Implementing and Assessing the Converging-Diverging Model of Design in a Sequence of Sophomore Projects Course had an existing design project on design, construction and testing of cranes Faculty team implemented a new course organization that included a recently published model for the design process Used student performance on the design project as an assessment instrument Grading Rubrics for Design Reports Indicator Prepares a technical report with content appropriate to audience Presents summarized results based on analysis of measurements Score 4 Considers audience fully. Report is exactly geared to correct audience 3 Considers audience well, but may have a few moments of inappropriate level Provides clear, complete, correct, and concise analysis. Does not present uninterpreted data Results are well summarized. Little or no uninterpreted data. Major points are covered. A few minor errors may occur. Describes in Procedures are clear appropriate detail and succinct. the experimental procedures used Uses appropriate methods to estimate and interpret error Present correct and detailed error analysis and explains its relevance 2 Tries to consider audience but may over- or underestimate technical level Some interpretation and summary is made, but significant data is missing or left uninterpreted. 1 Gives little or no regard to the audience Procedure is clear, but perhaps a bit short or wordy Procedure is complete but difficulty to follow. Inappropriate detail level is presented Procedure is incorrect or incomplete Presents correct error analysis but does not fully elaborate on its importance Attempts to address errors but is lacking in procedure or consistency Makes little or no effort to address experimental error Students present data incorrectly with little or no interpretation. Technical Merit of Crane Design “Performance” is an objective measure of how “good” the student design “Performance” of 2005 cranes was significantly better than that of 2004 cranes, according to the 2004 “Performance Equation”. ABET Accreditation Criteria EC2000 contained new outcomes-based criteria Programs tasked with Establishing objectives and outcomes Providing evidence that these were attained Emphasis on continuous assessment and continuous improvement Publications on Assessment K. Dahm, “Combining the Tasks of Grading Individual Assignments and Assessing Program Outcomes in Project-Based Courses,” Journal of SMET Education, 15, 1 (2014). J. A. Newell, H. L. Newell, K. D. Dahm, "Rubric Development for Assessment of Undergraduate Research: Evaluating Multidisciplinary Team Projects," Chemical Engineering Education, 37, 3 (2003). J. A. Newell, H. Newell, and K. D. Dahm, “Rubric Development and Inter-Rater Reliability Issues in Assessing Learning Outcomes,” Chemical Engineering Education, 36, 3 (2002). Summary Publications on educational innovations can often be produced with modest time investment beyond the work you would have done anyway. Assessment needed for publication can often be integrated with the task of grading, if you have rubrics or other instruments designed to enhance the specificity and objectivity of grading.