GENERAL EDUCATION Assessment Report Eastern Kentucky University Fall 2013 Report Prepared by Dr. Rose Perrine, Associate Dean University Programs; Coordinator General Education Assessment 1 General Education Assessment Report: Eastern Kentucky University Assessment Timeline EKU assesses all General Education courses every two years. All student learning competencies were assessed fall 2011 – spring 2012, and a data report prepared in fall 2012. Therefore, fall 2012 is the most recent data report available. Eastern Kentucky University’s General Education Competencies Eastern Kentucky University’s student learning competencies and their relationship to the Statewide competencies can be viewed in Appendix A. Means of Assessing Each Competency Common assessment processes include All competencies are assessed with direct student-learning measures. Student learning is assessed at or near the end of the course. Assessment instruments are developed by EKU faculty who teach the General Education courses. Departmental faculty members collaborate on a common assessment instrument for each course. The assessment is embedded in the courses such that students are graded on the assignment. Assessment instruments are unique to each course, but the same instrument is used in all sections of a course. Assessment instruments can contain objective, e.g., multiple choice, and/or subjectively-scored items, e.g., essay, papers. Common rubrics are applied to the student work. These rubrics were created by faculty within each general education block, and are based on the general education goals/student learning outcomes that are assigned to that area. For assessment items that yield objective responses, e.g., multiple choice, there are established criteria for categorizing students into levels of accomplishment. For assessment items that yield subjectively-scored responses, categorizing students into levels of accomplishment is based on faculty judgment. For these items departmental faculty discuss expectations and score some student work as a team. Once faculty members standardize their scoring then a single faculty member may score a student’s work. Difficult or ambiguous cases are discussed as a team. Some departments score most/all student work as a team, due to the complicated nature of the scoring for these assignments. Sampling procedures: Work from a minimum of 30 students is assessed for each course. For courses with less than 30 students, all work is assessed. For courses with multiple sections the following procedure may be used: (Optional procedure: All sections may be used.) 1—10 sections: Random sample of student work drawn from all sections 11-20 sections: Random sample of student work drawn from 10 sections* More than 20 sections: Random sample of student work drawn from half of the sections 2 *Instructions to faculty about scoring assessment items, categorizing students, sampling, preparing data reports, use of data, and commonly asked questions can be viewed in Appendix B. Summary of Data Collected The data report for fall 2012 (the most recent report available) can be viewed in Appendix C. Use of Results Information about how outcomes were used for faculty to improve student learning can be viewed in Appendix D. General Education Changes EKU revised its GE Program, effective fall 2012. The revisions can be viewed in Appendix E. Therefore, the next assessment data report (fall 2014) will show data from courses in the new program. Attachments Common rubrics for each GE Block can be viewed in Appendix F. Assessment instruments are described in Appendix G. 3 Appendix A Student Learning Competencies: State and EKU Comparison Oral and Written Communication STATEWIDE Competencies EKU Competencies Written Communication 1. 2. 3. 4. 5. Listen and speak competently in a variety of communication contexts, which may include public, interpersonal, and/or small-group settings. Write clear and effective prose in several forms, using conventions appropriate to audience (including academic audiences), purpose, and genre. Find, analyze, evaluate, and cite pertinent primary and secondary sources, including academic databases, to prepare speeches and written texts. Identify, analyze, and evaluate statements, assumptions, and conclusions representing diverse points of view, and construct informed, sustained, and ethical arguments in response. Plan, organize, revise, practice, edit, and proofread to improve the development and clarity of ideas. 1. 2. 3. Demonstrating rhetorical knowledge by: a. Focusing on a specific purpose for a defined audience. b. Defining a specific topic through a clearly stated thesis. c. Constructing an effective discourse organization. d. Providing adequate and relevant supporting evidence, appropriate documentation, and clear and valid assumptions and conclusions. Applying critical thinking, reading, and writing by: a. Understanding a writing assignment as a series of tasks, including research, understood as finding, evaluating, analyzing, summarizing, and synthesizing appropriate outside sources. b. Integrating their own ideas with those of others. c. Using various forms of technology to support research and to enhance written compositions. EKU Assessment Rubric Written Communication 1. 2. 3. 4. 5. Audience/Tone Organization a. Integration b. Cohesion Control of Written Language a. Sentence Structure/Syntax b. Word Choice/Vocabulary Surface Features Information Literacy Demonstrating control of written language by: a. Controlling sentence structures appropriate to academic writing. b. Controlling grammatical conventions of written Standard English, including word forms, punctuation, and spelling. 4 Oral communication 1. 2. 3. Applying critical thinking by: a. Utilizing various forms of technology to effectively research, organize, and integrate information required for message production and delivery. b. Adapting oral communication styles to appropriate contexts. c. Evaluating self and others’ communication skills. Oral communication 1. 2. 3. 4. 5. 6. 7. Structure Content Context Audience awareness Oral Delivery Nonverbal Delivery Presentation Aids Demonstrating command of communication skills by: a. Successfully implementing effective verbal delivery skills related to the context. b. Successfully implementing effective nonverbal delivery skills related to the context. Demonstrating other-oriented perspective by: a. Writing and articulating ethical issues inherent in the message. b. Adhering to standards of ethical communication in presenting one’s views. c. Writing and articulating messages appropriate for various cultures and groups. Oral and Written Communication Statewide 1 EKU Statewide 2 EKU Statewide 3 EKU Statewide 4 EKU Statewide 5 EKU 5 Mathematics STATEWIDE Competencies 1. Interpret information presented in mathematical and/or statistical forms. (LEAP B) 2. Illustrate and communicate mathematical and/or statistical information symbolically, visually and/or numerically. (LEAP A, B and C) 3. Determine when computations are needed and to execute the appropriate computations; (LEAP B) 4. Apply an appropriate model to the problem to be solved; (LEAP A, C and D) 5. Make inferences, evaluate assumptions, and assess limitations in estimation modeling and/or statistical analysis. (LEAP B, C and D) EKU Competencies 1. Using mathematical methods to state and solve quantitative problems, including those stated in verbal form. 2. Using numerical and graphical data to make reasonable and valid conclusions. 3. Applying mathematical methods to real life problems. EKU Assessment Rubric 1. 2. 3. 4. 5. 6. Comprehension Appropriate use of terminology and notation Execution of appropriate strategies for solving problems Use of mathematical/logical operations Interpretation of the meaning of solutions in the context of the problem(s) Integration across course Mathematics Statewide 1 EKU MA 2 Statewide 2 EKU MA 2 and 3 Statewide 3 EKU MA 1, 2 and 3 Statewide 4 EKU MA 1 and 3 Statewide 5 EKU MA 2 6 Arts and Humanities STATEWIDE Competencies EKU Competencies EKU Assessment Rubric Arts and Humanities Arts and Humanities Arts and Humanities 1. 1. Demonstrating an understanding of the critical thinking skills used by artists and humanists to study, to evaluate, and to express the human condition. 1. 2. 3. 2. Reflecting critically upon the individual ideas and values expressed in creative works. 3. Analyzing the cultural values and ethical issues expressed in creative works from different cultures. Utilize basic formal elements, techniques, concepts and vocabulary of specific disciplines within the Arts and Humanities. 2. Distinguish between various kinds of evidence by identifying reliable sources and valid arguments. 3. Demonstrate how social, cultural, and historical contexts influence creative expression in the arts and humanities. 4. Evaluate the significance of human expression and experience in shaping larger social, cultural, and historical contexts. 5. Evaluate enduring and contemporary issues of human experience. Foreign Language 4. Comprehension Clarity of Expression Formal/Structural analysis Contextual Analysis 4. Analyzing the aesthetic qualities of creative works. Demonstrate competency in a foreign language. Foreign language study develops essential skills and cultural awareness critical for success in a multilingual world. Arts and Humanities Statewide 1 EKU AH 1 and 4 Statewide 2 EKU AH 1 Statewide 3 EKU AH 2 and 3 Statewide 4 EKU AH 2 and 3 Statewide 5 EKU AH 2, 3 and 4 Foreign Language Statewide Foreign Language SLO EKU AH 1 and 3 7 Natural Sciences STATEWIDE Competencies EKU Competencies EKU Assessment Rubric Course Outcomes 1. Demonstrate an understanding of the methods of science inquiry. (LEAP A and B) 2. Explain basic concepts and principles in one or more of the sciences. (LEAP A and B) 3. Apply scientific principles to interpret and make predictions in one or more of the sciences. (LEAP A, B, and D) 4. Explain how scientific principles relate to issues of personal and/or public importance. (LEAP A, B, C, and D) Block Outcome 1. Demonstrating an understanding of the methods by which humans gather data and make conclusions in biological and physical sciences. 2. Explaining the major concepts and fundamental processes of biological and physical sciences. 3. 4. Conduct a hands-on project using scientific principles. Applying the principles and theories of biological and physical sciences to make reasonable and valid conclusions. Applying scientific knowledge to examine and address issues of personal and public importance. 1. 2. 3. 4. 5. Demonstrate an understanding of the methods used to carry out scientific inquiry. Explaining the major concepts of the natural sciences. Applying scientific principles to make reasonable and valid conclusions. Applying scientific knowledge to address issues of personal and public importance. Integration across course. Natural Sciences Course Outcomes Statewide 1 EKU NS 1 Statewide 2 EKU NS 2 Statewide 3 EKU NS 3 Statewide 4 EKU NS 4 Block Outcome Statewide Block Outcome EKU NS 1, 2, 3 and 4 8 Social and Behavioral Sciences STATEWIDE Competencies 1. 2. 3. 4. 5. Demonstrate knowledge of at least one area of the social and behavioral sciences. Apply knowledge, theories, and research methods, including ethical conduct, to analyze problems pertinent to at least one area of the social and behavioral sciences. Understand and demonstrate how at least one area of the social and behavioral sciences conceptualizes diversity and the ways it shapes human experience. Integrate knowledge of at least one area of the social and behavioral sciences into issues of personal or public importance. Communicate effectively using the language and terminology germane to at least one area of the social and behavioral sciences. EKU Competencies EKU Assessment Rubric History 1. Demonstrating relevant perspective, rooted in time and place, in the analysis of historical (written and artifactual) sources. 2. Demonstrating an understanding of the interactions of social, cultural, political, religious, economic, scientific and/or technological developments as factors in historical change. 3. Building and clearly communicating an argument on the basis of historical (written and artifactual) evidence and documentation. 4. Demonstrating ability to understand change over time and the significance and effects of historical events and developments. 1. 2. 3. 4. 5. Comprehension Application and analysis Interpretation and Evaluation Methods Integration Social and Behavioral Science 1. 2. 3. Demonstrating an understanding of the methods by which social scientists gather data and make conclusions. Explaining the major concepts and fundamental processes basic to the social sciences. Applying the principles and theories of the social sciences to make reasonable and valid conclusions about matters of personal and public importance. Arts and Humanities Statewide 1 EKU HIS 1, 2 and 4; SB 2 Statewide 2 EKU HIS 1; SB 1 Statewide 3 EKU HIS 3 and 4 Statewide 4 EKU SB 3 Statewide 5 EKU HIS and SB (all) 9 Appendix B Assessment Information for EKU Faculty These instructions are on the GE website for faculty to view as needed. http://www.gened.eku.edu/ ASSESSMENT GUIDELINES for GENERAL EDUCATION COURSES REVISED Spring 2013 Prepared by: Rose Perrine, Associate Dean University Programs rose.perrine@eku.edu; 622-6764 OVERVIEW OF ASSESSMENT PROCESS Faculty collaborate to develop assessment items for each course. All sections of the same course must use the same assessment items and process. A scoring rubric for each GE Block/Element guides the development of the assessment items, and Rose Perrine is available to help as needed. Assessment items can be exam questions (objective or open-ended), written assignments, portfolios, papers, or oral presentations. Good assessment is not an “add on.” Rather, it is an evaluation of student performance that provides faculty with information that they would want regardless of whether assessment data were required. It is best to evaluate students toward the end of the semester. We want to know what students learned by end of the course. Each course must be assessed twice in each four-year cycle. For courses with multiple sections: (1) assessment items should be given to students in all sections of a course, (2) all faculty should use the assessment items for grading purposes, but (C) samples may be selected to be scored for assessment purposes. Data should be aggregated across all sections chosen for assessment. The GE Committee should not see any reports that include faculty names or CRNs. Send data report to Rose Perrine. EXPLANATION: THE “LEVELS” OF ACHIEVEMENT ON THE GRADING RUBRICS When we evaluate students in our courses we can often categorize them into four levels: The students who “get it,” (meet expectations) the students who don’t “get it,” (do not meet course expectations) and the students who fall in between. Occasionally, we have a student who exceeds course expectations. These levels correspond to the levels on the Grading Rubrics developed for the assessment of General Education Courses. The levels on the Grading Rubrics ALWAYS refer to achieving the student learning outcomes for THAT SPECIFIC COURSE. Students who meet course expectations are Competent. Students who do not meet course expectations are Beginning. Students who fall in between are Developing, and the occasional student who “exceeds expectations” is Accomplished. Please do not confuse “A” work with “Accomplished.” “Accomplished” means “exceeds courses expectations.” HOW TO CATEGORIZE STUDENTS WHEN “OBJECTIVE” ASSESSMENT ITEMS ARE USED: Objective items have “right and wrong” answers, e.g., multiple choice, true/false, matching, fill-in-the-blank, short answer. 10 The grading rubrics were designed for written/oral assignments that require faculty judgment; thus, the language within each “cell” is not useful for categorizing students with “objective” assessment items. The following guidelines should be used with “objective” assessment items: A. For each criterion on the rubric (Comprehension, Methods, etc.) faculty should write at least 4 objective items that students who are competent in that specific course should be able to answer correctly. All sections of the same course must use the same assessment items. Thus, faculty must collaborate when writing these items. B. Each criterion on the rubric must be evaluated separately. Thus, a unique set of questions must be written for each criterion. For each criterion: ● Students who correctly answer 75--100% of the items for that criterion are “Competent” in that criterion. ● Students who correctly answer 50--74% of the items for that criterion are “Developing” in that criterion. ● Students who correctly answer 0—49% of the items for that criterion are “Beginning” in that criterion. note. It is not possible to classify students as “Accomplished” when using “objective” items. HOW TO CATEGORIZE STUDENTS WHEN WRITTEN/ORAL ASSIGNMENTS ARE USED: ACCOMPLISHED: Students may be categorized as “Accomplished” on written/oral assignments if they exceed the expectations of the course for that criterion. “Accomplished” level should be used ONLY in cases where the student clearly goes above and beyond the expectation. It is NOT just “A” work. These expectations are defined, in very general terms, on each grading rubric. COMPETENT: Students may be categorized as “Competent” on written/oral assignments if they meet the expectations of the course for that criterion. These expectations are defined, in very general terms, on each grading rubric. DEVELOPING. Student’s performance on assessment items does not fully meet the expectations for that criterion, but is not totally “off base” either. (Performance is incomplete in meeting expectations for that criterion.) These expectations are defined, in very general terms, on each grading rubric. BEGINNING: Student’s performance does not meet expectations for that criterion. These expectations are defined, in very general terms, on each grading rubric. 11 GE-2006 and GE-2012 Assessment Schedule for General Education Courses: Fall 2012 – Spring 2016 Eastern Kentucky University Interim Associate Dean University Programs: Rose Perrine rose.perrine@eku.edu DATE Document Date: Spring 2012 TASKS Fall 2010--Spring 2011 ALL GE-2006 courses should have been assessed (f2010 or sp2011). Fall 2011—Spring 2012 Score student work, prepare data report, and meet with faculty to discuss use of data. Modify instruments, processes, and/or curricula as needed. Send data report and use of data to Rose BY MAY 1, 2012. Fall 2012—Spring 2013 Assess ALL GE-2006* & GE-2012 courses (f2012 or Sp2013). *This will be the last required assessment for GE-2006 courses that are not also in GE-2012. For Block/Elements V/5 and Element 6 use most recent rubrics (created summer 2012) Fall 2013—Spring 2014 Score student work, prepare data report, and meet with faculty to discuss use of data. Modify instruments, processes, and/or curricula as needed. Send data report and use of data to Rose BY MAY 1, 2014. Spring 2014 GE Committee reapproves all GE-2006 courses. Reapproval will be automatic for those courses for which two data reports and use of data have been sent to Rose. Departments will not need to request reapproval. No additional assessments are required for GE-2006 courses that are not also in GE-2012. Fall 2014—Spring 2015 Assess ALL GE-2012 (f2014 or Sp2015). Fall 2015—Spring 2016 Score student work, prepare data report, and meet with faculty to discuss use of data. Modify instruments, processes, and/or curricula as needed. Send data report and use of data to Rose BY MAY 1, 2016. Spring 2016 GE Committee reapproves all GE-2012 courses. Reapproval will be automatic for those courses for which two data reports and use of data have been sent to Rose. Departments will not need to request reapproval. Suggested Sampling Procedures for Multi-Section Courses If a course has multiple sections, it is sometimes difficult to get data/assessment assignments from all sections. In an attempt to reduce the burden of getting all data, the following procedure may be used: (Optional procedure: All sections may be used.) 12 1—10 sections: 11-20 sections: More than 20 sections: Assessment data from all sections Assessment data from 10 sections* Assessment data from 1/2 of the sections* *Please select sections to be included in data report by randomly selecting from the following groups: (a) Richmond campus; (b) Extended campuses; (c) On-line courses; (D) Part-time faculty; (E) Full-time faculty. We understand that these groups are not mutually exclusive, but are provided as examples of populations that should be included in sample. Please note. The procedure of having all instructors in all sections collect the assessment assignment/data should be enforced, i.e., all students should complete the assignment. The only change is that the person responsible for gathering all the assignments/data now has the option of “nagging” only a subset of instructors to get those assignments/data at the end of the semester. This new procedure is optional and is intended to help those departments who have problems getting data/assignments from every section. Chairs. Chairs may want use the data to compare the performance of students in the various groups, e.g., online vs campus courses. However, data should be aggregated before sending to Rose. How many students’ assignment do we need to grade? If the assignment is easy to grade (e.g. scantrons) then grading all of the students’ work is desirable. If the assignment is more time-consuming to grade, then choose a random sample: (1) For 1—10 sections choose about 10% of the students’ work, with a minimum of 30 students; (2) For more than 10 sections choose about 5% of the students’ work. Fewer students may be chosen for the sample when the assignment is unusually difficult to evaluate, e.g., oral presentation videos, portfolios. Please contact Rose Perrine for guidance. You do NOT need to have the same sample size for each criterion. For example, if your assessment instrument includes multiple choice items to measure “Comprehension,” and an essay to measure “Integration,” then you might report all students’ scores for “Comprehension,” and a sample of 30 students for integration. EXAMPLE OF DATA SUMMARY & USE OF DATA Course: PST 101 Data from: Spring 2011 Report prepared by: Mary Chang Number of sections assessed: 4 Assessment Task: Comprehension and Methods were assessed via 60 multiple-choice items on the final exam. Clarity of Expression, Formal Analysis, Theoretical Application, and Integration were assessed via a paper. Sample: Four sections of the course were offered in spring 2011 (total 100 students). All students’ exams were assessed for Comprehension and Methods. A random sample of 10 student papers from each section were selected and graded by a committee for Clarity of Expression, Formal Analysis, Theoretical Application and Integration. 13 Data Summary (NUMBER of students in each category) PST 101: Spring 2011 Criteria Comprehension Clarity of Expression Formal/Structural Analysis Contextual Analysis Sample* Size 100 (all students in 4 sections) 40 (random sample of 10 students from each of 4 sections) 40 (random sample) 4Accomp N/A (multiple-choice items) 0 3Compet 40 2Develop 30 1Begin 30 20 20 0 5 10 20 15 NA X Theoretical Application Methods Integration 40 (random 5 20 sample) 100 (all) N/A 90 40 (random 0 35 sample) * Sample Size column needed only if sample size varies by criterion. 15 10 10 5 0 0 EXAMPLE: USE OF DATA Comprehension and Methods. The distribution of scores for Comprehension appears reasonable. However, there were 5 comprehension items that few students answered correctly. The faculty judged all 5 items to be important, and have discussed how those concepts could be emphasized and illustrated more in future classes. We have agreed to include the PST Paper #3c as an assigned reading in each class, as it emphasizes the concepts that we think are important. The distribution for Methods does not appear reasonable because 90% of the students were assessed as “competent.” This does not reflect the students’ performance on other assignments in the course. The faculty discussed the assessment items for methods and determined that they are challenging, but that faculty were more-or-less teaching to the test by using the same examples in class as are on the exam. We agreed to NOT use the same variables and concepts in any class examples that appear on the exam. We agreed on a set of examples that could be used in class and will check this item on the next assessment to see how students perform. Clarity of Expression, Formal Analysis, Theoretical Application & Integration. 50% of students were “developing” on Clarity of Expression. Because most students in this course have not completed ENG 101 and 102, this seems like a realistic distribution. Faculty have discussed ways to help students write with more clarity, and next semester will begin some practice writing, with feedback, in several class sessions. We have agreed to use the TCAC Book that was written by a team of EKU faculty involved in the TCAC program. The book has several lesson plans and suggestions for helping students become better writers. We also agreed to use the Noel Studio to present short lessons to students, and to encourage students to visit the Noel Studio often. 14 The distribution of scores for Integration does not appear reasonable. Faculty perceptions are that students do not integrate material well, but assessment scores suggest that a majority of students are competent. Faculty re-visited the integration part of the paper and realized that the assignment did not require students to integrate material on their own. Rather, in class, faculty tended to integrate the material for the students, and in the papers, students reiterated what the instructors had previously integrated. Faculty have agreed to modify their teaching strategies to demonstrate integration of material in class, but not use the same material that students are later required to integrate in the papers. We discussed several integration examples that we could present in class that do not use the variables students are expected to integrate on the assessment exam. Send Data Summary and Use of Data to rose.perrine@eku.edu COMMON QUESTIONS: ASSESSEMENT of GENERAL EDUCATION COURSES 1. WHAT AM I ASSESSING? You are assessing the general education goals that the course addresses. These general education goals appear on the course syllabus in all sections of the course. 2. WHY NOT JUST USE COURSE GRADES? Course grades are based on a combination of various course assignments. A student who makes a “B” in a course may have earned an “A” on three exams, and a “D” on a research paper. The global grade of “B” provides no information regarding in which parts of the course the student performed better or worse. On the other hand, assessment results for this student might indicate that he/she performed well only on lower-level thinking tasks, such as comprehension of information, which is often evaluated with exams. Assessment results might show that this same student performed poorly on higher-level thinking tasks, such as integration of material, which might be evaluated via a written assignment, or essay questions on an exam. 3. HOW DO WE KNOW ASSESSMENT ITEMS ARE VALID? The issue of validity (do items measure the construct accurately?) is no different for an assessment instrument than it is for a test. One type of validity that is important for academic tests is content validity, which refers to whether assessment items (or test items) reflect a specific domain of content. Thus, assessment items for a math course might include decisions regarding which formulas to use, calculations of equations, and interpretations of results. By creating assessment items that fit each criterion on the Rubric, assessment items are likely to have better content validity than many tests. Ultimately, the validity of the assessment instrument reflects that knowledge base of the people who created it. This is why assessment instruments should be created by faculty experts. When a group of experts collaborate on creating assessment items, the validity is likely to be better than when only one expert creates items. 4. HOW DO WE DEVELOP AN ASSESSMENT INSTRUMENT? First, Departments should strive to involve as many faculty as possible in the creation of an assessment instrument. Faculty should discuss what they perceive as the important aspects of a course, note the commonalities, and agree on a “core set” of course material. Faculty should then collaborate on developing assessment items that (a) measure this core set of material, and (b) fit the criteria on the Rubrics. Second, faculty should discuss the procedure for administering the assessment items. The assessment items should be embedded in an exam or assignment that is given later in the semester in order to test what students have learned in the course. All faculty should give the assessment at a similar time and in a similar context. Students should be told the same thing about the assessment – specifically, NOTHING that you would not normally say about an exam. It is not necessary to tell students that X% of this exam is assessment of GE course objectives. 15 To some degree, every exam in GE courses should be measuring the GE course objectives. From a student’s point of view there is no difference between assessment items and test items. 5. HOW DO WE GRADE THE ASSESSMENT ITEMS? Individual faculty should grade their students’ assessment items, use the score as part of the students’ grade, and use the overall results to determine potential strengths and weaknesses of his/her individual course. This individual grading may or may not be standardized. For example, if the assessment involves a research paper, one faculty member might decide to weight the literature review 30%, while another faculty member may weight the literature review only 10%. However, these scores are for the individual faculty members’ use; they are not the scores that are reported for assessment purposes. For purposes of reporting assessment results, data from all sections should be aggregated. Thus, instructors might submit to a committee all the assessment exams/papers. That committee might select a random sample and grade (or re-grade) the items according the Rubric. At least two faculty members should grade several assignments to check for reliability in grading procedures. If grading appears to be reliable for several assignments, then one faculty person could grade each assignment, while collaborating with the other grader when necessary. Scoring student work in a group provides opportunities for faculty to discuss common errors, and strengths and weakness of students, and provides opportunities to discuss potential changes to the assessment instrument, process, instructions to students, and/or course lesson plans. 16 Appendix C EKU: General Education Data Report Fall 2012 Course-level assessment Fall 2010—Spring 2012 (Second Year of Four-Year Cycle) OVERVIEW EKU’s revised General Education Program began in Fall 2006. Courses in the program are approved for four years only, and must be reapproved by the General Education Committee to remain in the program. Fall 2010 began our second four-year cycle. All courses are due to be assessed the first and third years of the cycle (2010—11 & 2012—13). Data reports and use of data are due the second the fourth years of the cycle (2011—12 & 2013—14). For this report data were analyzed for 164/165 of courses taught between Fall 2010—Spring 2012. STATUS OF ASSESSMENT PROCESS The Associate Dean of University Programs serves as the GE assessment coordinator, reviews data, and provides feedback to each department regarding their assessment instrument, data summary, and use of data. Regarding all of these components, significant progress has been made over the past six years. All courses now have valid assessment instruments that have been adopted by faculty, and processes for collecting and analyzing assessment data within departments are established. Use of data has moved from a focus on instrument refinement to a focus on improving student learning. A report on how data have been used is included in this document. CRITERION FOR SUCCESS 85% of students who complete general education courses will achieve the competences for that course. The competencies for a course are criteria on the GE block-specific, course-level scoring rubric used to evaluate students’ responses on the assessment instrument. Competencies and criteria on each rubric are based on the GE goals addressed by each block. A subset of the criteria on each rubric is defined as “critical thinking” based on the definition of critical thinking used by the University. Because EKU’s QEP is focused on critical thinking, data for critical thinking are presented separately. Operational Definition of “achieve.” In many cases the “developing” level of accomplishment may be evidence of meeting the learning objective because in a single general education course significant learning can occur even if students have not yet reached a “competent” level. Thus, in the data report “achieve” is defined as the percent of students who were evaluated as “accomplished,” “competent,” or “developing.” DATA SUMMARY Data were analyzed by calculating the percent of students who were evaluated as “accomplished,” “competent,” and “developing” for each criterion, by GE Block. Summary data by GE Block, collapsed across all criteria, are reported in Table 1. Interpretation of Data The percent of students who achieved the general education competencies ranged from 74 - 94%. The criterion of 85% of students achieving competencies was met in the 8/11 GE Blocks/areas. 17 Table 1. Students’ Achievement of General Education Competencies by Block % Achieving GE Competencies Aggregated Across All Rubric Criteria Aggregated Across Critical Thinking Criteria Only I a/b: Written Communication 85 81 I c: Oral Communication 88 92 II: Mathematics 85 85 III & VII: Arts & Humanities 88 98 IV & VII: Natural Sciences 74 68 V & VII: Historical and Social Sciences 81 76 VI: Wellness 94 95 VIII: Foreign Languages 85 85 VIII: American Sign Language 87 87 VIII: Race, Gender, Sexuality Theme 81 81 VIII: Society, Technology, Values Theme 89 88 GE BLOCK GENERAL EDUCATION CORE EKU SPECIFIC 18 Students’ Achievement of General Education Competencies by Block and Rubric Criteria COMPETENCY (Rubric Criterion) GE BLOCK N % Achieved GE Competency I a/b: Written Communication 2 courses Audience/Tone (CT) Organization: Integration (CT) Organization: Cohesion (CT) Sentence Structure/Syntax Word Choice/Vocabulary Surface Features Information Literacy Total Across all Criteria & Courses Total for Critical Thinking (CT) Criteria 147 147 147 147 147 147 149 90 74 78 89 96 93 74 85 81 109 107 100 109 101 109 101 80 97 90 86 92 88 85 88 92 493 455 88 81 489 85 414 432 500 82 85 86 85 85 I c: Oral Communication 2 courses Structure Content (CT) Context Audience Awareness (CT) Oral Delivery Nonverbal Delivery Presentation Aids Total Across all Criteria & Courses Total for Critical Thinking (CT) Criteria II & VII (qs): Quantitative 22 courses Comprehension (CT) Use of Terminology/Notation (CT) Execution: Strategies for Problem Solving (CT) Use of Math/Logical Operations (CT) Interpretation: Meaning of Solutions (CT) Integration (CT) Total Across all Criteria & Courses Total for Critical Thinking (CT) Criteria 19 COMPETENCY (Rubric Criterion) GE BLOCK N % Achieved GE Competency III & VII (ah):Arts & Humanities 33 courses Comprehension Clarity of Expression (CT) Formal/Structural Analysis (CT) Contextual Analysis (CT) Theoretical Application (CT) Methods Integration (CT) Total Across all Criteria & Courses Total for Critical Thinking (CT) Criteria 1274 1111 931 1008 921 825 1263 88 90 83 89 91 87 89 88 89 2920 2908 88 76 2919 64 1670 83 2918 64 74 68 2454 2426 503 2429 2383 90 81 66 83 73 81 76 IV & VII (ns):Natural Science 25 courses Methods Major Concepts Application: Reasonable & Valid Conclusions (CT) Application: Issues of Personal/Public Import (CT) Integration (CT) Total Across all Criteria & Courses Total for Critical Thinking (CT) Criteria V & VII (sbs): Historical and Social Sciences 28 courses Comprehension Application & Analysis (CT) Interpretation & Evaluation (CT) Methods Integration (CT) Total Across all Criteria & Courses Total for Critical Thinking (CT) Criteria . 20 Appendix D Use of Results for General Education Course Assessment SAMPLE Statements from Departments regarding USE OF DATA First Two Years of a Four-Year Cycle: General Education Program Fall 2010 – Spring 2012 Note from GE Assessment Coordinator. This document contains sample statements provided by departments regarding faculty use of GE assessment data during the first two years of the second four-year cycle of EKU’s General Education Program (fall 2010 – spring 2012). A few departments are still refining assessment instruments and processes, and, thus, their use-of-data statements focus on validating the instruments, and revising processes. However, we made significant progress in the first four-year GE cycle (fall 2006—spring 2010) in helping departments develop and refine valid instruments, and we are now more focused on helping faculty understand how to use data to improve student learning. The use-of-data statements below demonstrate that progress, and show that most departments are using GE data to improve student learning. SAMPLE USE OF DATA STATEMENTS BLOCK I: COMMUNICATION ENG 101/102: Research, Reading, Writing, and Rhetoric The 2010 course evaluation indicated that students did not employ enough visual rhetoric in their papers. To deal with that problem, that summer’s workshop focused on how and why graphic design could/should be employed in student papers. The emphasis was not the creation of graphics but their rhetorical ability to enhance a message. The workshop included group work and actual analysis of graphics to better understand the role of visual rhetoric in modern academic writing. The 2010 evaluation also suggested that instructors needed additional training in writing comments on student papers. In the summer workshop in 2011, we discussed giving students a clear sense in the end comment of what the student needs to improve but also to suggest ways that the student could improve. To that end, we had a practice session where instructors individually graded a sample paper, wrote end comments, and shared responses with the group. That exercise, I intended, would also help to more closely standardize the grades given at EKU in 101 and 102. ENG 105: First Year Writing Seminar The 2008 evaluation indicated few problems with superior scores in all areas, but the 2010 evaluation showed trouble some problems ranging from mechanical deficiencies to poor research and organizational skills. The scores were so egregiously low that I requested that we re-test the 105 students again this Fall (2011), thinking that their scores were some sort of anomaly. I shared the scores with the 105 instructors and apprised them of the poor scores. If I were to use just the 2010 results, I would have to completely re-think the teaching of that course. It is my belief that re-testing the 105 students would help clarify whether the miserable 2010 scores were or were not representative the normal population for that course, and therefore more clearly identify what the problem areas for 105 really are. (note. re-testing is taking place.) I have more extensive notes on what happened in those summer all-day workshops. Since I supervise a large number of instructors, individual conferences with instructors to improve their instructors have not been detailed here, but I speak often with as many of the 50 instructors as possible. This week, for example, I have spoken with three different instructors. But I have also taken more general measures that I believe will improve the overall instruction in composition, including a year-long training program for potential online instructors; the 21 collection and analysis of the syllabi of all instructors in all sections of composition, offering suggestions and changes when warranted; the addition of computer-networked instruction; the appearances of the authors of two of our textbooks who clarified for our instructors the purpose and best use of their books; and almost weekly messages from me to instructors about new pedagogical materials, committees in the composition and their work, announcements of writing contests open to our students, helpful websites, textbooks designed for specific student problems in composition, the availability of book-length support materials through one of our publisher, and any matters relevant to the teaching of composition our instructors need to know about ( I have written two this week). I also encourage instructors to come to me with any pedagogical or student problems (many have), and see me as a resource person in composition instruction. To that end, I hold generous office hours so that I can also offer an instructor a convenient time to meet with me. I also attend the Conference on College Composition and Communication to sit in on sessions dealing with the supervision of instructors and new methodologies that could improve instruction. Finally, I subscribe to two professional journals that also offer insight into improving instruction. CMS 100: Introduction to Human Communication The faculty felt that our most recent general education assessment cycle yielded more accurate results, as improvements in the data collection methods were made, the sample sizes were quite a bit larger, and the quality of the data itself increased. This time, data for CMS 100 and 210 was collected and analyzed separately, providing insights targeted to the goals of each course. Because we felt more confident that our results were generalizable this time, the results of the CMS 100 assessment were shared at the annual faculty retreat for all of those involved in teaching the general education courses. While the course syllabus did not alter significantly, many additional resources to help faculty teaching CMS 100 better address message structure, oral delivery, and nonverbal delivery (in terms of the oral communication criteria) were provided. Since the opening of the Noel Studio for Academic Creativity, faculty have also introduced students to the resources available to them there, including help in research (to bolster content and organization of content) and access to practice facilities to reinforce verbal and nonverbal communication fluency. Data gathered through this assessment cycle also informed faculty about the ongoing need to reinforce critical thinking competencies, particularly in message comprehension, analysis, selection of quality evidence/supporting materials, and perspective-taking. Faculty members were given resources from the QEP office to supplement the Paul & Elder Miniature Guide publication currently required in CMS 100. Faculty members spent time discussing these resources and received specific training on how to utilize the new resources at the retreat, along with pedagogical strategies to foster enhanced critical thinking. CMS 210: Public Speaking GE assessment strategies for the most recent assessment cycle improved since the last time data were collected. The sample size was larger and the quality of the data for analysis increased. This time, data for CMS 100 and 210 was collected and analyzed separately, providing insights targeted to the goals of each course. Given the number of sections of CMS 210 offered each year, the faculty felt the results of the assessment were representative of students taking CMS 210 and helpful in terms of making adjustments to the course. The assessment data were used first of all as an indicator of how many CMS 210 students actually possess competent public communication skills -- many more than we had thought. Thus, this data served as confirmation that faculty and students are meeting criteria better than "suspected." Data indicated, however, that CMS 210 faculty and students need to work more on audience awareness and analysis, as demonstrated in the speeches. Both the evaluated speeches and the accompanying outlines indicated the need for students to explore other perspectives, to consider audience points-of-view and subsequent message adaptation to better accomplish oral communication goals. At the annual CMS 100/210 faculty retreat, these specific assessment results were shared and discussed. Since there are a variety of activities and resources faculty members can 22 access to address these issues, no single strategy for improvement was advanced. Faculty recognize, however, that the development and implementation of a common assignment (across all sections of CMS 210) would be helpful both to reinforce audience-awareness requirements and to better assess the extent to which students are developing their other-orientation. BLOCK II &VII (qs): MATHEMATICS & QUANTITATIVE SKILLS MAT (sample of mathematics courses) The Mathematics Service Committee was unimpressed with the results, but noted that the results are inconclusive due to the small sample size sample size, the data seem to indicate that most students are performing at reasonable levels. To address the problems that a portion of the students in the class have we will try to enforce prerequisites for the class, catch struggling students early and suggest remedial work, and encourage students who need to drop back to lower level math classes to strengthen their background. The committee observed that placing the assessment questions at the end of the exam probably made it more likely that students, out of exhaustion and frustration, would skip them by the time they had spent almost 2 hours on the exam. Hence, we decided to place the questions at the beginning of the exam in future semesters. Furthermore, many students refuse put commensurate effort into non-multiple-choice questions—believing that the odds of a higher score lie with multiple-choices questions. The committee suggested that instructors emphasize to the students the use of performance on the assessment questions in deciding borderline course grades. College algebra has been identified by the Mathematical Association of America as one of the “gateway” courses: nationally it suffers from a 25-plus-year trend in poor preparation by college-bound students. It will probably take significant time for reforms in pre-college education in Kentucky and recruitment by EKU from a small pool of qualified students to gain much traction against this trend. The committee has come to the conclusion over several years that the Spring courses’ students are qualitatively different that those in Fall courses in Mat 107. Therefore, we need to sample the Fall 2012 cohort, rather than the Spring 2013. The committee also noted that the results are inconclusive due to the small sample size sample size (10) relative to the number of students taking MAT 107. PHI 100: Practical Reasoning Faculty made changes to PHI 100 in the Fall of 2010 based on analysis of the Spring 2009 assessment data. The data indicated that the area of Operations required the most effort in terms of improving student learning. In response to the data concerning Operations, instructors provide more opportunities for students to compare and discuss their answers to exercises covering specific logical concepts, skills, and techniques, e.g., having individual students share their answers with the class or in small groups. STA 215: Introduction to Statistical Reasoning While the scores are generally low, they are still generally better than the scores from the last round of assessment, which was completed in the spring semester of 2009; they are substantially better than the scores 23 from the assessment that was completed in the spring semester of 2007. In particular, the reduction in the number of 1’s from 2009 to 2011 is encouraging. The faculty would still like to see more 3’s in all areas. An increased use of technology was recommended in 2007, and since then some instructors have begun using online homework. Syllabi were adjusted to say that a two-variable scientific calculator is required and that the instructor will use a TI-83 or TI-84; this positive change has been maintained. Since the 2011 data indicate that student performance is headed in the right direction, faculty members plan to continue to use technology to help students to understand concepts without struggling with computations. The 2009 report indicated that hiring another tenure-track statistician might ultimately result in better assessment scores in STA 215 because it would be helpful if there were more experts in the field of statistics available to teach introductory statistics courses, and having another full-time statistician in the department would mean that there would be someone else to provide fresh ideas and help with curriculum development. In 2011, the department hired another tenure-track statistician, a department chair who is also a statistician, and two new lecturers with backgrounds in statistics. These additions to the department are expected to have positive effects on introductory statistics courses and statistics courses in general. The Statistics Curriculum Committee met on March 12, 2012, and discussed the possibility of changing the STA 215 textbook. They decided to keep the Moore text for at least one more year but to try using a new homework system that will provide students with more resources. The Department of Mathematics and Statistics has continued to make efforts to see that students come to college prepared to do college-level mathematics. The statistics faculty members are hoping that these efforts will ultimately result in better assessment scores in STA 215. STA 270: Applied Statistics The committee adopted a new text for the Fall 2011 semester. This text is more rigorous, focuses on interpretation, includes more probability, and uses MyStatLab for online homework. Instructors have found MyStatLab to be more effective for homework than the previous online homework system due to the extra “helps.” Clickers are still being used by some faculty to reinforce concepts in the class. Beginning in the Fall 2011, students can take a 1-credit-hour STA 270 laboratory class to reinforce the material they are learning in their classes. The results are an improvement from assessment in 2009, so the faculty members feel they are moving in the right direction. BLOCK III &VII (ah): ARTS & HUMANITIES AFA 201: The African Experience Faculty studied the assessment data from AFA 201/202 In Spring 2009 and 2010. In comparing the data and evaluating areas of strengths and weaknesses as provided by the data, faculty made changes to the course in Fall 2010 and subsequent semesters. Student learning outcomes were revaluated and modified to more accurately target and measure learning. In addition to proven instructional strategies, such group work and collaboration among class members, classroom simulations and role-playing, students were encouraged to attend outside events and interact with speakers as a way to broaden their viewpoints and encourage outside research on topics of interest. Instructors provided greater guidance as students initiated and completed work 24 on the major class writing assignment. In order to provide further clarity on the subject and help resolve any research issues students may be experiencing, one-on-one-conferences were required of all students after abstracts and paper proposals were submitted to the instructor. All students were also advised to either visit the Writing Center or schedule a follow-up conference with the instructor to facilitate proper use of textual evidence, primary and secondary source documentation and formatting as well as clarity of expression. ARH 390: Survey of Art History I Data collected between Fall 2010-the present indicates that students enrolled in ARH 390 continue to be primarily assessed as Accomplished, Competent, or Developing, in all criteria categories with the majority assessed as Competent. Again, Theoretical Application and Integration Across Course remain two criteria where students did not assess as consistently high, as is Contextual Analysis (i.e. a few more students assessed at Developing in these criteria than in other criteria, but the majority of the students did indeed assess at Competent). Because the variations in assessment numbers remain so slight, the committee plans to recommended individual faculty self-evaluate their teaching methods, in consultation with the Gen Ed committee, to determine how best to strengthen student accomplishment in the areas in question. It should be noted here that ARH 390 is included in Gen Ed block 7 and 8, two blocks that have been eliminated with the recent Gen Ed re-structuring. As such, ARH 390 may not be a Gen ED offering in the future. ARH 391: Survey of Art History II Data collected between Fall 2010-the present indicates that students enrolled in ARH 391 continue to be primarily assessed as Accomplished, Competent, or Developing in all criteria categories with the majority assessed as Competent. Formal Structural Analysis, Methods, and Integration Across Course are criteria where students did not assess as consistently high (i.e. a few more students assessed at Developing in these criteria than in other criteria, but the majority of the students did indeed assess at Competent). Because the variations in assessment numbers remain so slight, the committee plans to recommended individual faculty self-evaluate their teaching methods, in consultation with the Gen Ed committee, to determine how best to strengthen student accomplishment in the areas in question. It should be noted here that ARH 391 is included in Gen Ed block 7 and 8, two blocks that have been eliminated with the recent Gen Ed re-structuring. As such, ARH 391 may not be a Gen ED offering in the future. ART 200: Art Appreciation Data collected between Fall 2010-the present indicates that students enrolled in ART 200 continue to be primarily assessed as Competent, Developing, or Beginning in all criteria categories, with the majority assessed as Developing or Beginning. The Gen Ed committee believes that the course content for ART 200 is sound and theorizes that our previous recommendations failed to strengthen assessment scores in large part because there has been a great deal of turn-over in the faculty and instructors who teach ART 200 over the past few years and the committee may not have communicated our Gen Ed goals to these new faculty as thoroughly as needed. The committee continues to theorize that immature writing skills account for assessment scores at the lower end of the spectrum, and likewise continues to support oral presentations and writing assignments within the curriculum as a means of improving students’ ability to express their comprehension and analysis of course content. The committee plans to more thoroughly communicate our Gen Ed goals to new or part-time faculty teaching ART 200 in the future. We also plan to mandate, rather than simply recommend, both an oral presentation and a written essay component as evaluation methods in all sections of ART 200. The committee also plans to re-evaluate the assessment question that we currently have set for ART 200, in tandem with the faculty who teach the course, to better determine if the question requires more art historical, cross-period comprehension and analysis than is realistic of students enrolled in an Art Appreciation course are realistically 25 prepared for (i.e. the current question reads very similar to the questions prepared for ARH 390 and 390, but those two courses provide much more cross-period art historical interpretation and analysis than an Art Appreciation course could or even should). BEM 350/351: Cinema History I & II Faculty used data to further implement changes to instructor/student interaction in an effort to enhance student collaboration in the learning process. Small group workshops were scheduled to take place in the library during class, with the instructor fielding questions from student groups who responded to an in-class research assignment. ENG 210/211/212: English Literature In comparison with the Fall 2009 assessment, our work in General Education in Literature is showing a distinctive move upward. The dismissal of the common prompt most likely contributed to the improvement. Faculty have developed common lesson plans to improve students’ understanding of the concepts. We are making more use of the Noel Studio to help students improve their writing skills. ENR 112: Academic Literacy and Learning Reading faculty met and discussed the results of the assessment and the need for continued emphasis on summarizing and analyzing strategies. FCC: Culture and Civilization (sample courses) Future uses of these results: The portfolios are working well in their present format. The current events section should be expanded somewhat, since France is so consistently in the news. A larger selection of films to choose from will be allowed, based on student suggestions in many cases, How I use this data: I use this data to determine whether to slow down/accelerate the pace in class, reading assignment amount, and topics for group discussion. HON 205: Honors Humanities I An Excel spreadsheet containing the data was e-mailed to Honors Humanities instructors. The selected students performed best (in terms of the percentage of 3’s and 4’s) in Clarity, with 70% of the papers demonstrating Competent or Accomplished skills. The papers were scored lowest in Contextual Analysis and Integration. Most students in the sample seem to have a basic command of standard English (Clarity of Expression) and engage in rudimentary organizational strategies, such as paragraphing. Most essays seem to lack depth of understanding (Comprehension), but students comprehend and can apply the most general concepts. There is a problem in that the assignment was not exactly the same for all papers. Because some of the written assignments submitted for assessment required students to integrate texts from throughout the semester, whereas others asked students to consider only two works assigned in the last unit of the course, it was more difficult to estimate in the latter case the success with which students were able to integrate themes from throughout the course than it was in the former. The inconsistencies in the assignment directions could explain some of the perceived weaknesses in the areas of Contextual Analysis and Integration. Also, in this reading one grader noted that she basically applied the wording of the rubric rather than the headings (meets expectations 26 of the course, etc.) and that the descriptions in the rubric may not correlate with the realities of real course standards. While one Humanities professor who scored papers does not think the individual strengths and weakness of the writing submitted by students is effectively captured by assigning to them numbers corresponding to each of the criteria listed on the rubric, he did find that it became clear in reading these essays together that the best essays tended to be those with the most clearly identifiable argumentative structure and in which the authors frequently employed brief citations from the relevant texts to support the claims advanced in their essays. These are effective writing strategies, the development of which Humanities instructors will continue to seek to cultivate in students in their courses. The Honors Program recently revised the honors curriculum and obtained approval for the revisions from the university. Under the new curriculum, a Humanities sequence is no longer required. The Honors Program hosted its first workshop designed to aid faculty members in developing new interdisciplinary courses on May 8, 2012. More opportunities for course planning and development should follow. The Honors Program Director and Associate Director are also working with the General Education Assessment Coordinator to establish a programmatic assessment system. HON 308: Special Topics While students showed competence in Comprehension and Contextual Analysis using primary and secondary sources, they seemed challenged to articulate their ideas clearly. The instructor learned that even though most students who take the course are juniors, their writing skills and research methods were still developing. Hence, the instructor will do the following: (1) provide more specific writing and evaluation guidelines; and (2) request students to provide early drafts of their papers to examine and go over in one-on-one conferences instead of waiting until the end of the semester, when students have no chance to learn from their mistakes. The Honors Program recently revised the honors curriculum and obtained approval for the revisions from the university. Under the new curriculum, all sections of HON 308 will be Writing Intensive. The Honors Program hosted its first workshop designed to aid faculty members in developing new interdisciplinary courses on May 8, 2012. More opportunities for course planning and development should follow. The Honors Program Director and Associate Director are also working with the General Education Assessment Coordinator to establish a programmatic assessment system. HON 306: Honors Humanities II Excel spreadsheets containing the data were e-mailed to Honors Humanities instructors. The data continue to indicate that making the HON Humanities courses writing intensive has allowed the instructors to make the process of writing more of a focus within the course. The papers evaluated for Written Communication show their strongest area to be “Surface Features,” followed by both “Audience/Tone” and “Control of Written Language (Word Choice/Vocabulary).” The areas deemed weakest by the evaluator were “Information Literacy,” followed by “Organization/Integration.” Thus, the Honors Humanities faculty may wish to focus instruction on ways to “select relevant, accurate, appropriate, and significant sources” (the description of the “accomplished/4” category for “Information Literacy”) and to “fairly and accurately synthesize sources and integrate relevant information, with significant depth and breadth” (the description of the “4” category for “Organization/Integration”). 27 When evaluated for Critical Thinking, the strongest area in these same five papers was “Synthesis,” while the weakest area was “Application.” The description of the 4 ranking for “Application” is “Accurately applies relevant concepts/theories in different contexts and in novel/creative manner.” The instructors will continue to stress instructions on how to build an argument by accurately applying concepts from philosophical texts to literary works. In the papers evaluated for Arts & Humanities, the strongest areas were “Comprehension” and “Clarity,” each garnering a score of “3/Competent” in 6 out of the 10 papers. The weakest area was “Contextual Analysis,” with 3 scores of “1/Beginning.” Thus, the Honors Humanities faculty should continue to think of ways to incorporate contextual information into the course concerning the primary readings, although this concern might also be seen as being more in the domain of the Honors Civilization course sequence. The Honors Program recently revised the honors curriculum and obtained approval for the revisions from the university. Under the new curriculum, a Humanities sequence is no longer required. The Honors Program hosted its first workshop designed to aid faculty members in developing new interdisciplinary courses on May 8, 2012. More opportunities for course planning and development should follow. The Honors Program Director and Associate Director are also working with the General Education Assessment Coordinator to establish a programmatic assessment system. HUM: Humanities (all) In the Fall of 2009, we undertook fairly comprehensive review of the coordination of our teaching of Gen Ed courses, especially HUM 124, HUM 226 and HUM 228. This led to a number of improvements, noted below. As part of our ongoing discussions, the HUM section met again in the Fall of 2010 to revise our assessment assignments for all of our Gen Ed Courses (HUM 124, 226, 228, and 300W). As a result of this, we clarified the need for our students in their assessment essays to address themes of broad human significance in an integrated manner across the course. It was decided in most cases to ask students to make reference to two or more works studied, but not necessarily to require them to draw these from different sequential or thematic units of the course or from different artistic media. This is something that we are revisiting in light of the 201011 Gen Ed Assessment data, and in light of our general commitment to maintaining a proper distribution of the fine arts in our interdisciplinary courses (roughly 50% literature, 25% visual arts and 25% music and/or another relevant area such as philosophy/religion). HUM 124: Humanities and the Search for Meaning Taking into account the evidence of past experience, articulated by the veteran instructors, and addressing the need to integrate the new instructors, we decided for HUM 124 to begin working more cohesively as a unit with one main primary text, and anthology, Literature: The Human Experience (LHE), which has the virtue of being organized around a thematic approach to the human life-span (Innocence and Experience / Conformity and Rebellion / Love and Hate / The Presence of Death), while including an extensive variety of selections (in multiple genres, including short stories, poetry, essays, and drama, plus a section on poetry and art) from which instructors might choose in building a course. We had in the past found that the previously wide-open and less coordinated approach to HUM 124 (with various instructors selecting their own materials) did not uniformly ensure that students were being provided with the integrated approach to interdisciplinary arts and humanities learning that we are interested in fostering in this introductory General Education offering. The move to this unified textbook, supplemented and diversified by choices of each instructor (novels, stories, music, visual art, etc.), has allowed us to make certain that all of the SLO‟s for the course are being met more consistently across the board. These relate to identifying, criticizing, interpreting and evaluating aspects of human concern in an integrated manner across the fields of literature, visual art, music, design and philosophy/religion. Most of the 28 learning outcomes, we found in our review of the data, were being met. But since many students tended to be too narrow in their choice of “two works,” we are revising our assessment assignment in order better to ensure that the “integration across the course” criterion in particular is adequately met and measured (more detail below, re: HUM 228). The adoption of the LHE textbook has produced a greater sense of coherence within each course while providing the backbone for our students‟ broader exploration of interdisciplinary humanities. It has also led to greater coordination among the HUM 124 instructors, who are now better able to engage in dialogue about the course material fluidly and on a continual basis, sharing experiences and pedagogical strategies for the purpose of ensuring consistent student learning. Finally, since our Gen Ed students are taking HUM 124 as part of a series to fulfill Gen Ed Element 3 A/B requirements, this change has ensured that students from different sections of HUM 124 taken with different instructors have had a relatively similar experience and preparation for HUM 226 and HUM 228. HUM 228: The Search for Meaning: The Modern World In our consideration of the Gen Ed Assessment data for HUM 228, it was determined that while most students were making progress in the areas of content comprehension and contextual analysis (social and historical understanding), many students needed additional help with written expression and formal analysis. Accordingly, when this course was offered in the Fall of 2011, greater attention was paid to these aspects in both lecture and in the grading of essays. Moreover, while the initial data report (Fall 2010) indicated that many students were „integrating material across the course,‟ upon reflection and re-examination it was determined that (as with HUM 124 and 300W), while the “two or more works” criterion was met (the basis for this assessment), too many students were actually relying on works taken from one aspect or unit of the course, which is usually divided into 4 chronological and/or thematic sections. Accordingly, we are revising our assessment assignment (essay question on final exam) in order to demand that students be more inclusive and reaching in their effort at integration. In relation to this, we are concentrating more explicitly upon demonstrating continuities and connections among the different time periods and cultures examined in the course in order that students have a model for this kind of analysis when they are asked to perform it as part of their final integrative essay (the assessment assignment). The new assessment assignments for all Gen Ed courses (HUM 124, 226, 228 and 300W) will require students to make significant reference to at least two works from different thematic or chronological units of the course and/or different media and art forms. We feel that this change, to be implemented in all courses during the 2012-13 GE Assessment year, will result in greater assurance of learning with respect to “integration across the course,” especially, while supporting the other SLO‟s as well. MUH: Music Appreciation (sample courses) The results show over half of students scoring in the competent or above categories. More students appear to be scoring in the “Accomplished” category, especially in the area of contextual analysis. Students are demonstrating an understanding of the style periods and culture. In preparation for this writing assignment, students had a session led by the music librarian about finding appropriate sources for writing about music. The prompt for the assignment was well-defined. That instruction and an improvement in the prompt has reinforced higher scoring on the essays. We will definitely continue with the same type of instruction about library resources in music. PHE 200: Dance and Culture I continually hone the directions for the PHE 200 project to more closely align with the General Education Assessment Protocol. I have had to change the order of the class to give the students more time to absorb and reflect on the material they will use for the project. I have also found that they need more interaction in class 29 coming up with their theme and fully developing their argument for the paper. Giving the students a scoring guide and examples of past papers has helped improve the quality of their work. PHI 110: Beginning Philosophy Faculty made changes to PHI 110 in the Fall of 2010 based on analysis of the Spring 2009 assessment data. The data indicated that the areas of Comprehension, Clarity of Expression, and Integration were most in need of effort in terms of improving student learning. In response to the data concerning Comprehension, instructors stress the use of definitions of the appropriate philosophical terms in their presentation of the material and on assignments and exams. In response to the data concerning Clarity of Expression, instructors inform students of the many services provided by the Noel Studio for Academic Creativity and direct students struggling with Clarity of Expression to make an appointment with a Noel Consultant. In response to the data concerning Integration, instructors make greater use of activities that require students to apply the theoretical material to their personal and public lives, e.g., traditional philosophical thought experiments, current events, and other forms of popular culture. Instructors also make increased use of course Blackboard sites. PHI 371: Symbolic Logic Faculty made changes to PHI 371 in Fall 2010 based on analysis of the Spring 2009 assessment data. The data indicated that the areas of Terminology, Execution, Operations, and Integration required the most effort in terms of improving student learning. Based on the assessment instrument that he designed as a result of the previous assessment cycle, the current instructor of PHI 371 is able to refine the quality and the quantity of the questions on the final exam in order to focus in the course on the areas that will best promote student learning as indicated by the General Education Scoring Rubric for Quantitative Courses. REL 301: World Religions Faculty made changes to REL 301 in the Fall of 2010 based on analysis of the Spring 2009 assessment data. The data indicated that the areas of Methods and Integration required the most effort in terms of improving student learning, although the results showed a marked improvement in these areas from the last assessment cycle. In response to the data concerning Methods, faculty provide more assignments and activities giving students the opportunity to engage in dialogue with each other about different religions, e.g., in small groups in class or for extra credit through the use of Campus Blogs on specific religions on the course Blackboard site. In response to the data concerning Integration, faculty provide additional opportunities for students to engage with individuals of different faiths, e.g., having students interview and participate in dialogue with somebody from a different faith and write a reflection paper on their thoughts before, during, and after the interview/dialogue. THE 100: Introduction to Theatre Comparing the figures from May of 2010, we were very pleased with the results of Spring 2011. We saw a huge increase in students who scored a 3 (Competent) in all four areas assessed. Particularly encouraging was in increase in the area of Comprehension which went up from 5% in 2010 to 37% this spring. Students were much better about using terminology they had learned in class and using that terminology correctly! This was one of the areas that we had singled out for improvement and it appears that we were successful. In May 2010, students who scored a 1 (Beginning) ranged from a low of 7% to a high of 28%. Spring 2011 saw those numbers shrink to a low of 8% to a high of only 14% which is much more in line with our norms. Students scoring a 2 (Developing) in 2010 ranged from a low of 50% to a high of 67%. 2011 scores were a more balanced 38% to 45%. 30 We were very pleased to see the improvement and more even distribution of percentages this spring. Another encouraging observation was made by the faculty. Many more students demonstrated the ability to separate their “like or dislike” of the script and/or subject matter from the “quality” of the production teams work. This level of critical thinking is just exactly what we wish the students to come away with. In summary, the theatre faculty was pleased with the results of the assessment and with the plans formed to improve student’s achievement of educational goals. Faculty members met and discussed the positive outcomes suggested by this assessment, which they attributed to changes they made in instruction as a result of last year’s assessment. They discussed the need to continue these instructional approaches. Specifically, more attention should be given to explaining the prompt and the importance of including all the information that the prompt requires. BLOCK IV &VII (ns): NATURAL SCIENCES ANT 201: Introduction to Physical Anthropology Three points should be considered when reviewing the results. First, compared with the two previous assessments in 2009, I have included more objective questions, especially for assessing the applying scientific principles to make reasonable conclusions criterion. Secondly, the class demography has changed significantly. In Fall 2009, 201 had two different-sized sections (twenty-two and seven students); in Spring 2011 the three ANT 201 sections had roughly nineteen students each. Also, whereas most of Fall2009’snonmajors taking ANT 201 were criminal justice majors, the non-majors taking ANT 201 in Spring 2011 were mostly Animal Studies, Psychology, and History majors. Finally, we changed the course meeting schedule for ANT 201. In Fall 2009, we dedicated a third meeting session for the class, a dedicated 50-minute lab session. Since that semester, we reverted to two meeting days per week, with extra time on each day. We now have little difficulty providing the needed time for labs, application-oriented activities, and lectures. The course now routinely fills. In recent semesters, we have had some sections in which six students over the maximum have signed up for the class. BIO 121: Biology for Majors This is a course that is required of all our majors. Based on the Gen Ed Assessment we conducted in Spring 2011 and prior semesters, we found that our students displayed a competent level of understanding in all the assessment criteria. However, there were also some deficiencies, in the understanding of the methods, explaining of major concepts of biology, and most significantly in the application aspects. The faculty felt they were trying to convey too much information in the class, and this may perhaps be overwhelming the students. Therefore, during multiple weekend retreats a decision was made and a plan devised to split this class into a two semester sequence. These new courses are now BIO 111 (cellular and molecular Biology) and BIO 112 (Ecology and Evolution). These courses will rely heavily on critical and creative thinking skills. The lectures and labs have been completely redesigned, to promote active learning by the students. Faculty in these courses are also going to experiment by moving away from the traditional lecture format, to more of a studio based teaching. We believe that these changes will help the students grasp methods and concepts in Biology, and help them apply their understanding of biological principles to make valid conclusions. BIO 100: Introduction to Biology 31 This is a course that fulfils Block IV, and hence is required of all students across campus. Based on the Gen Ed Assessments conducted in Spring 2011 and prior semesters, we found that close to 50% of the students in this course exhibited a beginning level, with respect to the following criteria: a) Application of Scientific Principles to make conclusions b) Integration Hence the faculty in these courses decided to take a closer look at the labs and how they integrated with the lecture in an attempt to improve on these two criteria. Labs are perhaps the best way for students to apply their knowledge of Biology and help them understand by actually doing science. As of Fall 2011, this course has completely redesigned labs to make it more hands-on for the students. In addition, a new textbook was also adopted in this course. Further, the lecture syllabus was standardized to coordinate with the labs. We believe that with these changes the student learning outcomes will improve significantly. BIO 171: Human Anatomy This course satisfies Gen Ed Block VII (NS). Based on the Gen Ed Assessment conducted in Spring 2011, we found that overall the students exhibited a “Competent” level of understanding in all criteria, two criteria were cause for concern, they were: a) Application of scientific principles to address issues of importance b) Integration These results helped faculty of these courses to take a closer look at their course. As a result most of the content is now made available on Blackboard. Pictures of all Anatomical structures (bones) are available to students 24/7 so that students can review the material before and after class. Lectures have been revamped to help students relate the material to everyday life. AST: Astronomy (sample) The department is currently discussing the possibility of adding a laboratory component to some of the courses and applies to have the course included in Element 4B in the new GE program. While we feel this could be done, we are still in the very preliminary stages of this discussion. Resources for designing new courses are limited. The new laboratory component could help us improve especially students understanding of the methods used in astronomy and science more generally and would also give us more opportunity to work with students one-on-one to improve their ability to apply the course material to real problems. We are also in the process of improving our teaching methods. The department as a whole has made a strong movement toward using clicker technology to make the classroom a much more active-learning environment. We have also moved into a new technology-rich building with classrooms designed for more active pedagogical techniques. All of this makes us expect these results will continue to improve. We had hoped that requiring students to take MAT 105 or higher, would help better prepare students for coursework. The department is going to take a look at what we can do to: Improve the laboratory activities themselves, perhaps including a lab session that explicitly addresses scientific method. Find ways to create more connections between the laboratory activities and the lecture portion of class. CHE: Chemistry (sample) A review of the questions reveals that there is ambiguity with some of the questions that could cause problems, but most of the questions simply are relatively challenging and thus should not make up such a large proportion 32 of the questions for a given criterion. The assessment instrument will be revised to provide a more reasonable range of difficulty before the next data collection event. Although the assessment instrument clearly needs revising, we also will continue to make improvements to the lecture lab coordination to address ongoing issues with application of the course material and integration across the course. We will continue to pursue better lab‐ lecture connections and monitor the effect in the next data cycle. GEO 210: Introduction to Physical Geography Faculty met at the beginning of the Fall 2011 semester to review the assessment data. No faculty raised any concerns about assessment data for this course. Assessment data for this course were later reviewed by the department general education committee who found these data to be are consistent with data reported in our 2009 assessment report. Since those data met with faculty expectations, the committee deemed that no changes were necessary to the assessment process for this course. GLY: Geology (sample) Faculty met at the beginning of the Fall 2011 semester to review the assessment data. No faculty raised any concerns about assessment data for this the lower level courses. Assessment data for this course were later reviewed by the department general education committee who found these data to be are consistent with data reported in our 2009 assessment report. Since those data met with faculty expectations, the committee deemed that no changes were necessary to the assessment process for this course. Faculty debated whether to create new assessment items for our upper-division geology courses or to turn our upper-division courses into lower-division courses. Faculty agreed that our 300-level Geology courses needed to be turned into lowerdivision courses and handed this matter over to the department curriculum committee. The department curriculum committee will submit paperwork for these items to the college in Fall 2012. Faculty agreed that GLY 302 does not fill a niche in the new general education curriculum and it will no longer be part of gen ed. PHY: Physics (sample) The PHY 101 course has changed substantially over the last two years and new laboratory activities are being developed and implemented. While we do this we are informing the decisions about pedagogy with this deficiency in the application area in mind. We also have new faculty members who have just started teaching the course. We are also reviewing the assessment exam to make sure it is still an appropriate tool to use in the course. Different material is sometimes covered in this course and we want to make the assessment either consistent with the content taught or independent of that material. We are also reviewing the assessment exam to make sure it is still an appropriate tool to use in the course. Different material is sometimes covered in this course and we want to make the assessment either consistent with the content taught or independent of that material. By next assessment we will likely have a very different set of questions on the exam. The assessment exam for PHY 102 is the same as for PHY 101. For the 200 level courses need to make sure we are reviewing material from the first course in the sequence, so that students can more clearly make the connection between the concepts The PHY 132 course will likely not remain in the new General Education Program as students will have taken PHY 131 which is a prerequisite for PHY 132. PHY 131 already satisfies the new Element 4B. Students will not need credit from this course to satisfy a General Education requirement. BLOCK V &VII (sbs): HISTORY & SOCIAL/BEHAVIORAL SCIENCES 33 AFA 202: The African-American Experience Faculty studied the assessment data from AFA 201/202 in Spring 2009 and 2010. In comparing the data and evaluating areas of strengths and weaknesses as provided by the data, faculty made changes to the course in Fall 2010 and subsequent semesters. Student learning outcomes were revaluated and modified to more accurately target and measure learning. In addition to proven instructional strategies, such group work and collaboration among class members, classroom simulations and role-playing, students were encouraged to attend outside events and interact with speakers as a way to broaden their viewpoints and encourage outside research on topics of interest. Instructors provided greater guidance as students initiated and completed work on the major class writing assignment. In order to provide further clarity on the subject and help resolve any research issues students may be experiencing, one-on-one-conferences were required of all students after abstracts and paper proposals were submitted to the instructor. All students were also advised to either visit the Writing Center or schedule a follow-up conference with the instructor to facilitate proper use of textual evidence, primary and secondary source documentation and formatting as well as clarity of expression. ANS 200: Animal Studies This is the first time I’ve taught the course, and I am the only instructor. I initially thought I could provide a “Methods” assessment, but the course is so interdisciplinary that there is no one method that can easily be assessed, and different students applied different approaches. The competence assessment is based on quizzes (usually multiple-choice) and is used to determine if students read the material. One student continued to do well on the quizzes while frequently reiterating to me that she had not done the readings, so I plan to increase the number of fill-in-the-blanks in the quizzes. I was in general pleased with the essay answers (assessing application); much of the problem with answers seemed to be ignoring relevant material or not writing clearly or well. The book review required the students to read two books from the Reaktion Press ANIMAL series, each of which is about a different animal, and to compare and contrast the two books (e.g., similarities and differences in their emphases, attitudes, etc.) and to include relevant course material. Most students did the former effectively, fewer did the latter at all. I will need to revise the instructions to make clearer that students need to integrate material from the course into their book review. APP 200: Introduction to Appalachia The assessment instrument shows that future attention may be given to describing more concretely the methods used in the various disciplines used in Appalachian Studies. The instructors also discussed the possibility of making some adjustments to the course to provide greater consistency in assignments. One option might be to require specific items (beyond a required text book, if any) for reading rather than allowing students to select, read, and review books/documents of their own choosing. We might also combine an essay with a more programmatic analysis that would specifically ask students to comment on a document’s content, argument, and methodology. The short essay to follow would ask students to Integrate that document into other approaches to the subject they have studied in class. That way, students would devote specific attention to each of the categories in the assessment rubric. ANT 200: Anthropology of Human Society In early spring 2011, I called an ANT 200 meeting to review the new draft assessment questions that I wrote to match the new SLOs. This was actually the very first time all ANT 200 instructors were in the same room at the same time. This was a very productive meeting for many reasons; we not only vetted the assessment questions (with many subsequent tweaks) but we also shared various ideas on books and content, as well as straightened out a few misunderstandings. This was great – quite time-consuming, but great – and I wish I had done it 34 sooner! I share the raw data with the assessment committee in large part to demonstrate the wide range in performance among the sections. Although I have not tried to do any kind of fancy analysis, a quick look indicates that in some instances it is true that KC’s (my) students scored higher, but certainly not in all. Thus, I believe the argument (in this case) is not demonstrated that outcome is determined by employment status (full vs. part-time instruction). Rather, I believe this wide range points to an enormous amount of noise in these data, revealing what we all know: assessment is far from an exact science. Nevertheless, since I’ve now completed these assessments a time or two, I do now believe the SLO and assessment questions align much better than they did in previous assessments. As well, in my view, previous assessment questions were far too easy, and the current outcomes may be a more accurate reflection of learning. As such, I believe that only now am I poised to actually utilize these data in the way they were intended – to improve student learning. HIS: History (Sample) The department determined that while the faculty focused heavily on developing students’ written and verbal communication skills, a key reason students were receiving lower than desired and expected scores in the base level skill of comprehension was that the faculty assumed that their students came in knowing how to read – in particular how to read for essential information/argument. Realizing this was a false assumption, faculty made improvement of students’ reading skills a key general education course objective. To achieve this objective, they have adopted such approaches as reading work sheets, reading expectation guides (what issues/questions students should be able to address after completing their reading assignment) and even adopting text books which guide students in identifying essential information and making them use what they have read to work through exercises which move them from the lower order skill of comprehension to the higher order skill of interpretation and analysis. ANT 120: Cultural Anthropology The results of this assessment will be shared with Anthropology 120 instructors. In addition, the Fall 2011 Anthropology 120 workshop will include a detailed discussion of the process and outcomes of the assessment. During that workshop, we will discuss areas for improvement in the delivery of the Anthropology 120 course and prioritize our goals. Course Textbook. Throughout the assessment development dialogue, a recurring issue was the course textbooks. The 2009 SLOs were developed to align with a textbook by Conrad Kottak, “Cultural Anthropology: Appreciating Cultural Diversity.” However, multiple textbooks were in use by anthropology faculty and the instructors. Those who were not using Kottak felt that the SLOs did not align with their course material as closely as the instructors who used the Kottak text. After discussion and consultation with Department Chair, the anthropology team decided to adopt the Kottak text as the common, consistent textbook for Anthropology 120 beginning in the Summer of 2011. While this will require adjustment for some instructors, this alignment will ensure that the course reflects the SLOs as the basis for student learning in the course. Course Supplemental Materials. The Anthropology 120 course has witnessed a number of leadership changes over the past 10 years. With a new full-time, tenure-track cultural anthropologist, the program has secured supplemental materials such as video to complement the Anthropology 120 course. Especially with regards to complex and controversial topics such as race and racism, these supplemental materials support the delivery of content directly related to the SLOs. The integration of these materials will likely increase the level of learning in the areas of comprehension and integration specifically. Assessment Process. To maintain an institutional record of the General Education assessment process, here I describe in detail the assessment process for the Spring of 2011. Throughout the Fall of 2010, I worked with Anthropology 120 instructors to develop a set of 20 assessment questions. Using the 2009 SLOs and the general education assessment rubric for Block V (comprehension, analysis, applications, methods, and integration), five thematic question areas were developed: 1. Explain how, where, why, and with whom cultural anthropologists work. (METHODS, Questions 1-4) 35 2. Articulate cultural anthropology's perspective on culture, race, ethnicity, and cultural relativism. (COMPREHENSION, Questions 6-9) 3. Discuss cross-cultural understandings and/or practices of language, marriage, kinship, family, gender, race, making a living, religion, and art. (ANALYSIS, Questions 10-13) 4. Understand the dynamic and integrated relationship among humans, culture, and the environment. (INTEGRATION, Questions 5, 14-16) 5. See the broad impacts of colonialism and the modern world system on the world today. (APPLICATION, Questions 17-20) The Anthropology 120 team work shopped the 20 assessment questions throughout the Fall 2010 and Spring 2011, beginning with a workshop in the Fall. The process raised a number of important questions that we addressed with regards to the focus and goals of the Anthropology 120 course. By the end of the academic year, the Anthropology 120 was in agreement that the introduction of a consistent textbook would improve student learning. ECO: Economics (Sample) Overall, the assessment results suggest that students are making satisfactory progress in achieving the goals of general education in ECO 120 in both 2009 and 2010. The majority of students in ECO 120 are upper division students in education. The percentage of students rated as competent in each area may be higher than would be expected in a lower division economics course more heavily populated with lower division students. As might be expected, the majority of students were rated as competent for the knowledge/comprehension and methods criteria in both years. Both simply measure student ability to recognize economic concepts and the methods used in economic theory. The decrease in the percentage of students rated as competent in knowledge/comprehension and methods decreased slightly from 2009 to 2010. A lower percentage of students were rated as competent in application in both 2009 and in 2010, which measures student ability to engage in one form of critical thinking. Since application is more challenging than knowledge of concepts and methods, this result is expected. Again, the percentage of students rated as competent decreased from 2009 to 2010. The percentage of students rated as competent in integration is higher than the percentage rated as competent in application in both 2009 and 2010. This result is surprising and may suggest that the integration questions are too easy. Again, the percentage of students rated as competent decreased from 2009 to 2010. In each area the percentage of students rated as competent decreased from 2009 to 2010. This probably reflects instructor differences in teaching practices and the amount of time devoted to knowledge of topics measured on the assessment questions. The instructors assigned to ECO 120 will discuss these differences and/or edit the assessment questions to minimize the impact of instructor differences. We plan to use these results to improve our courses further. Each professor knows his or her own sections’ results and can alter their teaching if their students are not scoring as well on one particular criterion. While we might not be able to combat our students’ lack of mathematical-reasoning ability, we are emphasizing the tutoring possibilities for them. We have also been discussing the course objectives to make sure we cover what we feel the course should cover. One issue with this assessment is the nature of the assessment tool. By having several professors teach different sections of the same course, the criterion being assessed might change. For example, what is integration in one section might be application in another section that covered the connection between the topics. Also, the reading comprehension skills of the students seemed to play a factor. If an assessment question was worded in a style the students had seen before, they tended to score better, even if the topic being assessed was new. Consequently, it seemed that students tended to score better on questions written primarily by their own professors. 36 The percentages of students being rated as competent or better were roughly 56 percent in methods, 57 percent in comprehension, 47 percent in application and analysis, and 34 percent in integration. Since application and integration are higher order critical thinking skills, the assessment results are consistent with expectations. Over time, the scores on all four criteria have generally risen. From Fall, 2006, through Fall, 2007, to Fall, 2009, the percentages of competent or better students for all four criteria rose (with the lone exception of the percentage judged competent or better at application and analysis between 2006 and 2007). [The percentages for Fall, 2008, were much higher than the others. That year seems to be an exception, perhaps due to some error in assembling the data or because the professors that year nearly coincided with the committee which wrote the assessment questions. It has been noted that students seem to score better when the phrasing matches other course assessments.] Omitting 2008, Fall, 2010, shows improvement over 2006, 2007, and 2009 for comprehension and application. Methods shows a marked increase (almost 10 percentage points), probably as a result of the “closing the loop” from the 2009 assessment cycle. Methods were emphasized more as a result of the previous year. Beginning in 2008 or 2009, an effort was made to demonstrate how the course is relatively cohesive, and so there has been increase in integration scores since. This is evidence that “closing the loop” from previous assessment cycles has been maintained. We plan to use these results to improve our courses further. Each professor knows his or her own sections’ results and can alter their teaching if their students are not scoring as well on one particular criterion. While we might not be able to combat our students’ lack of mathematical-reasoning ability, we are emphasizing the tutoring possibilities for them. We hope this will see an increase in comprehension. GEO 100: Regions and Nations of the World Faculty met at the beginning of the Fall 2011 semester to review the assessment data. No faculty raised any concerns about assessment data for this course. Assessment data for this course were later reviewed by the department general education committee who found these data to be are consistent with data reported in our 2009 assessment report. Since those data met with faculty expectations, the committee deemed that no changes were necessary to the assessment process for this course. GEO 220: Human Geography Faculty met at the beginning of the Fall 2011 semester to review the assessment data. No faculty raised any concerns about assessment data for this course. Assessment data for this course were later reviewed by the department general education committee who found these data to be are consistent with data reported in our 2009 assessment report. Since those data met with faculty expectations, the committee deemed that no changes were necessary to the assessment process for this course. POL: Political Science (sample) Faculty will meet during the Fall 2011 semester to review the assessment data/results. At that meeting the faculty will discuss a variety of considerations regarding the assessment instrument including the nature of the instrument (multiple choice v. alternatives), the difficulty of the items on the instrument, the extent to which the assessment items align with stated course outcomes, student performance across the criteria/objectives, and possible pedagogical changes. It is hard to be certain what accounts for the declining scores in 2011. The assessment instrument and the instructions didn’t change, so that factor can be ruled out. It may be an issue related to specific sections. This is an issue I will explore more generally in a future meeting with the POL 100 faculty. Section 26527 was taught by me (Barracca). This section was a half-semester course that began after Spring Break. This type of course tends to be populated with a high percentage of students that dropped a fullsemester course that they were failing. Consequently, this section likely attracted students that were struggling 37 academically to begin with. Another approach is to look at the particular questions students did poorly on. The data indicate that students struggled most with the questions on social contract theory and Marxism. It might be fruitful to have the faculty discuss ways of improving the teaching of these concepts. Finally, it is possible that the change in 2011 may just be a result of sampling. Further assessments are needed to determine this with greater confidence. 4. Strategy for Improving As the assessment coordinator for the course, I plan to address these issues in the following ways: Discuss with instructors ways that we might better teach the concepts of social contract theory and Marxism. Since there has been considerable turnover in the faculty teaching POL 100 since the assessment instrument was first developed, we will have the current faculty review the concepts on the assessment to evaluate whether the terms are still appropriate or the best ones we could use. Students will be more strongly encouraged, earlier in the course, to acquire the basic knowledge and understanding they need for subsequent analysis and synthesis. We will continue to insist of the need for acquisition of knowledge, especially during the learning phase, because deliberation cannot be meaningful without the background knowledge. Study groups have been found helpful in addressing this need in the past, and will been couraged more forcefully in the future. PSY 200/280: Introduction to Psychology/ Life-Span Development The assessment coordinator for the department of Psychology held a retreat for all instructors to discuss assessment data. We discussed several strategies to help students learn. One was to focus on less material. The field of psychology is large and diverse and introductory textbooks are getting larger and more complex every year. We discussed lesson plans that would focus on the most important material, and give students practice in thinking critically about that material using exercises, team work, videos, and homework assignments. We agreed to test more often, using low-stake testing, such as mini-quizzes, as this has been shown to increase learning. One faculty team developed critical thinking exercises using popular media reports of psychological research. They presented their work at a University-wide conference focused on critical thinking. Over the summer we intend to revise the current handbook for part-time faculty to incorporate more information on critical thinking strategies in the classroom, but we also want to ensure that full time faculty receive this portion of the handbook. SOC 131: Introduction to Sociology The following specific actions were reported by Sociology 131 sociology faculty as techniques used to improve student learning based on earlier assessment findings. Responses are organized along the four General Education components:1) Comprehension, 2) Application and Analysis, 3) Methods, and 4) Integration. Comprehension: New course materials with electronic flashcards emphasizing key concepts and terms for each chapter. Practice quizzes based on key concepts, resulting in improved student scores over past semesters. More quizzes (online and in class) that focus attention on specific concepts and topics. Application and Analysis: The writing of reflective essays based on key terms and concepts from each chapter. Class presentations on these essays, with demonstrable evidence of application of sociological terms in both understanding of everyday life and of larger institutional structures. The analysis of actual data from the United States Census and the CIA Factbook on income, comparative international measures of quality of life (GDP, infant mortality). The use of movies as “case studies” to demonstrate examples of sociological concepts (such as primary socialization and bureaucracy)in conjunction with written analyses as class assignments. 38 Concept and theory application questions are included on all exams. The use of short research articles that relate to specific sections of material, with class discussions based on research article in class. Research article essay questions are included on exams. Methods: The use of secondary data which allows students to learn how to construct tables using simple descriptive statistics (i.e. percentages, measures of central tendency) and cross tabulations. The use of an interactive class assignments where students first complete a web- based survey in real time and then analyze the data using simple descriptive statistics for comparison. Integration: The use of data to assess the explanatory power of theories (e.g. cross comparisons of country characteristics such as life expectancy, GDP, and fertility rates to assess the explanatory power of dependency and modernization theories). As the semester progresses, course lectures are designed to integrate previous concepts/topics in the class. Exam application questions (all exams throughout the semester) require integration of material throughout the course. Theory, simple data analysis exercises, and methods are integrated into a series of short class assignments timed to coincide with coverage of class topics. SOC 235: Social Problems The following specific actions were reported by Sociology 235 sociology faculty as techniques used to improve student learning based on earlier assessment findings. Responses are organized along the four General Education components:1) Comprehension, 2) Application and Analysis, 3) Methods, and 4) Integration. Comprehension: Assignments are incorporated that have students summarize original research and chapters in the text. Application and Analysis: Students in corporate sociological concepts from course materials so that they can apply these concepts to a social problem they have chosen for their research paper. Methods: Assignments focus on "what makes a quality source" which emphasizes methodological quality. Assignments focus on different approaches to data collection. Integration: Assignments are designed to foster skills for integrating knowledge, data, methods, application, and analysis while using sociological concepts and theories related to current social problems. SWK 310: Social Welfare Policy History This was the first time a social work class had been assessed as a general education course and the assessment has been a learning process. Since two separate assignments and assessment tools were used, the findings cannot be generalized. The same assignment and assessment rubric will be used during the next assessment of SWK 310. 39 It appears that comprehension and methods are the strongest areas, which is to be expected of sophomore level students. Application progress was higher than expected at almost 85% at competent level or above. 40 Appendix E Changes to EKU’s General Education Program (Effective fall 2012) NEW PROGRAM EFFECTIVE FALL 2012 Element 1: IA: Written Communication I IB: Written Communication II IC: Oral Communication 3 hrs. 3 hrs. 3 hrs. Element 2: Mathematics 3 hrs. Element 3: 3A: Arts 3B: Humanities or 3 A/B Integrated A&H 3 hrs. 3 hrs. 6 hrs. Element 4: Natural Sciences 6hrs Element 5: 5A: Historical Perspectives 5B: Social and Behavioral Sci. 3 hrs. 3 hrs. Element 6: Diversity of Perspectives & Experiences 6 hrs. TOTAL GE Program: 36 hrs. 41 Previous General Education Program at EKU (GE-06) *Fall 2012 Assessment Data are based on this program General Education Core (33 hours) Block I. Communication (9 hours) I-A and I-B Written Communication (6 hours) AND I-C Oral Communication (3 hours) Block II.Mathematics (3 hours) Block III. III-A AND III-B OR III-C Arts and Humanities (6 hours) One arts course (3 hours) One humanities course (3 hours) Two humanities courses (6 hours) Block IV. IV-A AND IV-B Natural Sciences (6 hours) One biological science laboratory course (3 hours) One physical science laboratory course (3 hours) Block V. V-A AND V-B AND V-C Social and Behavioral Sciences (9 hours) One history course (3 hours) One social and behavioral science course (3 hours) One additional V-A or V-B course (3 hours) University General Education (15 hours) EKU SPECIFIC Block VI Wellness (3 hours) Block VII Breadth of Knowledge (6 hours). Two courses from two different areas: arts and humanities(ah), natural sciences(ns), quantitative skills(qs), and social and behavioral sciences(sbs). Block VIII Depth of Knowledge (6 hours) Six hours of coursework from: 1. Coherent block of supporting courses for a specific degree program. (6 hours) (Note: Each degree program will decide whether to specify supporting courses for this option.) OR 2. Second Language (American Sign or Foreign Language) (6 hours) OR 3. Two courses in the same theme (6 hours) (Note: Theme courses are designed by faculty, and approved by the General Education Committee.) 42 Appendix F EKU’s General Education Scoring Rubrics General Education Scoring Guide for WRITTEN COMMUNICATION Revised June 2008* Criteria 4-Accomplished Exceeds Course Expectations 3-Competent Meets Course Expectations Precisely demonstrates recognition of audience and sets relevant tone. Engages an audience effectively. Fairly and accurately synthesizes sources and integrates relevant information, with significant depth and breadth. Organization is clear and logical (parts make sense together; no contradictions). Organization is creative and engaging. Demonstrates recognition of audience and sets relevant tone most of the time. Fairly and accurately synthesizes sources and integrates relevant information. Writing is clear, accurate, and precise virtually all of the time. Elegant sentence structure; fluid integration of terms. Uses accurate, relevant, and precise vocabulary virtually all of the time. Writing is clear, accurate, and precise most of the time. Writing is clear and accurate some of the time. May have some awkward sentences. Organization is not clear and/or logical (parts do not make sense together and/or there are many contradictions). Writing is rarely clear and/or accurate. May have many awkward sentences. Uses accurate and relevant vocabulary most of the time. Limited use of accurate and relevant vocabulary. Rarely uses accurate and/or relevant vocabulary. (GE Goal 1) Nearly error free, accurate use of punctuation, grammar, capitalization, relevant citation format, etc. Accurately uses punctuation, grammar, capitalization, relevant citation format, etc. with minor or minimal errors that do not interfere with clarity. Information Literacy (GE Goal 1) Selects relevant, accurate, appropriate, and significant sources. Selects relevant, accurate, and appropriate sources. Major and/or frequent errors in use of punctuation, grammar, capitalization, relevant citation format, etc. Errors sometimes interfere with clarity. Selects some relevant, accurate, and appropriate sources. Major and/or frequent errors in use of punctuation, grammar, capitalization, relevant citation format, etc. Errors often interfere with clarity. Selects virtually no relevant, accurate, and/or appropriate sources. Audience/Tone (GE Goal 1,2) Organization Integration (GE Goal 2,8) Organization Cohesion (GE Goal 2,8) Control of Written Language Sentence Structure/ Syntax (GE Goal 1) Control of Written Language Word Choice/ Vocabulary (GE Goal 1) Surface Features Organization is clear and logical (parts make sense together; no contradictions) 2-Developing Incomplete in Meeting Course Expectations Is inconsistent in recognition of audience and setting of relevant tone. Synthesizes sources and integrates relevant information, but is not always fair and/or accurate. Organization is mostly clear and logical (most parts make sense together; may be some contradictions). 1-Beginning Inadequate in Meeting Course Expectations Fails to demonstrate recognition of audience and/or set relevant tone. Does not synthesize sources and/or integrate relevant information. 43 EKU General Education Scoring Rubric for ORAL COMMUNICATION Revised 2009 4-Accomplished Exceeds Course Expectations Structure Content Context Clearly and strategically organized introduction, main points, and conclusion; unfolds logically. Skillful use of transitions. Integrates relevant, accurate, recent information/research with significant breadth, depth with significant breadth, depth and creativity. Displays sensitivity when discussing ethical issues with perceptivity and insight. Sources clearly and accurately cited throughout presentation. Exceeds expectation of the presentation goals (informative, persuasive, ceremonial, etc.). Offers novel approach to the goals of the presentation. Adheres to proper time limits. Message suitable to occasion. 3-Competent Meets Course Expectations 2- Developing Incomplete in Meeting Course Expectations 1- Beginning Does Not Meet Course Expectations Clearly organized introduction, main points, and conclusion; unfolds logically. Skillful use of transitions. Somewhat organized introduction, main points, and conclusion; unfolds somewhat logically but listener(s) must put effort into following speaker. Some use of transitions. Overall disorganization. Difficult to follow logic. Poor or no use of transitions. Integrates some information/research but may at times be irrelevant at times be irrelevant, inaccurate, or outdated. Displays some sensitivity when discussing ethical issues. Sources cited in some portions of presentation. Does not integrate information/research. Displays little or no sensitivity. Displays little or no sensitivity when discussing ethical issues. No sources cited. Marginally meets expectation of the presentation goals (informative, persuasive, ceremonial, etc.) Problems adhering to proper time limits. Message suitable to occasion. Fails to meet expectation of the presentation goals. Does not adhere to time limits. Message not suitable to occasion. Integrates relevant, accurate, recent information/research with sufficient breadth and with sufficient breadth and depth. Displays sensitivity when discussing ethical issues. Sources clearly and accurately cited in some portions of presentation. Meets expectation of the presentation goals (informative, persuasive, ceremonial, etc.) Adheres to proper time limits. Message suitable to occasion. 44 ORAL COMMUNICATION continued CRITERIA Audience Awareness Oral Delivery Nonverbal Delivery tone volume pitch tone, volume, pitch, gestures, rate, posture, eye contact, facial expression, vocal variety, fluency, vocalized pauses (ums, ahs, like, you know, etc.) Presentation Aids 4-Accomplished Exceeds Course Expectations Masterfully makes content (language, examples, narratives, data, statistics, etc.) relevant to the audience. Develops strong rapport with audience. Language is not only free of serious errors in grammar, pronunciation, articulation, and word usage, but language use is vivid, unusually interesting, Exceptional use of nonverbal cues to emphasize, highlight and enhance language and enhance language. Absence of vocalized pauses. Nonverbal cues do not distract listeners from the presentation. Speaker appears natural, sincere, confident, and energetic. Speaker does not read speech. Presentation aids vividly and memorably enhance, reinforce, illustrate, and support presentation but do not substitute for the speech. Aids are well-designed, clear, and skillfully incorporated. Speaker does not read from the presentation aid. 3-Competent Meets Course Expectations 2- Developing Incomplete in Meeting Course Expectations 1- Beginning Does Not Meet Course Expectations Makes content (language, examples, narratives, data, statistics, etc.) relevant to the audience. Develops rapport with audience. Occasionally makes content (language, examples, narratives, data, statistics, etc.) relevant to the audience. Develops some rapport with audience. Fails to make content relevant to audience. Develop little or no rapport with audience. Language is free of serious errors in grammar, pronunciation, articulation, and word usage. Language may contain some errors in grammar, pronunciation, articulation, and word usage. Language contains several serious errors in grammar, pronunciation, articulation, and word usage. Nonverbal cues are appropriately used to support the language Few vocalized the language. Few vocalized pauses. Nonverbal cues do not distract listeners from the presentation. Speaker appears natural, sincere, confident, and energetic. Speaker does not read speech. Presentation aids enhance, reinforce, illustrate, and support presentation but do not substitute for the speech. Aids are well-designed, clear, and skillfully incorporated. Speaker does not read from the presentation aid. Nonverbal cues are used to support the language, but are sometimes incongruent or sometimes incongruent or distracting. Nonverbal cues do not support the language and are distracting. Presentation aids somewhat support presentation. Speaker sometimes reads from presentation aid. Presentation aids fail to support presentation or are poorly designed or implemented. Aids distract from presentation. Speaker reads from presentation aid. 45 General Education Scoring Guide for ARTS & HUMANITIES Revised June 2008 Criteria Comprehension (GE Goal 6) Clarity of Expression (GE Goal 2) Formal/ Structural Analysis (GE Goal 2,6,7) Contextual Analysis (GE Goal 2,6) 4-Accomplished 3-Competent 2-Developing 1-Beginning Exceeds Course Expectations Meets Course Expectations Incomplete in Meeting Course Expectations Inadequate in Meeting Course Expectations Demonstrates limited or inexact comprehension of significant concepts. (Not always accurate) Expresses ideas that are intelligible, but effective communication is impaired by grammatical flaws (not always clear). Displays lapses in logic. Fails to demonstrate comprehension of significant concepts. (Not accurate) Fails to formulate grammatically correct and/or intelligible sentences (unclear). Little/no logical line of reasoning. Fails to provide relevant analysis of stylistic features, techniques, or methods employed in the work(s) or provides inaccurate analysis. Fails to locate or inaccurately locates works and/or cultural movements in relation to relevant contexts. Shows no awareness of how these contexts influence the work(s). Demonstrates accurate, clear, and precise comprehension of significant concepts. Expresses ideas through sentences that are clearly formulated, grammatically correct, and stylistically compelling. Displays a logical line of reasoning. Provides accurate, relevant, and precise analysis of stylistic features, techniques, or methods employed in the work(s). Demonstrates accurate comprehension of significant concepts. Provides accurate and relevant analysis of stylistic features, techniques, or methods employed in the work(s). Provides limited relevant analysis of stylistic features, techniques, or methods employed in the work(s). Not always accurate. Accurately and precisely locates particular works and/or cultural movements in relation to multiple relevant contexts. Identifies and elaborates on the manner in which these contexts influence the work(s). Accurately locates particular works and/or cultural movements in relation to some relevant contexts. Identifies the manner in which these contexts influence the work(s). Approximately locates works and/or cultural movements in relation to some relevant contexts. May have some inaccuracies. Shows a general awareness of how the contexts influence the work(s). Expresses ideas through sentences that are clearly formulated, grammatically correct, and stylistically competent. May display some lapses in logic. N/A 46 ARTS & HUMANITIES Continued Criteria 4-Accomplished 3-Competent 2-Developing 1-Beginning Meets Course Expectations Incomplete in Meeting Course Expectations Inadequate in Meeting Course Expectations Accurately, precisely, and creatively applies relevant methods, models, and/or perspectives for the purpose of evaluating work(s), addressing issues, or solving problems. Demonstrates an accurate and precise understanding of relevant methods used to gather evidence to support conclusions. Accurately applies relevant methods, models, and/or perspectives for the purpose of evaluating work(s), addressing issues, or solving problems. Applies with limited success (not always accurate) relevant methods, models, and/or perspectives for the purpose of evaluating work(s), addressing issues, or solving problems. Demonstrates an incomplete understanding (not always accurate) of relevant methods used to gather evidence to support conclusions. May not always be accurate. Accurately, deeply and broadly integrates relevant information and significant concepts and principles in a logical manner. Accurately integrates relevant information and significant concepts and principles in a logical manner. Fails to apply or inaccurately applies relevant methods, models, and/or perspectives for the purpose of evaluating work(s), addressing issues, or solving problems. Fails to demonstrate an understanding or demonstrates inaccurate understanding of relevant methods used to gather evidence to support conclusions. Fails to integrate or inaccurately integrates relevant information and/or significant concepts and principles. Exceeds Course Expectations Theoretical Application (GE Goal 2,6,7) Methods (GE Goal 7) Integration Across Course (GE Goal 2, 8) Demonstrates an accurate understanding of relevant methods used to gather evidence to support conclusions. Accurately integrates some relevant information and significant concepts and principles in a logical manner. N/A 47 General Education Scoring Guide for MATHEMATICS Revised Summer 2008 4-Accomplished 3-Competent Exceeds Course Expectations Meets Course Expectations 2-Developing 1-Beginning N/A Criteria Uses terminology and notation appropriately in all instances Uses terminology and notation appropriately in most instances Incomplete in Meeting Course Expectations Incompletely comprehends the major concepts of the course Uses some appropriate terminology and notation (GE Goal 2) Execution of appropriate strategies for solving problems Executes a creative or sophisticated solution for solving a problem Executes an appropriate strategy for solving each problem Sometimes selects an inappropriate or inefficient strategy Often selects an inappropriate or inefficient strategy (GE Goals 2 & 7) Use of mathematical/logical operations Uses mathematical/logical operations appropriately in all instances Uses mathematical/logical operations appropriately in most instances Uses some appropriate mathematical/logical operations Often misuses, or fails to use, mathematical/logical operations Clearly and completely articulates a sophisticated interpretation of the data, and/or makes sophisticated inferences in the context of the problem(s) Fully integrates relevant information, meaningful concepts, and important principles Interprets data in the context of the problem(s) and makes appropriate inferences Incompletely interprets data and/or makes some incomplete or inappropriate inferences Inappropriately interprets data and/or makes incorrect inferences Integrates most relevant information, meaningful concepts, and important principles Integrates some relevant information, meaningful concepts, and important principles Fails to integrate relevant information, meaningful concepts, and important principles Comprehension N/A (GE Goal 2) Appropriate use of terminology and notation (GE Goal 2) Interpretation of the meaning of solutions in the context of the problem(s) (GE Goals 2 & 7) Integration across course (GE Goals 2 & 8) Adequately comprehends the major concepts of the course Inadequate in Meeting Course Expectations Inadequately comprehends the major concepts of the course Often misuses, or fails to use, terminology and notation 48 General Education Scoring Guide for NATURAL SCIENCES Revised 2006 4-Accomplished 3-Competent Exceeds Course Expectations Meets Course Expectations 2-Developing 1-Beginning N/A Criteria Demonstrate an understanding of the methods used to carry out scientific inquiry Incomplete in Meeting Course Expectations Demonstrates incomplete understanding of the methods used in science Inadequate in Meeting Course Expectations Demonstrates inadequate understanding of the methods used in science Demonstrates superior understanding of the methods used in science Demonstrates an understanding of the methods used in science (GE Goal 7) Explaining the major concepts of the natural sciences Fully comprehends major concepts and meaningful relationships of science Adequately comprehends the major concepts of science Incomplete comprehension of the major concepts of science Inadequate comprehension of the major concepts of science (GE Goal 5) Applying scientific principles to make reasonable and valid conclusions Consistently applies scientific principles to make reasonable and valid conclusions Most of the time applies scientific principles to make reasonable and valid conclusions Sometimes applies scientific principles to make reasonable and valid conclusions Does not apply scientific principles to make reasonable and valid conclusions (GE Goal 2 & 5) Applying scientific knowledge to address issues of personal and public importance Consistently applies scientific knowledge to address issues of personal and public importance Most of the time applies scientific knowledge to address issues of personal and public importance Sometimes applies scientific knowledge to address issues of personal and public importance Does not apply scientific knowledge to address issues of personal and public importance Fully integrates relevant information, meaningful concepts, and important principles Integrates most relevant information, meaningful concepts, and important principles Integrates some relevant information, meaningful concepts, and important principles Fails to integrate relevant information, meaningful concepts, and important principles (GE Goal 2,5,8) Integration across course (GE Goal 2,5,8) 49 General Education Scoring Guide for HISTORY & SOCIAL SCIENCES Revised 2006 4-Accomplished 3-Competent Exceeds Course Expectations Meets Course Expectations 2-Developing 1-Beginning N/A Criteria Comprehension GE Goals: History 3 Uses relevant concepts/theories in different contexts, but in an incomplete or superficial manner Asserts a position or interpretation, but fails to provide adequate justification; Limited identification of implications and consequences Does not use relevant concepts/theories in different contexts Comprehends the important concepts of the discipline as well as subsidiary and implicit aspects Comprehends the important concepts of the discipline Uses relevant concepts/theories insightfully in different contexts Uses relevant concepts/theories in different contexts Establishes a conclusive position or interpretation through the development of a cogent line of reasoning; Discusses implications and consequences Establishes a conclusive position with some justification; Identifies implications and consequences Demonstrates a superior understanding of methods used in the discipline Demonstrates an understanding of methods used in the discipline Demonstrates an incomplete understanding of methods used in the discipline Fails to demonstrate understanding of methods used in the discipline Fully integrates relevant information, appropriate perspectives, and important principles Integrates most relevant information, appropriate perspectives, and important principles Integrates some relevant information, appropriate perspectives, and important principles Fails to integrate relevant information, appropriate perspectives, and important principles SBS 2, 4 Interpretation and Evaluation GE Goals: History: 7 Methods GE Goals: History 7 Inadequate in Meeting Course Expectations Comprehends few of the important concepts of the discipline SBS 4 Application and Analysis GE Goals: History 2,3 Incomplete in Meeting Course Expectations Comprehends some of the important concepts of the discipline Fails to establish any recognizable conclusion SBS 7 Integration GE Goals: History 2,3,8 SBS 2,4,8 50 Appendix G Description of Assessment Instruments by GE Block GE Block IA & B: Written Communication IC: Oral Communication II: Mathematics III: Arts & Humanities IV: Natural Sciences V: History & Social/Behavioral Sciences Description of Assessment Instruments End-of-term papers. Random sample from all sections evaluated by faculty teams End-of-term video recordings of oral presentations: Random sample from all sections evaluated by faculty teams End-of-term objective exam with calculations and interpretations: All students or random sample from all sections (depending on course enrollment). Work scored by graduate students and/or faculty. End-of-term papers/essays: All students or random sample from all sections. Work scored by faculty teams. End-of-term tests including objective and subjective items: All students or random sample from all sections. Work scored by machine (if multiple-choice) or faculty. History: End-of-term essays: All students or random sample from all sections. Work scored by faculty teams. Social science: End-of-term tests including objective and subjective items. All students or random sample from all sections. Work scored by machine (if multiple choice) or faculty. 51