PROGRAM ASSESSMENT FORM LEARNING OUTCOMES FALL 2011 AND SPRING 2012 Name of Program: General Education (Competency in Critical Thinking) Name of Program Leader: Scott Karakas (Lisa Courcier) Date: April 23, 2012 LEARNING OUTCOME(S) This assessment focused on General Education Competency 3: Critical Thinking, within the required General Education Humanities course HUM 2510 – Understanding Visual and Performing Arts. Student achievement criteria for the General Education Competency in Critical Thinking are listed below. Competency 3: Critical Thinking Define an issue or problem using appropriate terminology; Select, organize, and evaluate information; Identify and analyze assumptions made by oneself and others; Synthesize information, and draw reasoned inferences; Develop and clearly state a position, taking into account all relevant points of view; Formulate an informed and logical conclusion, and test it for viability. HUM 2510 is a good subject for this assessment as one of its stated Learning Goals is to “develop critical thinking skills for analyzing individual works of visual and performing art.” For a complete list of the FGCU General Education Competencies, please see Appendix A. ASSESSMENT PLAN Name and brief description of the instruments/rubrics. (Attach a copy of the instrument to this document if appropriate). Both direct and indirect assessment of student learning of critical thinking skills were completed for this assessment. Direct Assessment – The HUM 2510 assessment team utilized a critical thinking skills scoring rubric, adapted from the Critical Thinking VALUE (Validated Assessment of Undergraduate Education) rubric provided by the Association of American Colleges and Universities (Appendix B). The rubric consisted of 4 possible levels: Lower Range (Poor), Benchmark (Good), Milestone 2 (Strong), and Milestone 3 (Very Strong—reserved only for highest essays). The criteria were taken directly from the essay grading rubric currently used in HUM 2510 and noted in the course’s essay assignment directions. The rubric was based on a 100-point scale to accommodate the ANGEL calculation system. Lower Range (0 points): Fails to identify or evaluate key concepts and/or underlying relationships and/or assumptions and implications; synthesizes information poorly; draws inappropriate or no inferences. Critical Thinking Skills Assessment (General Education) 1 Benchmark 1: (33 points): Identifies and evaluates some key concepts, assumptions and implications and underlying relationships; synthesizes some information; occasionally draws appropriate inferences. Milestone 2 (67 points): Defines key concepts. Identifies and evaluates underlying relationships effectively; identifies assumptions and implications; synthesizes information well; draws reasoned inferences. Milestone 3 (100 points): Accomplished and creative use of critical thinking skills, including a high level of defining key concepts, organizing and synthesizing information, identifying assumptions and implications, and drawing reasoned inferences. For a copy of the scoring rubric as it appeared online, please see Appendix C. All course students received instructor feedback for their essays, which included specific feedback for critical thinking skills (Appendix D). The process was then repeated with the same sample of students for the Critical Analysis Essay II assignment, to determine if the feedback had helped to improve student achievement in critical thinking skills. In addition, a trained course preceptor (grading assistant) read each essay, identified only by a CA1 or CA2 prefix and number, online in the rubric and then clicked on the appropriate criteria level. ANGEL assigned and recorded the score automatically. Once all the essays were scored, the data was downloaded for collation and dissemination to the course instructors. Indirect Assessment – The second part of the assessment plan was to create a student selfassessment survey (Appendix E), and embed it within each ANGEL section of HUM 2510. Survey questions were based on the critical thinking skills criteria used in the assignment directions, grading rubric, and critical thinking skills scoring rubric. The student selfassessment was administered during the Fall 2011 semester. Brief description of what is to be assessed/measured. Direct Assessment – A random sampling of 60 student Critical Thinking essays in HUM 2510 Understanding Visual and Performing Arts was gathered and assessed using the HUM 2510 Critical Thinking Rubric. For these essays, students are expected to analyze a work of visual art (essay one) and performing art (essay two) using the content knowledge that they have learned in the course. The purpose of the essays is to have students apply the content knowledge, demonstrating their ability to think critically about works of art. Indirect Assessment – Student feedback regarding their perceived levels of critical thinking skills was gathered in order to determine how well students were able to gauge their level of learning. A correlation was then set up between the actual level of learning determined by the direct assessment and the perceived level of learning determined by the indirect assessment. Date(s) of administration. The direct and indirect assessments were both administered within the course during the Fall 2011 semester. Sample (number of students, % of class, level, demographics). Direct Assessment – After the Critical Analysis Essay I assignments were graded normally, a randomly-generated sample of 60 student essays - approximately 4.3% of the 1387 students enrolled in the course during the Fall semester - was culled and uploaded to this Critical Thinking Skills Assessment (General Education) 2 integrated rubric. Each sample essay was scored by three different scorers. The same process was used for Critical Analysis Essay II. Indirect Assessment – Using the same essay scoring rubric, students were asked to rate their own ability to successfully complete the Critical Analysis Essay assignments as: Level 3 (Good), Level 2 (Strong), or Level 1 (Very Strong). A randomly-generated sample of 60 student self-assessments was pulled and compared with the results of the Essay I & II direct assessments. DATA ANALYSIS Direct Assessment The first goal of the assessment process was to determine if student scores improved between Critical Analysis Essay I and Critical Analysis Essay II. Students received feedback on their writing and critical thinking after they completed the first essay. The second goal was to compare scores from this year’s assessment (Fall 2011) with those from last year (Fall 2010). Fall 2011 results: The following table summarizes the scores for the two essays during Fall 2011: Critical Analysis Essay 1 Score 0 1 (33) 2 (67) 3 (100) Critical Analysis Essay 2 Score 0 1 (33) 2 (67) 3 (100) N = 60 essays Number 12 26 16 6 N = 60 essays Percentage 20% 43% 27% 10% Number 11 35 10 4 Percentage 18% 58% 17% 7% For complete assessment data from Fall 2011, please see Appendix F. Students were expected to score primarily at a Benchmark 1 with many students achieving at Milestone 2. Milestone 3 is high performing and would generally be above the level of student achievement for a General Education class. More importantly, we tracked student scores from Essay I to Essay II, expecting to see an improvement in overall scores. For Essay I, 80% of students scored at Benchmark 1 or higher, with 10% scoring at the highest level. On Essay II, 82% of students scored at Benchmark 1 or higher, with 7% scoring at the highest level. The percentage of students scoring at level 0 decreased 2%, and at Benchmark 1 increased 15%. Scores at Milestones 2 and 3 decreased, by 10% and 3% respectively. While average student scores declined from 42.2 to 37.1 between Critical Analysis Essay I and Critical Analysis Essay II, the number and percentage of students Critical Thinking Skills Assessment (General Education) 3 scoring at Benchmark 1 or higher rose slightly, from 48 to 49 and from 80% to 82%, suggesting that the overall goal was met. Course team members suggested three possible reasons for the decline in scores between the two essay assignments: 1. Timing. The second critical essay assignment is schedule so late in the semester that many students who have not been working ahead find themselves pressed to be able to complete this assignment in a meaningful way. 2. Visual arts (critical analysis 1) are easier to analyze for many students than the performing arts (critical analysis 2). The textbook’s discussion of performing arts does not lend itself to analysis as easily as the sections on visual arts. This concern is corroborated in the student self-assessment of their critical thinking abilities in relation to CA1 and CA2. 3. Many students persist in using pop music for their analysis in CA2, even though they text only discusses classical music, thus putting the students at a distinct disadvantage. Students often fall into the trap of summarizing the lyrics of the songs rather than analyzing the music. Fall 2010 results: The following table summarizes the scores for Critical Analysis Essays I & II during the previous assessment in Fall 2010: Critical Analysis Essay 1 Score 0 1 (33) 2 (67) 3 (100) Critical Analysis Essay 2 Score 0 1 (33) 2 (67) 3 (100) N = 100 essays Number 28 45 20 7 N = 93 essays Percentage 28% 45% 20% 7% Number 18 38 27 10 Percentage 19% 41% 29% 11% Comparison between the Fall 2010 and Fall 2011 assessments indicated that that, for Critical Analysis Essay II, the percentage of students scoring at level 0 decreased 1%, and those scoring at Benchmark 1 increased 17%. Scores at Milestones 2 and 3 decreased from 2010 to 2011, by 12% and 4% respectively. While average student scores declined from 43.7 to 37.1 between the Fall 2010 and Fall 2011 assessments, the percentage of students scoring at Benchmark 1 or higher rose slightly, from 81% to 82%. For complete assessment data for Fall 2011, please see Appendix F. In the next round of assessment (Fall 2012), we will continue to compare scores between Critical Analysis Essays I and II and also between this round of assessment (Fall 2011) and the next round (Fall 2012). Critical Thinking Skills Assessment (General Education) 4 Indirect Assessment The following table summarizes the responses for the student self-assessed critical thinking skill level survey: Critical Analysis Essay 1 Level No Response 3 (Good) 2 (Strong) 1 (Very Strong) Critical Analysis Essay 2 Level No Response 3 (Good) 2 (Strong) 1 (Very Strong) N = 60 responses Number 0 11 27 22 N = 60 essays Percentage 0% 18% 45% 37% Number 6 7 30 17 Percentage 10% 12% 50% 28% Note that the self-assessment scores appear to run on a 3-2-1 scale from weakest to strongest, while the essay scores appear to run in the reverse, with a 1-2-3 scale from weakest to strongest. In the 2011 indirect assessment for Critical Analysis Essay 1, 82% of students responded that their critical thinking skills were Strong or better, while in the direct assessment 80% demonstrated critical thinking skills at Benchmark 1 or above. In the 2011 indirect assessment for Critical Analysis Essay 2, 78% of students responded that their critical thinking skills were Strong or better, while in the direct assessment 82% demonstrated critical thinking skills at Benchmark 1 or above. The decline in student selfassessment of their abilities to analyze works of performing arts seems to corroborate the decline in overall scores between CA 1 and CA 2. Inter-rater reliability In addition to analyzing direct and indirect assessment scores, we also analyzed inter-rater reliability in the scoring of the essays. The goal is for 85% of essays receive the same score from at least two of the three scorers. The following table summarizes the matching scores for Critical Analysis Essay 2 during the Fall 2011 assessment: Critical Analysis Essay 2 Matching Scores 0 2 3 N = 60 essays Number 2 39 19 Percentage 3% 65% 32% For the Fall 2011 assessment, the goal for inter-rater reliability was met, with 97% of essays receiving matching scores from at least two of the three scorers and 32% receiving the same score from all three scorers. Critical Thinking Skills Assessment (General Education) 5 USE OF ASSESSMENT FINDINGS TO IMPROVE STUDENT LEARNING Recommended changes based on assessment findings. Include plan for sending substantive changes to department/college/university curriculum teams. Hum 2510 has been under revision for the past two years. The new version of the course was piloted in Spring 2012 concurrently with the old course, and the full version will be operational in Fall 2012 and will entirely replace the old course. The new course will continue to require Critical Analysis essays for visual art and performing art (music.) In order to improve student learning, the following changes have been instituted: (1) In the new course, students are prepared more systematically for the task of analysis with examples, exercises and readings. Students will now be submitting journal entries in addition to their other written work. Journal entries are a low-stakes way to give students practice with the different components of analysis before they have to write papers. (2) The new course conceptualizes the steps of critical analysis more explicitly. The hermeneutic process is broken down into five distinct steps or information-gathering stages: Personal (affective) response; Description; Formal Analysis; Historical / cultural contextualization ; Interpretation. The last step, Interpretation, is a synthesis that takes into account the other four steps or categories of information that are normally used to understand or interpret a given work This structure accords well with the way critical thinking is normally defined since it is based on the collection of evidence, the examination and analysis of evidence, and the formulation of an informed, critical hypothesis and the testing of that hypothesis against the known facts. (3) New assignments and rubrics have been written to guide students through the process and reduce the level of contamination of evidence from mechanical problems such as failing to understand the assignment or picking the wrong kind of work to analyze. The new rubrics provide a fine-grained assessment of outcomes that includes assessment of critical thinking skills. In other words, critical thinking is now integrated into the grading rubric rather than being assessed separately as in the past. The more fine-grained and explicit rubrics should help to improve assessment reliability across the whole course and eliminate the need for a separate sampling and assessment process for critical thinking. (4) Critical thinking skills are now given more explicit emphasis in assignments, rubrics and feedback comments. Faculty will be encouraged to take all opportunities to comment on critical thinking and point out examples where a lack of critical thinking led to unwanted results. Describe how data and recommendations were shared with faculty. (Attach a copy of minutes to this document if applicable). Information from this report has been shared with course faculty and preceptors by the HUM 2510 assessment team and course coordinator. The process for revising the course is ongoing and has been inclusive and transparent. Critical Thinking Skills Assessment (General Education) 6 APPENDIX A – FGCU General Education Competencies Competency 1: Quantitative Reasoning Solve mathematical problems; Analyze and interpret quantitative data; Summarize data into graphic and tabular formats; Make valid inferences from data; Distinguish between valid and invalid quantitative analysis and reasoning. Competency 2: Written Communication Employ the conventions of standard written English; Select a topic, and develop it for a specific audience and purpose, with respect for diverse perspectives; Organize and present relevant content with coherence, clarity, and unity; Develop research skills including the ability to collect, analyze, synthesize, and accurately present and document information; Use appropriate language to convey meaning effectively; Apply critical reading skills. Competency 3: Critical Thinking Define an issue or problem using appropriate terminology; Select, organize, and evaluate information; Identify and analyze assumptions made by oneself and others; Synthesize information, and draw reasoned inferences; Develop and clearly state a position, taking into account all relevant points of view; Formulate an informed and logical conclusion, and test it for viability. History: Approved by General Education Council on 11/2/05; revised and approved on 4/12/11 Critical Thinking Skills Assessment (General Education) 7 APPENDIX B – AAC&U Critical Thinking VALUE Rubric CRITICAL THINKING VALUE RUBRIC for more information, please contact value@aacu.org The VALUE rubrics were developed by teams of faculty experts representing colleges and universities across the United States through a process that examined many existing campus rubrics and related documents for each learning outcome and incorporated additional feedback from faculty. The rubrics articulate fundamental criteria for each learning outcome, with performance descriptors demonstrating progressively more sophisticated levels of attainment. The rubrics are intended for institutional-level use in evaluating and discussing student learning, not for grading. The core expectations articulated in all 15 of the VALUE rubrics can and should be translated into the language of individual campuses, disciplines, and even courses. The utility of the VALUE rubrics is to position learning at all undergraduate levels within a basic framework of expectations such that evidence of learning can by shared nationally through a common dialog and understanding of student success. Definition Critical thinking is a habit of mind characterized by the comprehensive exploration of issues, ideas, artifacts, and events before accepting or formulating an opinion or conclusion. Framing Language This rubric is designed to be transdisciplinary, reflecting the recognition that success in all disciplines requires habits of inquiry and analysis that share common attributes. Further, research suggests that successful critical thinkers from all disciplines increasingly need to be able to apply those habits in various and changing situations encountered in all walks of life. This rubric is designed for use with many different types of assignments and the suggestions here are not an exhaustive list of possibilities. Critical thinking can be demonstrated in assignments that require students to complete analyses of text, data, or issues. Assignments that cut across presentation mode might be especially useful in some fields. If insight into the process components of critical thinking (e.g., how information sources were evaluated regardless of whether they were included in the product) is important, assignments focused on student reflection might be especially illuminating. • • • • • Glossary The definitions that follow were developed to clarify terms and concepts used in this rubric only. Ambiguity: Information that may be interpreted in more than one way. Assumptions: Ideas, conditions, or beliefs (often implicit or unstated) that are "taken for granted or accepted as true without proof." (quoted from www.dictionary.reference.com/browse/assumptions) Context: The historical, ethical. political, cultural, environmental, or circumstantial settings or conditions that influence and complicate the consideration of any issues, ideas, artifacts, and events. Literal meaning: Interpretation of information exactly as stated. For example, "she was green with envy" would be interpreted to mean that her skin was green. Metaphor: Information that is (intended to be) interpreted in a non-literal way. For example, "she was green with envy" is intended to convey an intensity of emotion, not a skin color. Critical Thinking Skills Assessment (General Education) 8 CRITICAL THINKING VALUE RUBRIC for more information, please contact value@aacu.org Definition Critical thinking is a habit of mind characterized by the comprehensive exploration of issues, ideas, artifacts, and events before accepting or formulating an opinion or conclusion. Evaluators are encouraged to assign a zero to any work sample or collection of work that does not meet benchmark (cell one) level performance. Capstone Milestones Benchmark 4 3 Explanation of issues Issue/problem to be considered critically is stated clearly and described comprehensively, delivering all relevant information necessary for full understanding. Issue/problem to be considered critically is stated, described, and clarified so that understanding is not seriously impeded by omissions. Issue/problem to be considered critically is stated but description leaves some terms undefined, ambiguities unexplored, boundaries undetermined, and/or backgrounds unknown. Issue/problem to be considered critically is stated without clarification or description. Evidence Selecting and using information to investigate a point of view or conclusion Information is taken from source(s) with enough interpretation/evaluation to develop a comprehensive analysis or synthesis. Viewpoints of experts are questioned thoroughly. Information is taken from source(s) with enough interpretation/evaluation to develop a coherent analysis or synthesis. Viewpoints of experts are subject to questioning. Information is taken from source(s) with some interpretation/evaluation, but not enough to develop a coherent analysis or synthesis. Viewpoints of experts are taken as mostly fact, with little questioning. Information is taken from source(s) without any interpretation/evaluation. Viewpoints of experts are taken as fact, without question. Influence of context and assumptions Thoroughly (systematically and methodically) analyzes own and others' assumptions and carefully evaluates the relevance of contexts when presenting a position. Identifies own and others' assumptions and several relevant contexts when presenting a position. Questions some assumptions. Identifies several relevant contexts when presenting a position. May be more aware of others' assumptions than one's own (or vice versa). Shows an emerging awareness of present assumptions (sometimes labels assertions as assumptions). Begins to identify some contexts when presenting a position. Critical Thinking Skills Assessment (General Education) 2 9 1 Student's position (perspective, thesis/hypothesis) Specific position (perspective, thesis/hypothesis) is imaginative, taking into account the complexities of an issue. Limits of position (perspective, thesis/hypothesis) are acknowledged. Others' points of view are synthesized within position (perspective, thesis/hypothesis). Specific position (perspective, thesis/hypothesis) takes into account the complexities of an issue. Others' points of view are acknowledged within position (perspective, thesis/hypothesis). Specific position (perspective, Specific position (perspective, thesis/hypothesis) thesis/hypothesis) is stated, but is acknowledges different sides of simplistic and obvious. an issue. Conclusions and related outcomes (implications and consequences) Conclusions and related outcomes (consequences and implications) are logical and reflect student’s informed evaluation and ability to place evidence and perspectives discussed in priority order. Conclusion is logically tied to a range of information, including opposing viewpoints; related outcomes (consequences and implications) are identified clearly. Conclusion is logically tied to information (because information is chosen to fit the desired conclusion); some related outcomes (consequences and implications) are identified clearly. Critical Thinking Skills Assessment (General Education) 10 Conclusion is inconsistently tied to some of the information discussed; related outcomes (consequences and implications) are oversimplified. APPENDIX C – HUM 2510 Critical Thinking Rubric Scale Focus/Thesis Development Upper Range-Excellent (A) Original & creative thesis that is narrowly focused Thesis provides an entrance into the essay that fully answers all parts of the question Upper Range-Strong (B) Middle Range— Good (C) Lower Range— Poor (D/F) Strong thesis that is focused Thesis provides an entrance into the essay that fully answers all parts of the question Thesis exists but is mechanical or expected and not original or creative Essay may not answer all parts of the question Nonexistent or inadequate thesis Essay fails to address the question adequately Critical Thinking Skills Assessment (General Education) Unity & Coherence Creative and highly analytical content; excellent observations with strong support Uses text terminology knowledgeably and effectively Goes beyond description or plot summary Accomplished and creative use of critical thinking skills Strong analysis with adequate support, demonstrated use of critical thinking skills Occasional reliance on description or plot summary Good use of text terminology demonstrates understanding of terms Adequate but unremarkable analysis; some use of support and critical thinking skills; heavy reliance on description or plot summary Uses text terminology in a way that demonstrates understanding, though may be limited Little to no analysis: plot summary and/or description only; little to no support or critical thinking evident. Uses text terminology in a way that fails to demonstrate understanding or does not use text terminology 11 Essay stays on topic throughout; fully answers all parts of the question Smooth transitions between topics; strong and coherent flow Meets length requirements Essay stays on topic but does not always clearly connect the development to the thesis Generally good flow from one topic to another Meets length requirements Essay strays from topic on occasion Mechanical flow from one topic to another Meets length requirements Essay does not stay on topic Awkward format with poor flow between topics Does not meet length requirements Mechanics No spelling, mechanical, or grammatical errors Minor spelling, mechanical, or grammatical errors exist but do not impede reading or comprehension Minor spelling, mechanical, or grammatical errors that somewhat impede reading or comprehension Spelling, mechanical, or grammatical errors proliferate APPENDIX D – Critical Thinking Skills Comments for Critical Analysis Essays Very strong use of critical thinking skills! Accomplished and creative use of critical thinking skills, including a high level of defining key concepts, organizing and synthesizing information, identifying assumptions and implications, and drawing reasoned inferences. Great work! Strong use of critical thinking skills! You define key concepts and identify and evaluate underlying relationships effectively. You identify assumptions and implications, synthesize information well, and draw reasoned inferences. Nice job! Good use of critical thinking skills. You identify and evaluate some key concepts, assumptions and implications and underlying relationships. You synthesize some information and occasionally draw appropriate inferences, all of which is a good start. Build on it to strengthen your writing even more. Your critical thinking skills need strengthening. Critical thinking requires that you consider all available evidence; identify and evaluate underlying assumptions, implications and relationships, synthesize information well, and draw appropriate inferences. Some or all of these steps were missing in your paper. Often, just applying simple logic and common sense will help you evaluate evidence and synthesize more critically. Working on these skills should enable you to produce a stronger essay. Critical Thinking Skills Assessment (General Education) 12 APPENDIX E – Critical Thinking Self-Assessment Online Survey Insert online survey text. Critical Thinking Skills Assessment (General Education) 13 APPENDIX F – Assessment Data for HUM 2510, Fall 2011 CA 1 ID CA 1-1 CA 1-2 CA 1-3 CA 1-4 CA 1-5 CA 1-6 CA 1-7 CA 1-8 CA 1-9 CA 1-10 CA 1-11 CA 1-12 CA 1-13 CA 1-14 CA 1-15 CA 1-16 CA 1-17 CA 1-18 CA 1-19 CA 1-20 CA 1-21 CA 1-22 CA 1-23 Self-Assessed CT Skill Level Poi Level nts Level 3 (Good) 33 Level 1 (Very Strong) 67 Level 1 (Very Strong) 33 Level 2 (Strong) 0 Level 1 (Very Strong) 33 Level 2 (Strong) 0 Level 1 (Very Strong) 100 Level 2 (Strong) 67 Level 1 (Very Strong) 33 Level 1 (Very Strong) 0 Level 2 (Strong) 33 Level 3 (Good) 33 Level 1 (Very Strong) 100 Level 2 (Strong) 100 Level 2 (Strong) 0 Level 2 (Strong) 67 Level 1 (Very Strong) 0 Level 2 (Strong) 0 Level 1 (Very Strong) 67 Level 1 (Very Strong) 100 Level 1 (Very Strong) 100 Level 1 (Very Strong) 33 Level 2 (Strong) 33 Preceptor 1 Score Preceptor 2 Score Rubric Poi nts Rubric Scor er 3 Point s Benchmark 67 Milestone 2 33 Milestone 2 67 Milestone 2 67 Benchmark Lower Range 33 Benchmark 33 67 67 Benchmark Lower Range 0 Milestone 2 Lower Range 33 Benchmark 33 Milestone 3 100 Milestone 2 100 Milestone 2 100 Milestone 3 67 Benchmark Lower Range 33 Benchmark 33 67 Milestone 2 0 Benchmark 67 Milestone 2 33 Benchmark 33 Benchmark 33 Milestone 3 100 Milestone 3 100 Milestone 3 Lower Range 67 Milestone 2 100 33 Benchmark 0 Milestone 2 Lower Range Lower Range 67 Milestone 2 67 100 Milestone 3 0 67 Milestone 2 67 Milestone 2 67 Milestone 2 67 Milestone 3 100 Milestone 3 100 Milestone 3 100 100 Benchmark 0 Milestone 3 Lower Range Benchmark 33 Benchmark 33 Critical Thinking Skills Assessment (General Education) 33 33 Rubric Benchm ark Milesto ne 2 Benchm ark Milesto ne 2 Benchm ark Benchm ark Milesto ne 2 Milesto ne 2 Benchm ark Lower Range Benchm ark Benchm ark Milesto ne 3 Milesto ne 3 Lower Range Milesto ne 2 Lower Range Milesto ne 2 Milesto ne 2 Milesto ne 3 Milesto ne 3 Benchm ark Benchm ark CA 1 Final Score Poi nts Rubric Benchma 33 rk Mileston 67 e2 Benchma 33 rk Mileston 67 e2 Benchma 33 rk Benchma 33 rk Mileston 100 e2 Mileston 67 e2 Benchma 33 rk Lower 0 Range Benchma 33 rk Benchma 33 rk Mileston 100 e3 Mileston 100 e3 Lower 0 Range Mileston 67 e2 Lower 0 Range Mileston 67 e2 Mileston 67 e2 Mileston 100 e3 Mileston 100 e3 Benchma 33 rk Benchma 33 rk CA 2 ID CA21 CA22 CA23 CA24 CA25 CA26 CA27 CA28 CA29 CA210 CA211 CA212 CA213 CA214 CA215 CA216 CA217 CA218 CA219 CA220 CA221 CA222 CA223 Self-Assessed CT Skill Level Level Precept 1 Score Poi nts Level 2 (Strong) Level 1 (Very Strong) 33 Level 2 (Strong) 33 Level 2 (Strong) 33 No response 33 Level 3 (Good) Level 1 (Very Strong) Level 1 (Very Strong) Level 1 (Very Strong) Level 1 (Very Strong) 33 Level 2 (Strong) 0 Level 3 (Good) Level 1 (Very Strong) Level 1 (Very Strong) Level 1 (Very Strong) 0 Level 2 (Strong) Level 1 (Very Strong) 0 67 33 33 67 100 100 0 0 67 Level 3 (Good) Level 1 (Very Strong) Level 1 (Very Strong) 100 Level 2 (Strong) 67 Level 3 (Good) 33 No response 0 14 33 33 Rubric Lower Range Benchmar k Benchmar k Benchmar k Benchmar k Benchmar k Milestone 2 Benchmar k Benchmar k Milestone 2 Lower Range Lower Range Milestone 3 Milestone 3 Lower Range Lower Range Milestone 2 Benchmar k Benchmar k Milestone 3 Milestone 2 Benchmar k Lower Range Precept 2 Score Poi nts 0 67 33 100 67 33 67 100 100 67 33 33 67 33 33 33 67 0 67 100 33 0 100 Rubric Lower Range Milestone 2 Benchmar k Milestone 3 Milestone 2 Benchmar k Milestone 2 Milestone 3 Milestone 3 Milestone 2 Benchmar k Benchmar k Milestone 2 Benchmar k Benchmar k Benchmar k Milestone 2 Lower Range Milestone 2 Milestone 3 Benchmar k Lower Range Milestone 3 Scor er 3 Point s 0 33 33 33 33 33 67 33 33 67 33 0 100 100 33 33 33 33 33 100 67 33 33 Rubric Lower Range Benchm ark Benchm ark Benchm ark Benchm ark Benchm ark Milesto ne 2 Benchm ark Benchm ark Milesto ne 2 Benchm ark Lower Range Milesto ne 3 Milesto ne 3 Benchm ark Lower Range Benchm ark Benchm ark Benchm ark Milesto ne 3 Milesto ne 2 Benchm ark Benchm ark CA 2 Final Score Poi nts Rubric Lower 0 Range Benchma 33 rk Benchma 33 rk Benchma 33 rk Benchma 33 rk Benchma 33 rk Mileston 67 e2 Benchma 33 rk Benchma 33 rk Mileston 67 e2 Benchma 33 rk Lower 0 Range Mileston 100 e3 Mileston 100 e3 Benchma 33 rk Lower 33 Range Mileston 67 e2 Benchma 33 rk Benchma 33 rk Mileston 100 e3 Mileston 67 e2 Benchma 33 rk Benchma 33 rk CA 1-24 CA 1-25 CA 1-26 CA 1-27 CA 1-28 CA 1-29 CA 1-30 CA 1-31 CA 1-32 CA 1-33 CA 1-34 CA 1-35 CA 1-36 CA 1-37 CA 1-38 CA 1-39 CA 1-40 CA 1-41 CA 1-42 CA 1-43 CA 1-44 CA 1-45 CA 1-46 CA 1-47 CA 1-48 CA 1-49 Level 1 (Very Strong) Level 2 (Strong) Level 2 (Strong) Level 3 (Good) Level 1 (Very Strong) Level 1 (Very Strong) Level 3 (Good) Level 2 (Strong) Level 2 (Strong) Level 3 (Good) Level 1 (Very Strong) Level 2 (Strong) Level 3 (Good) Level 2 (Strong) Level 1 (Very Strong) Level 2 (Strong) Level 2 (Strong) Level 3 (Good) Level 3 (Good) Level 2 (Strong) Level 3 (Good) Level 2 (Strong) Level 1 (Very Strong) Level 1 (Very Strong) Level 2 (Strong) Level 2 (Strong) CA Level 2 0 Lower Range 100 Milestone 3 0 33 Benchmark 33 33 33 Benchmark 0 67 Milestone 2 0 67 Milestone 2 0 Benchmark Lower Range Lower Range Lower Range 33 Benchmark 100 Milestone 3 33 33 Benchmark 33 Benchmark 33 100 Milestone 3 33 Benchmark 100 33 Benchmark 67 Milestone 2 67 33 Benchmark 33 33 67 Milestone 2 0 Benchmark Lower Range 67 Milestone 2 Lower Range Lower Range 67 Milestone 2 67 67 Milestone 2 0 33 Benchmark 0 Benchmark Lower Range Lower Range Lower Range Lower Range 67 Milestone 2 67 100 Milestone 3 0 67 Milestone 2 67 33 Benchmark 33 67 Milestone 2 0 33 Benchmark 33 67 Milestone 2 0 0 Benchmark Lower Range Lower Range 67 Milestone 2 0 33 Benchmark 67 Milestone 2 33 67 Milestone 2 33 Benchmark 67 33 Benchmark 33 33 67 Milestone 2 0 Benchmark Lower Range 67 Lower Range Benchm ark Benchm ark Milesto ne 2 Milesto ne 2 Benchm ark Benchm ark Milesto ne 3 Milesto ne 2 Benchm ark Milesto ne 2 Milesto ne 2 Lower Range Lower Range Milesto ne 2 Lower Range Milesto ne 2 Benchm ark Lower Range Benchm ark Lower Range Lower Range Benchm ark Milesto ne 2 Benchm ark Milesto ne 2 33 Benchmark 33 Benchmark 33 Benchm 0 0 33 0 0 0 0 33 0 Critical Thinking Skills Assessment (General Education) 33 67 67 67 CA224 CA225 CA226 CA227 CA228 CA229 CA230 CA231 CA232 CA233 CA234 CA235 CA236 CA237 CA238 CA239 CA240 CA241 CA242 CA243 CA244 CA245 CA246 CA247 CA248 CA249 Level 1 (Very Strong) 67 Level 2 (Strong) 33 Level 2 (Strong) 33 Level 2 (Strong) 0 Level 2 (Strong) Level 1 (Very Strong 0 33 Level 2 (Strong) 33 Level 3 (Good) Level 1 (Very Strong) 33 No response 33 Level 2 (Strong) 0 Level 2 (Strong) 33 Level 2 (Strong) 100 67 Lower Range Benchma rk Benchma rk Mileston e2 Mileston e2 Benchma rk Benchma rk Mileston e3 Mileston e2 Benchma rk Mileston e2 Mileston e2 Lower Range Lower Range Mileston e2 Lower Range Mileston e2 Benchma rk Lower Range Benchma rk Lower Range Lower Range Benchma rk Mileston e2 Benchma rk Mileston e2 33 Benchma CA2- 0 33 33 67 67 33 33 100 67 33 67 67 0 0 67 0 67 33 0 33 0 0 33 67 33 Level 2 (Strong) 0 Level 2 (Strong) 0 No response 0 Level 2 (Strong) 33 No response 33 Level 2 (Strong) 0 Level 2 (Strong) 0 Level 2 (Strong. 33 Level 2 (Strong) 33 Level 2 (Strong) 33 Level 2 (Strong) 33 Milestone 2 Benchmar k Benchmar k Lower Range Lower Range Benchmar k Benchmar k Benchmar k Lower Range Benchmar k Lower Range Benchmar k Milestone 3 Lower Range Milestone 3 Lower Range Lower Range Lower Range Benchmar k Benchmar k Lower Range Lower Range Benchmar k Benchmar k Benchmar k Benchmar k Level 3 (Good) 67 Milestone No response Level 1 (Very Strong) 15 0 0 100 0 Benchmar k Benchmar k Milestone 2 Benchmar k Lower Range Benchmar k Milestone 3 Lower Range Benchmar k Benchmar k Lower Range Lower Range Benchmar k Benchmar k Milestone 3 Milestone 2 Benchmar k Benchmar k Benchmar k Milestone 2 Milestone 2 Benchmar k Milestone 2 Benchmar k Lower Range Lower Range 67 Milestone 33 33 67 33 0 33 100 0 33 33 0 0 33 33 100 67 33 33 33 67 67 33 67 33 0 33 Benchm ark Benchm ark Benchm ark Lower Range Lower Range Benchm ark Benchm ark Benchm ark Benchm ark Benchm ark Lower Range Benchm ark Benchm ark Benchm ark Milesto ne 3 Lower Range Lower Range Lower Range Benchm ark Benchm ark Lower Range Lower Range Benchm ark Benchm ark Benchm ark Benchm ark 67 Milesto 67 33 33 0 0 33 33 33 33 33 0 33 33 33 100 0 0 33 33 33 33 0 33 33 33 33 Benchma rk Benchma rk Benchma rk Lower Range Lower Range Benchma rk Benchma rk Benchma rk Benchma rk Benchma rk Lower Range Benchma rk Benchma rk Benchma rk Mileston e3 Lower Range Lower Range Lower Range Benchma rk Benchma rk Lower Range Lower Range Benchma rk Benchma rk Benchma rk Benchma rk 67 Mileston 67 33 33 0 0 33 33 33 33 33 0 33 33 33 100 0 0 33 33 33 33 0 33 33 33 1-50 (Strong) CA 1-51 CA 1-52 CA 1-53 CA 1-54 CA 1-55 CA 1-56 CA 1-57 CA 1-58 CA 1-59 CA 1-60 Level 2 (Strong) Level 1 (Very Strong) Level 1 (Very Strong) Level 2 (Strong) Level 3 (Good) Level 2 (Strong Level 2 (Strong) Level 3 (Good) Level 1 (Very Strong) Level 2 (Strong) ark 33 Benchmark 67 Milestone 2 33 33 Benchmark 33 Benchmark 33 33 Benchmark 67 Milestone 2 33 33 Benchmark Lower Range 67 Milestone 2 33 100 Milestone 3 0 33 Benchmark 33 33 Benchmark 33 67 Milestone 2 67 0 Benchmark Lower Range Lower Range Lower Range 67 Milestone 2 0 33 Benchmark 67 Milestone 2 33 0 33 0 0 Benchm ark Benchm ark Benchm ark Benchm ark Lower Range Benchm ark Lower Range Milesto ne 2 Lower Range Benchm ark 33 33 33 33 0 33 33 67 0 33 42. 2 rk 50 Benchma rk Benchma rk Benchma rk Benchma rk Lower Range Benchma rk Lower Range Mileston e2 Lower Range Benchma rk Average Score CA251 CA252 CA253 CA254 CA255 CA256 CA257 CA258 CA259 CA260 2 Level 2 (Strong) Level 1 (Very Strong 67 Level 2 (Strong) 67 Level 2 (Strong) 0 Level 2 (Strong) 0 Level 2 (Strong) 67 Level 2 (Strong) 0 Level 3 (Good) Level 1 (Very Strong) 33 Level 2 (Strong) 33 33 33 Milestone 2 Benchmar k Milestone 2 Lower Range Lower Range Milestone 2 Lower Range Benchmar k Benchmar k Benchmar k 2 100 67 33 67 67 67 0 67 33 33 Milestone 3 Milestone 2 Benchmar k Milestone 2 Milestone 2 Milestone 2 Lower Range Milestone 2 Benchmar k Benchmar k ne 2 67 33 67 0 0 67 0 67 33 33 Milesto ne 2 Benchm ark Milesto ne 2 Lower Range Lower Range Milesto ne 2 Lower Range Milesto ne 2 Benchm ark Benchm ark Self-Assessment Answer Choices: Level 1 (Very Strong): I demonstrated accomplished and creative use of critical thinking skills including a high level of defining key concepts organizing and synthesizing information identifying assumptions and implications and drawing reasoned inferences. Level 2 (Strong): I defined key concepts. I also identified and evaluated underlying relationships effectively; I identified assumptions and implications; I synthesized information well; I drew reasoned inferences. Level 3 (Good): I identified and evaluated some key concepts assumptions and implications and underlying relationships; I synthesized some information and I occasionally drew appropriate inferences. Level 4 (Not so strong): I didn't really identify or evaluate key concepts and/or underlying relationships and/or assumptions and implications; I didn't synthesize information very well; my inferences were usually either inappropriate or I didn't make any. Critical Thinking Skills Assessment (General Education) 16 e2 67 33 67 0 0 67 0 67 33 33 37. 1 Mileston e2 Benchma rk Mileston e2 Lower Range Lower Range Mileston e2 Lower Range Mileston e2 Benchma rk Benchma rk Average Score