Critical Thinking

advertisement
PROGRAM ASSESSMENT FORM
LEARNING OUTCOMES
FALL 2012 AND SPRING 2013
Name of Program: General Education (Competency in Critical Thinking)
Name of Program Leader: Kris De Welde (Lisa Courcier)
Date: March 28, 2013
LEARNING OUTCOME(S)
This assessment focused on General Education Competency 3: Critical Thinking, within the
required General Education Humanities course HUM 2510 – Understanding Visual and
Performing Arts. Student achievement criteria for the General Education Competency in
Critical Thinking are listed below.
Competency 3: Critical Thinking
 Define an issue or problem using appropriate terminology;
 Select, organize, and evaluate information;
 Identify and analyze assumptions made by oneself and others;
 Synthesize information, and draw reasoned inferences;
 Develop and clearly state a position, taking into account all relevant points of view;
 Formulate an informed and logical conclusion, and test it for viability.
HUM 2510 is a good subject for this assessment as one of its stated Learning Goals is to
“develop critical thinking skills for analyzing individual works of visual and performing art.”
For a complete list of the FGCU General Education Competencies, please see Appendix A.
ASSESSMENT PLAN
Name and brief description of the instruments/rubrics. (Attach a copy of the instrument to this
document if appropriate).
Only direct assessment of student learning of critical thinking skills was completed for this
assessment, having completed both direct and indirect in the past.
Direct Assessment – The HUM 2510 assessment team utilized a critical thinking skills
scoring rubric, adapted from the Critical Thinking VALUE (Validated Assessment of
Undergraduate Education) rubric provided by the Association of American Colleges and
Universities (Appendix B). The rubric consisted of 4 possible levels: Lower Range (Poor),
Benchmark (Good), Milestone 2 (Strong), and Milestone 3 (Very Strong—reserved only for
highest essays). The criteria were taken directly from the essay grading rubric currently
used in HUM 2510 and noted in the course’s essay assignment directions. The rubric was
based on a 100-point scale to accommodate the ANGEL calculation system.

Lower Range (0 points): Fails to identify or evaluate key concepts and/or
underlying relationships and/or assumptions and implications; synthesizes
information poorly; draws inappropriate or no inferences.
 Benchmark 1: (33 points): Identifies and evaluates some key concepts, assumptions
and implications and underlying relationships; synthesizes some information;
occasionally draws appropriate inferences.
Critical Thinking Skills Assessment (General Education)
1

Milestone 2 (67 points): Defines key concepts. Identifies and evaluates underlying
relationships effectively; identifies assumptions and implications; synthesizes
information well; draws reasoned inferences.

Milestone 3 (100 points): Accomplished and creative use of critical thinking skills,
including a high level of defining key concepts, organizing and synthesizing
information, identifying assumptions and implications, and drawing reasoned
inferences.
All course students received instructor feedback for their essays, which included specific
feedback for critical thinking skills (Appendix C). The first set of essays, Critical Thinking
I, were graded and the students were provided feedback. The scoring team used the rubric to
score 60 randomly selected essays. The process was then repeated with the same sample of
students for the Critical Analysis Essay II assignment, to determine if the feedback had
helped to improve student achievement in critical thinking skills. Once all the essays were
scored, the data was downloaded for collation and dissemination to the faculty for review.
Brief description of what is to be assessed/measured.
Direct Assessment – A random sampling of 60 student Critical Thinking essays in HUM
2510 Understanding Visual and Performing Arts was gathered and assessed using the HUM
2510 Critical Thinking Rubric. For these essays, students are expected to analyze a work of
visual art (essay one) and performing art (essay two) using the content knowledge that they
have learned in the course. The purpose of the essays is to have students apply the content
knowledge, demonstrating their ability to think critically about works of art.
Date(s) of administration.
The direct assessment was administered within the course during the Fall 2012 semester.
Sample (number of students, % of class, level, demographics).
Direct Assessment – After the Critical Analysis Essay I (Paper 2 in Fall 12) assignments
were graded normally, a randomly-generated sample of 60 student essays - approximately
4.02% of the 1492 students enrolled in the course during the Fall 2012semester - was culled
and uploaded to this integrated rubric. Each sample essay was scored by three different
scorers. The same process was used for Critical Analysis Essay II (Paper 4 in Fall12).
DATA ANALYSIS
Direct Assessment
The first goal of the assessment process was to determine if student scores improved
between Critical Analysis Essay I and Critical Analysis Essay II. Students received
feedback on their writing and critical thinking after they completed the first essay.
The second goal was to compare scores from this year’s assessment (Fall 2012) with those
from last year (Fall 2011).
Fall 2012 results:
The following table summarizes the scores for the two essays during Fall 2012:
Critical Thinking Skills Assessment (General Education)
2
Critical Analysis
Essay 1
Score
0
1 (33)
2 (67)
3 (100)
Critical Analysis
Essay 2
Score
0
1 (33)
2 (67)
3 (100)
N = 60 essays
Number
1
23
30
6
N = 60 essays
Percentage
1.7%
38.3%
50%
10%
Number
4
29
22
5
Percentage
6.7%
48.3%
36.7%
8.3%
For complete assessment data from Fall 2012, please see Appendix D.
Students were expected to score primarily at a Benchmark 1 with many students achieving
at Milestone 2. Milestone 3 is high performing and would generally be above the level of
student achievement for a General Education class. More importantly, we tracked student
scores from Essay 1 to Essay 2, expecting to see an improvement in overall scores.
For Essay I, 98.3% of students scored at Benchmark 1 or higher, with 10% scoring at the
highest level. On Essay II, 93.3% of students scored at Benchmark 1 or higher, with 8.3%
scoring at the highest level. Students continue to score lower overall in the second essay,
though our past experience has offered an understanding of why this is the case. Some of
the possible reasons are as noted in our report last year:



Timing: the second critical analysis paper was scheduled so late in the semester that
students were pressed to complete it in a meaningful way;
More perceived difficulty in analyzing performing arts, augmented by a textbook
whose discussion of the performing arts did not lend itself well to analysis;
Students’ decision to analyze pop music—and lyrics—rather than the Classical
music discussed in the textbook often put them at a distinct disadvantage.
Fall 12 circumstances, in which students no longer had the option of analyzing pop
music and the redesigned course used a new text, caused course team members to
suggest possible reasons for the decline in scores between the first and second essays.
1. Again it appears that visual arts (critical analysis 1) are easier to analyze for many
students than the performing arts (critical analysis 2). While both the visual arts and
performing arts sections of the new online course materials cover technical aspects of
each arts field, the performing arts lessons, discussing distinct elements of music theory
largely through aural representaion, do not lend themselves to analysis as easily as do
the visual arts lessons, in which students are to a greater extent led to consider how the
disparate elements and principles discussed work together to create a whole.
2. Critical Analysis Essay II (Paper 4 in Fall 12), had two foci: technical music analysis
and classical music concert attendance. For many students this was their first
experience with either event. The conjunction of two unfamiliar experiences appeared
to put some students at a disadvantage, as they seemed only to focus on one or the other
Critical Thinking Skills Assessment (General Education)
3
of the two paper components, and thus had difficulty in synthesizing the two parts into a
coherent analysis.
A comparison of student scores from Fall 2011 to Fall 2012, however, does show
improvement in the overall scores:
Critical Analysis
Essay 1
Score
0
1 (33)
2 (67)
3 (100)
Critical Analysis
Essay 2
Score
0
1 (33)
2 (67)
3 (100)
Critical Analysis
Essay Scores
Combined
Score
0
1 (33)
2 (67)
3 (100)
Fall 2012
Fall 2011
Difference
Number
1
23
30
6
Number
12
26
16
6
-11
-3
+14
even
Number
4
29
22
5
Fall 2012
Number
11
35
10
4
Fall 2011
-7
-6
+12
+1
Difference
Number
5
52
52
11
Number
23
61
26
10
-18
-9
+14
+1
On the whole, the number of students achieving at the bottom end of the scale for both
essays (combined) with a score of 0 decreased from 23 to 5. The number of students with a
score of 1 also decreased from 61 to 52, redistributing scores to the higher range. The total
(combined) number of students achieving at higher ends of the scale thus increased: for a
score of 2 from 26 to 52 and for a score of 3 from 10 to 11. The changes that have been
made to the course structure, including increased support for student learning and
engagement with the material, has apparently led to an increase in student scores on these
essays.
In the next round of assessment (Fall 2013), we will continue to compare scores between
Critical Analysis Essays I and II and also between this round of assessment (Fall 2012) and
the next round (Fall 2013).
Indirect Assessment
There was no indirect assessment in Fall 2012.
Inter-rater reliability
In addition to analyzing direct assessment scores, we also analyzed inter-rater reliability in
the scoring of the essays. The goal is for 85% of essays receive the same score from at least
two of the three scorers.
Critical Thinking Skills Assessment (General Education)
4
The following table summarizes the matching scores for Critical Analysis Essay 1 (Paper 2,
in Fall 12) during the Fall 2012 assessment:
Critical Analysis
Essay 1
Matching Scores
0
2
3
N = 60 essays
Number
0
26
34
Percentage
0%
43%
57%
For the Fall 2012 assessment, the goal for inter-rater reliability was met in Critical Analysis
Essay I, with 100% of essays receiving matching scores from at least two of the three
scorers and 57% receiving the same score from all three scorers.
The following table summarizes the matching scores for Critical Analysis Essay 2 (Paper 4,
in Fall 12) during the Fall 12 assessment:
Critical Analysis
Essay 2
Matching Scores
0
2
3
N = 60 essays
Number
0
17
43
Percentage
0%
28.3%
71.7%
For the Fall 2012 assessment, the goal for inter-rater reliability was met in Essay 2, with
100% of essays receiving matching scores from at least two of the three scorers and 71.7%
receiving the same score from all three scorers.
USE OF ASSESSMENT FINDINGS TO IMPROVE STUDENT LEARNING
Recommended changes based on assessment findings. Include plan for sending substantive
changes to department/college/university curriculum teams.
HUM 2510 has been under revision for the past three years. The new version of the course
was piloted in Spring 2012 concurrently with the old course, and the full version became
operational in Fall 2012, entirely replacing the old course.
The new course continues to require Critical Analysis essays for visual art and performing
art (music.) In order to improve student learning, the following changes were instituted,
along with refinements for future semesters:
(1) In the new course, students are prepared more systematically for the task of analysis
with examples, exercises, and readings. Students now submit journal entries in addition to
their other written work. Journal entries are a low-stakes way to give students practice with
the different components of analysis before they have to write papers.
(2) The new course conceptualizes the steps of critical analysis more explicitly. The
hermeneutic process is broken down into five distinct steps or information-gathering stages:
Personal (affective) response; Description; Formal Analysis; Historical / cultural
contextualization; Interpretation. The last step, Interpretation, is a synthesis that takes into
account the other four steps or categories of information that are normally used to
understand or interpret a given work. This structure accords well with the way critical
Critical Thinking Skills Assessment (General Education)
5
thinking is normally defined since it is based on the collection of evidence, the examination
and analysis of evidence, and the formulation of an informed, critical hypothesis and the
testing of that hypothesis against the known facts.
(3) New assignments and rubrics have been written to guide students through the process
and reduce the level of contamination of evidence from mechanical problems such as failing
to understand the assignment or picking the wrong kind of work to analyze. The new
rubrics provide a fine-grained assessment of outcomes that includes assessment of critical
thinking skills. In other words, critical thinking is now integrated into the grading rubric
rather than being assessed separately as in the past. The more fine-grained and explicit
rubrics should help to improve assessment reliability across the whole course and eliminate
the need for a separate sampling and assessment process for critical thinking.
(4) Critical thinking skills are now given more explicit emphasis in assignments, rubrics
and feedback comments. Faculty will be encouraged to take all opportunities to comment
on critical thinking and point out examples where a lack of critical thinking led to unwanted
results.
These changes were continued in Spring 2013, with refinements and additional changes:
The critical analysis papers now mandate use of downloadable templates that contain
section headings for each part of the paper. The paper instructions are keyed to each section
of the template, guiding students through what is expected in each part of the paper. This
formal framework directs students into more focused writing than did the previous
semesters’ freeform essay assignment. The structure should define the papers more
effectively, concentrating the analysis. There is far less room for filler or vague generalities
(and it is more evident to graders). Along with creating more concrete areas on which to
focus, leading “questions to consider” in the instructions should help foment more critical
analysis in which information is gathered and synthesized, and inferences drawn.
Critical Analysis Essay II (Paper 4 in Fall 12) has been changed to Paper 3, moving it
earlier in the course schedule and alleviating the end-of-the-semester time constraints that
may have affected this paper’s scores in previous semesters. As well, the assignment has
been changed from the dual emphasis of music analysis and the classical music concert
experience to analysis of one of a selection of recorded music located in the course site.
This change should positively affect essay scores in several ways. Separating music analysis
from first-time concert attendance should relieve the problems attendant to combining two
new experiences—technical music analysis and classical music concert attendance—and
allow students to focus better on the single task of analyzing the music. Students’ response
to the classical music concert experience is now covered in the fourth paper of the semester.
As well, the new performing arts critical analysis essay (Paper 3) instructions emphasize
practice in listening to, describing, and analyzing music. Because the paper is now due
earlier, well before the performing arts section of the course has been completed, students
are encouraged to use their own words to describe and analyze what they are hearing,
further focusing description and analysis by relieving the pressure of combining first-time
music analysis with mastery of technical terminology. Students also are warned specifically
against using any outside sources, a restriction that removes another element that tended to
diffuse analysis in previous iterations of the paper.
Describe how data and recommendations were shared with faculty. (Attach a copy of minutes to
this document if applicable).
Information from this report has been shared with course faculty and preceptors by the
HUM 2510 assessment team and course coordinator. The process for revising the course is
ongoing and has been inclusive and transparent.
Critical Thinking Skills Assessment (General Education)
6
APPENDIX A – FGCU General Education Competencies
Competency 1: Quantitative Reasoning
 Solve mathematical problems;
 Analyze and interpret quantitative data;
 Summarize data into graphic and tabular formats;
 Make valid inferences from data;
 Distinguish between valid and invalid quantitative analysis and reasoning.

Competency 2: Written Communication
 Employ the conventions of standard written English;
 Select a topic, and develop it for a specific audience and purpose, with respect for diverse
perspectives;
 Organize and present relevant content with coherence, clarity, and unity;
 Develop research skills including the ability to collect, analyze, synthesize, and accurately
present and document information;
 Use appropriate language to convey meaning effectively;
 Apply critical reading skills.

Competency 3: Critical Thinking
 Define an issue or problem using appropriate terminology;
 Select, organize, and evaluate information;
 Identify and analyze assumptions made by oneself and others;
 Synthesize information, and draw reasoned inferences;
 Develop and clearly state a position, taking into account all relevant points of view;
 Formulate an informed and logical conclusion, and test it for viability.
History: Approved by General Education Council on 11/2/05; revised and approved on 4/12/11
Critical Thinking Skills Assessment (General Education)
7
APPENDIX B – AAC&U Critical Thinking VALUE Rubric
CRITICAL THINKING VALUE RUBRIC
for more information, please contact value@aacu.org
The VALUE rubrics were developed by teams of faculty experts representing colleges and universities across the United States through a process
that examined many existing campus rubrics and related documents for each learning outcome and incorporated additional feedback from faculty. The
rubrics articulate fundamental criteria for each learning outcome, with performance descriptors demonstrating progressively more sophisticated levels of
attainment. The rubrics are intended for institutional-level use in evaluating and discussing student learning, not for grading. The core expectations
articulated in all 15 of the VALUE rubrics can and should be translated into the language of individual campuses, disciplines, and even courses. The utility
of the VALUE rubrics is to position learning at all undergraduate levels within a basic framework of expectations such that evidence of learning can by
shared nationally through a common dialog and understanding of student success.
Definition
Critical thinking is a habit of mind characterized by the comprehensive exploration of issues, ideas, artifacts, and events before accepting or
formulating an opinion or conclusion.
Framing Language
This rubric is designed to be transdisciplinary, reflecting the recognition that success in all disciplines requires habits of inquiry and analysis that
share common attributes. Further, research suggests that successful critical thinkers from all disciplines increasingly need to be able to apply those habits
in various and changing situations encountered in all walks of life.
This rubric is designed for use with many different types of assignments and the suggestions here are not an exhaustive list of possibilities. Critical
thinking can be demonstrated in assignments that require students to complete analyses of text, data, or issues. Assignments that cut across presentation
mode might be especially useful in some fields. If insight into the process components of critical thinking (e.g., how information sources were evaluated
regardless of whether they were included in the product) is important, assignments focused on student reflection might be especially illuminating.
•
•
•
•
•
Glossary
The definitions that follow were developed to clarify terms and concepts used in this rubric only.
Ambiguity: Information that may be interpreted in more than one way.
Assumptions: Ideas, conditions, or beliefs (often implicit or unstated) that are "taken for granted or accepted as true without proof." (quoted from
www.dictionary.reference.com/browse/assumptions)
Context: The historical, ethical. political, cultural, environmental, or circumstantial settings or conditions that influence and complicate the
consideration of any issues, ideas, artifacts, and events.
Literal meaning: Interpretation of information exactly as stated. For example, "she was green with envy" would be interpreted to mean that her
skin was green.
Metaphor: Information that is (intended to be) interpreted in a non-literal way. For example, "she was green with envy" is intended to convey an
intensity of emotion, not a skin color.
Critical Thinking Skills Assessment (General Education)
8
CRITICAL THINKING VALUE RUBRIC
for more information, please contact value@aacu.org
Definition
Critical thinking is a habit of mind characterized by the comprehensive exploration of issues, ideas, artifacts, and events before accepting or formulating an opinion or
conclusion.
Evaluators are encouraged to assign a zero to any work sample or collection of work that does not meet benchmark (cell one) level performance.
Capstone
Milestones
Benchmark
4
3
Explanation of issues
Issue/problem to be
considered critically is
stated clearly and described
comprehensively,
delivering all relevant
information necessary for
full understanding.
Issue/problem to be
considered critically is stated,
described, and clarified so that
understanding is not seriously
impeded by omissions.
Issue/problem to be
considered critically is stated
but description leaves some
terms undefined, ambiguities
unexplored, boundaries
undetermined, and/or
backgrounds unknown.
Issue/problem to be considered
critically is stated without clarification
or description.
Evidence
Selecting and using information to
investigate a point of view or
conclusion
Information is taken from
source(s) with enough
interpretation/evaluation
to develop a
comprehensive analysis or
synthesis.
Viewpoints of experts are
questioned thoroughly.
Information is taken from
source(s) with enough
interpretation/evaluation to
develop a coherent analysis or
synthesis.
Viewpoints of experts are
subject to questioning.
Information is taken from
source(s) with some
interpretation/evaluation, but
not enough to develop a
coherent analysis or synthesis.
Viewpoints of experts are
taken as mostly fact, with little
questioning.
Information is taken from source(s)
without any interpretation/evaluation.
Viewpoints of experts are taken as
fact, without question.
Influence of context and
assumptions
Thoroughly (systematically
and methodically) analyzes
own and others'
assumptions and carefully
evaluates the relevance of
contexts when presenting a
position.
Identifies own and others'
assumptions and several
relevant contexts when
presenting a position.
Questions some assumptions.
Identifies several relevant
contexts when presenting a
position. May be more aware
of others' assumptions than
one's own (or vice versa).
Shows an emerging awareness of
present assumptions (sometimes labels
assertions as assumptions). Begins to
identify some contexts when
presenting a position.
Critical Thinking Skills Assessment (General Education)
2
9
1
Student's position
(perspective,
thesis/hypothesis)
Specific position
(perspective,
thesis/hypothesis) is
imaginative, taking into
account the complexities
of an issue.
Limits of position
(perspective,
thesis/hypothesis) are
acknowledged.
Others' points of view are
synthesized within position
(perspective,
thesis/hypothesis).
Specific position (perspective,
thesis/hypothesis) takes into
account the complexities of an
issue.
Others' points of view are
acknowledged within position
(perspective,
thesis/hypothesis).
Specific position (perspective, Specific position (perspective,
thesis/hypothesis)
thesis/hypothesis) is stated, but is
acknowledges different sides of simplistic and obvious.
an issue.
Conclusions and related
outcomes (implications and
consequences)
Conclusions and related
outcomes (consequences
and implications) are
logical and reflect student’s
informed evaluation and
ability to place evidence
and perspectives discussed
in priority order.
Conclusion is logically tied to a
range of information, including
opposing viewpoints; related
outcomes (consequences and
implications) are identified
clearly.
Conclusion is logically tied to
information (because
information is chosen to fit the
desired conclusion); some
related outcomes
(consequences and
implications) are identified
clearly.
Critical Thinking Skills Assessment (General Education)
10
Conclusion is inconsistently tied to
some of the information discussed;
related outcomes (consequences and
implications) are oversimplified.
APPENDIX C – Critical Thinking Skills Comments for Critical Analysis Essays

Very strong use of critical thinking skills! Accomplished and creative use of critical thinking skills, including a high level of defining key concepts,
organizing and synthesizing information, identifying assumptions and implications, and drawing reasoned inferences. Great work!

Strong use of critical thinking skills! You define key concepts and identify and evaluate underlying relationships effectively. You identify assumptions
and implications, synthesize information well, and draw reasoned inferences. Nice job!

Good use of critical thinking skills. You identify and evaluate some key concepts, assumptions and implications and underlying relationships. You
synthesize some information and occasionally draw appropriate inferences, all of which is a good start. Build on it to strengthen your writing even more.

Your critical thinking skills need strengthening. Critical thinking requires that you consider all available evidence; identify and evaluate underlying
assumptions, implications and relationships, synthesize information well, and draw appropriate inferences. Some or all of these steps were missing in
your paper. Often, just applying simple logic and common sense will help you evaluate evidence and synthesize more critically. Working on these skills
should enable you to produce a stronger essay.
Critical Thinking Skills Assessment (General Education)
11
APPENDIX D – Assessment Data for HUM 2510, Fall 2012
Paper
4
FINAL
Paper 2 Fall 12 score
33
33
3
33
3
33
67
67
67
4
67
4
67
67
67
67
3
33
3
33
33
67
33
33
4
67
4
67
B-5
33
33
33
33
5
100
4
67
67
B-6
100
100
100
100
5
100
5
100
67
B-7
67
33
33
33
4
67
4
67
100
100
B-8
100
100
100
100
5
100
5
100
67
67
67
B-9
33
67
33
33
4
67
4
67
0
33
33
33
B-10
33
33
33
33
3
33
4
67
100
67
67
67
B-11
100
100
100
100
5
100
5
100
33
100
100
100
B-12
100
67
67
67
4
67
4
67
A-13
33
33
33
33
B-13
33
33
33
33
4
67
4
67
A-14
33
100
100
100
B-14
67
67
67
67
5
100
4
67
A-15
33
33
33
33
B-15
67
67
67
67
4
67
5
100
A-16
33
100
33
33
B-16
33
67
33
33
3
33
3
33
A-17
33
100
33
33
B-17
33
33
33
33
5
100
4
67
A-18
33
67
33
33
B-18
67
33
33
33
3
33
4
67
A-19
67
100
67
67
B-19
33
33
33
33
4
67
4
67
A-20
100
100
100
100
B-20
67
67
67
67
5
100
5
100
A-21
33
33
33
33
B-21
33
67
33
33
5
100
5
100
A-22
67
67
67
67
B-22
33
33
33
33
4
67
4
67
A-23
67
67
67
67
B-23
0
0
0
0
4
67
3
33
A-24
0
0
0
0
B-24
100
100
100
100
4
67
4
67
A-25
67
67
67
67
B-25
67
67
67
67
4
67
4
67
A-26
67
33
67
67
B-26
0
33
0
0
3
33
3
33
A-27
100
67
67
67
B-27
67
67
67
67
4
67
5
100
Scorer
1
Scorer
2
Scorer
1
Scorer
2
A-1
67
67
67
67
B-1
33
33
A-2
67
33
33
A-3
33
33
33
33
B-2
67
33
B-3
67
A-4
67
67
67
67
B-4
A-5
33
33
33
33
A-6
A-7
100
67
67
100
67
67
A-8
100
100
A-9
67
A-10
A-11
A-12
Paper 2
Paper 2
FINAL
Scorer 3
Paper
4
Critical Thinking Skills Assessment (General Education)
Scorer 3
12
CT Skills
Rubric
Equivalent
CT Skills
Rubric
Equivalent
Paper 4 Fall 12
score
A-28
33
33
33
33
B-28
33
33
33
33
3
33
3
33
A-29
67
33
33
33
B-29
67
67
67
67
5
100
4
67
A-30
67
67
67
67
B-30
67
67
67
67
4
67
5
100
A-31
67
67
67
67
B-31
67
67
67
67
5
100
5
100
A-32
33
33
33
33
B-32
0
0
0
0
4
67
3
33
A-33
67
33
33
33
B-33
33
67
33
33
4
67
4
67
A-34
67
67
67
67
B-34
67
67
67
67
3
33
5
100
A-35
67
100
67
67
B-35
67
67
67
67
3
33
5
100
A-36
67
100
67
67
B-36
67
100
67
67
4
67
5
100
A-37
33
100
33
33
B-37
67
67
67
67
4
67
4
67
A-38
67
33
33
33
B-38
33
67
67
67
5
100
4
67
A-39
67
33
33
33
B-39
33
33
33
33
3
33
3
33
A-40
33
33
33
33
B-40
33
67
33
33
3
33
3
33
A-41
33
33
33
33
B-41
67
100
67
67
4
67
4
67
A-42
33
33
33
33
B-42
33
33
33
33
4
67
4
67
A-43
67
100
67
67
B-43
100
100
100
100
3
33
5
100
A-44
67
67
67
67
B-44
33
33
33
33
5
100
4
67
A-45
100
100
100
100
B-45
100
67
67
67
4
67
4
67
A-46
33
33
33
33
B-46
0
0
0
0
3
33
3
33
A-47
67
67
67
67
B-47
33
33
33
33
4
67
4
67
A-48
100
33
33
33
B-48
33
67
33
33
5
100
5
100
A-49
67
67
67
67
B-49
33
33
33
33
5
100
5
100
A-50
33
67
33
33
B-50
33
67
33
33
3
33
4
67
A-51
67
33
67
67
B-51
33
67
33
33
4
67
5
100
A-52
100
67
67
67
B-52
67
67
67
67
4
67
4
67
A-53
100
100
100
100
B-53
33
33
33
33
5
100
4
67
A-54
67
67
67
67
B-54
33
33
33
33
4
67
4
67
A-55
67
67
67
67
B-55
67
67
67
67
5
100
4
67
A-56
67
67
67
67
B-56
33
33
33
33
4
67
3
33
A-57
67
67
67
67
B-57
67
67
67
67
5
100
5
100
Critical Thinking Skills Assessment (General Education)
13
A-58
67
67
67
67
B-58
33
33
33
33
4
67
4
67
A-59
67
67
67
67
B-59
67
67
67
67
4
67
4
67
A-60
100
67
67
67
Paper 2
Average:
56.15
Paper 2
Consensus:
57%
*Consensus in terms of all three
scorers
B-60
33
33
33
Paper 4
Average:
Paper 4
Consensus:
33
4
67
5
100
48.85
Paper 2 Average
68.42
Paper 4 Average
71.7%
Paper 2 Assessment & Fall 12 Consensus: 50%
Paper 4 Assessment & Fall 12 Consensus: 36.7%
*Consensus based on Final Score and Fall 12 scores.
Critical Thinking Skills Assessment (General Education)
14
70.67
Download