PROGRAM ASSESSMENT FORM
LEARNING OUTCOMES
FALL 2013 AND SPRING 2014
Name of Program: General Education (Competency in Critical Thinking)
Name of Program Leader: Kris De Welde (Lisa Courcier)
Date: February 19, 2014
LEARNING OUTCOME(S)
This assessment focused on General Education Competency 3: Critical Thinking, within the
required General Education Humanities course HUM 2510 – Understanding Visual and
Performing Arts. Student achievement criteria for the General Education Competency in
Critical Thinking are listed below.
Competency 3: Critical Thinking
 Define an issue or problem using appropriate terminology;
 Select, organize, and evaluate information;
 Identify and analyze assumptions made by oneself and others;
 Synthesize information, and draw reasoned inferences;
 Develop and clearly state a position, taking into account all relevant points of view;
 Formulate an informed and logical conclusion, and test it for viability.
HUM 2510 is a good subject for this assessment as one of its stated Learning Goals is to
“develop critical thinking skills for analyzing individual works of visual and performing art.”
For a complete list of the FGCU General Education Competencies, please see Appendix A.
ASSESSMENT PLAN
Name and brief description of the instruments/rubrics. (Attach a copy of the instrument to this
document if appropriate).
Only direct assessment of student learning of critical thinking skills was completed for this
assessment, having completed both direct and indirect in the past.
Direct Assessment – The HUM 2510 assessment team utilized a critical thinking skills
scoring rubric, adapted from the Critical Thinking VALUE (Validated Assessment of
Undergraduate Education) rubric provided by the Association of American Colleges and
Universities (Appendix B). The rubric consisted of 4 possible levels: Lower Range (Poor),
Benchmark (Good), Milestone 2 (Strong), and Milestone 3 (Very Strong—reserved only for
highest essays). The criteria were taken directly from the essay grading rubric currently
used in HUM 2510 and noted in the course’s essay assignment directions. The rubric was
based on a 100-point scale to accommodate the ANGEL calculation system (our previous
Learning Management System). For continuity this point system was retained for the Fall
2013 scoring, although the papers were no longer scored in ANGEL.

Lower Range (0 points): Fails to identify or evaluate key concepts and/or
underlying relationships and/or assumptions and implications; synthesizes
information poorly; draws inappropriate or no inferences.
Critical Thinking Skills Assessment (General Education)
1

Benchmark 1: (33 points): Identifies and evaluates some key concepts, assumptions
and implications and underlying relationships; synthesizes some information;
occasionally draws appropriate inferences.

Milestone 2 (67 points): Defines key concepts. Identifies and evaluates underlying
relationships effectively; identifies assumptions and implications; synthesizes
information well; draws reasoned inferences.

Milestone 3 (100 points): Accomplished and creative use of critical thinking skills,
including a high level of defining key concepts, organizing and synthesizing
information, identifying assumptions and implications, and drawing reasoned
inferences.
All students received instructor feedback for their essays, which included specific feedback
for critical thinking skills (Appendix C). The scoring team used the rubric to score 60
randomly selected essays from Critical Analysis Essay I). The process was then repeated
with the same sample of students for the Critical Analysis Essay II assignment, to determine
if the feedback had helped to improve student achievement in critical thinking skills. Once
all the essays were scored, the data was downloaded for collation and dissemination to the
HUM 2510 faculty for review.
Brief description of what is to be assessed/measured.
Direct Assessment – A random sampling of 60 student Critical Thinking essays in HUM
2510 Understanding Visual and Performing Arts was gathered and assessed using the HUM
2510 Critical Thinking Rubric. For these essays, students are expected to analyze a work of
visual art (essay I) and performing art (essay II) using the content knowledge that they have
learned in the course. The purpose of the essays is to have students apply the content
knowledge, demonstrating their ability to think critically about works of art.
Date(s) of administration.
The direct assessment was administered within the course during the Fall 2013 semester.
Sample (number of students, % of class, level, demographics).
Direct Assessment – After the Critical Analysis Essay I assignments were graded normally,
a randomly-generated sample of 60 student essays - approximately 3.69% of the 1625
students enrolled in the course during the Fall 2013 semester - was culled and scored
according to the critical thinking skills rubric. Each sample essay was scored by three
different scorers. The process was repeated for the same students for Critical Analysis
Essay II.
DATA ANALYSIS
Direct Assessment
The first goal of the assessment process was to determine if student scores improved
between Critical Analysis Essay I and Critical Analysis Essay II. Students received
feedback on their writing and critical thinking after they completed the first essay.
The second goal was to compare scores from this year’s assessment (Fall 2013) with those
from last year (Fall 2012).
Fall 2013 results:
Critical Thinking Skills Assessment (General Education)
2
The following table summarizes the scores for the two essays during Fall 2013:
Critical Analysis
Essay I
Score
0
1 (33)
2 (67)
3 (100)
Critical Analysis
Essay II
Score
0
1 (33)
2 (67)
3 (100)
N = 60 essays
Number
3
33
18
6
N = 60 essays
Percentage
5%
55%
30%
10%
Number
2
29
19
10
Percentage
3.3%
48.3%
31.7%
16.7%
For complete assessment data from Fall 2013, please see Appendix D.
Students were expected to score primarily at a Benchmark 1 with many students achieving
at Milestone 2. Milestone 3 is high performing and would generally be above the level of
student achievement for a General Education class. More importantly, we tracked student
scores from Essay I to Essay II, expecting to see an improvement in overall scores.
For Essay I, 95% of students scored at Benchmark 1 or higher, with 10% scoring at the
highest level. On Essay II, 96.7% of students scored at Benchmark 1 or higher, with 16.7%
scoring at the highest level.
A comparison of student scores from Fall 2012 to Fall 2013, does show improvement in the
overall scores:
Critical
Analysis
Essay I
Score
0
1 (33)
2 (67)
3 (100)
Critical
Analysis
Essay II
Score
0
1 (33)
2 (67)
3 (100)
Critical
Analysis
Essay Scores
Combined
Score
0
Fall 2013
Fall 2012
Number
3
33
18
6
Number
1
23
30
6
Number
2
29
19
10
Fall 2013
Number
4
29
22
5
Fall 2012
Number
5
Number
5
Critical Thinking Skills Assessment (General Education)
Difference
Fall 12 and Fall
13
+2
+10
-12
even
-2
even
-3
+5
even
3
1 (33)
2 (67)
3 (100)
62
37
16
52
52
11
+10
-15
+5
On the whole, the number of students achieving at the bottom end of the scale for both essays
(combined) with a score of 0 remained the same. The number of students with a score of 1
increased from 52 to 62, redistributing scores to a slightly lower range. The number of
students with a score of 2 also decreased from 52 to 37. The total (combined) number of
students achieving at the highest end of the scale, score of 3, however, increased from 11 to
16.
Inter-rater reliability
In addition to analyzing direct assessment scores, we also analyzed inter-rater reliability in
the scoring of the essays. The goal is for 85% of essays receive the same score from at least
two of the three scorers.
The following table summarizes the matching scores for Critical Analysis Essay I during
the Fall 2013 assessment:
Critical Analysis
Essay I
Matching Scores
0
2
3
N = 60 essays
Number
0
39
21
Percentage
0%
65%
35%
For the Fall 2013 assessment, the goal for inter-rater reliability was met in Critical Analysis
Essay I, with 100% of essays receiving matching scores from at least two of the three
scorers and 35% receiving the same score from all three scorers.
The following table summarizes the matching scores for Critical Analysis Essay II during
the Fall 13 assessment:
Critical Analysis
Essay II
Matching Scores
0
2
3
N = 60 essays
Number
0
36
24
Percentage
0%
60%
40%
For the Fall 2013 assessment, the goal for inter-rater reliability was met in Critical Analysis
Essay II, with 100% of essays receiving matching scores from at least two of the three
scorers and 40% receiving the same score from all three scorers.
USE OF ASSESSMENT FINDINGS TO IMPROVE STUDENT LEARNING
Recommended changes based on assessment findings. Include plan for sending substantive
changes to department/college/university curriculum teams.
HUM 2510 has been under revision for the past four years. The new version of the course
was piloted in Spring 2012 concurrently with the old course, and the full version became
operational in Fall 2012, entirely replacing the old course.
Critical Thinking Skills Assessment (General Education)
4
The new course continues to require Critical Analysis essays for visual art and performing
art (music). In order to improve student learning in the areas our assessment identified as
important to revise, the following changes were instituted in Spring 2012:
(1) In the new course, students are prepared more systematically for the task of analysis
with examples, exercises, and readings. Students now submit journal entries in addition to
their other written work. Journal entries are a “low-stakes” way to give students practice
with the different components of analysis before they have to write formal papers.
(2) The new course conceptualizes the steps of critical analysis more explicitly. The
hermeneutic process is broken down into five distinct steps or information-gathering stages:
Personal (Affective) Response; Description; Formal Analysis; Historical / Cultural
Contextualization; Interpretation. The last step, Interpretation, is a synthesis that takes into
account the other four steps or categories of information that are normally used to
understand or interpret a given work. This structure accords well with the way critical
thinking is normally defined since it is based on the collection of evidence, the examination
and analysis of evidence, and the formulation of an informed, critical hypothesis and the
testing of that hypothesis against the known facts.
(3) New assignments and rubrics have been written to guide students through the process
and reduce the level of contamination of evidence from mechanical problems such as failing
to understand the assignment or picking the wrong kind of work to analyze. The new
rubrics provide a fine-grained assessment of outcomes that includes assessment of critical
thinking skills. In other words, critical thinking is now integrated into the grading rubric
rather than being assessed separately as in previous years. The more fine-grained and
explicit rubrics should help to improve assessment reliability across the whole course and
eliminate the need for a separate sampling and assessment process for critical thinking.
(4) Critical thinking skills are now given more explicit emphasis in assignments, rubrics
and feedback comments. Faculty will be encouraged to take all opportunities to comment
on critical thinking and point out examples where a lack of critical thinking led to unwanted
results.
It is possible that these changes have contributed to increases in the higher end of the scoring
(Milestone 3)
These changes were continued in Spring 2013, with the following refinements and additional
changes as per interpretations made from the previous assessment:
(1) The critical analysis papers now mandate use of downloadable templates that contain
section headings for each part of the paper. The paper instructions are keyed to each section
of the template, guiding students through what is expected in each part of the paper. This
formal framework directs students into more focused writing than did the previous
semesters’ freeform essay assignment. The structure defines the papers more effectively,
concentrating the analysis. There is far less room for “filler” or vague generalities (and
these are more evident to graders). Along with creating more concrete areas on which to
focus, leading “questions to consider” in the instructions help foment more critical analysis
in which information is gathered and synthesized, and inferences drawn.
Critical Analysis Essay II has been moved earlier in the course schedule thereby alleviating
the end-of-the-semester time constraints that may have affected this paper’s scores in
previous semesters. As well, the assignment has been changed from the dual emphasis of
music analysis and the classical music concert experience to analysis of one of a selection
of recorded music located in the course site. This change should positively affect essay
scores in several ways. Separating music analysis from first-time concert attendance should
Critical Thinking Skills Assessment (General Education)
5
relieve the problems attendant to combining two new experiences—technical music
analysis and classical music concert attendance—and allow students to focus better on the
single task of analyzing the music. Students’ response to the classical music concert
experience is now covered in the fourth paper of the semester.
As well, the new performing arts critical analysis essay instructions emphasize practice in
listening to, describing, and analyzing music. Because the paper is now due earlier, well
before the performing arts section of the course has been completed, students are
encouraged to use their own words to describe and analyze what they are hearing, further
focusing description and analysis by relieving the pressure of combining first-time music
analysis with mastery of technical terminology. Students also are warned specifically
against using any outside sources, a restriction that removes another element that tended to
weaken analysis in previous iterations of the paper.
These changes are intended to address the most recent redistribution of scores to the lower
range by helping students focus on 1) areas of emphasis in each paper by providing a template
structure so that all areas are attended to, and 2) the technical analysis of music itself that is
separate from other topics in the course (e.g., attending a live concert, music terminology).”
Describe how data and recommendations were shared with faculty. (Attach a copy of minutes to
this document if applicable).
Information from this report has been shared with course faculty and preceptors by the
HUM 2510 assessment team and course coordinator. The process for revising the course is
ongoing and has been inclusive and transparent.
Critical Thinking Skills Assessment (General Education)
6
APPENDIX A – FGCU General Education Competencies
Competency 1: Quantitative Reasoning
 Solve mathematical problems;
 Analyze and interpret quantitative data;
 Summarize data into graphic and tabular formats;
 Make valid inferences from data;
 Distinguish between valid and invalid quantitative analysis and reasoning.

Competency 2: Written Communication
 Employ the conventions of standard written English;
 Select a topic, and develop it for a specific audience and purpose, with respect for diverse
perspectives;
 Organize and present relevant content with coherence, clarity, and unity;
 Develop research skills including the ability to collect, analyze, synthesize, and accurately
present and document information;
 Use appropriate language to convey meaning effectively;
 Apply critical reading skills.

Competency 3: Critical Thinking
 Define an issue or problem using appropriate terminology;
 Select, organize, and evaluate information;
 Identify and analyze assumptions made by oneself and others;
 Synthesize information, and draw reasoned inferences;
 Develop and clearly state a position, taking into account all relevant points of view;
 Formulate an informed and logical conclusion, and test it for viability.
History: Approved by General Education Council on 11/2/05; revised and approved on 4/12/11
Critical Thinking Skills Assessment (General Education)
7
APPENDIX B – AAC&U Critical Thinking VALUE Rubric
CRITICAL THINKING VALUE RUBRIC
for more information, please contact value@aacu.org
The VALUE rubrics were developed by teams of faculty experts representing colleges and universities across the United States through a process
that examined many existing campus rubrics and related documents for each learning outcome and incorporated additional feedback from faculty. The
rubrics articulate fundamental criteria for each learning outcome, with performance descriptors demonstrating progressively more sophisticated levels of
attainment. The rubrics are intended for institutional-level use in evaluating and discussing student learning, not for grading. The core expectations
articulated in all 15 of the VALUE rubrics can and should be translated into the language of individual campuses, disciplines, and even courses. The utility
of the VALUE rubrics is to position learning at all undergraduate levels within a basic framework of expectations such that evidence of learning can by
shared nationally through a common dialog and understanding of student success.
Definition
Critical thinking is a habit of mind characterized by the comprehensive exploration of issues, ideas, artifacts, and events before accepting or
formulating an opinion or conclusion.
Framing Language
This rubric is designed to be transdisciplinary, reflecting the recognition that success in all disciplines requires habits of inquiry and analysis that
share common attributes. Further, research suggests that successful critical thinkers from all disciplines increasingly need to be able to apply those habits
in various and changing situations encountered in all walks of life.
This rubric is designed for use with many different types of assignments and the suggestions here are not an exhaustive list of possibilities. Critical
thinking can be demonstrated in assignments that require students to complete analyses of text, data, or issues. Assignments that cut across presentation
mode might be especially useful in some fields. If insight into the process components of critical thinking (e.g., how information sources were evaluated
regardless of whether they were included in the product) is important, assignments focused on student reflection might be especially illuminating.
•
•
•
•
•
Glossary
The definitions that follow were developed to clarify terms and concepts used in this rubric only.
Ambiguity: Information that may be interpreted in more than one way.
Assumptions: Ideas, conditions, or beliefs (often implicit or unstated) that are "taken for granted or accepted as true without proof." (quoted from
www.dictionary.reference.com/browse/assumptions)
Context: The historical, ethical. political, cultural, environmental, or circumstantial settings or conditions that influence and complicate the
consideration of any issues, ideas, artifacts, and events.
Literal meaning: Interpretation of information exactly as stated. For example, "she was green with envy" would be interpreted to mean that her
skin was green.
Metaphor: Information that is (intended to be) interpreted in a non-literal way. For example, "she was green with envy" is intended to convey an
intensity of emotion, not a skin color.
Critical Thinking Skills Assessment (General Education)
8
CRITICAL THINKING VALUE RUBRIC
for more information, please contact value@aacu.org
Definition
Critical thinking is a habit of mind characterized by the comprehensive exploration of issues, ideas, artifacts, and events before accepting or formulating an opinion or
conclusion.
Evaluators are encouraged to assign a zero to any work sample or collection of work that does not meet benchmark (cell one) level performance.
Capstone
Milestones
Benchmark
4
3
Explanation of issues
Issue/problem to be
considered critically is
stated clearly and described
comprehensively,
delivering all relevant
information necessary for
full understanding.
Issue/problem to be
considered critically is stated,
described, and clarified so that
understanding is not seriously
impeded by omissions.
Issue/problem to be
considered critically is stated
but description leaves some
terms undefined, ambiguities
unexplored, boundaries
undetermined, and/or
backgrounds unknown.
Issue/problem to be considered
critically is stated without clarification
or description.
Evidence
Selecting and using information to
investigate a point of view or
conclusion
Information is taken from
source(s) with enough
interpretation/evaluation
to develop a
comprehensive analysis or
synthesis.
Viewpoints of experts are
questioned thoroughly.
Information is taken from
source(s) with enough
interpretation/evaluation to
develop a coherent analysis or
synthesis.
Viewpoints of experts are
subject to questioning.
Information is taken from
source(s) with some
interpretation/evaluation, but
not enough to develop a
coherent analysis or synthesis.
Viewpoints of experts are
taken as mostly fact, with little
questioning.
Information is taken from source(s)
without any interpretation/evaluation.
Viewpoints of experts are taken as
fact, without question.
Influence of context and
assumptions
Thoroughly (systematically
and methodically) analyzes
own and others'
assumptions and carefully
evaluates the relevance of
contexts when presenting a
position.
Identifies own and others'
assumptions and several
relevant contexts when
presenting a position.
Questions some assumptions.
Identifies several relevant
contexts when presenting a
position. May be more aware
of others' assumptions than
one's own (or vice versa).
Shows an emerging awareness of
present assumptions (sometimes labels
assertions as assumptions). Begins to
identify some contexts when
presenting a position.
Critical Thinking Skills Assessment (General Education)
2
9
1
Student's position
(perspective,
thesis/hypothesis)
Specific position
(perspective,
thesis/hypothesis) is
imaginative, taking into
account the complexities
of an issue.
Limits of position
(perspective,
thesis/hypothesis) are
acknowledged.
Others' points of view are
synthesized within position
(perspective,
thesis/hypothesis).
Specific position (perspective,
thesis/hypothesis) takes into
account the complexities of an
issue.
Others' points of view are
acknowledged within position
(perspective,
thesis/hypothesis).
Specific position (perspective, Specific position (perspective,
thesis/hypothesis)
thesis/hypothesis) is stated, but is
acknowledges different sides of simplistic and obvious.
an issue.
Conclusions and related
outcomes (implications and
consequences)
Conclusions and related
outcomes (consequences
and implications) are
logical and reflect student’s
informed evaluation and
ability to place evidence
and perspectives discussed
in priority order.
Conclusion is logically tied to a
range of information, including
opposing viewpoints; related
outcomes (consequences and
implications) are identified
clearly.
Conclusion is logically tied to
information (because
information is chosen to fit the
desired conclusion); some
related outcomes
(consequences and
implications) are identified
clearly.
Critical Thinking Skills Assessment (General Education)
10
Conclusion is inconsistently tied to
some of the information discussed;
related outcomes (consequences and
implications) are oversimplified.
APPENDIX C – Critical Thinking Skills Comments for Critical Analysis Essays

Very strong use of critical thinking skills! Accomplished and creative use of critical thinking skills, including a high level of defining key concepts,
organizing and synthesizing information, identifying assumptions and implications, and drawing reasoned inferences. Great work!

Strong use of critical thinking skills! You define key concepts and identify and evaluate underlying relationships effectively. You identify assumptions
and implications, synthesize information well, and draw reasoned inferences. Nice job!

Good use of critical thinking skills. You identify and evaluate some key concepts, assumptions and implications and underlying relationships. You
synthesize some information and occasionally draw appropriate inferences, all of which is a good start. Build on it to strengthen your writing even more.

Your critical thinking skills need strengthening. Critical thinking requires that you consider all available evidence; identify and evaluate underlying
assumptions, implications and relationships, synthesize information well, and draw appropriate inferences. Some or all of these steps were missing in
your paper. Often, just applying simple logic and common sense will help you evaluate evidence and synthesize more critically. Working on these skills
should enable you to produce a stronger essay.
Critical Thinking Skills Assessment (General Education)
11
APPENDIX D – Assessment Data for HUM 2510, Fall 2013
Essay
I
A1
A2
A3
A4
A5
A6
A7
A8
A9
A10
A11
A12
A13
A14
A15
A16
A17
A18
A19
A20
A21
A22
A23
A24
A25
A26
A27
A28
A29
A30
A31
A32
A33
A34
A35
Score (100, 67, 33, 0)
Essay II
Scorer 1
Scorer 2
Scorer 3
33
33
0
100
67
67
100
33
67
33
100
67
67
33
33
67
33
33
33
33
67
67
67
33
67
33
67
67
33
100
33
67
67
0
33
0
33
33
67
67
33
100
33
33
0
67
33
67
67
33
33
33
0
33
33
67
100
33
67
100
0
67
100
0
67
33
67
33
33
0
33
33
33
67
67
33
100
33
33
33
100
67
67
33
33
67
33
0
33
33
67
67
33
67
100
33
67
100
33
67
33
67
67
33
33
Final
Score
33
33
33
67
67
33
100
33
33
33
100
67
67
33
33
67
33
0
33
33
67
67
33
67
100
33
67
100
33
67
33
67
33
33
33
B1
B2
B3
B4
B5
B6
B7
B8
B9
B10
B11
B12
B13
B14
B15
B16
B17
B18
B19
B20
B21
B22
B23
B24
B25
B26
B27
B28
B29
B30
B31
B32
B33
B34
B35
Original Fall 13 Scores
Equivalencies Chart: Very Strong, Strong, Good, Lower Range = In Assessment Rubric: 100, 67,
33, 0. In Fall 13 Essay I: 10, 8, 6, 0. In Fall 13 Essay II: 7, 6, 5, 0)
Score (100, 67, 33, 0)
Scorer
1
Scorer
2
0
33
33
100
33
0
67
67
33
33
100
67
67
33
33
33
33
33
33
33
67
33
67
67
100
33
33
67
33
100
100
33
67
67
33
33
67
67
100
67
33
67
33
0
0
67
100
33
33
0
33
0
33
67
33
100
33
33
67
67
0
67
33
33
33
67
33
33
67
33
Critical Thinking Skills Assessment (General Education)
Scorer
3
Final
Score
33
33
33
100
67
33
67
67
33
33
100
100
67
33
33
33
33
33
67
33
100
33
67
67
100
33
67
67
33
100
67
33
67
67
33
33
33
33
100
67
33
67
67
33
33
100
100
67
33
33
33
33
33
67
33
100
33
67
67
100
33
67
67
33
100
67
33
67
67
33
Essay I
A1
A2
A3
A4
A5
A6
A7
A8
A9
A10
A11
A12
A13
A14
A15
A16
A17
A18
A19
A20
A21
A22
A23
A24
A25
A26
A27
A28
A29
A30
A31
A32
A33
A34
A35
6
8
6
0
8
8
8
8
8
8
10
10
10
10
8
8
10
6
8
8
10
8
8
8
8
8
8
10
8
10
10
10
10
10
8
12
Rubric
Equivalent
33
67
33
0
67
67
67
67
67
67
100
100
100
100
67
67
100
33
67
67
100
67
67
67
67
67
67
100
67
100
100
100
100
100
67
Essay II
B1
B2
B3
B4
B5
B6
B7
B8
B9
B10
B11
B12
B13
B14
B15
B16
B17
B18
B19
B20
B21
B22
B23
B24
B25
B26
B27
B28
B29
B30
B31
B32
B33
B34
B35
5
6
7
6
6
6
6
7
6
7
7
7
7
5
7
7
7
7
6
7
6
6
5
7
7
6
6
7
6
6
7
6
7
7
0
Essay I
Equivalent
6
8
10
8
8
8
8
10
8
10
10
10
10
6
10
10
10
10
8
10
8
8
6
10
10
8
8
10
8
8
10
8
10
10
0
Rubric
Equivalent
33
67
100
67
67
67
67
100
67
100
100
100
100
33
100
100
100
100
67
100
67
67
33
100
100
67
67
100
67
67
100
67
100
100
0
A36
A37
A38
A39
A40
A41
A42
A43
A44
A45
A46
A47
A48
A49
A50
A51
A52
A53
A54
A55
A56
A57
A58
A59
A60
67
33
67
33
67
100
67
67
33
67
33
33
33
33
67
33
67
67
67
33
33
33
33
67
100
33
0
100
33
0
67
0
100
33
100
33
33
67
33
33
0
33
67
33
0
0
33
33
33
67
33
0
67
33
67
100
0
67
33
100
33
33
33
33
67
33
33
67
33
33
33
33
33
67
67
33
0
67
33
67
100
0
67
33
100
33
33
33
33
67
33
33
67
33
33
33
33
33
67
67
B36
B37
B38
B39
B40
B41
B42
B43
B44
B45
B46
B47
B48
B49
B50
B51
B52
B53
B54
B55
B56
B57
B58
B59
B60
33
33
67
67
67
67
33
67
33
67
33
33
33
33
67
33
67
100
33
33
0
33
100
33
100
33
33
100
0
33
100
33
67
33
67
33
0
33
67
67
33
33
67
0
33
0
0
100
0
33
33
33
67
67
67
100
33
67
33
67
33
0
33
67
67
33
33
100
33
33
33
33
100
33
100
33
33
67
67
67
100
33
67
33
67
33
0
33
67
67
33
33
100
33
33
0
33
100
33
100
A36
A37
A38
A39
A40
A41
A42
A43
A44
A45
A46
A47
A48
A49
A50
A51
A52
A53
A54
A55
A56
A57
A58
A59
A60
10
8
10
10
10
10
6
10
10
10
10
10
10
8
8
8
8
10
8
8
6
6
10
10
8
Avg. 8.53
100
67
100
100
100
100
33
100
100
100
100
100
100
67
67
67
67
100
67
67
33
33
100
100
67
76.78
B36
B37
B38
B39
B40
B41
B42
B43
B44
B45
B46
B47
B48
B49
B50
B51
B52
B53
B54
B55
B56
B57
B58
B59
B60
7
7
7
6
7
7
7
7
7
7
6
7
7
6
6
6
6
7
6
7
6
6
7
7
5
10
10
10
8
10
10
10
10
10
10
8
10
10
8
8
8
8
10
8
10
8
8
10
10
6
Avg. 8.80
Paper 2 Average 48.25
Paper 3 Average 54.38
Paper 1 Average 76.78%
Paper 2 Average 81.22
Paper 2 Consensus 35%
Paper 3 Consensus 40%
Paper 1 Consensus 25%
Paper 2 Consensus 25%
Consensus based all three scorers
Critical Thinking Skills Assessment (General Education)
Consensus based on Final
Score and Fall 13 scores
13
100
100
100
67
100
100
100
100
100
100
67
100
100
67
67
67
67
100
67
100
67
67
100
100
33
81.22