Assessment Plan for: - University of Alaska Anchorage

advertisement
Associate of Arts
Educational Effectiveness Assessment Plan
Revised October 15, 2008
The Associate of Arts Assessment Committee:
Shawnalee Whitney Oral Communication Skills Assessment Coordinator
Associate Professor, Communications
Patricia M. Jenkins
Written Communication Skills Assessment Coordinator
Associate Professor, English
John Mouracade
Humanities Assessment Coordinator
Assistant Professor, Philosophy
Charles Licka
Fine Arts Assessment Coordinator
Chair/Professor Art History, Art
M. Hilary Davies
Mathematical Scineces Assessment Coordinator
Professor, Mathematical Sciences
Jerry D. Kudenov
Natural Sciences Assessment Coordinator
Chair/Professor, Biological Sciences
John Petraitis
Social Sciences Assessment Coordinator
Chair/Professor, Psychology
Suzanne Forster,
Associate of Arts Assessment Coordinator
Professor, English
Submitted to
The Dean of the College of Arts and Sciences, October 15, 2008
The Office of Academic Affairs:
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 1 of 68
TABLE OF CONTENTS
Introduction__________________________________________________________________3
The Program
4
Program Outcomes____________________________________________________________ 5
Association of Assessment Tools to Program Outcomes_______________________________7
Assessment Tools _______________________
________________________ 9
Assessment Implementation and Analysis for Program Improvement___________________10
General Implementation Strategy _______________________________________________10
Oral Communication Skills
Written Communication Skills
Mathematical Sciences
Fine Arts
Humanities
Natural Sciences
Social Sciences
Method of Data Analysis and Formulation of Recommendations for
Program Improvement ________________________________________________________12
Modification of the Assessment Plan_____________________________________________13
Appendix A: Associate of Arts (AA) Degree Requirements (catalog copy)________________14
Appendix B: Oral Communication Skills Assessment Pre- and Post-test_________________15
Appendix C: Written Communication Assessment Instructions and Data Sheets __________16
Appendix D: Mathematical Sciences Assessment Test__________________________________19
Appendix E: Fine Arts Assessment Test______
__________________________________ _ 20
Appendix F: Humanities Assessment Plan
22
Appendix G: Sample Natural Sciences AA Assessment Exam _________________________27
Appendix H: Sample Social Sciences Discipline-Specific Assessment Tests and
JPC A101 Social Sciences GER Questionnaire
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
29
Page 2 of 68
INTRODUCTION
This document defines the educational objectives and expected outcomes for the University of Alaska
Anchorage College of Arts and Sciences Associate of Arts (AA) Degree Program and outlines a plan for
assessing the achievement of the stated objectives and outcomes.
The Associate of Arts Assessment Committee consists of one faculty representative from each of the
seven disciplinary categories represented in the AA degree program: Oral Communications; Written
Communications; Mathematical Sciences, Fine Arts, Humanities, Natural Sciences, Social Sciences. In
devising appropriate standards, committee members consulted published professional standards, faculty
colleagues, and program accreditation recommendations (See Appendix A). Assessment began with the
three Basic Skills components of the GER program, then expanded over several years to encompass the
Fine Arts, Social and Natural Sciences, and finally, the Humanities. Each committee member worked
with faculty in their respective departments and divisions in developing a draft set of outcomes and the
pilot assessment mechanisms for review and approval. Initial assessment results, analysis, and
recommendations are taken back to the originating departments each fall for faculty review and feedback.
In addition to reporting yearly assessment results, AA Assessment coordinators meet periodically with
their respective departments or disciplines to develop and refine outcomes reflective of the academic
interests and concerns of the discipline, discuss assessment results, and consider program changes in light
of those results.
To date, an AA Mission Statement and Degree Program Outcomes have been articulated and
assessment mechanisms designed for each of the categories represented in the AA. Oral and Written
Communications and Mathematics have completed two full assessment cycles; Fine Arts has completed
one full cycle; the Social Sciences, Natural Sciences, and Humanities have each piloted an assessment
mechanism in the most recent academic year. Assessment of Humanities courses has been staged over
several years because, unlike Oral and Written Communication and Mathematical Sciences, the
Humanities Division involves multiple disciplines and with courses developing three separate skill
sets: content-oriented courses, skills-oriented courses in logic, and skills-oriented courses in
logic. Humanities will expand its assessment in AY2008-2009 to include the third category of
Humanities course, Language-Oriented courses.
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 3 of 68
THE PROGRAM
The Associate of Arts (AA) is a broad liberal arts degree housed in the College of Arts and Sciences
(CAS) and unrelated to any specific program or certificate. The AA consists of seven broad disciplinary
categories: Oral Communication Skills, Written Communication Skills, Humanities, Fine Arts,
Mathematics and Natural Sciences, and Social Sciences.
The mission of the AA degree program is to provide a solid foundation in mathematics, oral and
written communication, the social and natural sciences, humanities and fine arts. It prepares
students for baccalaureate programs and career advancement and to better understand their
world.
The AA degree provides students with a “broad exposure to systems of thought and inquiry, allows
exploration of a variety of disciplines and learning experiences, and provides a solid foundation for
further study at the baccalaureate level.”1 It consists of 30 credits of General Education Requirements
(GER) (Oral Communication Skills 3, Written Communication Skills 6, Humanities and Fine Arts 9,
Natural Sciences 6, Social Sciences 6) courses; 3 credits of MATH A105 or any course from the
Quantitative Skills category of the GERs; and 27 credits of elective coursework, for a total of 60 credits.
For the catalog description of the program, see Appendix A.
As a liberal arts degree, the AA provides students a reasonable degree of flexibility in choosing courses.
With the exceptions noted below, required portions of the AA degree closely reflect the University’s GER
requirements for a baccalaureate degree:
1. The Quantitative Skills portion of the AA degree allows as one option MATH A105
Intermediate Algebra, which is not a GER course.
2. One of the options in the Written Communications requirements is CIOS A260A Business
Communications, which is not a GER course.
3. The Natural Sciences requirement does not include a lab component.
4. There is no Tier III Capstone requirement.
The AA Program was substantially altered in AY2005-2006 to bring it more in line with the baccalaureate
requirements, improve retention, and enable students to matriculate more quickly. These changes
included adding a 3-credit Quantitative Skills requirement (MATH A105 or any GER Quantitative Skills
course), reducing the Social Sciences requirement from 9 credits to 6; and eliminating the 9-credit
Applied Studies requirement. With the required number of general education credits over one-half (33),
the AA program is well within the Association of American Colleges and Universities recommendations
for supporting the “centrality of general education.”2
1
UAA Catalog, p. 78
2 Taking Responsibility for the Quality of the Baccalaureate Degree: A Report form the Greater Expectations Project on Accreditation and
Assessment. AAC&U, 2004, p. 9.
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 4 of 68
AA PROGRAM OUTCOMES
Fine Arts
Written Communication Skills
Oral Communication Skills
Students graduating with an Associate of Arts degree from UAA will be able to
1. Demonstrate an understanding of the communication process and communication components
involved in the process
 Source field of experience/encoding
 Receiver field of experience/encoding
 Feedback and the dynamic nature of the communication process
 Message components
 Channel types
2. Understand how to effectively adapt a message to an audience (individual, group, or public)
 Message construction, organization, transitions and connections
 Message support including pathos, logos, and ethos appeals
 Nonverbal adaptation including voice, posture, volume, eye contact, space, touch
 Listening and responsiveness to feedback
 Receiver attributes and needs
 External factors
1. Use Standard Written English correctly and effectively
 Write sentences that follow rules for sentence mechanics (capitalization and punctuation)
 Write sentences that follow rules for structural relationships (comparison, coordination,
correlation, negation, parallelism, and subordination)
 Write sentences that follow rules for grammatical relationships (adjectives, adverbs,
nouns, pronouns, and verbs)
2. Respond appropriately and effectively to writing assignments
 Use an appropriate genre
 Adhere to genre expectations and conventions for content, development, and structure
 Respond to audience needs
 Focus on a purpose
 Adopt appropriate voice, tone, and level of formality
 Use appropriate technical, professional, or academic language and style
 Provide appropriate and effective rhetorical and structural cues
3. Use research responsibly and effectively
 Locate or produce appropriate research for writing assignments
 Integrate research effectively
 Use research effectively
 Avoid plagiarism by knowing how, when, and where to document sources
1. Identify and describe art works by reference and formal content concerns
 historical context and expressive style
 structural principles of design/composition
 organization of design and compositional elements
 media
2. Interpret the meaning/intent of art work and assess their stylistic and cultural significance
 personal responses
 substantive and critical evaluation through their historical and critical importance and their
relationship to the time period produced and their contemporary reception
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 5 of 68
AA PROGRAM OUTCOMES (CONTD.)
Students graduating with an Associate of Arts degree from UAA will be able to
Humanities
Content-oriented courses
Identify texts or objects, place them in the historical context of the discipline, articulate the
central problem they address, and provide reasoned assessment of their significance
Skills-oriented courses in logic
1. Identify the premises and conclusions of brief written arguments, evaluate their soundness
or cogency, and recognize common fallacies
2. Use the formal techniques to determine the validity of simple deductive arguments and
evaluate the adequacy of evidence according to appropriate inductive standards
Skills-oriented courses in language
Demonstrate proficiency in listening, speaking and writing
Mathematical Sciences
1. Use appropriate mathematical language and symbols to develop and communicate
Solutions
 Use appropriate arithmetic symbols and language
 Use appropriate algebraic symbols and language
 Use appropriate geometric symbols and language
Natural Sciences
1. Apply the scientific method by formulating questions or problems, proposing hypothetical
answers or solutions, testing those hypotheses, reaching supportable conclusions
Social
Sciences
2. Demonstrate quantitative and analytical skills and knowledge
 Compute and interpret ratios and percentages, and use scientific notation
 Use function notation, including composition and inverses
 Convert between exponential and logarithmic notation
 Solve simple applied problems using appropriate algebraic techniques
 Demonstrate graphical competency in graphing lines, parabolas, and circles
1. Apply the scientific method to understanding the social world
2. Demonstrate an understanding of the fundamentals of one or more scientific disciplines, a
knowledge of the discoveries and advances made within that discipline and the impact
of scientific information in sculpting thought and in providing the foundations for the
technology in use at various times in history
2. Develop and apply evidence-based conclusions about the social world
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 6 of 68
Written
Communication
Skills
Oral
Communication
Skills
Objective
Test
Holistic
Scoring
Program Outcomes
Essay
Exam
Pre- and
Post-test
ASSOCIATION OF ASSESSMENT TOOLS TO PROGRAM OUTCOMES
1
Demonstrate an understanding of the communication process
and communication components involved in the process.
1
0
0
0
2
Understand how to effectively adapt a message to an
audience (individual, group, or public)
0
0
0
0
1
Use Standard Written English correctly and effectively
0
0
1
0
2
Respond appropriately and effectively to writing
assignments
0
0
1
0
3
Use research responsibly and effectively
0
0
1
0
0
0
0
0
0
0
0
0
0
0
0
0
Content-oriented courses
Identify texts or objects, place them in the historical context
of the discipline, articulate the central problem they address,
and provide reasoned assessment of their significance
Humanities
Skills-oriented courses in logic
Identify the premises and conclusions of brief written
arguments, evaluate their soundness or cogency, and
recognize common fallacies and Use the formal techniques
to determine the validity of simple deductive arguments and
evaluate the adequacy of evidence according to appropriate
inductive standards
Skills-oriented courses in language
Demonstrate proficiency in listening, speaking and writing
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 7 of 68
Objective
Test
1
Identify and describe art works by reference and formal
content concerns
0
0
0
1
2
Interpret the meaning/intent of art works and assess their
stylistic and cultural significance
0
1
0
0
1
Use appropriate mathematical language and symbols to
develop and communicate solutions
0
0
0
1
2
Demonstrate quantitative and analytical skills and
knowledge
0
0
0
1
1
Apply the scientific method by formulating questions or
problems, proposing hypothetical answers or solutions,
testing those hypotheses, reaching supportable conclusions
0
0
0
1
2
Demonstrate an understanding of the fundamentals of one or
more scientific disciplines, a knowledge of the discoveries
and advances made within that discipline and the impact
of scientific information in sculpting thought and in
providing the foundations for the technology in use at
various times in history
0
0
0
1
1
Apply the scientific method to understanding the social
world
0
0
0
1
2
Develop evidence-based conclusions about the social world
0
0
0
1
Fine Arts
Mathematics
Natural Sciences
Social Sciences
Holistic
Scoring
Program Outcomes
Essay
Exam
Pre- and
Post-test
ASSOCIATION OF ASSESSMENT TOOLS TO PROGRAM OUTCOMES (CONTD.)
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 8 of 68
ASSESSMENT TOOLS
Program Outcomes Assessment Tools and Administration
Tool
Oral
Communication
Pre- and PostTest
Written
Communication
Holistic Scoring
Humanities
Fine Arts
Essay Exam
Mathematics
Assessment Test
Description
Two-question, multi-part, essay
test
Tabulation sheets for holistic
scoring on each of three identified
outcomes. Outcomes 1 and 3
scored based on student
performance on final research
paper; outcome 2 scored on
student performance on two short
writing assignments. (See
Appendix C)
To be determined separately by
departments housing the skillsbased courses in language and
logic and by those housing the
content-based courses
Two-question, multi-part, essay
tests.
Ten-question, multiple-choice
comprehensive test
Natural Sciences Discipline-specific Pre-and Post
Multiple-choice Multiple-choice (not more than 20
questions)
Test
Social Sciences
Multiple-choice
Pre- and PostTest
Discipline-specific multiplechoice (not more than 20
questions) pre-and post test
Associate of Arts Educational Effectiveness Assessment Plan
Frequenc
y/ Start
Date
Fall and
Spring
annually
Fall and
Spring
annually
Collection
Method
Administered
by
Test will be part of
course grade. Two or
more faculty will code
the answers on a 1-5
scale.
Faculty teaching
GER
Communications
courses
One faculty from each
of the four 200-level
composition courses
will collect data based
on student
performance on three
writing assignments
Faculty teaching
200-level GER
composition
courses; results
compiled and
analyzed
Composition
Coordinator.
Faculty teaching
the course; results
compiled and
analyzed AA
Assessment
Fall and
Spring
annually on a
rotating
basis.
Fall and
Spring
annually
One faculty member
from each of the
disciplines teaching
100-level and 200level GER Fine Arts
courses will collect
data based on student
performance based on
two essay
examinations.
Scantron cards
Fall 2007
and each
semester
thereafter on
a rotating
basis
Fall 2007
and each
semester
thereafter on
a rotating
basis
Faculty teaching
the course; results
compiled and
analyzed
Composition
Coordinator
Faculty teaching
the course; results
compiled and
analyzed by AA
Mathematics
Assessment
Coordinator
Faculty teaching
the course; results
compiled and
analyzed by AA
Nat. Sci.
Coordinator
Faculty teaching
the course
Submitted 11-3-08
Page 9 of 68
ASSESSMENT IMPLEMENTATION & ANALYSIS FOR PROGRAM IMPROVEMENT
General Implementation Strategy
ORAL COMMUNICATION SKILLS
A pilot test of the first question was administered in two Communication GER courses during Spring
semester 2006 and again at the end of Spring semester 2007. The test consists of a pre- and post-test; the
post-test is part of the course grade. Two or more faculty coded the answers on a 1-5 scale.
Communications faculty agreed to do just the first question in a pilot study in spring 2006. The first
question, dealing with process and communication components, is sufficiently broad in scope to be
applicable throughout the Communications GER courses and is consistent across the GER Oral
Communication courses. The second question is broader in scope, but the faculty have not yet decided to
include the second question.
WRITTEN COMMUNICATION SKILLS
In the fall semester of 2005 and again in fall of 2006, Patricia Jenkins, Composition Coordinator in the
Department of English, assessed the outcomes of the Written Communication Skills of students in the AA
Program. Because all students are required to take 6 credit hours of composition at the ENGL A111-level
or above, the assessment mechanism should be administered to students completing their second-semester
composition requirement. All four 200-level writing courses fulfill the requirement (ENGL A211
Introduction to Writing about Literature; ENGL A212 Technical Communication; ENGL A213 Writing
in the Social and Natural Sciences; and ENGL A214 Persuasive Writing).
One faculty member from each of the four 200-level composition courses collected data based on student
performance on three writing assignments. These faculty members were provided with tabulation sheets
itemizing and ranking the outcome criteria on a 1 to 5 scale, with 5 being the highest value. Jenkins then
compiled and analyzed the data.
MATHEMATICAL SCIENCES
Prior to Fall 2005, no Mathematics courses were required for the AA degree. Beginning in Fall 2005, AA
degree-seeking students were required to take Math A105 (Intermediate Algebra) or any of the GER
Quantitative Skills. After examining several nationally recognized standardized tests, the Mathematical
Sciences Department decided to write its own assessment test for the Mathematics requirement of the
Associate of Arts degree. The Mathematical Sciences Department faculty met and accepted the
objectives, outcomes, and assessment process on September 15, 2005. Specifically, faculty agreed to








Initiate a Pilot program in Spring 2006 to test 2-4 sections of Math A105 taught by the UAA
Mathematical Sciences Department.
Provide written instructions for instructors volunteering to participate in the pilot.
Write a 10 question multiple choice test. The test would be written by a subset of Mathematics
faculty who regularly teach Math A105.
The test administered in Spring 2006 would be part of the final exam.
The grade on the test would be part of the course grade.
The results would be interpreted by the Mathematical Sciences Department.
The test would focus on the goals and outcomes included in this document under “Program
Objectives and Outcomes.”
The data would be analyzed by Mathematics faculty members after the test was administered and
results obtained.
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 10 of 68
The Pilot Program was implemented in Spring 2006. Seven sections of MATH A105 taught by the
Mathematical Sciences Department participated in the pilot. The faculty met and reviewed the results on
September 1, 2006. It was recommended that all MATH A105 sections taught by the Mathematical
Sciences Department would participate in the Fall 2006, Spring 2007, and succeeding Fall and Spring
semesters. All sections (except one) of MATH A105 taught by the Mathematical Sciences Department
participated in the Fall 2006 and Spring 2007 assessment. A total of 482 students took the Assessment
Test in Fall 2006 and Spring 2007. Sections taught by College Preparatory and Developmental Studies
(CPDS) and sections not taught at the main campus have not participated in the testing up to this time
NATURAL SCIENCES
Assessment Method Proposed Strategy: We want to determine the effectiveness of NS-GER in teaching
students how to apply the scientific method to issues both in the natural sciences and to the ways that
sciences impacts their lives. We also propose using natural science articles from media most likely
accessed by our students about which we can assess their understanding of fundamental principles and
knowledge about a discipline’s discoveries and impacts.
Construction of Discipline-specific Tests: The Natural Science faculty anticipate using a basic set of ten
multiple-choice questions that will be modified according to the given NS-GER being measured that can
include:
 A description of observations, empirical hypothesis or research question;
 A table or graph of observed phenomena that may include a quantitative and/or verbal summary;
 A series of ten objective multiple-choice questions based on the information provided;
 A scoring rubric using a 10-point scale will be employed.
Test Preview: Each Department’s NS-GER set of test questions will be submitted to the NS AA
Assessment Committee (consisting of NS Chairs) by week 5 of fall and spring semesters for review and
comments.
Test: Students will be given a discipline-specific NS-GER test as part of their final exam.
Analysis: Faculty will score test results separately from the overall grade to determine whether students
have attained a level of understanding that demonstrates their successful achievement of NS-GER
objectives.
Implementation: It is proposed that AA assessment through NS-GER courses commence the fall
semester of Academic Year 2007-08, and that it rotate through each of the four science departments as
listed below:
Department
AY08
Astronomy
Biology
ASTR A103, A104
AY09
AY10
AY11
AY12
BIOL A102, A103
BIOL A111, A112
BIOL A115. A116
Chemistry
Geology
CHEM A103, A104
CHEM A105, A106
GEOL A111, A221
GEOL A115, A179
PHYS A123, A124
PHYS A211, A212
Physics
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 11 of 68
SOCIAL SCIENCES
Differences in course and disciplinary foci in the Social Sciences (SS) mean that the only reasonable
common denominator on which to assess UAA’s SS-GERs is on their coverage of the scientific method.
However, each discipline relies largely on different methods: some rely more on systematic case studies,
others on surveys of representative samples, some on naturalistic observation, some on archival analysis,
some on correlational studies, and some on experiments. As such, perhaps the best way to assess UAA’s
SS-GER’s—in a meaningful way— is for each course to have a discipline-specific test on the scientific
methods used in that discipline.
Toward that end, representatives from the CAS departments with SS-GER’s met twice during 2006-2007.
The representatives were Dr. Christine Hanson (Anthropology), Dr. Dorn Van Dommelen (Geography),
Dr. Fred Pearce (Journalism/Public Communication), Dr. Jim Muller (Political Science), Dr. John
Petraitis (Psychology), Dr. Sharon Araji (Sociology), and Dr. Kimberly Pace (Women Studies). The
discussions produced general (but not unanimous) agreement on the following points.
 The scientific method, defined as the systematic observation, analysis, and interpretation of the
social world is the common foundation of the various social sciences.
 A cross-disciplinary test of social science facts is not reasonable.
 A cross-disciplinary test of social science methods is not optimal.
 Discipline-specific tests of social science methods are an acceptable way of assessing UAA’s SSGER.
Furthermore, representatives of the Social Sciences generally agreed that each discipline would develop a
discipline-specific. Each test, ideally, should:
 Focus on the scientific method of the discipline;
 Include no more than 20 multiple-choice items, making the tests easy to administer and score;
 Be administered at the beginning and end of each SS-GER, and include some student-specific
identifier (e.g., name, student ID#), thereby making it possible to track each student’s progress
over the course of the semester.
To date, two departments – JPC and Psychology -- have constructed their discipline-specific tests and
both are ready to pilot-test the tests in Fall 2007. For a sample assessment, see Appendix G: Sample Draft
Social Sciences Discipline-Specific Assessment Test.
TIMELINE
Assessment Tool Administered:
AA Report to CAS Dean’s Office:
Preliminary Reports to Represented Departments:
Amended category report to AA Coordinator:
Amended Report and Plan to CAS Dean’s Office:
Fall and /or Spring Semester annually,
depending on disciplinary category
June 15
September
September/early October
October 15
Method of Data Analysis and Formulation of Recommendations for Program
Improvement
Program faculty are to meet at least once a year to review the data collected using the assessment tools.
This meeting should result in recommendations for program changes that are designed to enhance
performance relative to the program’s objectives and outcomes. The results of the data collection, an
interpretation of the results, and the recommended programmatic changes are to be forwarded to the
office of Academic Affairs (in the required format) by the end of May each year. A plan for
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 12 of 68
implementing the recommended changes, including of advertising the changes to all the program’s
stakeholders, is also to be completed at this meeting.
The proposed programmatic changes may be any action or change in policy that the faculty deems as
being necessary to improve performance relative to programs objectives and outcomes. Recommended
changes should also consider workload (faculty, staff, and students), budgetary, facilities, and other
relevant constraints. A few examples of changes made by programs at UAA include:
o changes in course content, scheduling, sequencing, prerequisites, delivery methods, etc.
o changes in faculty/staff assignments
o changes in advising methods and requirements
o addition and/or replacement of equipment
o changes to facilities
Modification of the Assessment Plan
Faculty members of each department within a disciplinary category, after reviewing the collected data and
the processes used to collect it, may decide to alter the assessment plan. Changes may be made to any
component of the plan, including the objectives, outcomes, assessment tools, or any other aspect of the
plan. The changes are to be approved by the faculty of the program. The modified assessment plan is to
be forwarded to the dean/director’s office and the Office of Academic Affairs.
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 13 of 68
Appendix A: UAA Associate of Arts Degree Requirements (Catalog Copy)
DEGREE REQUIREMENTS
All Courses must be at the 100-level or above. At least 20 credits of
the required 60 credits must be at the 200-level. Students intending
to complete the Associate of Arts degree and then continue on to a
baccalaureate degree, consult the *Advising Note for AA Students
who plan to pursue a baccalaureate degree below.
General Education Requirements
1. Oral Communication Skills
3
COMM A111 Fundamentals of Oral Communication
COMM A235 Small Group Communication
COMM A237 Interpersonal Communication
COMM A241 Public Speaking
2. Written Communication Skills
6*
ENGL A111: Methods of Written Communication,
and one of the following:
CIOS A260A Business Communications+
ENGL A211 Academic Writing About Literature
ENGL A212 Technical Writing
ENGL A213 Writing in the Social and Natural Sciences
ENGL A214 Persuasive Writing
3. Humanities and Fine Arts
9*
Three courses from the GER Classification List.
At least one course each from the Humanities and
Fine Arts areas.
4. Mathematical and Natural Sciences
9*
MATH A105 Intermediate Algebra (3) + *
or one course from the Quantitative Skills area of GER
Classification List (3)
Two Natural Science courses from the Natural Sciences
area of GER Classification List (3+3) (6)*
5. Social Sciences
6*
Two Social Science courses (from two different disciplines)
from the Social Sciences area of GER Classification List
Degree Completion Requirements
6. Electives 27*
Total Minimum Credits 60
+ Please note: Math A105 and CIOS A260A do not meet the General Education
Requirements for the baccalaureate degree.
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 14 of 68
APPENDIX B: ORAL COMMUNICATION SKILLS ASSESSMENT PRE- AND POST-TEST
Draft Questions
Outcome One
1) Write a detailed description of the components involved in the communication process.
Describe each component and the relationship between the components. You may diagram a
model of the communication process as part of your answer.
Outcome Two
2) Write a detailed description of how to effectively adapt a message to an audience. The
audience may be an individual, group, organization or a public audience. Your answer should
address message construction, message support, nonverbal communication, and how you would
adapt your communication to receiver attributes and environmental factors. You may answer
this question by discussing a recent communication experience.
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 15 of 68
APPENDIX C: WRITTEN COMMUNICATIONS INSTRUCTIONS AND DATA SHEETS
April 6, 2006
To:
From:
Cc:
Gabrielle, Robin, Angie, and Claudia.
Trish Jenkins
Suzanne Forster, Coordinator of AA Degree Assessment
If you recall I asked the four of you to participate in a pilot outcomes assessment of the
Written Communication requirement for the Associate of Arts degree at UAA. The
assessment is based on your evaluation of students’ writing. It does not include an
evaluation of the instructor. The actual assessment will consider the 200-level
composition courses (211, 212, 213, and 214).
Last semester, you agreed to complete the assessment for the following classes:
Instructor
Course
Section
Gabrielle
Angie
Robin
Claudia
211
212
213
214
004
007
004
005
Class Meeting
Day & Time
T/R 2:30 to 3:45
T/R 10:00 to 11:15
T/R 1:00 to 2:15
T/R 8:30 to 9:45
The assessment asks instructors to assess students in three areas:
 Correct and effective use of Standard Written English
 Appropriate and effective response to writing assignments
 Responsible and effective use of research
I have attached data sheets (that include the criteria) for you to use. If you have any
questions, please let me know (aftmj) or 64379). If I can help you in any way, let me
know. Thanks for participating in the pilot. I look forward to discussing the process
with you later.
Outcome 1: Use Standard Written English correctly and effectively.
Instructor: Please assess each student’s use of Standard Written English as demonstrated in the
final draft of his or her research paper. Use a scale of 1 to 5, with “5” being the highest. Criteria
are provided below.
Student Criteria
1
Mechanics: Write sentences that follow rules
for capitalization and punctuation.
Associate of Arts Educational Effectiveness Assessment Plan
Score (5 is highest)
1 2 3 4 5
Submitted 11-3-08
Page 16 of 68
Sentence structure: Write sentences that
follow rules for structural relationships
(comparison, coordination, correlation,
negation, parallelism, and subordination) and
that are complete and not fused.
Grammar: Write sentences that follow rules
for grammatical relationships (adjectives,
adverbs, nouns, pronouns, and verbs).
Student Criteria
Mechanics: Write sentences that follow rules
2
for capitalization and punctuation.
Sentence structure: Write sentences that
follow rules for structural relationships
(comparison, coordination, correlation,
negation, parallelism, and subordination) and
that are complete and not fused.
Grammar: Write sentences that follow rules
for grammatical relationships (adjectives,
adverbs, nouns, pronouns, and verbs).
Student Criteria
3
Mechanics: Write sentences that follow rules
for capitalization and punctuation.
Sentence structure: Write sentences that
follow rules for structural relationships
(comparison, coordination, correlation,
negation, parallelism, and subordination) and
that are complete and not fused.
Grammar: Write sentences that follow rules
for grammatical relationships (adjectives,
adverbs, nouns, pronouns, and verbs).
1 2 3 4 5
1 2 3 4 5
Score (5 is highest)
1 2 3 4 5
1 2 3 4 5
1 2 3 4 5
Score (5 is highest)
1 2 3 4 5
1 2 3 4 5
1 2 3 4 5
Outcome 2: Respond appropriately and effectively to writing assignments.
Instructor: Please assess each student’s ability to respond appropriately and effectively to
writing assignments. Use a scale of 1 to 5, with “5” being the highest. Criteria are provided
below.
Criteria for assessing writing assignments
The student has
 Used an appropriate genre.
 Adhered to genre expectations and conventions for content, development, and structure.
 Responded to audience needs.
 Focused on a purpose.
 Adopted appropriate voice, tone, and level of formality.
 Used appropriate technical, professional, or academic language and style.
 Provided appropriate and effective rhetorical and structural cues.
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 17 of 68
Student Score for short writing
assignment #1
1
1
1
2
1
3
1
4
1
5
1
6
1
7
1
8
1
9
1
10
1
11
1
12
1
13
1
14
Outcome 3:
Score for short writing
assignment #2
2 3 4 5
1
2 3 4 5
1
2 3 4 5
1
2 3 4 5
1
2 3 4 5
1
2 3 4 5
1
2 3 4 5
1
2 3 4 5
1
2 3 4 5
1
2 3 4 5
1
2 3 4 5
1
2 3 4 5
1
2 3 4 5
1
2 3 4 5
1
Use research responsibly and
2 3 4 5
2 3 4 5
2 3 4 5
2 3 4 5
2 3 4 5
2 3 4 5
2 3 4 5
2 3 4 5
2 3 4 5
2 3 4 5
2 3 4 5
2 3 4 5
2 3 4 5
2 3 4 5
effectively.
Instructor: Please assess each student’s use of research as demonstrated in the student’s
research process and in the student’s final draft of his or her research paper. Use a scale of 1 to
5, with “5” being the highest. Criteria are provided below.
Student Outcome
Located or produced appropriate
1
research for writing assignments.
Integrated research effectively.
Used research effectively.
Avoided plagiarism by knowing how,
when, and where to document sources.
Located or produced appropriate
2
research for writing assignments.
Integrated research effectively.
Used research effectively.
Avoided plagiarism by knowing how,
when, and where to document sources.
Located or produced appropriate
3
research for writing assignments.
Integrated research effectively.
Used research effectively.
Avoided plagiarism by knowing how,
when, and where to document sources.
Located or produced appropriate
4
research for writing assignments.
Integrated research effectively.
Used research effectively.
Avoided plagiarism by knowing how,
when, where to document sources.
Associate of Arts Educational Effectiveness Assessment Plan
Score
1 2 3 4 5
1 2 3 4 5
1 2 3 4 5
1 2 3 4 5
1 2 3 4 5
1 2 3 4 5
1 2 3 4 5
1 2 3 4 5
1 2 3 4 5
1 2 3 4 5
1 2 3 4 5
1 2 3 4 5
1 2 3 4 5
1 2 3 4 5
1 2 3 4 5
1 2 3 4 5
Submitted 11-3-08
Page 18 of 68
APPENDIX D: MATHEMATICAL SCIENCES ASSESSMENT TEST
Tool Description:
A 10 question test covering topics listed in the Outcomes for the Mathematics requirement of the
Associate of Arts degree. A copy of the test is not included with this document for
confidentiality reasons.
Factors that affect the collected data:
The test will be included as part of the Final Exam to ensure that students take it seriously.
How to interpret the data:
Spring 2006
Fall 2006
Spring 2007
Fall 2007
Spring 2008
Standard
Deviation
1.84
2.08
2.15
2.04
2.03
Mean Score
Median Score
Highest Score
Lowest Score
5.57
5.44
5.29
5.47
6.03
5.5
5.7
5.2
5.47
6.05
10
10
10
10
10
0
0
0
1
1
Only two of the faculty who participated in the testing normally use Multiple Choice testing.
Therefore, students could have been at a disadvantage taking the 10 question Multiple Choice
Assessment Test as part of their Final Exam. The test used in Spring 2006 was substantially
different from the test used in succeeding semesters.
From the data, it was evident that the students are generally weak in finding inverse functions
and rationalizing expressions. Students performed well on problems involving linear equations
and systems, circles and parabolas, and logarithms and exponentials. In conclusion, the students
performed better on new material from MATH A105 than on material taught in the prerequisite
course of MATH A055. Students also did better on material taught at the end of MATH A105.
This indicates that all the material in the Course Content Guide was taught by the faculty
teaching MATH A105.
For every question, the correct answer (except in two instances) has the highest response.
Statistical analysis of the data indicated that the test questions were appropriate.
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 19 of 68
APPENDIX E: FINE ARTS ASSESSMENT TEST
The Fine Arts Question is divided into two parts. Each part of the question addresses one section
of the expected outcomes. The first part of the question is objective. Students are expected to
find factual information about two specific works of art. They are expected to cover the history,
elements, organization and medium of each work based on the material covered in the course
during the semester. The second part of the question covers the critical analysis. It is vital that
students not only be able to identify works, but that they can form an evaluation of the works
based on historical and contemporary criticism and their personal response. At the close of a Fine
Arts GER, students will have the skills to develop an informed personal response to art in a way
that would be possible without these courses. It is the combination of the two outcomes that are
crucial to the Fine Arts GER.
In conjunction with the two sections of the expected outcomes, the question is framed as a
comparison of two different works. A compare and contrast question is an excellent way to show
what the students have learned from the courses. It gives students an opportunity to relate
different works to each other and help define and evaluate each work. This approach will
contribute to the student’s critical thinking and their appreciation for the Fine Arts.
Instructions for administering the Fine Arts GER question:
The attached essay question should b given as part of the final exam for the GER Fine Arts
courses. It may be included as 5% of the students grade or more at the discretion of the
instructor. The purpose of the question is to assess the outcomes of the Fine Arts Courses.
The instructor needs to assign two specific works of art/theatre/dance/music to the students to
use in the essay question. The works should be chosen from the course work of the semester.
The instructor may, if he or she wishes, ask the students to choose two pieces on their own from
the course work from the semester.
The question should not take more than 30 minutes to complete, so the instructor should allow
for this in compiling a final exam.
Instructions for students taking the test:
Students, please answer the following two-part question in clear, complete and legible
sentences. (The instructor will assign the two works of art to be compared or the student may be
asked to pick two of their own based on the material covered during the semester).
Make sure you are specific and complete in your answers. Please use the back of the page if
necessary. (Time approximately 30 minutes)
QUESTION:
Compare and contrast the two assigned or chosen works of art/theatre/dance/music covering the
following:
PART I: The historical context and the expressive style of the pieces, their structural principles,
organization of those principles and their mediums.
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 20 of 68
Part II: Interpretation of art work (meaning and intent), stylistic and cultural significance,
personal responses, critical evaluation of the works’ historical and critical value, and the context
of the art work.
Procedures
Overall the question is broad enough to be used by all the courses. The individual instructors can
customize the question to fit the specific subject matter in their courses. The instructor may
select the two works to be compared or the instructor may opt for the students being given the
opportunity to select their own works to analyze. The modification does not alter the question.
The actual test question always remains the same. The question can be used for any of the
courses at any of the levels. It is expected however that the course level will be important in the
analysis of the answers.
The instructions and grading criteria below are to be used and adapted consistently. Grading
covers the two parts of the question based on a comparative approach. The sample below is used
by the Art Department.
Outcome 1: Identify and describe art works by reference and formal content concerns
Instructor: Assess each student’s ability to respond to the following criteria. Use a scale
of 0 to 4 with “4” being the highest grade possible. 4=A, 3=B, 2=C, 1=D, 0=F.
STUDENT: 1
CRITERIA
Describe the historical and expressive style
of the works of art
Describe the structural principles of design
and composition
Describe the organization of design and
compositional elements
Describe the media
SCORE (4 is maximum)
0 1
2
3
4
0
1
2
3
4
0
1
2
3
4
0
1
2
3
4
Outcome 2: Interpret the meaning/intent of art works and assess their stylistic and
cultural significance
STUDENT: 1
CRITERIA
Discuss your personal responses to the
works of art
Critically evaluate the works of art relevant
to their historical importance
Discuss the relationship of the art works to
the time period in which they were
produced
SCORE (4 is maximum)
0 1
2
3
4
0
1
2
3
4
0
1
2
3
4
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 21 of 68
APPENDIX D: HUMANITIES ASSESSMENT TEST
Associate of Arts Assessment Plan for the Humanities
I.
Contents
a. Overview of Humanities in the Associate of Arts Program
b. List of Humanities Courses in the Associate of Arts Program
c. Student Outcomes
i. Skills Courses
ii. Content Courses
d. Division of Courses into Skill and Content Areas
e. Assessment Tool
f. Administration of Tool
A. Overview of Humanities in the Associate of Arts Program
Students earning an Associate of Arts degree must complete 60 credits, including a minimum of
3 and a maximum of 6 credits in the humanities. The following is a tentative plan for assessing
the effectiveness of the humanities courses in meeting the objectives stated in the catalog for the
humanities.
According to the UAA 2006-2007 catalog the goals and nature of the humanities are as follows.
(p.84)
The humanities examine the characteristic of reality, the purpose of human existence, the
properties of knowledge, and the qualities of sound reasoning, eloquent communication, and
creative expression. They study the problems of right conduct in personal, social, and political
life. They also consider the qualities of the divine, the sacred, and the mysterious. In these tasks
the humanities reflect upon the world’s heritage of the arts, history, languages, literature,
religion, and philosophy. Students who complete a content-oriented course in the humanities
should be able to identify texts or objects, to place them in the historical context of the discipline,
to articulate the central problems they address, and to provide reasoned assessments of their
significance. Students who complete a skills-oriented humanities course in logic should be able
to identify the premises and conclusions of brief written arguments, to evaluate their soundness
or cogency, and to recognize common fallacies. They should also be able to use a formal
technique to determine the validity of simple deductive arguments and to evaluate the adequacy
of evidence according to appropriate inductive standards. Students who complete a skill-oriented
humanities course in a language should demonstrate proficiency in listening, speaking and
writing.
B. List of Humanities Courses in the Associate of Arts Program
Courses completed at UAA must be selected from the following Humanities courses:
AKNS A101 Alaska Native Languages I
AKNS A102 Alaska Native Languages II
AKNS A201 Native Perspectives
ART A261 History of World Art I
ART A262 History of World Art II
ART A360A History of Non-Western Art I
Associate of Arts Educational Effectiveness Assessment Plan
ART A360B History of Non-Western Art II
ASL A101 Elementary American Sign
Language I
ASL A102 Elementary American Sign
Language II
ASL A201 Intermediate American Sign
Submitted 11-3-08
Page 22 of 68
Language I
ASL A202 Intermediate American Sign
Language II
CHIN A101 Elementary Chinese I
CHIN A102 Elementary Chinese II
ENGL A121 Introduction to Literature
ENGL A201 Masterpieces of World Literature I
ENGL A202 Masterpieces of World Literature
II
ENGL A301 Literature of Britain I
ENGL A302 Literature of Britain II
ENGL A305 Topics in National Literatures
ENGL A306 Literature of the United States I
ENGL A307 Literature of the United States II
ENGL A310 Ancient Literature
ENGL A383 Film Interpretation
ENGL A445 Alaska Native Literatures
FREN A101 Elementary French I
FREN A102 Elementary French II
FREN A201 Intermediate French I
FREN A202 Intermediate French II
GER A101 Elementary German I
GER A102 Elementary German II
GER A201 Intermediate German I
GER A202 Intermediate German II
HIST A101 Western Civilization I
HIST A102 Western Civilization II
HIST A121 East Asian Civilization I
HIST A122 East Asian Civilization II
HIST A131 History of United States I
HIST A132 History of United States II
HIST A341 History of Alaska
HUM A211 Introduction to Humanities I
HUM A212 Introduction to Humanities II
HUM A250 Myths and Contemporary Culture
ITAL A101 Elementary Italian I
ITAL A102 Elementary Italian II
JPN A101 Elementary Japanese I
JPN A102 Elementary Japanese II
JPN A201 Intermediate Japanese I
JPN A202 Intermediate Japanese II
KOR A101 Elementary Korean I
KOR A102 Elementary Korean II
LAT A101 Elementary Latin I
LAT A102 Elementary Latin II
LING A101 The Nature of Language
MUS A221 History of Music I
MUS A222 History of Music II
PHIL A101 Introduction to Logic
PHIL A201 Introduction to Philosophy
PHIL A211 History of Philosophy I
PHIL A212 History of Philosophy II
PHIL A301 Ethics
PHIL A313B Eastern Philosophy and Religion
PHIL A314 Western Religion
PS A331 Political Philosophy
PS A332 History of Political Philosophy I:
Classical
PS A333 History of Political Philosophy II:
Modern
RUSS A101 Elementary Russian I
RUSS A102 Elementary Russian II
RUSS A201 Intermediate Russian I
RUSS A202 Intermediate Russian II
SPAN A101 Elementary Spanish I
SPAN A102 Elementary Spanish II
SPAN A201 Intermediate Spanish I
SPAN A202 Intermediate Spanish II
THR A311 Representative Plays I
THR A312 Representative Plays II
THR A411 History of the Theatre I
THR A412 History of the Theatre II
C. Student Outcomes
The catalog description of the GER courses in the humanities focuses on two different outcomes,
understanding content and acquiring skills.
i. Outcomes for content courses:
Students who complete a content-oriented course in the humanities should be able to:
1.
2.
3.
4.
identify texts or objects,
to place them in the historical context of the discipline,
to articulate the central problems they address,
and to provide reasoned assessments of their significance.
ii.
Outcomes for skills courses (2 types):
a. Logic
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 23 of 68
Students who complete a skills-oriented humanities course in logic should be able to:
1. identify the premises and conclusions of brief written arguments,
2. to evaluate their soundness or cogency,
3. to recognize common fallacies
4. to use a formal technique to determine the validity of simple deductive arguments
5. to evaluate the adequacy of evidence according to appropriate inductive standards.
b. Language
Students who complete a skill-oriented humanities course in a language should
1. demonstrate proficiency in listening, speaking and writing.
D. Division of Courses into Skill and Content Areas
Content courses include:
AKNS A201 Native Perspectives
ART A261 History of World Art I
ART A262 History of World Art II
ART A360A History of Non-Western Art I
ART A360B History of Non-Western Art II
ENGL A121 Introduction to Literature
ENGL A201 Masterpieces of World Literature I
ENGL A202 Masterpieces of World Literature
II
ENGL A301 Literature of Britain I
ENGL A302 Literature of Britain II
ENGL A305 Topics in National Literatures
ENGL A306 Literature of the United States I
ENGL A307 Literature of the United States II
ENGL A310 Ancient Literature
ENGL A383 Film Interpretation
HIST A101 Western Civilization I
HIST A102 Western Civilization II
HIST A121 East Asian Civilization I
HIST A122 East Asian Civilization II
HIST A131 History of United States I
HIST A132 History of United States II
HIST A341 History of Alaska
HUM A211 Introduction to Humanities I
HUM A212 Introduction to Humanities II
HUM A250 Myths and Contemporary Culture
LING A101 The Nature of Language
MUS A221 History of Music I
MUS A222 History of Music II
PHIL A201 Introduction to Philosophy
PHIL A211 History of Philosophy I
PHIL A212 History of Philosophy II
PHIL A301 Ethics
PHIL A313B Eastern Philosophy and Religion
PHIL A314 Western Religion
PS A331 Political Philosophy
PS A332 History of Political Philosophy I:
Classical
PS A333 History of Political Philosophy II:
Modern
THR A311 Representative Plays I
THR A312 Representative Plays II
THR A411 History of the Theatre I
THR A412 History of the Theatre II
Skills courses include:
AKNS A101 Alaska Native Languages I
AKNS A102 Alaska Native Languages II
ASL A101 Elementary American Sign
Language I
ASL A102 Elementary American Sign
Language II
ASL A201 Intermediate American Sign
Language I
ASL A202 Intermediate American Sign
Language II
CHIN A101 Elementary Chinese I
Associate of Arts Educational Effectiveness Assessment Plan
CHIN A102 Elementary Chinese II
FREN A101 Elementary French I
FREN A102 Elementary French II
FREN A201 Intermediate French I
FREN A202 Intermediate French II
GER A101 Elementary German I
GER A102 Elementary German II
GER A201 Intermediate German I
GER A202 Intermediate German II
ITAL A101 Elementary Italian I
ITAL A102 Elementary Italian II
Submitted 11-3-08
Page 24 of 68
JPN A101 Elementary Japanese I
JPN A102 Elementary Japanese II
JPN A201 Intermediate Japanese I
JPN A202 Intermediate Japanese II
KOR A101 Elementary Korean I
KOR A102 Elementary Korean II
LAT A101 Elementary Latin I
LAT A102 Elementary Latin II
PHIL 101 Introduction to Logic
RUSS A101 Elementary Russian I
RUSS A102 Elementary Russian II
RUSS A201 Intermediate Russian I
RUSS A202 Intermediate Russian II
SPAN A101 Elementary Spanish I
SPAN A102 Elementary Spanish II
SPAN A201 Intermediate Spanish I
SPAN A202 Intermediate Spanish II
E. Assessment Tool
Associate of Arts Student Learning Outcomes Assessment
Planning/Results Sheet
Semester/Year _______________ Subject___
________________________
Outcome #_____________________________________________________________________
______________________________________________________________________________
Instructor________________________ Instructor Rank ________________________
Type of Instructor (adjunct, term, tenure track, tenured) ________________________
Course ___________________ Section______________
Total Enrollment ________________ Total Number of Students Assessed______________________
Total Number Successful ______________Total Number Unsuccessful ____________
Total Points or Percentage Possible_________ Total Points or Percent Required for Success___________
Description of assignment _______________________________________________________________
_____________________________________________________________________________________
_____________________________________________________________________________________
Please either list all individual student points or scores for this assessment OR attach a copy of your grade sheet
without student names.
_______ _______ _______ _______ _______ _______ _______ _______ _______ _______
_______ _______ _______ _______ _______ _______ _______ _______ _______ _______
_______ _______ _______ _______ _______ _______ _______ _______ _______ _______
_______ _______ _______ _______ _______ _______ _______ _______ _______ _______
_______ _______ _______ _______ _______ _______ _______ _______ _______ _______
_______ _______ _______ _______ _______ _______ _______ _______ _______ _______
_______ _______ _______ _______ _______ _______ _______ _______ _______ _______
_______ _______ _______ _______ _______ _______ _______ _______ _______ _______
Please use the back side to write any analysis or comments regarding this assessment tool, this course, or this
program.
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 25 of 68
Please attach a copy of:
1. The Assignment
2. A “Successful” assessment score sheet with the corresponding student product
3. An “Unsuccessful” assessment score sheet with the corresponding student product
Please remove any student identifiers.
F. Administration of Tool
The assessment coordinator will provide a copy of the assessment survey document along with
instructions for completing the survey by Nov. 1 for courses being assessed in the fall semester and
April 1 for those being assessed in the spring semester. Faculty members will pick an appropriate
assignment, i.e., one that measures students’ achievement of the relevant outcomes. The faculty
member will also choose a grade that serves as a cut off for measuring success. The faculty member
will summarize student performance as required by the survey sheet (see above) and submit these results
to the assessment coordinator along with a copy of the assignment and examples of both successful and
unsuccessful assignments.
Information acquired through the assessment process should be reported to the humanities GER
assessment coordinator at the end of the academic year during which the assessment occurs. The
coordinator will then incorporate this information into the annual report.
Department heads will be contacted to determine frequency of offering and an appropriate rotation will
be set up in coordination with department chairs.
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 26 of 68
APPENDIX G: SAMPLE NATURAL SCIENCES AA ASSESSMENT EXAM
1. Assessment exams should follow a basic format for all natural science courses for the AA
Degree so that:
a. Examples and subject matter derived from the natural science (Astronomy–Physics,
Biological Sciences, Chemistry and Geology) disciplines assessed for a given academic
year will be presented in tabular, graphic and/or textual (newspaper, magazine) formats.
A sample article from www.biologynews.net that addresses the genetic decoding of an
oral pathogen is provided below:
Scientists decode genome of oral pathogen April 5, 2007
(http://www.biologynews.net/archives/2007/04/05/scientists_decode_genome_of_oral_pathogen.html)
Scientists decode genome of oral pathogen
Transmission electron micrograph of S.
sanguinis.
S. sanguinis within an infected heart
valve.
This is a case of infective endocarditis in
a rabbit model
Virginia Commonwealth University researchers have decoded the genome of a bacteria normally present in the healthy
human mouth that can cause a deadly heart infection if it enters the bloodstream. The finding enables scientists to better
understand the organism, Streptococcus sanguinis, and develop new strategies for treatment and infection prevention. S.
sanguinis, a type of bacteria that is naturally present in the mouth, is among a variety of microorganisms responsible for
the formation of dental plaque. In general, S. sanguinis is harmless. However, if it enters the bloodstream, possibly
through a minor cut or wound in the mouth, it can cause bacterial endocarditis, a serious and often lethal infection of the
heart. Individuals with preexisting heart problems are at an increased risk of developing bacterial endocarditis. The
infection may result in impaired heart function and complications such as heart attack and stroke. Typically, before dental
surgery, such patients are given high dose antibiotics to prevent infection. Decoding S. sanguinis, a streptococcal bacteria,
will provide researchers with unique insight into its complex life cycle, metabolism and its ability to invade the host and
cause bacterial endocarditis. "We can apply this information toward the design of new treatments and preventative
strategies to protect against this disease," said lead investigator, Francis Macrina, Ph.D., VCU’s vice president for
research. "Analysis of the genome revealed a surprising number of proteins on the S. sanguinis cell surface that may be
new targets for drugs or vaccines. We are already at work pursuing some of these leads." Although it is not directly
associated with tooth decay or gum disease, S. sanguinis is a prominent member of dental plaque. "Genomic studies of
this organism will also help us better understand the formation of dental plaque and the initiation of oral diseases," added
Macrina.
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 27 of 68
The team reported that the genome of the gram-positive bacterium is a circular DNA molecule consisting of approximately
2.4 million base pairs. They analyzed the S. sanguinis genome and found that it was larger than other streptococci that
b. A total of 10 multiple-choice questions will be administered in two sections on the last
exam of a semester.
2. Section 1:
a. Focuses on Scientific Method and its elements.
b. Differentiating between observation, hypothesis, testing, theory and paradigm shifts.
c. Sample questions:
i. On the basis of the above article, the ability of Streptococcus sanguinis to cause
lethal infections of the human heart is a(n):
1. Observation.
2. Hypothesis.
3. Experimental result.
4. Theory.
5. None of the above.
ii. The statement that Streptococcus sanguinis can cause bacterial endocarditis in
humans is a(n):
1. Fact.
2. Observation.
3. Hypothesis.
4. Experimental result.
5. Theory.
3. Section 2:
a. Application of Scientific Method.
b. Formulating hypotheses and conclusions on the basis of data, information and articles
taken from the media.
c. Sample questions:
i. On the basis of the above article, the genome of Streptococcus sanguinis is
considerably larger compared to those of other related bacteria that have been
sequenced. The additional genomic material possessed by this species of
bacterium was probably acquired through a process called Bacterial _________:
1. Transduction
2. Transformation
3. Transfiguration
4. Transgenesis
5. None of the above.
ii. Some of the extra DNA possessed by Streptococcus sanguinis may promote this
species enhanced survival in the face of good oral hygiene and explain its
emergence as an important pathogen. If true, this example represents a case of:
1. Evolution.
2. Natural selection.
3. Adaptation.
4. Decent with modification.
5. All of the above.
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 28 of 68
Appendix G: Sample Draft Social Sciences Discipline-Specific Assessment Test
Associate of Arts Assessment Plan for the Social Sciences
June 11, 2008
John Petraitis, Department of Psychology
Social Science AA Assessment Coordinator
Assessment Background
To earn an Associate of Arts degree, students must complete 60 credits, including 6 credits in courses
that have been approved for the Social Sciences GER (SS-GER) (see p. 82 of UAA’s 2007-2008
catalog). Those 6 credits must be divided between approved courses from two of the following
disciplines: Anthropology, Business Administration, Economics, Environmental Studies, Geography,
Health Sciences, Human Services, International Studies, Journalism/Public Communications, Justice,
Political Science, Psychology, Sociology, Social Work, and Women’s Studies. Because (a) CAS has
been assigned the responsibility of managing and assessing all AA degrees, (b) 21 of the 30 courses in
the SS-GER list are taught by department in CAS, and (c) the vast majority of students complete their
SS-GER requirement with CAS courses, systematic assessment of the social science portion of the AA
degree will begin with CAS departments. These 21 CAS-based SS-GER courses are listed Table 1.
Table 1: CAS-Based Social Science GER courses
DEPT
ANTH
ANTH
ANTH
ANTH
ENVI
GEOG/INTL
INTL
JPC
PS
PS
PS
PS/SOC
PSY
PSY
SOC
SOC
SOC
SOC
SOC
SOC
WS
#
A101
A200
A202
A250
A201
A101
A301
A101
A101
A102
A311
A351
A111
A150
A101
A110
A201
A202
A222
A342
A200
TITLE
Intro to Anthropology
Natives of Alaska
Cultural Anthropology
The Rise of Civilizations
Living on Earth: Intro to Environmental Studies
Local Places: Global Regions/Intro to Geography
Canada: Introductory Survey
Media & Society
Intro. to American Government
Intro to Political Science
Comparative Politics
Political Sociology
General Psychology
Lifespan Development
Intro to Sociology
Intro to Gerontology: Multidisciplinary Approach
Social Problems and Solutions
The Social Organization of Society
Small and Rural Communities
Sexual, Marital and Family Lifestyles
Intro to Women's Studies
Identifying the Goals of SS-GERs
A logical starting point for assessing the social science portion of the AA degree is the general
description of SS-GERs on page 85 of UAA’s 2007-2008 catalog.
The social sciences focus on the acquisition, analysis, and interpretation of empirical data
relevant to the human experience. Disciplines differ in their focus on collective as opposed to
individual behavior, biological as opposed to social or cultural factors, the present as opposed
to the past, and quantitative as opposed to qualitative data.
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 29 of 68
1. Students who complete a general education social sciences course should be motivated to
reflect on the workings of the society of which they are apart and should possess a broad
perspective on the diversity of human behavior.
2. They should be able to distinguish between empirical and non-empirical truth claims.
3. They should be aware of the limits of human objectivity and understand the rudiments of how
ideas about social phenomena may be tested and verified or rejected.
4. They should have an introductory knowledge of social science thinking which includes
observation, empirical data analysis, theoretical models, quantitative reasoning, and
application to social aspects of contemporary life.
5. A student who has met the social science general education requirement is expected to be
able to demonstrate knowledge of social science approaches and to apply that knowledge in
a particular content area.
(Note: UAA’s catalog includes all of the above sentences, but does not bullet-point the final five
sentences. Numbering the final five sentences, however, was done in this report for clarity and these
sentences are referred to as Objectives 1-5 throughout the rest of this report.)
At the risk of over-simplification, Objective 1 focuses on the ‘social’ part of the social sciences,
addressing the knowledge, theories, and insights gained by scholars about the social world; Objectives
2-5, by contrast, focus on the ‘science’ part of the social sciences, addressing the systematic processes
and methods by which scholars have generated knowledge, tested theories, and gained insights about the
social world.
Arguably, each course in the SS-GER list should address each of the above 5 objectives, teaching
students two things: what social scientists know about the social world, and how social scientists go about
gaining such knowledge. Consequently, assessment of the SS-GER courses should, arguably, be based on
a demonstration of increasing understanding of the content of each course (e.g., the facts, theories,
perspectives), and increasing understanding of the scientific process of each discipline (e.g., appreciation
of the methods). Demonstrating such increases would require (a) that students complete some type of
pretest near the beginning of the semester and a posttest at some point later in the semester, (b) there be a
way of linking each student’s pretest with his/her posttest, and (c) analyses be limited to students who
complete both the pretest and posttest. This last point is important because any changes (presumably,
increases) in scores between the pretest and posttest might be misleading if the analyses include people
who were present at the pretest but who withdrew from the course before the posttest. Such analyses might
artificially show better average performance on the posttest than the pretest simply because pretest
averages were suppressed by the inclusion of more under-prepared students whereas posttest averages were
inflated by with withdrawal of under-prepared students during the intervening weeks. This phenomenon in
known as ‘selective attrition’ and requires that analyses be limited to students who were present at both the
pretest and posttest.
Social Science Pre-tests and Post-tests
With this logic in mind, faculty from ANTH, GEOG, JPC, PS, PSY, SOC and WS were asked to
construct 20-item multiple-choice quizzes for their SS-GER courses, quizzes that could be administered
in those classes near the beginning of the semester and at some point later in the semester. Faculty were
encouraged to customize these quizzes – as much as possible – around the scientific methods that are
most common in their disciplines because each discipline appropriately relies on different scientific
methods. For instance, PSY might rely more heavily on experimentation whereas ANTH, SOC and PS
might rely more on naturalistic observation, participant observation, and carefully-designed case studies,
respectively. Faculty were also encouraged to have student put some identifier – either a name or ID
number – on their pretests and posttests, thereby allowing the tests to be matched and allowing analyses
to be limited to students who completed both tests.
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 30 of 68
Quizzes were constructed for 10 of the 21 CAS-based SS-GER courses and administered in 42 of
those courses during Fall 08 and/or Spring 09. However, data were collected and submitted in such a
way that pretest and posttest could be matched by name or ID for only 28 sections. Table 2 summarizes
participation.
Table 2: Participation in SS-GER Pre-testing and Post-testing for Fall 07 & Spring 08
# of sections
# of sections in which pre- # of sections
offered in
test & postreporting
Test conFall 08test were
matchable
DEPT TITLE
structed
Spring 09
administered
data
ANTH A101 Intro to Anthropology
Y
5
2
0
ANTH A200 Natives of Alaska
Y
4
2
0
ANTH A202 Cultural Anthropology
N
2
0
0
ANTH A250 Rise of Civilizations
N
6
0
0
ENVI A201 Intro to Environ. Studies
N
2
0
0
GEOG A101 Intro to Geography
Y
6
2
0
INTL A301 Canada: Intro. Survey
N
0
JPC A101 Media & Society
Y
3
2
0
PS A101 Intro. To Amer. Gov’t
Y
6
5
5
PS A102 Intro to Political Sci.
Y
5
4
3
PS A311 Comparative Politics
Y
1
1
1
PS/SOC A351 Political Sociology
N
1
0
0
General
Psychology
PSY A111
Y
16
9
7
PSY A150 Lifespan Development
Y
13
12
10
SOC A101 Intro to Sociology
2 versions
21
2
1
SOC A110 Intro to Gerontology
N
1
0
0
SOC A201 Soc. Problems/Solutions
N
2
0
0
SOC A202 Soc. Organiz of Society
N
1
0
0
SOC A222 Small/Rural Commun.
N
0
SOC A342 Sexual/Marital/Fam Life.
N
1
0
0
WS A200 Intro to Women's Studies
Y
2
1
1
TOTAL
10 (48%)
98
42
28
Table 2 demonstrates that participation by faculty was inconsistent. This is, however,
understandable given that faculty have little incentive to construct tests, administer them twice per
semester, and ensure that their many students faithfully complete the tests in a way where each student’s
pretest answers could be matched to his/her posttest answers. In fact, although the goal of SS-GER
assessment this year was to administer pretests and posttests in every section of SS-GER courses, the
incomplete participation rate made that impossible. Moreover, the scarcity of matchable data made it
impossible to analyze even those courses where faculty did participate. Consequently, the scaled-down
goal for the report this year was to analyze data from at least one (if not two) sections of courses were
faculty administered pretests and posttests. The analyses are described below.
Results
Table 3 summarizes the results. In all cases, scores were converted to a 100-point scale. For example,
the average number of questions answered correctly on the pretest for PSY A111 was 11.26 out of 20
possible points. Multiplying this value by five converted the mean of 11.26 (out of 20) to 53.6 (out of
100). Similar conversions were conducted for all courses.
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 31 of 68
In cases where pretests and posttest have equal sample sizes, analyses were limited to students
who completed both the pretest and posttest, thereby eliminating the chance that selective attrition
inflated posttest scores. In all of these cases except for one (SOC A101, Version B), instructors made
there raw data available, making it possible to compute each student’s score on the pretest and posttest,
pretest and posttest means, standard deviations (SD) and matched-pairs t-tests to see if pretest and
posttest means were significantly different. In cases where pretest and posttest sample sizes are unequal,
instructors generously provided means based on their own analyses but did not provide the raw data
which would have allowed for further analyses, like standard deviations and matched-pairs t-tests.
Table 3: Pretest and Posttest Results for SS-GERs in Fall 07 & Spring 08
DEPT TITLE
ANTH A101 Intro to Anthropology
ANTH A200 Natives of Alaska
ANTH A202 Cultural Anthropology
ANTH A250 Rise of Civilizations
ENVI A201 Intro to Environ. Studies
GEOG A101 Intro to Geography
INTL A301 Canada: Intro. Survey
JPC A101 Media & Society
PS A101 Intro. To Amer. Gov’t
PS A102 Intro to Political Sci.
PS A311 Comparative Politics
PS/SOC A351 Political Sociology
PSY A111 General Psychology
PSY A150 Lifespan Development
SOC A101 Intro Soc. (version A)
SOC A101 Intro Soc. (version B)
SOC A110 Intro to Gerontology
SOC A201 Soc. Problem/Solution
SOC A202 Soc. Organiz of Society
SOC A222 Small/Rural Commun.
SOC A342 Sexual/Marital/Fam Life.
WS A200 Intro to Women's Studies
* p<.05 one-tailed
Pretest &
Posttest
Sample
Sizes
64 & 63
91 & 91
79 & 86
68 & 55
49 & 49
45 & 45
15 & 15
63 & 63
93 & 93
28 & 28
31 & 32
14 & 14
Pretest
Mean
(SD)
53.0
48.1 (35.9)
65.5
48.9
58.3 (14.6)
60.9 (14.4)
57.7 (11.1)
56.3 (15.4)
61.9 (16.0)
55.7 (14.3)
16.6
43.2 (13.8)
Posttest
Mean
(SD)
57.4
97.1 (11.1)
84.9
50.1
63.1 (16.0)
71.0 (13.0)
61.3 (12.5)
70.2 (15.0)
64.2 (17.0)
69.1 (13.3)
36.3
81.1 (12.4)
Matchedpairs tvalue
12.90*
2.79*
8.14*
1.39
6.72*
1.86*
6.51*
*
14.0*
Inspection of the Table 3 suggests the following.
 ANTH A101 showed roughly a 4-point increase in scores from pretest to posttest. Given that
each pretest/posttest question was worth 5 points, students who complete both the pretest and
posttest in ANTH A101 improved their performance by approximately 1 question. Data,
however, were reported in such a way that it was not possible to know if this increase was
statistically significant.
 ANTH A200 showed a 49-point increase in test scores, a statistically-significant increase that
could not be attributed to selective attrition. At the posttest student had doubled their ability to
identify 20 different language regions in Alaska, doing a nearly perfect job.
 GEOG A101 showed roughly a 20-point increase in test scores, a statistically-significant
increase that could not be attributed to selective attrition.
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 32 of 68








JPC A101 showed a small 1-point increase in test scores. However, because raw data were not
submitted this year it was not possible to determine at this time if the increase was statistically
significant (which seems unlikely) or whether is was within the margin of error (which seems
highly likely). Moreover, the lower sample size at the posttest raises the possibility that selective
attrition inflated the difference between the pretest and posttest scores.
PS A101 showed roughly a 5-point increase in test scores, a statistically-significant increase that
could not be attributed to selective attrition. Given that each pretest/posttest question was worth
5 points, students who complete both the pretest and posttest in PS A101 improved their
performance by approximately 1 question.
PS A102 showed roughly a 10-point increase, a statistically-significant increase that could not be
attributed to selective attrition. The size of the increase corresponds to an improvement of 2
questions out of 20.
PS A311 showed a small increase that could not be attributed to selective attrition. However, the
roughly 4-point increase – an improvement of about 1 question out of 20 -- was not statistically
significant, perhaps because of the low sample size (n=15) this year.
PSY A111 showed roughly a 14-point increase, a statistically-significant increase in test scores
that could not be attributed to selective attrition. Students improved there performance by about
3 of 20 questions.
PSY A150 did show a small but nonetheless significant increase in test scores, an increase that
could not be attributed to selective attrition. This small increase (about 2 points or less than ½ of
a test question) merits further attention because data from only four of ten sections with usable
data were analyzed, and increases might be larger or smaller in other sections.
SOC A101 did show a significant increase in test scores, an increase that could not be attributed
to selective attrition. This was true of both versions of tests used in SOC A101. Version A
showed roughly a 13-point increase (about 3 of 20 questions), and Version B showed roughly a
20-point increase. However, Version B appeared to be very difficult (perhaps too difficult),
having a posttest mean of only 36.3 out of 100 (converted from 12.7 out of 35).
WS A200 showed roughly a 38-point increase, a statistically-significant improvement that could
not be attributed to selective attrition. Students improved their performance by about 7-8
questions out of 20.
Linking Results with UAA’s Five Objectives for SS-GER Courses
UAA’s SS-GER courses have five objectives. Objective 1 focuses on students gaining
knowledge about targeted aspects of their social worlds; Objectives 2-5 focus on students gaining
knowledge about the scientific methods that are used in one or more of the social sciences.
However, inspection of the pretests and posttests (see Appendix) reveal unequal attention to
knowledge in a discipline (e.g., facts, theories) compared to the scientific method. As the following
Table 4 shows, the pretests and posttests used for PSY A111 and PSY A150 focused exclusively on the
scientific methods used in psychology, testing students’ understanding of research design and research
analyses. Pretests and posttest used in JPC A101 and one section of SOC A101 had a mix of questions,
each having three questions about disciplinary facts (e.g., about targeted audiences for radio in JPC
A101, or the foundations of conflict theory in SOC A101), but having 85% of the questions focused on
scientific methods (e.g., use of random sampling or on methods for testing hypotheses). By contrast,
however, the pretests and posttests used in some courses had no questions about the scientific methods
used in the relevant discipline, and focused exclusively on knowledge in the discipline. As examples,
ANTH A200 used a test that had focused exclusively on being able identify the 20 tribal language
regions in Alaska, PS A101 focused on established facts (e.g., about the Federalist Papers, the Bill of
Rights, and Alaska’s senior senator), and Version B of the pretest/posttest used in SOC A101 focused on
knowledge of key sociological concepts (e.g., social stratification).
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 33 of 68
Table 4: Content Analysis of Items in SS-GER Pretests and Posttest for Fall 07 & Spring 08
DEPT
ANTH A101
ANTH A200
ANTH A202
ANTH A250
ENVI A201
GEOG A101
INTL A301
JPC A101
PS A101
PS A102
PS A311
PS/SOC A351
PSY A111
PSY A150
SOC A101
SOC A101
SOC A110
SOC A201
SOC A202
SOC A222
SOC A342
WS A200
AVERAGE
TITLE
Intro to Anthropology
Natives of Alaska
Cultural Anthropology
Rise of Civilizations
Intro to Environ. Studies
Intro to Geography
Canada: Intro. Survey
Media & Society
Intro. To Amer. Gov’t
Intro to Political Sci.
Comparative Politics
Political Sociology
General Psychology
Lifespan Development
Intro. Soc (version A)
Intro. Soc. (version B)
Intro to Gerontology
Soc. Problem/Solution
Soc. Organiz of Society
Small/Rural Commun.
Sexual/Marital/Fam Life.
Intro to Women's Studies
Test items that
focused on
disciplinary
knowledge
2-7, 11-17, 20
1-20
2
2, 17, 20
1-20
1-20
1-20
None
None
3-6
1-7
1-20
Test items that
focused on
disciplinary
methods
1, 8-10, 18-19
None
1, 3
1, 3-16, 18-19
None
None
None
1-20
1-20
1-2, 7-20
None
None
% of items
focused on
disciplinary
methods
30%
0%
67%
85%
0%
0%
0%
100%
100%
85%
0%
0%
39%
Gaining knowledge from a discipline is, of course, very important. Students with AA degrees
should know about different language regions in Alaska, the Federalist Papers, and social stratification.
And, gaining such knowledge is consistent with Objective 1 of UAA’s SS-GER courses:
1. ‘Students who complete a general education social sciences course should be motivated to
reflect on the workings of the society of which they are apart and should possess a broad
perspective on the diversity of human behavior.’
However, Objectives 2-5 state that students should also be taught about the ‘science’ part of the
social sciences – about how social science is based on systematic observation, articulated observation
procedures, and potentially-replicable conclusions. Of the 12 pretests and posttests constructed for AY
07-08, six of them do not yet demonstrate attention to the following four objectives of SS GERs.
2. [Students] should be able to distinguish between empirical and non-empirical truth claims.
3. [Students] should be aware of the limits of human objectivity and understand the rudiments
of how ideas about social phenomena may be tested and verified or rejected.
4. [Students] should have an introductory knowledge of social science thinking which includes
observation, empirical data analysis, theoretical models, quantitative reasoning, and
application to social aspects of contemporary life.
5. A student who has met the social science general education requirement is expected to be
able to demonstrate knowledge of social science approaches and to apply that knowledge in
a particular content area.”
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 34 of 68
For some courses, it might be very easy to revise subsequent pretests and posttests to give more attention
to scientific methods. For instance, PS A311 (Comparative Politics) relies on in-depth comparisons
(essentially, detailed cases-studies) of different political systems. As such, the pretest and posttest for
that course in AY 08-09 might easily be redesigned to address the strategies used in political case
studies, the benefits of comparative case studies, and the limitations of such methods.
For other courses, however, it might be very difficult to develop pretests and posttest that focus,
in substantial part, on Objectives 2-5. In such cases, one needs to ask whether such courses should be
among the list of SS GERs. All of the 21 CAS-based courses in the SS-GER list are ‘social’ because
they focus on some aspect of the social (human-made) world. Further, all of the CAS-disciplines with
courses in the SS-GER list are appropriately considered ‘social sciences.’ But some of these 21 courses
might not be taught in a way that emphasizes the science of the discipline, and some of these courses
(not disciplines) might not actually be about social sciences but instead are about social fact and social
theory.
Recommendations
AY 07-08 was the first year of assessment of UAA’s SS-GER offerings. Many faculty deserve rich
appreciation for their help, including the department chairs with SS-GER courses and instructors of
those courses. The first year, perhaps, taught more about the process of SS-GER assessment and less
about the outcome. The following recommendations are offered to improve the process of SS-GER
assessment in years to come.
1. Select for evaluation 1-2 sections per year of each SS-GER, rather than targeting every section.
2. Compensate faculty for participation in SS-GER assessment.
3. Encourage participation by faculty who in are teaching SS-GER courses in AY 08-09 that were
not evaluated in AY 07-08.
4. Have the SS-Assessment coordinator either (a) carefully train instructors in how to administer
pretests and posttests, or (b) personally administer the tests rather than the instructors.
5. Have each participating section of a particular GER (e.g., SOC A101) use the same test, rather
than different instructors using different tests.
6. As was done for ANTH A101, place pretests and posttests on Blackboard. Although timeconsuming at first, placing the tests on Blackboard allows the tests to be completed without using
class time, and automatically allows each student’s pretest to be linked to his/her posttest.
7. Do not make “B” the correct answer on so many multiple choice questions. The axiom ‘when in
doubt, guess B’ seemed to hold true during SS-GER assessment where about 40% of correct
answers were ‘B.’
8. Revise the tests so that at least 25% (preferably, more) of the items focus on the science of the
social sciences, focusing on vocabulary, strengths, and weaknesses with one or more of the
systematic empirical methods on which course material is based.
9. Future assessments might inspect course content guides (CCGs), syllabi and assignments for SSGER courses. CCGs can reveal which courses are designed to teach about scientific methods;
syllabi and assignments can reveal which courses actually teach about such methods.
The last two recommendations are likely to be the most controversial. Without doubt, the disciplines of
anthropology, geography, political science, psychology, sociology, and women’s studies all belong
among the social sciences because some (of course, not all) practitioners rely on the scientific method to
document facts and generate new knowledge. However, there is probably unequal commitment across
instructors of courses in the SS-GER list to teaching about social science methods. In fact, some faculty
who teach courses in the list have argued that the scientific method is not particularly relevant to their
SS-GER course. However, recommending that at least 25% of a pretest/posttest address the scientific
method seems like a reasonable threshold for a course in the SS-GER list. This is not to say that 25% of
the course should be based on the scientific method. Rather it is to say that the application of the
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 35 of 68
scientific method to understanding the social/human-made world is perhaps the only common
denominator among the socials sciences and therefore provides an ideal focus for assessment of SS-GER
courses. If a course cannot construct 5 out of 20 questions about the scientific methods that underlie
course material, that course might not fit UAA’s current catalog description of a SS GER. Similarly, if a
course’s CCG, syllabi and assignments reveal little about scientific methods the course might not fit the
current description of SS GERs.
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 36 of 68
Appendix
Appendix: Pretests and Posttest Used SS-GER Courses in Fall 07 & Spring 08
DEPT
COURSE
ANTH A101 Intro to Anthropology
ANTH A200 Natives of Alaska
ANTH A202 Cultural Anthropology
ANTH A250 Rise of Civilizations
ENVI A201 Intro to Environ. Studies
GEOG A101 Intro to Geography
INTL A301 Canada: Intro. Survey
JPC A101 Media & Society
PS A101 Intro. To Amer. Gov’t
PS A102 Intro to Political Sci.
PS A311 Comparative Politics
PS/SOC A351 Political Sociology
PSY A111 General Psychology
PSY A150 Lifespan Development
SOC A101 Intro to Sociology (Version A)
SOC A101 Intro to Sociology (Version B)
SOC A110 Intro to Gerontology
SOC A201 Soc. Problems/Solutions
SOC A202 Soc. Organiz of Society
SOC A222 Small/Rural Commun.
SOC A342 Sexual/Marital/Fam Life.
WS A200 Intro to Women's Studies
Associate of Arts Educational Effectiveness Assessment Plan
Page
11-15
16
No test in AY 07-08
No test in AY 07-08
No test in AY 07-08
17
No test in AY 07-08
18-20
21-23
24-26
27-29
No test in AY 07-08
30-33
24
35-39
40
No test in AY 07-08
No test in AY 07-08
No test in AY 07-08
No test in AY 07-08
No test in AY 07-08
41-43
Submitted 11-3-08
Page 37 of 68
ANTH A101 Pretest and Posttest for Fall 07-Spring 08
ANTH A101 Pretest and Posttest
Question 1 Anthropology is called a social science because?
Answers
A. It relies solely on the intuition of anthropologists for answering questions about humans and
human groups.
B. It requires empirical information regarding humans as members of social groups.
C. Anthropologists are members of some human society.
D. Anthropologists teach in universities.
E. None of the above.
Question 2
There are four subfields in anthropology with are_____?
Answers
A. Psychology, Geology, Archaeology and Biological Anthropology.
B. Linguistics, Archaeology, Palaeology and Cultural Anthropology.
C. Cultural Anthropology, Archaeology, Biological Anthropology and Linguistic Anthropology.
D. None of the above.
Question 3
A plant or animal which depends on another species for protection and reproductive success
(in return for which it serves as food or source of useful material) is
Answers
A. domesticated.
B. civilized
C. doomed to become extinct.
D. the product of conscious efforts by humans to plan food production.
E. C and D
Question 4
Human's major mode of adaptation which enables him or her to live effectively in diverse
environments is
Answers
A. body hair
B. sweat glands
C. bipedal locomotion
D. culture
E. specialized teeth
Question 5
Important to the definition of culture is that behavior is:
Answers
A. learned
B. shared
C. patterned
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 38 of 68
D. all of the above
Unanswered
Question 6
The concept of culture_____
Answers
A. refers only to operas, plays and other fine arts
B. is the customary manner in which human groups learn to organize their behavior and thought in
relation to their environment
C. manifests itself biologically
D. b and c
Question 7
As part of your job, you may study the frequency of blood types in human populations,
or watch the behavior of monkeys and apes, or dig for early hominid bones in East Africa.
You are a/an_____
Answers
A. ethnologist.
B. primatologist.
C. ethologist.
D. physical anthropologist.
E. cultural anthropologist.
Question 8
It is difficult to form objective hypotheses about culture that are free from the cultural biases
of the investigator (i.e., that are not ____________.)
Answers
A. culture-bound
B. culture free
C. scientific
D. emotional
E. all of the above
Question 9
A material object that shows signs of having been made or altered by humans is called
a(an)________.
Answers
A. tool
B. structure
C. feature
D. artifact
E. none of the above
Question 10
The exact location of an artifact or fossil must be recorded accurately both in time and space.
For that reason, the first thing that you will do when investigating a site is_____
Answers
A. carefully scrape off all the dirt and photograph the area
B. lay out a grid system with a permanent datum point
C. carefully draw all the surface features
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 39 of 68
D. dig a deep trench to see how deep the site is
E. it doesn't really matter what you do first as long as YOU get the artifacts.
Question 11
Gene pool is_____
Answers
A. a term referring to biological billiards
B. a liquid area of the human body where the observation of genes is possible
C. the total of all the genes possessed by the members of a given population
D. a collection of genetically altered experiments
E. a gathering of genetic engineers to exchange ideas
Question 12
The remains of a blind amputee discovered in Shanidar Cave in Iraq, and the remains
of a man crippled by arthritis at La Chapelle, suggest that Neandertals_____
Answers
A. had more accidents than modern peoples.
B. were genetically inferior.
C. were the discarded wanderers of more developed peoples.
D. were productive enough to support handicapped individuals.
E. ate foods that were too rich for them.
Question 13
To say that food foraging societies are egalitarian means that
Answers
A. there are no status differences.
B. the only status differences are age and sex.
C. everyone is equal except women.
D. men are usually subordinate to women.
E. children are the center of community life.
Question 14
One of the most significant characteristics of the food-producing way of life was the development
of _______________.
Answers
A. permanent settlements
B. transient populations
C. skillful hunters
D. adept gathers
E. increased egalitarianism
Question 15
Marriage within a particular groups of individuals is called
Answers
A. incest
B. exogamy
C. monogamy
D. endogamy
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 40 of 68
E. polygamy
Question 16
The most preferred form of marriage around the world is
Answers
A. polygyny
B. monogamy
C. polyandry
D. polygamy
E. the levirate.
Question 17 The archaeologist is limited in the reconstruction of past cultures because
Answers
A. there is an overabundance of cultural remains
B. the reconstruction of cultural intangibles (beliefs, morals, values) is very difficult and the
remains of material culture represent only a small portion of what existed in the living culture
C. reconstructing the technology of a culture in nearly impossible
D. archaeologist do not engage in enough research in the study of preliterate cultures
E. there are too many written records documenting the beliefs and values of most non-Western
societies
Question 18
How is social behavior of extinct primates reconstructed?
Answers
A. By relating the behavior and ecology of modern primates to similar animals inhabiting similar
ecosystems in the past
B. By equating the behavior of ancient animals to that of modern animals with similar-sized
brains
C. By equating the behavior of ancient animals to that of the most primitive living primates -- the
prosimians (strepsirhine)
D. By equating the behavior of ancient animals to that of primitive aspects of modern primate
behavior
Question 19
The most common form of marriage around the world is_____
Answers
A. monogamy
B. serial monogamy
C. polygyny
D. polyandry
E. levirate
Unanswered
Question 20
Natural selection_____
Answers
A. means the ability of some individuals to kill enemies and survive.
B. refers to the tendency for moral goodness to win out over moral badness in human societies.
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 41 of 68
C. refers to the ability of some individuals to breed.
D. occurs when individuals possess certain genetically based traits that help them have more
offspring, and thus contribute a larger share of genes to future gene pools.
E. means "survival of the fattest."
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 42 of 68
ANTH A200 Pretest and Posttest for Fall 07-Spring 08
GEOG A101 Pretest and Posttest for Fall 07-Spring 08
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 43 of 68
Associate of Arts
for the Social Sciences
Geography 101
Explain the significance of and compare the above population pyramids. In you answers, you should …
1. Discuss the percentage of elderly versus young in each country and discuss gender imbalances in
the elderly cohort.
2. Explain the social and economic reasons behind these pyramids and the countries’ growth rates.
3. Predict the consequences to each of the above nations given their population structures and
growth rates.
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 44 of 68
JPC A101 Pretest and Posttest for Fall 07-Spring 08
JPC A101
Social Sciences GER Questionnaire
1. Social Science methods are based on what principles of inquiry
a. Socratic methods
b. Random methods
c. Empirical methods
d. Hypothetical methods
2. Mass Communications
a. Cannot be an empirical discipline
b. Is not a discipline
c. Is outdated
d. Is the study of what is communicated, by whom, to what affect
3. Mass Communications research
a. Has only one method of analysis
b. Uses many methods of analysis
c. Is based on quantitative analysis only
d. Is based on rhetorical theory only
4. Mass Communications theory
a. Doesn’t exist
b. Is designed to explain and predict
c. Cannot be established
d. Is a solved problem
5. Internal validity in Mass Communications research
a. Is impossible to establish
b. Is a function of proper definitions and logic
c. Is something that one should no worry about
d. Is arbitrary
6. External validity in Mass Communications research
a. Is arbitrary
b. Is a function of convention
c. Meets the test of other research
d. Is something that should be of no concern
7. Quantitative methods in mass communications research are used
a. Never
b. Always
c. When dealing with large data
d. When convenient
8. Qualitative methods in mass communications research are used
a. Never
b. Always
c. When analyzing manifest content
d. When convenient
9. Which kind of research method reveals correlations between two variables?
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 45 of 68
a. Surveys
b. Experiments
c. Content analysis
d. Focus group interviews
10. Correlation cannot establish
a. Causality
b. Meaning
c. Tradition
d. Relationships
11. Which kind of research method employs a control group for comparison?
a. Surveys
b. Experiments
c. Content analysis
d. Focus group interviews
12. Institutional Review Boards are important in Mass Communications research
a. Because they provide funding
b. Because they provide protection to human subjects
c. Because they manage grants and contracts
d. The IRB is not important to research
13. Moving images and visual communications
a. Are impossible to empirically study
b. Require unique methods of empirical analysis
c. Need critical attention
d. Cannot be codified
14. For this kind of method, researchers systematically code and measure media content
a. Surveys
b. Experiments
c. Content analysis
d. Focus group interviews
15. The Arbitron and Nielsen ratings systems use what principles of research
a. Lucky guesses
b. Representative samples
c. Non-representative samples
d. Random samples
16. Newspaper readership studies
a. Are arbitrary
b. Are necessary to understand changes in audience
c. Are a waste of time and money
d. Are not taken seriously
17. Radio formats usually target special audiences according to
a. Age and income
b. Gender
c. Race or ethnicity
d. All of the above
18. VALS research for advertising refers to
a. Emotional, social and economic audience profiles
b. Profiles of advertising by geographic region
c. Viceroy’s Analysis of Life Systems
d. The study of audience attention spans
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 46 of 68
19. Psychographics involves the study of
a. Sex
b. Age
c. Socioeconomic class
d. Values and lifestyles
20. Which line of research has generally demonstrated that that mass media don’t tell people what to
think as much as they tell people what to think about?
a. Cultivation analysis
b. Agenda-setting
c. Social learning theory
d. Audience studies
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 47 of 68
PS A101 Pretest and Posttest for Fall 07-Spring 08
PS 101 Pre/Post Quiz Key
NAME:_____________________
1. Deciding "who gets what, when, and how" is called
a. politics.
b. government.
c. democracy.
d. representative democracy
2. In the Federalist Papers in 1787, __________ warned against a direct democracy.
a. George Washington
b. Thomas Jefferson
c. James Madison
d. John Locke
3. The philosopher who argued that natural law guaranteed every person "certain inalienable rights" was
a. John Locke.
b. Adam Smith.
c. Jean-Jacques Rousseau.
d. Thomas Hobbes.
4. The requirement that every person (not just a citizen) be offered "due process of law" can be found in
the United States constitution in
a. Amendments 5 and 14.
b. Amendments 13 and 14.
c. Amendments 5 and 6.
d. Amendments 25 and 27.
5. The written guarantees of basic individual liberties the first ten amendments to the U.S. Constitution
is known as
a. the Writ of Rights and Grievances.
b. the Bill of Rights.
c. the Magna Carta.
d. the writ of habeas corpus.
6. Congress has attempted to restrict the President's powers as Commander-in-Chief through the
a. Case Act.
b. National Emergencies Act.
c. War Powers Act.
d. Budget Impoundment and Control Act of 1974.
7. The federal system in the United States is large and complex and has three levels of government:
a. national, state, and local.
b. enumerated, implied, and concurrent.
c. executive, legislative, and judicial.
d. federal, unitary, and confederation.
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 48 of 68
8. PAC contributions go overwhelmingly to
a. Republicans.
b. incumbent officeholders.
c. Democrats.
d. political challengers.
9. In order to establish a system for selecting government personnel based on merit, Congress passed the
Pendleton Act in 1883, which created the
a. Civil Service Commission.
b. Personnel Selection Commission.
c. Merit Selection Service.
d. Secret Service Commission.
10. A committee organized by corporations, labor unions, trade associations, etc., for the purpose of
soliciting campaign contribution and distributing the money to political candidates is called a
a. conference committee.
b. lobbyist committee.
c. political action committee.
d. political financial committee.
11.The barriers to women's advancement to top positions are often very subtle, giving rise to the phrase
a. slippery floor.
b. "pink" ladder.
c. glass ceiling.
d. "frilly" office.
12. In 1896, in the landmark case of Plessy v. Ferguson, the Supreme Court upheld
a. state laws requiring segregation.
b. all laws aimed at enforcing integrated schools.
c. voting right for freed slaves.
d. state laws requiring abolitionism.
13. The media have long been referred to as America's
a. least important source for news and politics.
b. most volatile branch of government.
c. most powerful branch of government.
d. "fourth branch" of government.
14. All taxpayers have the option of helping fund presidential elections through public money by
checking off a box on their
a. driver's license renewal forms.
b. income tax returns.
c. membership application to political action committees.
d. voter registration card.
15. The power of a court to hear a case in question is a court's
a. jurisdiction
b. first jurisdiction
c. appellate jurisdiction
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 49 of 68
d. stare decisis
16. The agenda of the U.S. Supreme Court is set by:
a. the president
b. Congress
c. the Senate at the beginning of each congressional session
d. Supreme Court itself
17. The United Nations charter was signed in:
a. 1900
b. 1945
c. 1969
d. 2001
18. A mutual-security agreement and joint military command uniting the nations of Western Europe,
initially formed to resist Soviet Expansionism, is known as
a. Southeast Atlantic Peace Agreement
b. North Atlantic Peace Accord
c. North Atlantic Treaty Organization
d. Western Europe Peace Agreement
19. A U.S. program to rebuild the nations of Western Europe in the aftermath of World War II in order
to render them less susceptible to communist influence and takeover was the
a. Monroe doctrine
b, Containment
c. Liberation
d. Marshall Plan
20. A public assistance program that provides health care to the poor is:
a, health care friends
b. medicare
c. medicaid
d. health assistance
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 50 of 68
PS A102 Pretest and Posttest for Fall 07-Spring 08
PS 102 PRE-QUIZ
NAME:___________________
1.
According to Karl Marx, class distinctions are based primarily on
A) a group's relationship to the factors of production.
B) ethnic identity.
C) traditional hierarchies of authority.
D) possession of significant information.
2. The murder of many members of one ethnic group by members of another is often referred to as
A) genocide.
B) low intensity conflict.
C) a rebellion.
D) guerrilla warfare.
3.
What is the ultimate goal of a revolution?
A) to replace the top leadership
B) to assume control of existing political systems
C) to replace the existing political system
D) to equalize resources
4.
The most pressing item contributing to global climate change is?
A) Methane
B) CO2
C) Fire ants
D) Backyard bar-b-ques
5.
The current Prime Minister of Great Britain is?
A) Tony Blair
B) Lord Baltimore
C) Gordon Brown
D) Richard Harris
6. If the ice of Greenland were to completely melt away, ocean levels would rise an estimated
A) 5 feet
B) 11 feet
C) 23 feet
D) 52 feet
7.
The current Secretary General of the United Nations is?
A) Kofi Annan
B) Boutros Boutros-Ghali
C) Ban Ki-Moon
D) U Thant
8.
The name of Al Gore’s documentary on the pressing problem of global climate change is?
A) Sicko
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 51 of 68
B) An Inconvenient Truth
C) Better Watch Out
D) Beyond a Simple Heat Wave
9.
The current Secretary of State is?
A) Colin Powell
B) Newt Gingrich
C) Condoleezza Rice
D) John Butler
10.
The United States has a _________ system of government.
A) federal
B) parliamentary
C) confederal
D) authoritarian
11.
In which country did Karl Marx think Communism had the greatest chance of success?
A) Russia
B) France
C) Great Britain
D) The United States
12. Which of the following ideologies is particularly advocates individual freedom, limited
government and laissez-faire economics?
A) socialism
B) conservativism
C) classical liberalism
D) none of the above
13. Alaska’s senior Senator is?
A) Tony Knowles
B) Lisa Murkowski
C) Ted Stevens
D) Don Young
14.
Political interest groups are comprised of people who
A) work together to placed their members in public office
B) are members of the same occupational or class group
C) work together to achieve a particular policy goal
D) feel incapable of influencing politics by themselves
15.
Canada is an example of what kind of country?
A) communist
B) socialist
C) democratic
D) fascist
16. In what subfield of Political Science would you be most likely to do an in-depth study of the
United Nations?
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 52 of 68
A)
B)
C)
D)
International Relations
Comparative Politics
Public Administration
American Government
17.
Broadcast media consists of all of the following except:
A) Internet
B) Cable
C) Newspapers
D) Radio
18.
The United States Congress is an example of a _______ legislature.
A) unicameral
B) ceremonial
C) bicameral
D) fused
19.
The current Chief Justice of the United States Supreme Court is?
A) John Roberts
B) John Paul Stevens
C) William Rehnquist
D) Karl Rove
20. Which of the following is an important area of legislative oversight?
A) enacting regulatory legislation
B) approving major executive appointments
C) committee hearings on legislation
D) all of the above
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 53 of 68
PS A311 Pretest and Posttest for Fall 07-Spring 08
PS 311 PRE/POST QUIZ
NAME: ____________________________
1. Comparative politics is a subfield of political science that
a. studies foreign affairs policies of nation states.
b. compares different policy perspectives within a given country.
c. compares the struggle for power across different countries.
2. Which of the following is not a model of comparison used by the subfield?
a. Structuralism
b. Rationalism
c. Culturalism
d. Nationalism
3. Sovereignty is defined as the:
a. Rights bestowed on religious minorities within a nation-state
b. Ability of a government to carry out actions or policies within its territory.
c. Right of the United Nations to require a country to adhere to UN protocols.
4. The U.S. economy is theoretically most closely based on ideals expressed by:
a. James Madison
b. Thomas Jefferson
c. Milton Friedman
d. Alexander Hamilton
5. The _____ is critical to the definition of communism.
a. Absence of the state
b. Control of the means of production by the government
c. Control of the economy by corporations
6. Classical liberalism includes which of the following beliefs?
a. The right of same sex couples to marry and the right to universal health care.
b. Protection of the U.S. flag from desecration and prayer in schools.
c. Individual freedoms and limited government.
7. An autocracy is defined by:
a. Rule by the people
b. Rule by an individual
c. Rule by a small group
8. Bicameralism is:
a. separation of church and state
b. the system of separating state government from federal government
c. a system of two legislative bodies
d. when democrats and republicans work together to forge consensus
9. ‘Federalism’ is defined as:
a. The distinction of power and authority between a centralized government and local govts.
b. The dominance of national government over international governments
c. A unicameral legislative system
10. Countries liberated from communist rule are most often referred to as:
a. Transitional developed countries
b. Newly industrialized nations
c. Post communist nation states
d. All of the above
11. The U.S. system of government is most accurately defined as a:
a. Democracy
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 54 of 68
b. Democratic republic
c. Socialist democracy
d. Theocracy
12. Which of the following institutions is also referred to as ‘the fourth estate’?
a. Bureaucracies
b. The media
c. Multi-national corporations
d. Health care organizations
13. In round numbers, how many nation-states exist today according to the United Nations?
a. 190
b. 350
c. 1020
d. 80
14. Who said “the state is a human community that claims the monopoly of the legitimate use of
physical force within a given territory”?
a. Josef Stalin
b. Karl Marx
c. Max Weber
d. John Locke
15. The World is Flat is a book written by Thomas Friedman that refers to which worldwide
phenomenon?
a. Climate change
b. Globalization
c. Transmission of communicable diseases
16. Colonialism resulted in which of the following?
a. Transformation of the borders of nation-states
b. Transformation of the nature of relations between ethnic communities within a nation-state
c. Subordination of the indigenous economic structure to the needs of a foreign power
d. All of the above
e. None of the above
17. Which country emits the most greenhouse gases?
a. Japan
b. Germany
c. The United States
d. Russia
18. Scientists say that the world needs to reduce total greenhouse gas emissions by _____ in order to
stabilize atmospheric greenhouse gas concentrations and avoid “dangerous climatic change.”
a. 50-80%
b. 200-400%
c. 10-15%
19. Which of the following is a true statement about ‘states’ and ‘nations’?
a. ‘Nations’ are not defined by their sovereign power.
b. There is no difference between ‘state’ and ‘nation.’
c. State borders always closely mimic national boundries.
20. The unequal economic relationship between developed countries and developing countries is often
referred to as:
a. Neo-colonialism
b. The poverty gap
c. Globalization
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 55 of 68
PSY A111 Pretest and Posttest for Fall 07-Spring 08
Fundamental Tools in Psychology: 20 Questions
Name:





Most quizzes are designed to assess individual students and how well each student
understands the material. Most quizzes are given once and different students get different
scores based on their individual performances.
This quiz, however, is very different. It is designed to assess the course and how well it
teaches some key material to all students. This quiz will be given twice: at the beginning and
the end of the semester. Different students will not get different scores based on their
performance; instead all students who complete it will receive extra credit for participating in this
study.
Please put you name on this quiz so you can receive extra credit.
Please answer each of the following questions to the best of your ability at this time.
You will only be given 10 minutes, so work as quickly as possible.
1. A specification of how a researcher measures a research variable is known as a(n):
A) hypothesis.
B) theory.
C) replication.
D) operational definition.
2. In order to understand the highly unusual behavior of a 6th grade boy, a developmental
psychologist has carefully investigated the boy’s current life situation and his physical,
interpersonal, and school records. Which research method has the psychologist
employed?
A) the survey
B) the case study
C) Experimentation
D) naturalistic observation
3. In order to determine whether the strength of elderly people's emotional well-being is
related to their income levels, researchers would most likely make use of:
A) case studies.
B) correlational research.
C) experimentation.
D) naturalistic observation.
4. In which type of research is a representative random sample of people asked to answer
questions about their behaviors or attitudes?
A) Experimentation
B) the survey
C) the case study
D) naturalistic observation
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 56 of 68
5. In a test of the effects of sleep deprivation on problem-solving skills of teens, researchers would
wake teenaged research participants after either 3, 6, or 9 hours of sleep on each of four
consecutive nights. This research is an example of:
A) naturalistic observation.
B) survey research.
C) a case study.
D) an experiment.
6. In order to track the development of social skills, Professor Ober carefully monitors 1st – 6th
grade children, recording their social interactions on the playground. Professor Ober is most
clearly engaged in:
A) survey research.
B) naturalistic observation.
C) experimentation.
D) correlational research.
7. Psychologists select a random sample of research participants in order to ensure that:
A) the participants are representative of the population they are interested in studying.
B) there will be a large number of participants in the research study.
C) the study will not be influenced by the researcher's personal values.
D) the same number of participants will be assigned to each of the experimental conditions.
8.
Which of the following methods is most helpful for revealing cause-effect relationships?
A) the survey
B) the experiment
C) correlational research
D) naturalistic observation
9. The biggest danger of relying on case-study evidence is that it:
A) is based on naturalistic observation.
B) may be unrepresentative of what is generally true.
C) overestimates the importance of operational definitions.
D) leads us to underestimate the causal relationships between events.
10. A researcher would be most likely to discover a positive correlation between:
A) intelligence and academic success.
B) financial poverty and physical health.
C) self-esteem and depression.
D) school grades and school absences.
11. Suppose that those who watch a lot of violence are also particularly likely to behave
aggressively. This relationship would NOT necessarily indicate that watching violence
influences aggressive behavior because:
A) Random sequences often don't look random.
B) Correlation does not prove causation.
C) Sampling extreme cases leads to false generalizations.
D) Events often seem more probable in hindsight.
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 57 of 68
12. In which type of research would an investigator manipulate one factor in order to observe
its effect on some behavior or mental process?
A) the survey
B) the case study
C) Experimentation
D) naturalistic observation
13. To assess the effect of televised violence on aggression, researchers plan to expose one
group of children to violent movie scenes and another group to nonviolent scenes. In
order to reduce the chance that the children in one group have more aggressive
personalities than those in the other group, the researchers should make use of:
A) random assignment.
B) random sampling.
C) naturalistic observations.
D) the double-blind procedure.
14. In order to study the potential effects of social interaction on problem solving, some
research participants were instructed to solve problems working together; other
participants were instructed to solve problems working alone. Those who worked alone
were exposed to the ________ condition.
A) Experimental
B) Survey
C) Control
D) Correlational
15. In a psychological experiment, the potentially causal factor that is manipulated by the
investigator is called the ________ variable.
A) Dependent
B) Independent
C) Control
D) Experimental
16. In an experimental study of the effects of sleep deprivation on anxiety, sleep deprivation
would be the ________ variable.
A) Experimental
B) Dependent
C) Correlational
D) Independent
17. The mean of a distribution of scores is the:
A) most frequently occurring score.
B) arithmetic average of all the scores.
C) least frequently occurring score.
D) score exceeded by 50 percent of all the scores.
18. Central tendency is to variation as ________ is to ________.
A) scatterplot; correlation
B) range; skewed distribution
C) mean; standard deviation
D) median; mode
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 58 of 68
19. In order to represent graphically the correlation between two variables, researchers often
construct a:
A) skewed distribution.
B) scatterplot.
C) standard deviation.
D) bar graph.
20. Which of the following is a statistical measure of both the direction and the strength of a
relationship between two variables?
A) correlation coefficient
B) standard deviation
C) Range
D) Mean


For which course did you take this quiz? (Circle one)
o
PSY 111 (General Psychology)
o
PSY 150 (Lifespan Development)
Did you take this quiz…(circle one)
o
…during the first week of the semester
o
…sometime after the first week of the semester.
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 59 of 68
PSY A150 Pretest and Posttest for Fall 07-Spring 08
See PSY A111 pretest and posttest. Both PSY A111 and PSY A150 used the same quizzes.
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 60 of 68
SOC A101 (VERSION A) Pretest and Posttest for Fall 07-Spring 08
Sociology 101
NAME: __________________________
1. The term ‘empirical’ refers to:
a. Carefully gathered, unbiased data regarding social conditions and behavior
b. The application of moral principles to social policy
c. The application of scientific methods to the study of moral problems
d. Using the techniques of investigative journalism to analyze social problems
2. A distinguishing characteristic of modern sociology is an emphasis on:
a. Explanations based on carefully collected empirical data.
b. Speculation about causes and results of social phenomena
c. The development of well-reasoned discourse on social issues
d. The solution of social problems based on the opinions of experts.
3. The sociological perspective that focuses on how social structures are created and maintained in
the course of human interaction is:
a. Conflict theory
b. Functionalism
c. Symbolic interactionism
d. The ecological perspective
4. Professor William’s sociology class is studying religion. They want to know what purpose
religious systems have for society. Their inquiry will likely take which of the following
approaches in sociology?
a. Conflict
b. Functionalist
c. Interactionist
d. Middle level
5. The sociological perspective that emphasizes the role of differences among people in different
economic classes is:
a. Conflict theory
b. Ethnomethodology
c. Functionalism
d. Symbolic interactionism
6. The question “Who benefits from the exercise of power and who loses?” is characteristic of
which of the following theoretical perspectives?
a. Conflict theory
b. Functionalism
c. Symbolic interactionism
d. The ecological perspective
Table 1.1. Global and Regional Trends in the Estimated Prevalence of Protein-Energy
Malnutrition in Underweight Children Under 5, Since 1980.
1980
1990
1995
2000
Region
%
Million
%
Million
%
Million
%
Million
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 61 of 68
Africa
26.2
Asia
43.9
Latin America 14.2
Developing
37.4
Countries
Source: WHO, 2000.
22.5
146.0
7.3
175.7
27.3
36.5
10.2
32.1
30.1
141.3
5.6
177.0
27.9
32.8
8.3
29.2
34.0
121.0
4.5
159.5
28.5
29.0
6.3
26.7
38.3
108.0
3.4
149.6
7. Refer to Table 1.1 showing prevalence of malnutrition in the world. Which of the following has
the largest percent of undernourished children?
a. Asia
b. Latin America
c. Africa
d. North America
8. Refer to Table 1.1. Which of the following regions has the fewest underweight children
according to the World Health Organization?
a. Asia
b. Latin America
c. Africa
d. North America
9. In the table shown below, according to the World Health Organization which region has the
greatest prevalence of overweight adults?
a. Africa
b. The Americas
c. Europe
d. The Western Pacific
Regional and Global Prevalence and Number of Overweight Adults and
Children Under 5, by WHO Region
Children
Adults
%
%
WHO Region
prevalence
Million
prevalence Million
Africa
3.4
3.3
2.9
8.2
The Americans
4.5
3.4
20.9
109.0
Southeast Asia
4.5
3.0
1.1
10.0
Europe
NA
NA
16.7
106.5
Eastern Mediterranean
1.8
3.0
10.0
24.9
Western Pacific
4.0
5.3
3.8
42.5
Global
3.6
21.5
8.2
301.1
Total for children includes and estimated 3.5 million overweight children in
Europe, although Europe survey data not always adequate.
Source: WHO, 2000
10. A scientist conducting an empirical study:
a. Engages in armchair theorizing.
b. Gathers evidence to understand the behavior under investigation.
c. Relies on hunches and intuition.
d. States his or her personal biases at the beginning of the study.
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 62 of 68
11. A statement that expresses a guess about a possible relationship between two or more
phenomena is termed:
a. A functional explanation.
b. A hypothesis
c. A scientific hunch
d. Theory
12. Characteristics of individuals, groups, or entire societies that can change from one case to
another are termed:
a. Indicators
b. Norms
c. Relationships
d. Variables
13. The factor that the scientist believes causes changes in the behavior under investigation is termed
the:
a. Dependent variable
b. Independent variable
c. Intervening variable
d. Antecedent variable
14. Which of the following is an example of a hypothesis?
a. Canadians living in the province of Quebec are more likely to support the use of French
as their primary language, than are those living in other provinces.
b. Canadian life and culture are much influenced by the United States.
c. In recent years there has been considerable controversy between the United States and
Canada over acid rain.
d. The life expectancy in the United States and Canada is roughly the same.
15. The term ‘sample’ refers to:
a. A selection
b. A set of respondents
c. A probability
d. None of these
16. Any unintended effect that results from the attention given to subjects in an experiment is known
as the:
a. Asch effect
b. Hawthorne effect
c. Law of diminishing returns
d. Peter principle
17. Researchers are most likely to use random sampling in cases where:
a. Respondents are reluctant to answer
b. They wish to generalize to a larger population
c. They wish to provide descriptions or how members of a specific group feel about an issue
d. They wish to be unobtrusive
18. A theory may be described as:
a. A hunch about how things fit together
b. A set of interrelated concepts that seeks to explain an observable phenomenon
c. Opinions about the way things ought to be related
d. Predictions of the future
19. In examining the percent analysis of households since 1970, as shown in Table 2.3, we see
a. A decrease in the proportion of married couple families
b. An increase in the proportion of married couple families
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 63 of 68
c. A decrease in non-family households
d. A decrease in female-headed households
Table 2.3
Types of Households in the United States, 1970 and 2000 (as
percentage of total households)
Type of Household
1970
2000
All households
100.0
100.0
Nonfamily households
18.8
31.9
Family households
81.2
68.1
No own children under 18
35.8
35.3
With own children under 18
45.3
32.8
Married-couple family
70.5
51.7
No own children under 18
30.3
28.1
With own children under 18
40.3
23.5
Male householder
1.9
4.2
No own children under 18
1.4
2.1
With own children under 18
0.5
2.1
Female householder
8.7
12.2
No own children under 18
4.2
5.1
With own children under 18
4.5
7.2
20. The statistics for youth unemployment and suicide in France shown in Figure 2.3 indicate that
a. Unemployment causes higher suicide among males
b. There is a significant positive relationship between unemployment and suicide for males
c. There is no relationship between employment and suicide among young adults
d. There has been little change in suicide rates since the early 1980s.
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 64 of 68
SOC A101 (VERSION B) Pretest and Posttest for Fall 07-Spring 08
SOCIOLOGY 101-002 POSTTEST NAME _______________________
Answer the following as best you can in the space available.
1. Define Sociology.
2. Define Culture.
3. What is the primary focus of Symbolic Interaction?
4. How does Functionalism view society?
5. How does Conflict Theory view society?
6. What is meant by Social Stratification?
7. What are the key components of Social Change?
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 65 of 68
WS A200 Pretest and Posttest for Fall 07-Spring 08
Name: ________________________________________
1. The beginning of the women’s movement in the United States is dated to the _____ in 1848:
a. League of Women Voters
b. Seneca Falls Convention
c. Civil War
d. Vindication of the rights of women
2. What amendment gave women the right to vote?
a. 15th
b. 19th
c. 27th
d. 13th
3. Which suffragist introduced the Equal Rights Amendment?
a. Lucretia Mott
b. Elizabeth Cady Stanton
c. Alice Paul
d. Susan B. Anthony
4. When did color-coding according to gender become widespread?
a. Post-WWI era
b. Depression era
c. Post-WWII era
d. After the feminist movement began during the 1970s
5. Who is given credit for the beginning of the second wave of the women’s movement after she
wrote ‘The Feminine Mystique’?
a. Rosie the Riviter
b. Gloria Steinem
c. Eleanor Roosevelt
d. Betty Friedan
6. Which Christian religious denomination recently passed resolutions excluding women from
leadership roles in the church and encouraging wives to submit to their husbands?
a. Lutheran
b. Roman Catholic
c. Southern Baptist
d. Methodist
7. The threat of being called a lesbian, which keeps all women in line, is called:
a. Lesbian identification
b. Lesbian round-up
c. Lesbian hostility
d. Lesbian baiting
8. What Supreme Court ruling removed the states’ ban on abortion?
a. Roe v. Wade
b. Griswold v. Connecticut
c. Webster v. Reproductive Health Services
d. Harris v. McRae
9. When did the Supreme Court remove the ban on contraceptives for married persons?
a. Late 19th century
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 66 of 68
b. Right after WWI
c. Right after WWII
d. Mid 1960s
10. An important legislative gain concerning women’s employment passed in 1963 was:
a. Title VII of the Civil Rights Act
b. The Equal Rights Amendment
c. The Equal Pay Act
d. Roe v. Wade
11. Contemporary third wave feminist perspectives are shaped by:
a. Globalization
b. Sexuality
c. Identity
d. All of the above
12. Which feminist artist began The Dinner Party?
a. Judy Chicago
b. Emily Carr
c. Georgia O’Keefe
d. Cindy Sherman
13. A person that displays a lack of gender differentiation or a blending of gender in known as (a)n:
a. Transsexual
b. Androgynous
c. Androcentric
d. Transvestite
14. To be transgendered is to:
a. Push against gender boundaries
b. Be homosexual
c. Be androgynous
d. Be queer
15. The term for the hatred of women is:
a. Misogyny
b. Homophobia
c. Androcentrism
d. Sexism
16. Two issues that mobilized antifeminist backlash were:
a. Abortion and HIV/AIDS
b. Abortion and the ERA
c. ERA and gay/lesbian issues
d. HIV/AIDS and gay/lesbian issues
17. The first woman considered for presidential nomination was:
a. Gloria Steinem
b. Shirley Chisholm
c. Hilary Clinton
d. Winona LaDuke
18. The catch-all category for compulsive over exercising is:
a. Anorexia nervosa
b. Bulimia nervosa
c. Muscle dysmorphia
d. Compulsive eating
e. Anorexia althletica
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 67 of 68
19. At what New York bar did the modern gay liberation movement begin?
a. Studio 54
b. Stonewall
c. Club 57
d. Scandals
20. The following is a rape myth:
a. Women are partly to blame
b. Reports happen less frequently than indicated
c. Rape tends to be intraracial
d. Both (a) and (b)
e. All of the above
Associate of Arts Educational Effectiveness Assessment Plan
Submitted 11-3-08
Page 68 of 68
Download