SYLLABUS Course: Psychology 370--Sec 1 (Schedule#22479; Psychological Testing and Measurement)

advertisement
SYLLABUS
Course: Psychology 370--Sec 1 (Schedule#22479; Psychological Testing and Measurement)
Course Description: Measurement theory and the basic principles of testing. Selection,
construction, and critical evaluation of group tests of intelligence, personality, aptitude, interest,
and achievement.
Prerequisites: Grade of B or better in Psychology 270 or equivalent statistics course; grade of B
or better in Psychology 301. Proof of completion of prerequisite required: Copy of transcript.
Note: Students electing to take Psychology 410 for the methods requirement may petition waiver
of the Psychology 301 prerequisite by permission of the undergraduate adviser.
Credit: 3 units
Semester: Fall, 2012
Time: Tuesday & Thursday: 2:00 - 3:15 pm
Location: LSS-246
Instructor: Dale N. Glaser, Ph.D.
Phone and SDSU Office: 619-220-0602; North Life Science (NLS) 118C
Office Hours: By Appointment
E-Mail: glaserconsult@sbcglobal.net
TA: Bahareh Soltani
TA Email: soltani.berry@gmail.com{contact for office hours}
Overview
A cursory review of a daily newspaper or weekly magazine will find, in one way or another,
something being measured. Measurement may range from such disparate sources/topics as
examining opinions regarding genetic testing (and insurance companies!!),
politicians/propositions, to median home prices (as you know there have been huge
fluctuations the last few years!) to an article titled: "Positive emotions increase life
satisfaction by building resilience" [http://uncnews.unc.edu/content/view/2688/71] or in a
12/27/11 article indicating that "women shown more vulnerable to stress", or Does text
messaging harm students' writing skills? [http://www.edutopia.org/poll-text-messagingwriting-skills] as follows:
(1) Yes. I believe students are carrying over the writing habits they pick up through text messaging into
school assignments.
54% (1580 votes)
(2) Maybe. Although text messaging may have some impact on how students write, I don't think it's a
significant problem.
18% (522 votes)
(3) No. I believe students can write one way to their friends and another way in class. They can keep the
two methods separate.
25% (728 votes)
And then from an article titled "Statistics Paint Picture of U.S. Life" (12/20/09 in SD Union) the
following statistics are enumerated:
1. More adults play video games than take educational courses
2. Americans drink more bottled water than alcohol
3. One in 10 male students said he carried a weapon to school within the previous month
4. An estimated 110 billion text messages were sent on cell phones in Dec 08, more than
double the 48 billion in the previous December.
5. The number of pieces of mail delivered by the Postal Service, which being declining
in 2007, dipped in 2008 to the lowest in a decade.
6. Women pulled even with men among new recipients of doctoral degrees in 2007 for
the first time
7. About three in 10 people who married in the early 1900s did not stay married long
enough to celebrate their 10th anniversary
Or a large collection of statistics obtained regarding drug use and teenagers (from:
http://www.gdcada.org/statistics/teens.htm):
(1) Binge drinking (having five or more drinks in a sitting) is common in most segments of
society in the U.S., and is climbing fastest among 18 to 20-year-olds, who are too young to drink
legally
(2) Illegal drug use is declining among youth, while the abuse of prescription drugs, especially
pain relievers, is increasing. Many abuse prescription drugs thinking that they are safe, when in
fact they can cause addiction and severe side effects..
And testing is not without controversy, as noted in the 6/20/06 issue of the San Francisco
Chronicle in regards to the California Exit Exam:
"At Stanford University's School of Education, we analyzed California's policy for assessing students
learning English. We found that 1 out of every 4 students learning English did not pass California's exit
exam and will not be able to graduate. We also found that the design of California's exit exam and the way
it is administered potentially account for the large number of English learners failing to pass. California's
exam falls short in many areas when compared to other states' more comprehensive exit exams and recent
research findings." (McCloskey & Ocampo)
Or further controversy is detailed in a 12/1/8/09 article titled "19 universities investigated for
admissions bias".
And then in a 8/3/12 editorial in the LA Times titled "Teaching, and testing, smarter", "despite
the barrage of criticism that schools are spending increasing amounts of time testing our chldren
and teachers are being forced to teach to the test, the reality is that testing is no fad........the
increasing emphasis on testing in U.S. schools is a consequence of perhaps the most profound
change n American education in modern times--the shift in focus from teaching to learning".
Thus, measurement is a pervasive part of our lives, whether we know it or not (how many of you
monitor your speedometer, weigh yourself, or take those little “rate your____” in the monthly
magazines?!!). Moreover, measurement and testing takes place in a wide array of contexts, for
example from education (SAT, GRE, test scores in college classes, etc.) to industry (return on
investment, work output, performance appraisals, etc.) to health care (Length of Stay, outcomes,
cost benefit/analysis, etc.). And frequently, the question comes up: how good is one’s measure?
How do you know you REALLY measured what you purported to measure? What is the
relevance of the measure / test?
Course Objectives
This class is designed to provide an introduction to concepts, theories, and methods regarding
psychological testing and measurement. We will focus on areas such as psychometric principles
(e.g., validity and reliability), test and item analysis, test construction, and applications of
psychological testing in a wide variety of settings (such as industry and education). The primary
objectives of this class are as follows:
 Provide you with a fundamental understanding of the core issues in psychological testing
and measurement
 Understand the key techniques undergirding the analysis of tests and measurement
 Be able to interpret and report psychometric properties of tests and scores, such as
reliability and validity
 Distinguish between tests that assess personality vs. ability vs. interests
In addition, as an ongoing string of brief papers, you will analyze the results of a survey entailing
writing a methods and descriptive section and a host of psychometric testing (e.g., reliability,
validity).
Helpful Hints/Platitudes
Even though this is not a statistics course, much of psychological testing and measurement
involves the incorporation of statistical techniques and/or principles. Hence, even though one of
the chapters in the text will cover basic statistics, it may be helpful to review statistics/research
design notes from prior classes if the need arises.
Course Requirements
1) Given the comprehensive (and cumulative) nature of the curriculum, attendance is strongly
encouraged and should be adhered to per school policy.
2) Brief Papers. A series of papers (2-4 pages, though may be longer for #5 and #6) will be
assigned corresponding to the chapter and related material. The papers will be as follows
(with instructions and details for the paper to be appended on Blackboard). Moreover, there
will be a dataset provided for you that will serve as your primary database for the duration of
this semester. The structure of the database will be discussed in class. The papers to be
assigned are as follows (15 points each):
(1) Paper #1: Inventory Review/Critique and Applicability
(2) Paper #2: Descriptive Statistics--Analysis, Describe, and Report
(3) Paper #3: Psychometric Testing---Reliability
(4) Paper #4: Psychometric Testing---Predictive Validity
(5) Paper #5: Psychometric Testing---Construct Validity
(6) Paper #6: Psychometric Testing---Survey Critique and Assessing Psychometric Quality
Your papers are expected to be concise, succinct, and typed (and double-spaced, preferably
adhering to APA style....... see 6th Edition of APA publication manual). Further elaboration
and expectations of the papers will be provided in lecture.
Moreover, you have the option of working individually or in small groups (max. n = 3) for the
papers. If you decide to work in a dyad/triad, it may be the better part of prudence to select
your working partner based on their strengths (i.e., facility with SPSS, etc.) so as to optimize
the balance and perceived equity in the group (will discuss social loafing!!).
The assigned papers [as will as text powerpoint slides [that are aggregated by test] and
handouts] can be accessed via Blackboard and only hard-copy (email not acceptable) papers
will be accepted. Late papers will see a 10% reduction in points on daily (1.5 point reduction)
basis-[weekend will count as 2 days]
3) Tests. Mixture of multiple choice, true/false, and short essay. Material will be culled from
text, handouts, and lecture. Bring calculators for each of the tests, but nothing
preprogrammed!! Each test will be worth 100 points. Please bring Scantron Form No. 882-E
(Green) to each test
General etiquette!!: For the consideration of others please turn off and/or do not use any
electronic devices (i.e., texting, surfing the web, sending emails, etc.) during class instruction;
if you have the compelling reason to do so please excuse yourself from the class. Thank you!


Students with disabilities: ADA/Accommodations: San Diego State University seeks to
provide equal access to its programs, services and activities for people with disabilities.
If you will need accommodations in the class, reasonable prior notice needs to be given
to the Student Disability Services (SDS), 619.594.6473 or online at
http://www.sa.sdsu.edu/sds. SDS will work with you and the instructor to make
arrangements for accommodations. All written information in this course can be made
available in alternative format with prior notification to the SDS.
Academic dishonesty: The Student Code of Conduct is online at
http://www.sa.sdsu.edu/srr/conduct1.html. The academic dishonesty code specifies
actions for behaviors such as cheating on tests, plagiarism, and/or inappropriately
collaborating with others. I will enforce the code in the course; cheating or other
violations will result in appropriate penalties, including a failing grade on the assignment
or in the course, and the reporting of that incident to the Office of Student Rights and
Responsibilities. Students have the right to appeal such action in accord with the due
process.
Grading
23.08% of your grade will be based on the short papers (90 possible points) and 76.92% (300
possible points) will be accorded for the three in-class tests. Total possible points = 390.
Grading will be commensurate with school policy. Make-up of tests will be granted only when
notification is provided prior to test administration. Extra credit will not be provided in this
course!
It is required that all work on the papers be based on your individual effort. This implies that you
did not access other student's work (unless of course your working within a group!!..though you
are not permitted to share work across groups) nor did you plagiarize work compiled by efforts
other than your own. Failure to meet any of these conditions will result in '0' points for the given
paper and measures will be taken as per university policy.
Safety
To be prepared for emergencies, each student is responsible for becoming familiar with the
evacuation plan specific to each classroom. The evacuation plan is posted within each classroom
and should be examined on the first day of class.
Text
Miller, L. A., McIntire, S. A., & Lovler, R. L. (2011). Foundations of Psychological
Testing: A Practical Approach (3rd Edition). LA: CA; Sage.
Course Schedule
Aug. 28 & 30
What are psychological tests?
Required Readings:
Chap. 1
Sept. 4 & 6
Why is Psychological testing important?
Required Readings:
Chap. 2
Paper #1 Assigned
Sept. 11 & 13
Is there a right or wrong way to use psychological tests?
Required Readings:
Chap. 3
Paper #1 Due
Sept. 18 & 20
Psychometric Principles: How do test users interpet test scores?
Level of measurement and statistics.
Required Readings:
Chap. 5
Paper #2 Assigned
Sept. 25 & Sept. 27
Psychometric Principles: How do test users interpet test scores?
Level of measurement and statistics (con't)
Paper #2 Due
Test #1 (ch. 1, 2, 3, 5)
Required Readings:
Chap. 5
Oct. 2 & 4
Psychometric Principles: What is Test Reliability?
Required Readings:
Chap. 6
Paper #3 assigned
Oct. 9 & 11
Psychometric Principles: What is Test Reliability? (con't)
Psychometric Principles: How do we gather evidence of validity
based on the content of a test?
Paper #3 Due
Required Readings:
Chap. 6 (con't); chap. 7
Oct. 16 & 18
Psychometric Principles: How do we gather evidence of validity
based on the content of a test? (con't)
Psychometric Principles: How Do We Gather Evidence of Validity
Based on a Test’s Relationships With External Criteria
Required Readings:
Chap. 7 (con't); Chap. 8
Paper #4 assigned
Oct. 23 & 25
Psychometric Principles: How Do We Gather Evidence of Validity
Based on a Test’s Relationships With External Criteria (con't);
Psychometric Principles: How Do We Gather Evidence of Validity
Based on a Test’s Relationship With Constructs?
Required Readings:
Chap. 8 (con't); Chap. 9
Paper #4 Due
Oct 30 & Nov. 1
Test #2 (ch. 6, 7, 8, 9 & ch. 13 (pp. 401-406))
Psychometric Principles: How Do We Gather Evidence of Validity
Based on a Test’s Relationship With Constructs? (con't)
Norm and Criterion-Referenced and Authentic Assessment
Required Readings:
Chap. 9 (con't)
Chap. 13: pp. 401-406
Nov 6 & 8
How Do We Construct, Administer, and Use Survey Data?
Survey Design & Construction,
Required Readings:
Chap. 10
Paper #5 Assigned
Nov 13 & 15
How Do We Construct, Administer, and Use Survey Data?
Survey Design & Construction,
Required Readings:
Chap. 10
Paper #5 Assigned
Nov 20
How Do We Develop a Test?
Required Readings: Chap. 11
Paper #5 Due
Paper #6 Assigned
Nov. 22
Thanksgiving: No Class!!!!
Nov. 27 & 29
How do we Assess the Psychometric Quality of a Test
Required Readings:
Chap. 12
Paper #6 Due
Dec. 4 & 6
How are Tests Used in Organizational Settings
Required Readings:
Chap. 15
Dec. 13
Final Exam: 1300-1500 (1:00 to 3:00 pm) (per catalogue)
Test #3 (ch. 10, 11, 12 & 15)
Download