SYLLABUS Course: Psychology 370--Sec 2 (Schedule#22653; Psychological Testing and Measurement) Course Description: Measurement theory and the basic principles of testing. Selection, construction, and critical evaluation of group tests of intelligence, personality, aptitude, interest, and achievement. Prerequisites: Grade of B or better in Psychology 270 or equivalent statistics course; grade of B or better in Psychology 301. Proof of completion of prerequisite required: Copy of transcript. Note: Students electing to take Psychology 410 for the methods requirement may petition waiver of the Psychology 301 prerequisite by permission of the undergraduate adviser. Credit: 3 units Semester: Spring, 2015 Time: Monday & Wednesday 3:30 - 4:45 pm Location: LSN-132 Instructor: Dale N. Glaser, Ph.D. Phone: 619-220-0602 Office Hours: By Appointment E-Mail: glaserconsult@sbcglobal.net Or (dglaser@mail.sdsu.edu) Overview It is indisputable that measurement is a key element in the social, health, and behavioral sciences, and especially for psychology. A cursory read of a daily newspaper or weekly news magazine will find some type of reporting of data and statistics which involves the measurement process. For instance, in 7/17/14 LA times an article titled: Big jump in number of millennial’s living with parents reported indicated that “A record 57 million Americans, or 18.1% of the population, lived in multigenerational arrangements in 2012, according to the Pew Research Center. That's more than double the 28 million people who lived in such households in 1980”. Or in 7/22/14 edition of LA Times: “Pay raises for recent college grads far below average” detailing that salaries for recent college graduates have risen at less than half the pace for all U.S. workers since the recession, an analysis by the Federal Reserve Bank of San Francisco found…..[it was] found that median earnings for recent college graduates rose only 6% between 2006 and 2013, compared with 15% for the workforce at large.” In the LA Times (5/29/13) article: More women than ever are breadwinners pointing out that ”two years ago, more than 40% of American households with children relied on a mother as their biggest or only source of income---a massive jump from 11% of families in 1960” (A9). In a 5/24/13 article in the LA times “three in four U.S. workers say they intend to work past retirement age” Or in the SD Union on 8/6/2012 "51% of employees admitted to swearing in the office. Of those, 95% said they do it in front of their colleagues, and 51% in front of their boss" (implications for promotion?). And in a 7/12/13 LA Times article titled “Smartphones are used in surprising places, study finds”: “3 in 4 U.S. smartphone users surveyed said they are within five feet of their devices most of the time....more than a third said they use their devices at movie theaters, and 12% said they use them in the shower….but perhaps most unusual is the act that 1 in 11 users said they have used Smartphones________....12% believe their smartphone gets in the way of their relationships”. From a lead article in Time Magazine titled "The Pursuit of Happiness" (7/2013) the following statistics are enumerated: 1 1. People who dwell on the past and future are less likely to be happy than people who concentrate on the present 2. 1/4 of single people believe married people have more boring social lives 3. A bad job is better than no job: previously out-of-work people are happier even if a new job has poor pay and hours. 4. 11% of Americans have experienced depression by the age of 18. 5. One-third of Americans say they want to earn significantly more money 6. 1 in 3 stressed Americans copes by shopping 7. Half of couples cohabit before getting married 8. 62% of new mothers are part of the American workforce 9. Teens watch about four hours of TV each day, Adults five: Reality programs like American Idol dominated ratings in 2012 10. Self-improvement products are now a $10 billion industry 11. 23 million American use 4,000 online dating services each month. 12. Homeowners aren’t any happier than renters. They are more likely to experience stress and pack on extra pounds, perhaps as a result. In a NY times article dated 7/18/14: How Tests Make Us Smarter TESTS have a bad reputation in education circles these days: They take time, the critics say, put students under pressure and, in the case of standardized testing, crowd out other educational priorities. But the truth is that, used properly, testing as part of an educational routine provides an important tool not just to measure learning, but to promote it. In one study I published with Jeffrey D. Karpicke, a psychologist at Purdue, we assessed how well students remembered material they had read. After an initial reading, students were tested on some passages by being given a blank sheet of paper and asked to recall as much as possible. They recalled about 70 percent of the ideas. Other passages were not tested but were reread, and thus 100 percent of the ideas were re-exposed. In final tests given either two days or a week later, the passages that had been tested just after reading were remembered much better than those that had been reread. What’s at work here? When students are tested, they are required to retrieve knowledge from memory. Much educational activity, such as lectures and textbook readings, is aimed at helping students acquire and store knowledge. Various kinds of testing, though, when used appropriately, encourage students to practice the valuable skill of retrieving and using knowledge. The fact of improved retention after a quiz — called the testing effect or the retrieval practice effect — makes the learning stronger and embeds it more securely in memory. And then in a 8/3/12 editorial in the LA Times titled "Teaching, and testing, smarter", "despite the barrage of criticism that schools are spending increasing amounts of time testing our children and teachers are being forced to teach to the test, the reality is that testing is no fad........the increasing emphasis on testing in U.S. schools is a consequence of perhaps the most profound change n American education in modern times--the shift in focus from teaching to learning". 2 Thus, measurement is a pervasive part of our lives, whether we know it or not (how many of you monitor your speedometer, weigh yourself, or take those little “rate your____” in the monthly magazines?!!). Moreover, measurement and testing takes place in a wide array of contexts, for example from education (SAT, GRE, test scores in college classes, etc.) to industry (return on investment, work output, performance appraisals, etc.) to health care (Length of Stay, outcomes, cost benefit/analysis, etc.). And frequently, the question comes up: how good is one’s measure? How do you know you REALLY measured what you purported to measure? What is the relevance of the measure / test? Course Objectives This class is designed to provide an introduction to concepts, theories, and methods regarding psychological testing and measurement. We will focus on areas such as psychometric principles (e.g., validity and reliability), test and item analysis, test construction, and applications of psychological testing in a wide variety of settings (such as industry and education). The primary objectives of this class are as follows: Provide you with a fundamental understanding of the core issues in psychological testing and measurement Understand the key techniques undergirding the analysis of tests and measurement Be able to interpret and report psychometric properties of tests and scores, such as reliability and validity Distinguish between tests that assess personality vs. ability vs. interests In addition, as an ongoing string of brief papers, you will analyze the results of a survey entailing writing a methods and descriptive section and a host of psychometric testing (e.g., reliability, validity). * Additional Department Level Learning Objectives: In addition to the objectives outlined above, other learning objectives identified as important across the Psychology Curriculum that overlap with this course are: 1. 2. 3. 4. 5. 6. 7. 8. 9. Explain the roles of persons, situations, and person-situation interactions as causes of behavior. (SLO 1.3) Identify appropriate applications of psychology in solving problems such as the pursuit and effect of healthy lifestyles, origin and treatment of abnormal behavior, psychological tests and measurements, psychology-based interventions, and the resolution of interpersonal and intercultural conflicts. (SLO 2.2) Apply psychological concepts, theories, and research findings as these relate to everyday life. (SLO 2.4) Formulate scientific questions using operational definitions. (SLO 3.1) Generate appropriate methodological techniques for testing specific hypotheses. (SLO 3.2) Identify the factors required to make causal inferences about relationships between variables. (SLO 3.4) Design a simple self-report measure. (SLO 3.5) Define, explain, and identify appropriate use of reliability and validity. (SLO 3.6) Demonstrate understanding of measurement error (both systematic and unsystematic). (SLO 3.7) 3 10. 11. 12. 13. 14. 15. 16. 17. 18. 19. 20. 21. 22. 23. 24. 25. Explain correctly such terms as mean, median, standard deviation, and statistical significance. (SLO 3.8) Understand interpret appropriately t, F, r, and r squared. (SLO 3.9) Evaluate the appropriateness of conclusions derived from psychological research and the parameters of particular research methods. (SLO 4.3) Recognize the necessity of and identify specific ethical behavior in all aspects of the science and practice of psychology. (SLO 5.1) Be familiar with the rights of human research participants and therapy clients. (SLO 5.2) Describe the concept of informed consent to research and treatment. (SLO 5.4) Identify the role that an institutional review board plays in psychological research. (SLO 5.6) Identify how sociocultural and international contexts influence individual differences. (SLO 6.3) Explain how individual differences influence beliefs, values, and interactions with others and vice versa. (SLO 6.4) Understand that research findings may not generalize to all people. (SLO 6.7) Distinguish between scientific findings and opinions. (SLO 7.2) Frame questions or generate hypotheses about human behavior based on experiences and/or exposure to information from scientific literature, the general media, and specialized sources. (SLO 7.4) Plan and execute a project that involves data collection. (SLO 8.3) Prepare a written report based on data they have collected. (SLO 8.4) Engage in creative thinking by evaluating new ideas with an open but critical mind. (SLO 9.1) Demonstrate effective writing skills and use of APA-style in various formats (e.g., essays, technical papers). SLO (9.4) Helpful Hints/Platitudes Even though this is not a statistics course, much of psychological testing and measurement involves the incorporation of statistical techniques and/or principles. Hence, even though one of the chapters in the text will cover basic statistics, it may be helpful to review statistics/research design notes from prior classes if the need arises. Course Requirements 1) Given the comprehensive (and cumulative) nature of the curriculum, attendance is strongly encouraged and should be adhered to per school policy. 2) Brief Papers. A series of papers (2-4 pages, though may be longer for #5 and #6) will be assigned corresponding to the chapter and related material. The papers will be as follows (with instructions and details for the paper to be appended on Blackboard). Moreover, there will be a dataset provided for you that will serve as your primary database for the duration of this semester. The structure of the database will be discussed in class. The papers to be assigned are as follows (15 points each): (1) Paper #1: Inventory Review/Critique and Applicability (2) Paper #2: Descriptive Statistics--Analysis, Describe, and Report (3) Paper #3: Psychometric Testing---Reliability (4) Paper #4: Psychometric Testing---Predictive Validity 4 (5) Paper #5: Psychometric Testing---Construct Validity (6) Paper #6: Psychometric Testing---Survey Critique and Assessing Psychometric Quality Your papers are expected to be concise, succinct, and typed (and double-spaced, preferably adhering to APA style....... see 6th Edition of APA publication manual). Further elaboration and expectations of the papers will be provided in lecture. Moreover, you have the option of working individually or in small groups (max. n = 3) for the papers. If you decide to work in a dyad/triad, it may be the better part of prudence to select your working partner based on their strengths (i.e., facility with SPSS, etc.) so as to optimize the balance and perceived equity in the group (will discuss social loafing!!). The assigned papers [as will as text powerpoint slides [that are aggregated by test] and handouts] can be accessed via Blackboard and only hard-copy (email not acceptable) papers will be accepted. Late papers will see a 10% reduction in points on daily (1.5 point reduction) basis-[weekend will count as 2 days] 3) Tests. Mixture of multiple choice, true/false, and short essay. Material will be culled from text, handouts, and lecture. Bring calculators for each of the tests, but nothing preprogrammed!! Each test will be worth 100 points. Please bring Scantron Form No. 882-E (Green) to each test General etiquette!!: For the consideration of others please turn off and/or do not use any electronic devices (i.e., texting, surfing the web, sending emails, etc.) during class instruction; if you have the compelling reason to do so please excuse yourself from the class. Thank you! Students with disabilities: ADA/Accommodations: San Diego State University seeks to provide equal access to its programs, services and activities for people with disabilities. If you will need accommodations in the class, reasonable prior notice needs to be given to the Student Disability Services (SDS), 619.594.6473 or online at http://www.sa.sdsu.edu/sds. SDS will work with you and the instructor to make arrangements for accommodations. All written information in this course can be made available in alternative format with prior notification to the SDS. Academic dishonesty: The Student Code of Conduct is online at http://www.sa.sdsu.edu/srr/conduct1.html. The academic dishonesty code specifies actions for behaviors such as cheating on tests, plagiarism, and/or inappropriately collaborating with others. I will enforce the code in the course; cheating or other violations will result in appropriate penalties, including a failing grade on the assignment or in the course, and the reporting of that incident to the Office of Student Rights and Responsibilities. Students have the right to appeal such action in accord with the due process. Grading 23.08% of your grade will be based on the short papers (90 possible points) and 76.92% (300 possible points) will be accorded for the three in-class tests. Total possible points = 390. Grading will be commensurate with school policy (though contingent on the obtained distribution of scores, there may be some modification to the grading structure as outlined below). Make-up 5 of tests will be granted only when notification is provided prior to test administration. Extra credit will not be provided in this course! 90% - 100% = A 87% – 89% = A84% - 86% = B+ 79 - 83% = B 76% - 78% = B73% - 75% = C+ 69% -72% = C 66% - 68% = C61% - 65% = D+ 58% - 60% = D 55% - 57% = D0% -54 = F It is required that all work on the papers be based on your individual effort. This implies that you did not access other student's work (unless of course your working within a group!!..though you are not permitted to share work across groups) nor did you plagiarize work compiled by efforts other than your own. Failure to meet any of these conditions will result in '0' points for the given paper and measures will be taken as per university policy. Safety To be prepared for emergencies, each student is responsible for becoming familiar with the evacuation plan specific to each classroom. The evacuation plan is posted within each classroom and should be examined on the first day of class. Text Miller, L. A., McIntire, S. A., & Lovler, R. L. (2011). Foundations of Psychological Testing: A Practical Approach (3rd Edition). LA: CA; Sage. 6 Course Schedule Jan. 21 & 26 What are psychological tests? Required Readings: Chap. 1 Jan. 28 & Feb. 2 Why is Psychological testing important? Required Readings: Chap. 2 Paper #1 Assigned Feb. 4 & 9 Is there a right or wrong way to use psychological tests? Required Readings: Chap. 3 Paper #1 Due Feb. 11 & 16 Psychometric Principles: How do test users interpet test scores? Level of measurement and statistics. Required Readings: Chap. 5 Paper #2 Assigned Feb. 18 & 23 Psychometric Principles: How do test users interpet test scores? Level of measurement and statistics (con't) Paper #2 Due Test #1 (ch. 1, 2, 3, 5) Required Readings: Chap. 5 Feb. 25 & Mar. 2 Psychometric Principles: What is Test Reliability? Required Readings: Chap. 6 Paper #3 assigned Mar. 4 & 9 Psychometric Principles: What is Test Reliability? (con't) Psychometric Principles: How do we gather evidence of validity based on the content of a test? Paper #3 Due Required Readings: Chap. 6 (con't); chap. 7 Mar. 11 & 16 Psychometric Principles: How do we gather evidence of validity based on the content of a test? (con't) Psychometric Principles: How Do We Gather Evidence of Validity Based on a Test’s Relationships With External Criteria Required Readings: Chap. 7 (con't); Chap. 8 Paper #4 assigned Mar. 18 & 23 Psychometric Principles: How Do We Gather Evidence of Validity Based on a Test’s Relationships With External Criteria (con't); Psychometric Principles: How Do We Gather Evidence of Validity Based on a Test’s Relationship With Constructs? Required Readings: Chap. 8 (con't); Chap. 9 Paper #4 Due 7 3/30-4/3 Spring Break----No Class!!!! Mar. 25 & Apr. 6 Test #2 (ch. 6, 7, 8, 9 & ch. 13 (pp. 401-406)) Psychometric Principles: How Do We Gather Evidence of Validity Based on a Test’s Relationship With Constructs? (con't) Norm and Criterion-Referenced and Authentic Assessment Required Readings: Chap. 9 (con't) Chap. 13: pp. 401-406 Apr. 8 & 13 How Do We Construct, Administer, and Use Survey Data? Survey Design & Construction. Required Readings: Chap. 10 Paper #5 Assigned Apr. 15 & 20 How Do We Construct, Administer, and Use Survey Data? Survey Design & Construction. How Do We Develop a Test? Required Readings: Chap. 10-11 Paper #5 Assigned Apr. 22 & 27 How Do We Develop a Test? (con’t) How do we Assess the Psychometric Quality of a Test Required Readings: Chap. 11-12 Paper #5 Due Paper #6 Assigned Apr. 29 & May 4 How do we Assess the Psychometric Quality of a Test (con’t) How are Tests Used in Organizational Settings Required Readings: Chap. 12 & 15 Paper #6 Due May 6 How are Tests Used in Organizational Settings (con’t) Required Readings: Chap. 15 May 13 Final Exam: 1530-1730 (3:30 to 5:30 pm) (per catalogue) Test #3 (ch. 10, 11, 12 & 15) 8