Chapter 11: Testing and Individual Differences AP Psychology The Questions Define intelligence and list characteristics of how psychologists measure intelligence: — abstract versus verbal measures; — speed of processing. Discuss how culture influences the definition of intelligence. Compare and contrast historic and contemporary theories of intelligence (e.g., Charles Spearman, Howard Gardner, Robert Sternberg). Explain how psychologists design tests, including standardization strategies and other techniques to establish reliability and validity. Interpret the meaning of scores in terms of the normal curve. Describe relevant labels related to intelligence testing (e.g., gifted, cognitively disabled). Debate the appropriate testing practices, particularly in relation to culture-fair test uses. Identify key contributors in intelligence research and testing (e.g., Alfred Binet, Francis Galton, Howard Gardner, Charles Spearman, Robert Sternberg, Louis Terman, David Wechsler). Measuring Individual Differences Psychology relies heavily on testing individuals, it is part of the foundation for psychological analysis. To be effective, however, strict guidelines must be followed. Validity: Does the test actually measure what we say it does/what we want it to? Ex. Reading on a math test Face validity: Does the test look like it tests what it is supposed to test? Content validity: Each part of the test is representative of the larger body of knowledge. Measuring Individual Differences Criterion Validity: The behavior (such as college grades) that a test (such as the SAT) is designed to predict Predictive Validity: The success with which a test predicts the behavior it is designed to predict. Assessing Intelligence Football 10 linemen’s 9 success Greater correlation over broad range of body weights As the range of data under consideration narrows, its predictive power diminishes 8 7 6 5 Little correlation within restricted range 4 3 2 1 0 180 250 290 Body weight in pounds Measuring Individual Differences The second part of a credible test is reliability. Reliability: A test yields the same results over time Test-Retest or Split-Half Reliability Reliable, but not valid Not reliable, not valid Reliable and valid Creating Validity and Reliability The most efficient way to create validity and reliability is to use a standardized test. In the most basic sense, a standardized test means: The administration and scoring is the same for each test The results of the test can be used to draw a conclusion about the test takers in regard to the objectives of the test. Ex. AP test, S.A.T. Judging Normal A “normal curve” is applied to test to determine establish “norms.” When a statistically significant sample of the population has been tested, strong conclusions can be drawn. A normal range for IQ scores is 70-130. Scores below 70 indicate mental retardation while scores above 130 are considered gifted. Normal Distribution of IQ Scores Degrees of Mental Retardation Types of Tests There are two main types of tests: 1. Objective Tests: Tests that have one set answer, that can be scored easily by machine Ex. Multiple choice 1. Subjective Tests: Tests in which individuals are given ambiguous figures or an open ended question which requires some interpretation and analysis. Ex. FRQs Inter-rater reliability Sample Subjective Test The Rorschach Inkblot Test is one of the most widely known, and inaccurate subjective tests. The following slides are real inkblots from the test that was, at one time, a widely used test. Today, it has lost much, if not all of its credibility in determining intelligence or mental illness. Intelligence Testing A term that is used frequently, but often misunderstood is “intelligence.” What exactly is intelligence? Many people disagree about what exactly intelligence is, but most do agree that it is: Relative: defined in relation to the same abilities in a comparison group (usually age) Hypothetically constructed: it is unobservable, but instead inferred from behavior Testing IQ IQ (intelligence quotient) became a popular way to classify people in the early 1900s when two French psychologists (Alfred Binet and Theodore Simon) developed a test to identify those students who were gifted, and those who needed extra help. 3 Types?????? Which one bests describes intelligence, your opinion? Single ability A small group of abilities Wide variety of abilities Binet-SimonTest The test had four important distinctions: Scores were interpreted at their current performance Used to identify students in need of help, not label them or categorize them Emphasized that training and opportunity could affect intelligence Was empirically constructed Scoring the test was done by calculating the mental age (MA) and the chronological age (CA). MA= The average age at which normal individuals achieve a particular score CA= The number of years since an individuals birth Coming to America The idea of IQ testing became popular in America for three reasons: A huge increase in immigration New laws requiring universal education Military assessing new recruits for WWI It created an inexpensive and objective way to separate those could benefit from education or military leadership training and those who needed assistance. Stanford Connection Louis Terman, a Stanford Professor HE developed IQ Came up with the formula Stanford-Binet Intelligence Scale When the Binet test was adopted by a Stanford professor, he changed the equation to make intelligence scores into non-decimal numbers. This now became known as the Intelligence Quotient (IQ). =IQ David Weschler Intelligence Scores 3 Types Adult Children Pre school/primary No IQ score given But still can get you a normal distribution We will do these. Now Downside of IQ Testing Despite its utility, IQ testing had a big downside. Tests ended up reinforcing prevailing prejudices about race and gender. Ignored was the fact that environmental disadvantages limit the full development of people’s intellectual abilities. Same problem of NCLB!!! Heritability What are some inheritable traits? Genes “0” means that environment indicates the trait and is totally responsible for the difference “1” means that all of the variation in genetic Components of Intelligence Savant Syndrome: Individuals with remarkable, but rare talent, even though they are mentally deficient in other areas. Ex. Dustin Hoffman in Rain Man Flynn Effect Performance tests are steady (this century) Since the gene pool has stayed stable the idea is that environmental factors play a large role. Nutrition Education Television Video Games Theories of Intelligence Spearman’s Factor: Charles Spearman thought intelligence was a general factor behind all of our mental ability. Single ability Small group of ability OR wide variety Spearman argues single ability, the single general factor or g Catell’s Fluid and Crystallized Intelligence Sternberg Triarchic Theory Three types of intelligence (obviously) 1. Analytic: reflective, ability to compare and contrast to be able to explain and analyze 2. Creative intelligence: can use knowledge to create new innovative ways to solve problems 3. Practical: Street smarts, or apply real world situations Theories of Intelligence Howard Gardner believed that IQ scores measured only a limited range of human mental abilities. He argued we have seven separate mental abilities he calls the multiple intelligences. Linguistic intelligence ("word smart"): Logical-mathematical intelligence ("number/reasoning smart") Spatial intelligence ("picture smart") Bodily-Kinesthetic intelligence ("body smart") Musical intelligence ("music smart") Interpersonal intelligence ("people smart") Intrapersonal intelligence ("self smart")