Validity © 2010 The McGraw-Hill Companies, Inc. The Concept of Validity • Face Validity © 2010 The McGraw-Hill Companies, Inc. Content Validity • Test Blueprinting • The Quantification of Content Validity • Culture and the Relativity of Test Validity © 2010 The McGraw-Hill Companies, Inc. Criterion-Related Validity • What is a Criterion? – Characteristics of a criterion • Concurrent Validity • Predictive Validity – The validity coefficient – Incremental validity – Expectancy data – Decision theory and test utility © 2010 The McGraw-Hill Companies, Inc. Construct Validity • Evidence of Construct Validity – Evidence of homogeneity – Evidence of changes with age – Evidence of pretest/posttest changes – Evidence from distinct groups – Convergent evidence – Discriminant evidence – Factor analysis © 2010 The McGraw-Hill Companies, Inc. © 2010 The McGraw-Hill Companies, Inc. © 2010 The McGraw-Hill Companies, Inc. Five stages of developing a test: Once the idea for a test is conceived Items for the test are drafted This first draft of the test is then tried out on a group of sample testtakers. Item analysis are employed to assist making judgments about which items are good as they are, which items need to beThe Test Development Process Revised. Once the data from t tryout are collected, testtaker’s performan on the test as a whol and on each item is analyzed. © 2010 The McGraw-Hill Companies, Inc.
