Score Types and Selection

advertisement
GENERAL MEASUREMENT
CONCEPTS
ELEMENTS OF SCORE ANALYSIS
• TYPES OF SCORES
• COMMON UNIT OF MEASURE
• THREE STEPS OF ANALYZING A SET OF
SCORES
• CALCULATORS AND COMPUTERS
WHY ANALYSIS TEST SCORES?
“FOR A LARGE GROUP A SIMPLE LIST
OF SCORES HAS NO MEANING”
“OVERALL GROUP PERFORMANCE
AND/OR IMPROVEMENT CAN ONLY BE
INTERPRETED BY CONDENSING THE
INFORMATION AND APPLYING
DESCRIPTIVE STATISTICS TO IT”
WHY ANALYSIS TEST SCORES?
“ONCE THE OVERALL GROUP
PERFORMANCE IS DETERMINED,
INDIVIDUAL PERFORMANCE CAN
THEN BE EVALUATED IN
RELATION IN RELATION TO THE
OVERALL GROUP PERFORMANCE”
TYPES OF SCORES
• CONTINUOUS SCORES
• DISCRETE SCORES
CONTINUOUS SCORES
• HAVE POTENTIALLY AN INFINITE
NUMBER OF VALUES AS THEY CAN BE
MEASURED WITH VARYING DEGREES
OF ACCURACY
• BETWEEN ANY TWO VALUES EXIST
COUNTLESS VALUES THAT CAN BE
EXPRESSRED AS FRACTIONS
• EXAMPLES: TIME, WEIGHT, & LENGTH
CONTINUOUS SCORES
• MOST CONTINUOUS SCORES ARE
ROUNDED OFF TO THE NEAREST
UNIT OF MEASUREMENT WHEN
RECORDED
• 5 OR MORE IS ROUNDED UP AND 4
OR LESS IS ROUNDED DOWN
• EXAMPLE ROUNDING TO A WHOLE
NUMBER: 1.6 = 2; 1.4 = 1
DISCRETE SCORES
• LIMETED TO A SPECIFIC NUMBER
OF VALUES
• ARE NOT EXPRESSED IN
FRACTIONS
• EXAMPLES - FREE THROWS MADE
IN BASKETBALL OR SUCCESSFUL
THROWS AT A TARGET
OTHER CLASSIFICATION OF SCORES
•
•
•
•
RATIO
INTERVAL
ORDINAL
NOMINAL
RATIO SCORES
• COMMON UNIT OF MEASUREMENT
BETWEEN EACH SCORE
• TRUE ZERO POINT
• STATEMENTS ABOUT EQUALITY
OF RATIOS CAN BE MADE: 1 SCORE
CAN BE REFERRED TO AS 2 TIMES
GREATER THAN ANOTHER SCORE
• EXAMPLES INCLUDE DISTANCE,
TIME, WEIGHT, AND LENGTH
INTERVAL SCORES
• COMMON UNIT OF MEASUREMENT
BETWEEN EACH SCORE
• NO TRUE ZERO (A SCORE OF ZERO
ON A KNOWLEDGE TEST DOES NOT
INDICATE TOTAL LACK OF
KNOWLEDGE) AND HENCE
STATEMENTS ABOUT EQUALITY
OF RATIOS CAN NOT BE MADE
“MOST PHYSICAL PEFORMANCE
SCORES ARE EITHER RATIO OR
INTERVAL SCORES”
ORDINAL SCORES
• DO NOT HAVE A COMMON UNIT OF
MEASUREMENT BETWEEN SCORES AND
DO NOT HAVE A TRUE ZERO
• THERE IS AN ORDER IN THE SCORES
THAT MAKES IT POSSIBLE TO DESCRIBE
OR LIST ONE SCORE HIGHER THAN THE
OTHER SCORE
• EXAMPLE: CLASS RANK ON A PUSH-UP
TEST
NOMINAL SCORES
• CANNOT BE RANKED ORDER
• MUTUALLY EXCLUSIVE SCORES
• CANNOT SAY THAT ONE SCORE IS
BETTER THAN ANOTHER SCORE
• EXAMPLES: SPORT PREFERENCE,
GENDER, AND ETHNICITY
COMMON UNITS OF MEASURE
• SCORES MUST BE RECORDED IN A
SINGLE UNIT OF MEASUREMENT SUCH
AS CENTIMETERS RATHER THAN
METERS AND CENTIMETERS
• USUALLY RECORDED IN THE SMALLER
ONE SUCH AS CENTIMETERS
• RECORDING SCORES IN THE SMALLER
UNIT OF MEASURE AS THEY ARE
COLLECTED IS LESS TIME-CONSUMING
THAN CONVERTING THEM INTO THAT
FORM LATER
SELECTING A CRITERION
SCORE
MEAN SCORE VERSUS BEST SCORE
• CRITERION SCORE IS THE
MEASURE USED TO INDICATE A
PERSON’S ABILITY
• GENERALLY A BETTER INDICATOR
WHEN DEVELOPED FROM MORE
THAN 1 TRIAL (I.E., MEAN SCORE
FROM MORE THAN 1 TRIAL)
• RELIABILITY INCREASES AS THE
NUMBER OF MEASURES
INCREASES
MEAN SCORE VERSUS BEST SCORE
• GENERALLY THE MOST RELIABILE
CRITERION SCORE AND THE BEST
INDICATOR OF TRUE ABILITY
(TYPICAL PERFORMANCE) MAY BE
THE MEAN SCORE OF MULTIPLE
TRIALS AS THE SUM OF THE
ERRORS OF MEASURMENT IS ZERO
• NOTE: OBSERVED SCORE EQUALS
TRUE SCORE PLUS ERROR SCORE
MEAN SCORE VERSUS BEST SCORE
• FOR MULTIPLE-TRIAL PHYSICAL
PERFORMANCE TESTS WHERE MAXIMAL
ABILITY RATHER THAN TYPICAL ABILITY IS
DESIRED, AND THE EQUIPMENT AND SCORING
PROCEDURE ARE HIGHLY ACCURATE, THE
BEST SCORE IS THE BEST INDICATOR OF A
PERSON’S TRUE ABILITY AS A PERSON
CANNOT SCORE BETTER THAN HER OR HIS
PHYSIOLOGICAL CAPACITY
• TYPICAL OF MANY PHYSIOLOGICAL
MEASUREMENTS TAKEN IN A LABORATORY
SETTING)
MEAN SCORE VERSUS BEST SCORE
• IF THE BEST SCORE IS USED AS
THE CRITERION SCORE:
- IT SHOULD BE BASED ON
MULTIPLE TRIALS
- IT IS NOT THE SAME TRIAL FOR
EACH PERSON
MEAN SCORE VERSUS BEST SCORE
• DEPEDNING ON THE SITUATION AND WHAT THE
TEST ADMINISTRATOR BELIEVES IS MOST
APPROPRIATE, AN INDIVIDUAL’S CRITERION
SCORE FROM MULTIPLE TRIAL TESTS MAY BE
DETERMINED IN ANY OF THE FOLLOWING WAYS:
MEAN OF ALL TRIAL SCORES
BEST SCORE OF ALL TRIAL SCORES
MEAN OF THE SELECTED TRIAL
SCORES BASED ON THE TRIALS ON
WHICH THE GROUP SCORED BEST
MEAN OF THE SELECTED TRIAL
SCORES BASED ON THE TRIALS ON
WHICH THE INDIVIDUAL SCORED
BEST
THREE STEPS OF ANALYZING A
SET OF TEST SCORES
• SELECT THE APPROPRIATE
ANALYSIS TECHNIQUE
• COMPLETE CALCULATIONS WITH
THE ANALSYS TECHNIQUE
• INTERPRET THE RESULTS OF THE
ANALYSIS TECHNIQUE
CALCULATORS AND COMPUTERS
• SCORE ANALYSIS SHOULD BE
ACCURATE AND QUICK
• CALCULATORS WORK WELL WITH
SMALL DATA SETS; BUT WITH LARGER
DATA SETS THE USE OF CALCULATORS
BECOME MORE TIME-CONSUMING AND
MORE MISTAKES TEND TO BE MADE
• COMPUTERS WITH DATA ANALYSIS
SOFTWARE SUCH AS SPSS ARE VERY
FAST AND ACCURATE
QUESTIONS
OR
COMMENTS??
Download