measurement

advertisement
1
 Procedure
for assigning symbols,
letters, or numbers to empirical
properties of variables according to
rules.
2
 Difficulty
in measuring concepts directly
(e.g., academic achievement)
 Usually
measure indicators of concepts (e.g.,
CGPA)
 Level
of measurement determines the type
of statistical analysis.
 The
level of measurement you use depends
on how you want to measure an outcome.
3
 Nominal
 Ordinal
 Interval
 Ratio
4
 Latin
word nomin (name)
 Variable categorical in nature
 Differ in quality not quantity (numbers have no
meaning only label)
 Characterizes
observation into one (and
only one) category  mutually exclusive
 Solely qualitative
 No obsolute zero (0)
 Matematical operation not possible.
5
 Describes
variables that can be ordered
along some type of continuum.
 Not only categories, order as well.
 Ranking according to various outcomes,
e.g., big & little.
 No obsolute ‘0’, only relative position;
e.g., Zul is taller than Sheereen and
Sheereen is taller than Rozumah (no
information on how much taller).
 Matematical operation not possible.
6
Latin word intervalum (spaces between walls).
 Describes variables that have equal intervals btw
them.
 Allow us to determine the difference btw points
along the same type of continuum (e.g., the
difference btw 300 and 400 is the same as the
difference btw 700 and 800; i.e., 100).
 0 is arbitrary (subjective, temporary).
 Simple matematical operation.
 More precise & convey > info than nominal &
ordinal; but must be cautious in interpreting.

7
 Latin
word ratio (calculation).
 Describes variables that have equal intervals
btw them & have absolute 0.
 Most precise.
 Complex matematical operation.
 Highest level of measurement.
8
9
1. Nominal
2. Ordinal
3. Ratio
A.
B.
4. Interval
C.
D.
Have a true zero
(highest level).
Categorical in
nature (lowest
level)
Have equidistant
points along some
underlying
continuum.
Are ranked.
10
TYPES OF
MEASUREMENT
ON HEIGHT
1.
2.
3.
4.
Nominal
Ordinal
Ratio
Interval
A is 5 inches taller than B
(know precise
difference).
B.
Precise height measured
on a scale with true
zero.
C.
Categorize people into A
and B (people different
in height).
d. Tall and Short (have
some meaning, but
nature of difference is
not known).
A.
11
 Nominal
level variables are categorical in
nature (lowest level)
 Ordinal -- are ranked.
 Interval -- have equidistant points along
some underlying continuum.
 Ratio -- have a true zero (highest level).
12
Reliability and validity are the hallmarks of
good measurement.
Assessments tools must be reliable and valid,
otherwise the research hypothesis may be
incorrectly rejected.
13
 Reliability
is a practical measure of how
consistent and stable a measurement instrument
or a test might be.
 Reliability
is often measured using the
correlation coefficient.
14
 Dependency
 Consistency
 Stablility
 Trustworthiness
 Predictability
 Faithfulness
15
1.
2.
3.
4.
Test-retest
Parallel forms
Inter-rater
Internal consistency
16
A
measure of stability.
 Examines consistency over time.
 Administer the same test/measure at two
different times to the same group of
participants.
 Coefficient: rtest1.test2
17
A
measure of equivalence.
 Examines consistency between forms.
 Administer different forms of the same test
to the same group of participants.
 Coefficient: rform1.form2
18
A
measure of agreement.
 Examines consistency across raters.
 Have two raters, rate behaviors and
determine the amount of agreement
between them.
 Coefficient: % of agreement.
19
A
measure of consistently each item
measures the same underlying construct.
 Examines reliability within a particular
set of item.
 Correlate performance on each item with
overall performance across participants.
 Coefficient: Chronbach’s alpha
20
 Is
the quality of a test doing what it is designed
to do.
 The
test or instrument you are using actually
measures what you need to have measured.
21
 Truthfulness,
 Accuracy
 Authenticity
 Genuineness
 soundness
22
1.
2.
Content
Criterion
i.
ii.
3.
Concurrent
Predictive
Construct
23
A
measure of how well the items represent the
entire universe of items
 Established
by asking expert if the items assess
what you want them to.
 History
test = test items ask questions on history
not Science.
24
i.
Concurrent validity
 A measure of how well a test estimates a
criterion.

Established by selecting a criterion and
correlate scores on the test with scores
on ther criterion in the present.

Good student = test result + reports by
lecturers.
25
ii. Predictive Validity

A measure of how well a test predicts a
criterion.

Select a criterion and correlates scores on the
test with scores on the criterion in the
future.

High merit on STPM/Diploma = Score high
CGPA.

Pass driving test = Good driver.
26

A measure of how well a test assesses some
underlying construct.

Assess the underlying construct on which the test
is based and correlate these scores with the
scores.

Theoretically and practically sound.

Intelligence test actually measures intelligence.
27
A
test can be reliable without being valid
but the reverse is not true.
A
test can be reliable, but not valid, but a test
cannot be valid without first being reliable.


Reliablity is a necessary, but not sufficient, condition
of validity.
You are answering questions on simple addition, but
we called it spelling test! Obviously it is not a test on
spelling  lack of validity, does not affect reliability.
28
Download