Psychometrics - School of Education

advertisement
1
STUDY OF PROMISING AFTER-SCHOOL PROGRAMS
PROGRAM STAFF—STUDENT REPORT GLOSSARY
FALL 2003
Measure
SPRING 2004
Elementary
Middle
Elementary
Middle
After-School Activities
X
X
X
X
Child Behavior Scale
X
X
X
X
Mock Report Card: Work
Habits
X
X
X
X
Task Persistence
X
X
X
X
Teacher Checklist of Peer
Relations: Prosocial Behavior
(Social Skills with Peers)
X
X
X
X
SPRING 2005
Elementary
Middle
2
AFTER-SCHOOL ACTIVITIES
After-School Activities was created for the Study of Promising After-School Programs to
measure after-school program staff’s knowledge of the student’s participation in structured
activities sponsored by the school or another program.
Items
1. Organized sports team
2. After-school activities such as band, choir, drama, yearbook, or STEP/drill team or
cheerleading
3. Extra reading or math classes after school
4. Other activities NOT sponsored by your after-school program
Response scale
1 = yes
2 = no
3 = don’t know
Scoring
Not applicable
Administration
Fall 2003
Spring 2004
Psychometrics
Elementary: Fall 2003 (N = 798)
Yes
No
Don’t know
Organized sports
18%
32%
50%
School-based activities
23%
36%
41%
Reading/math classes
20%
31%
49%
Other activities
10%
20%
70%
Middle: Fall 2003 (N = 446)
Yes
No
Don’t know
Organized sports
25%
30%
45%
School-based activities
20%
41%
39%
Reading/math classes
18%
40%
42%
Other activities
10%
13%
77%
3
Elementary: Spring 2004 (N = 815)
Yes
No
Don’t know
Organized sports
25%
30%
45%
School-based activities
25%
39%
36%
Reading/math classes
30%
31%
39%
Other activities
13%
25%
62%
Middle: Spring 2004 (N = 426)
Yes
No
Don’t know
Organized sports
25%
27%
48%
School-based activities
19%
35%
46%
Reading/math classes
26%
31%
43%
Other activities
15%
20%
65%
4
CHILD BEHAVIOR SCALE
The Child Behavior Scale (Ladd & Profilet, 1996) is a measure of children’s aggressive,
withdrawn, and prosocial behaviors. The Study of Promising After-School Programs utilized 17
items to form two scales, Aggressive with Peers and Prosocial with Peers, consistent with those
used in the NICHD Study of Early Child Care and Youth Development, with a modified
response scale (original: 1 = doesn’t apply, 2 = applies sometimes, 3 = certainly applies). Items
were reworded to refer to other students rather than classmates.
Citation
Ladd, G. W., & Profilet, S. M. (1996). The Child Behavior Scale: A teacher-report measure of
young children’s aggressive, withdrawn, and prosocial behaviors. Developmental Psychology,
32(6), 1008-1024.
Items
1. Tends to react to other students’ distress by teasing them or making things worse
2. Seems concerned when other students are distressed
3. Is an aggressive child
4. Taunts and teases other students
5. Threatens other students
6. Is kind toward students
7. Listens to students
8. Compromises in conflicts with students
9. Is cooperative with students
10. Loses temper easily in conflicts with students
11. Argues with students
12. Is friendly toward other students
13. Annoys or irritates other students
14. Disrupts students’ activities
15. Shows concern for moral issues (e.g. fairness, welfare of others)
16. Offers help or comfort when other students are upset
17. Will continue to bother or hurt other students even when they are clearly upset
Response scale
0 = not true
1 = sometimes true
2 = often true
Scoring
Mean item scores
Aggressive with Peers = 9 items: 1, 3, 4, 5, 10, 11, 13, 14, 17
Prosocial with Peers = 8 items: 2, 6, 7, 8, 9, 12, 15, 16
Administration
Fall 2003
Spring 2004
5
Psychometrics
Elementary: Fall 2003
N
M
SD
Range
Alpha
Aggressive with peers
795
0.31
0.43
0-2
.92
Prosocial with peers
796
1.38
0.44
0-2
.88
Middle: Fall 2003
N
M
SD
Range
Alpha
Aggressive with peers
444
0.24
0.35
0-1.56
.90
Prosocial with peers
436
1.40
0.45
0.13-2
.90
Elementary: Spring 2004
N
M
SD
Range
Alpha
Aggressive with peers
814
0.34
0.45
0-2
.93
Prosocial with peers
813
1.36
0.45
0-2
.89
Middle: Spring 2004
N
M
SD
Range
Alpha
Aggressive with peers
425
0.28
0.41
0-2
.93
Prosocial with peers
425
1.40
0.50
0-2
.93
6
MOCK REPORT CARD: WORK HABITS
The Mock Report Card (Pierce, Hamm, & Vandell, 1999) is a teacher-report measure of
children’s academic performance and work habits. In the Study of Promising After-School
Programs, one item was reworded in the program staff survey to refer to the program rather than
the classroom.
Citation
Pierce, K. M., Hamm, J. V., & Vandell, D. L. (1999). Experiences in after-school programs and
children’s adjustment in first-grade class classrooms. Child Development, 70, 756-767.
Items
1. Follows program procedures
2. Works well independently
3. Works neatly and carefully
4. Uses time wisely
5. Completes work promptly
6. Keeps materials organized
Response scale
1 = very poor
2 = somewhat poor
3 = average
4 = good
5 = very good
Scoring
Mean item score
Administration
Fall 2003
Spring 2004
Psychometrics
Elementary
N
M
SD
Range
Alpha
Fall 2003
796
3.71
0.97
1-5
.96
Spring 2004
813
3.57
0.97
1-5
.96
Middle
N
M
SD
Range
Alpha
Fall 2003
423
3.75
1.00
1-5
.97
Spring 2004
426
3.59
0.97
1.17-5
.97
7
TASK PERSISTENCE
Task Persistence is adapted from Walker & Arbreton’s (2001) Self-Efficacy measure, a child
self-report utilizing a 4-point scale (1 = strongly disagree, 4 = agree). The response scale was
modified for the Study of Promising After-School Programs.
Citation
Walker, K. E., & Arbreton, A. J. A. (2001). Working together to build Beacon Centers in San
Francisco. Philadelphia: Public/Private Ventures.
Items
1. If the student can’t do a job the first time, he/she keeps trying until he/she can
2. This student gives up on things before finishing them
3. If something looks too hard, this student will not even bother to try it
4. This student handles unexpected problems very well
5. Failure just makes this student try harder
6. This student is unsure about his/her ability to do things
7. This student can depend on himself/herself
8. This student gives up easily
Response scale
1 = not at all true
2 = a little true
3 = mostly true
4 = really true
Scoring
Mean item score; items 2, 3, 6, and 8 are reverse coded.
Administration
Fall 2003
Spring 2004
Psychometrics
Elementary
N
M
SD
Range
Alpha
Fall 2003
793
3.03
0.61
1-4
.89
Spring 2004
806
2.96
0.60
1-4
.89
Middle
N
M
SD
Range
Alpha
Fall 2003
423
3.09
0.61
1-4
.91
Spring 2004
425
3.01
0.63
1-4
.92
8
TEACHER CHECKLIST OF PEER RELATIONS: PROSOCIAL BEHAVIOR
(SOCIAL SKILLS WITH PEERS)
The Prosocial Behavior scale on the Teacher Checklist of Peer Relations (Coie & Doge, 1988) is
a measure of children’s social skills with peers.
Citation
Coie, J. D., & Dodge, K. A. (1988). Multiple sources of data on social behavior and social status
in the school: A cross-age comparison. Child Development, 59, 815-829.
Items
1. Understands others’ feelings
2. Is socially aware of what is happening in a situation
3. Accurately interprets what a peer is trying to do
4. Refrains from over-impulsive responding
5. Generates many solutions to interpersonal problems
6. Generates good-quality solutions to interpersonal problems
7. Is aware of the effects of his/her behavior on others
Response scale
1 = very poor
2 = somewhat poor
3 = average
4 = good
5 = very good
Scoring
Mean item score
Administration
Fall 2003
Spring 2004
Psychometrics
Elementary
N
M
SD
Range
Alpha
Fall 2003
797
3.59
0.82
1-5
.94
Spring 2004
814
3.46
0.84
1-5
.94
Middle
N
M
SD
Range
Alpha
Fall 2003
432
3.64
0.85
1.14-5
.95
Spring 2004
426
3.52
0.83
1.29-5
.95
Download