Name of Grant Program:
Massachusetts 21st Century Community Learning Centers
– Exemplary Programs Grant
Fund Code: 647-B2
Addendum D – Survey of Academic & Youth Outcomes (SAYO) Outcomes Selection and APT Information
INSTRUCTIONS
Programs are required to utilize the SAYO tools to assess the overall effects of how participation in 21st CCLC programs
supports students’ academic and social emotional learning experiences. The SAYO is designed to measure the effect of
the instruction and support provided to students enrolled through use of the: SAYO-T completed by the school day
teachers of the students served by the program; SAYO-S completed by the program staff; and SAYO-Y completed by the
student participants. The SAYO is a research based program outcome evaluation tool developed by the Department of
Elementary and Secondary Education and the National Institute on Out-of-School Time.
SAYO Youth (SAYO-Y) Survey Description
The SAYO-Y measures students’ experiences in the 21st CCLC program, youth’s sense of competence, and youth’s
future aspirations. The SAYO-Y is designed to supplement areas measured by the SAYO-Staff and SAYO-Teacher
surveys, and is an opportunity to hear directly from youth and learn more about their experiences, attitudes, perceptions,
and beliefs.
Assessment of Program Practices (APT) Description
The APT is a research-based field-tested observation tool that includes those program practices which research suggests
are related to the outcomes measured by the SAYO. The goal of the APT is to assess the extent to which 21st CCLC
programs are implementing practices congruent with their desired SAYO outcomes. The APT is intended to be a tool that
assists with continuous program improvement and with identifying areas for professional development.
All sites are required to:



Implement the SAYO-T, S and Y
Sample a minimum of 50 students engaged in 21st CCLC grant-funded activities pre/post. For OST if a site
serves less than 50 students then it must sample everyone enrolled in the program.
Implement the Assessment of Program Practices Observation Tool (APT Q & O).
ELT Sites ONLY: SAYO-T & S:

SAYO-T
o completed by the classroom teacher
o Outcome areas: Learning Skills, Engagement, Initiative, Relationships with Peers

SAYO-S
o Completed by the educator during the 21st CCLC-ELT grant-funded activities
o Outcome areas: Engagement, Initiative, Relationships with Adults, Relationships with Peers
ELT
District/Program
Site(s)
ELT grantees should e- mail this page as part of their application.
ELT Sites Only (Please Check)
______I have read and understand the above requirements for implementing the SAYO and APT tools.
Name of Grant Program:
Massachusetts 21st Century Community Learning
Centers Program – Continuation Grant
Fund Code: 647-A / 245-A
Survey of Academic & Youth Outcomes (SAYO) Form (OST ONLY)
District/Program
Site(s)
OST grantees should e- mail this page as part of their application.
If the outcome selection will vary across sites please complete a separate form for each of those sites. Sites that
have the same outcomes may be included on one form.
I. SCHOOL-DAY TEACHER SURVEY TOOL (SAYO-T)
From the list below, select one primary and (optional) one secondary outcome from the Academic Outcomes section
(B). Also select three (3) outcomes from the Intermediary Outcomes section (C). Homework/Academic Support (A) is
a required outcome if you plan to provide Homework/Academic Support. Select the outcomes that best match the
expected results of the proposed activities. The district and school curricular priorities, school improvement plan, and
student level data/need should guide the outcomes selected.
A. Homework/Academic Support (Must select if provided)
Homework/Academic Support (must be a structured homework or academic support program)
B. Academic Outcomes for School-Day Teacher Tool - Select 1 Primary Outcome and (optional) 1 Secondary Outcome.
Primary Outcome (required - select 1)
Mathematics (Includes: Communication, Reasoning & Problem-Solving) [may also include Science/STEM]
English Language Arts (Includes Reading, Verbal Communication, and Written Communication) [may also
include Social Science]
Secondary Outcome (optional - select 1)
Mathematics (Includes: Communication, Reasoning & Problem-Solving) [may also include Science/STEM]
English Language Arts (Includes Reading, Verbal Communication, and Written Communication) [may also
include Social Science]
C. Intermediary Outcomes for School-Day Teacher Tool (Select a minimum of three)
Behavior in the Classroom (includes ability to function within the classroom, follows rules & limits, accepts consequences)
Engagement in Learning (includes staying on task, interested in learning new things, & participates in classroom activities)
Initiative (includes persistence on tasks, takes initiative to get information and resources needed to accomplish work, and
takes responsibility for own self)
Problem-Solving Skills (includes analytical skills, prioritizing, planning, and problem solving/decision making)
Communication (includes listening skills, oral presentation skills, and verbal skills)
Relations with Adults (includes discussing interests or ideas, showing respect, and seeking assistance)
II. 21st CCLC STAFF SURVEY (SAYO-S) – OST SELECTION (Grades 3-12 select Learning Skills plus two additional
outcomes; Grades K-2 select a minimum of 3 outcomes).
Learning Skills
Behavior in the Program
Engagement in Learning
Problem-Solving Skills
Initiative
Communication Skills
Relationships w/Adults
Relationships w/Peers