Program Evaluation as a Process

advertisement

Program Evaluation Guide

2013 - 2014

(Changes are noted in RED)

Board Approved: May 2013

Raytown Quality Schools Program Evaluation Plan

Mission Statement

“A unified learning community leading individuals to achieve the exceptional.”

Preface

At least biennially, the Raytown Quality School District reviews the goals and objectives of each program and service. The board of directors receives the reports of the effectiveness of each program and service, and, when necessary takes action to ensure that the programs and services offered by the district efficiently achieve their stated goals.

Raytown Quality Schools Program Evaluation Plan ~

2

Our diverse and caring community will ensure all students the opportunity to develop an educational foundation that empowers them to create their future.

Program Evaluation Overview

Definition:

Program Evaluation is a systematic, purposeful process of studying, reviewing, and analyzing data gather from multiple sources in order to make informed decisions about a program. Program Evaluation is the practice of district individuals and teams engaging in critical examination and analysis of their work to discover what is working and what is not in order to redefine their work and to improve its results (Killion, 2009: Revised).

Purpose for Program Evaluation:

The purpose of program evaluation is: o To create an accurate picture and basic understanding of the program to be evaluated o To demonstrate how the program supports district goals o To review and analyze data for the purpose of improvement o To support, directly or indirectly, student achievement

Program Evaluation as a Process:

Program Evaluation is a process not an event. It is a regular review of progress toward a set of goals and/or a set of essential questions. The process focuses our thinking on improvement and impact. It is a living process in that we regularly review progress and adjust our goals or essential questions as needed to ensure forward movement toward improved student achievement.

Raytown Quality Schools Program Evaluation Plan ~

3

Our diverse and caring community will ensure all students the opportunity to develop an educational foundation that empowers them to create their future.

Description of the Evaluation Process:

 Process Timeline

 Program Goal: At least biennially, the Raytown Quality School

District reviews the goals and objectives of each program and service; receives reports of the effectiveness of each program and service; and, takes action to ensure that the programs and services offered by the district efficiently achieve their goals.

 Procedural Sequence for Reporting Evaluation Results to the Board

Third preceding month a.

Receive Reminder Notice and schedule planning meeting b.

Attend Planning Meeting c.

Review evaluation process, expectations, and template d.

Formulate essential questions i.

MSIP Five Standards ii.

Recent changes iii.

Strengths/Opportunities for Growth e.

Formulate data sources needed to evaluate f.

Gather data

 Second preceding month

 a.

Evaluate data b.

Write draft report c.

Schedule Review Meeting

Preceding month a.

Attend Review Meeting i.

Review Report ii.

Discuss findings b.

If needed gather additional data, revise, and review report

 Presentation month a.

Upload to Electronic School Board

Present to BOE

Raytown Quality Schools Program Evaluation Plan ~

4

Our diverse and caring community will ensure all students the opportunity to develop an educational foundation that empowers them to create their future.

Timeline for Reporting Evaluation Results to the Board of

Directors

June

Component I

Instructional Design and Practices

Annually

Curriculum and Instruction Services (Combined)

Assessment Services

Professional Development Program

Guidance and Counseling Services

July

Component II

Instructional Support and State and Federal Programs

Even Numbered Year Odd Numbered Year

Library Media Services

A+ High School Program

Community Education Program

Gifted/Talented Education Services

Co-Curricular Activities Programs

Extra-Curricular Activities Program

Career and Technical Education Program

Parents as Teachers Program

Technology Services

Special Education Services

Early Childhood Education

State and Federal Programs

At-Risk Services

August

Component III

Leadership and Governance

Even Numbered Year

Fiscal Management Program

Community Relations Program

MOSIS Data Reporting

Safety and Security Services

Nutrition Services

Transportation Services

Odd Numbered Year

Policy Management Program

District Evaluation Program

Human Resources

Public Information Services

Facilities and Support Services

Health Services

September

Component IV

School Improvement Plans (Developed each year by building teams)

Raytown Quality Schools Program Evaluation Plan ~

5

Our diverse and caring community will ensure all students the opportunity to develop an educational foundation that empowers them to create their future.

Program Evaluation Report Template

A.

What is the essential focus? a.

Description of the Program: Here is where we give an overview of the program being evaluated with a short history, number of students and/or employees involved, etc. b.

Budget Information: Here is where we state the budget that supports the program and the amount budgeted for the entire program. Sometimes we will list budget impact or a description of what we provide with this funding.

This section is different for each program. c.

Date Reviewed d.

Program Personnel Responsible: The name of the supervisor of the program and others responsible for program implementation e.

Evaluators: List all those involved in the evaluation process (individual names or a statement such as department or titles)

B.

What are the essential components? a.

Current Program Goals and/or Objectives: These are developed by the group using the district CSIP, vision, mission, and discussion with staff b.

Additional Goals and/or Objectives: Any other goals you would want to add the ones listed above.

C.

What role does each component perform to increase student achievement? a.

Data Used to Evaluate Program: List all data reviewed and analyzed in program review

D.

How have these components worked to increase student achievement? a.

Analysis of Strengths: What does the program do well? What does the staff in the program do well? What positive impact does the program have on student achievement? b.

Essential Questions: These are questions that come up from the data.

They can focus on needs, direction, but always should include questions regarding move toward positive impact of student achievement. c.

Board Focus: Based on the information gathered through your evaluation, answer the following questions: i.

What information can you share that ensures this program is the best focus for our student in this particular area or need? (Research) ii.

What data sources have been reviewed and analyzed to establish the connection between the program and the results? (Data Analysis) iii.

What evidence do you have to show this program is improving student performance or meeting/exceeding board or district goals? iv.

Can this program sustain itself if funds are cut? If not, what makes this program the one we should fund or support? (Results)

E.

What are the next steps? a.

Recommendations: Based on the essential questions, state the recommendations that will move you toward answering the questions. This may cause you to rewrite your objectives or goals

F.

Signatures of persons listed in A.d. and A.e. above and Date

Raytown Quality Schools Program Evaluation Plan ~

6

Our diverse and caring community will ensure all students the opportunity to develop an educational foundation that empowers them to create their future.

Program Evaluation Impact Upon

Annual Performance Report

Program Evaluated

Direct Impact:

Curriculum and Instruction Services

Assessment Services

Career and Technical Education Program

Special Education Services

Early Childhood Education

State and Federal Programs

At-Risk Services

Indirect Impact:

Professional Development Program

Guidance and Counseling Services

Library Media Services

Gifted/Talented Education Services

Co-Curricular Activities Program

Technology Services

Extra-Curricular Activities Program

Fiscal Management Program

Safety and Security Services

Nutrition Services

Transportation Services

Health Services

Facilities and Support Services

Human Resources

District Evaluation program

Policy Management Program

Community Relations Program

Data Reporting Services

Public Information Services

Parents as Teachers Program

A+ High School Program

Community Education Program

Program Evaluated

Direct Impact:

Curriculum and Instruction Services

Assessment Services

Career and Technical Education Program

Special Education Services

Early Childhood Education Services

State and Federal Programs

Early Childhood Education Services

At-Risk Services

Indirect Impact:

APR MSIP V Standard/Indicator

Academic Achievement—The district administers assessments required by the

Missouri Assessment Program (MAP) to measure academic achievement and demonstrates improvement in the performance of its students over time.

1. Student performance on assessments required by the MAP meets or exceeds the state standard or demonstrates improvement in performance over time.

2. The percent of students tested on each required MAP assessment meets or exceeds the state standard.

3. Growth data indicate that students meet or exceed growth expectations.

APR MSIP V Standard/Indicator

Subgroup Achievement—The district demonstrates required improvement in student performance for its subgroups.

1. The performance of students identified on each assessment in identified subgroups, including free/reduced price lunch, racial/ethnic background, English language learners, and students with disabilities, meets or exceeds the state standard or

Raytown Quality Schools Program Evaluation Plan ~

7

Our diverse and caring community will ensure all students the opportunity to develop an educational foundation that empowers them to create their future.

Professional Development Program

Guidance and Counseling Services

Library Media Services

Gifted/Talented Education Services

Co-Curricular Activities Program

Technology Services

Extra-Curricular Activities Program

Fiscal Management Program

Safety and Security Services

Nutrition Services

Transportation Services

Health Services

Facilities and Support Services

Human Resources

District Evaluation program

Policy Management Program

Community Relations Program

MOSIS Data Reporting

Public Information Services

Parents as Teachers Program

A+ High School Program

Community Education Program

Program Evaluated

Direct Impact:

Curriculum and Instruction Services

Assessment Services

Professional Development Program

Guidance and Counseling Services

Career and Technical Education Program

Special Education Services

State and Federal Programs

At-Risk Services

Indirect Impact:

Library Media Services

Gifted/Talented Education Services

Co-Curricular Activities Program

Early Childhood Education

Technology Services

Extra-Curricular Activities Program

Fiscal Management Program

Safety and Security Services

Nutrition Services

Transportation Services

Health Services

Facilities and Support Services

Human Resources

District Evaluation program

Policy Management Program demonstrates required improvement.

APR MSIP V Standard/Indicator

College and Career Readiness—The district provides adequate post-secondary preparation for all students.

1. The percent of graduates who scored at or above the state standard on any departmentapproved measure(s) of college and career readiness, for example, the ACT®, SAT®,

COMPASS® or Armed Services Vocational

Aptitude Battery (ASVAB), meets or exceeds the state standard or demonstrates required improvement.

2. The district’s average composite score(s) on any department-approved measure(s) of college and career readiness, for example, the

ACT®, SAT®, COMPASS®, or ASVAB, meet(s) or exceed(s) the state standard or demonstrate(s) required improvement.

3. The percent of graduates who participated in any department-approved measure(s) of college and career readiness, for example, the

ACT®, SAT®, COMPASS®, or ASVAB, meets or exceeds the state standard or

Raytown Quality Schools Program Evaluation Plan ~

8

Our diverse and caring community will ensure all students the opportunity to develop an educational foundation that empowers them to create their future.

Community Relations Program

MOSIS Data Reporting

Public Information Services

Parents as Teachers Program

A+ High School Program

Community Education Program

Program Evaluated

Direct Impact:

Curriculum and Instruction Services

Guidance and Counseling Services

Extra-Curricular Activities Program

MOSIS Date Reporting

Gifted/Talented Education Services

Co-Curricular Activities Program

Career Education Program

Special Education Services

Early Childhood Education

State and Federal Programs

At-Risk Services

Indirect Impact:

Professional Development Program

Assessment Services

Library Media Services

Technology Services

Fiscal Management Program

Safety and Security Services

Nutrition Services demonstrates required improvement.

4. The percent of graduates who earned a qualifying score or grade on an Advanced

Placement (AP), International Baccalaureate

(IB), or Technical Skills Attainment (TSA) assessments and/or receive college credit or a qualifying grade through early college, dual enrollment, or approved dual credit courses meets or exceeds the state standard or demonstrates required improvement.

5. The percent of graduates who attend postsecondary education/training or are in the military within six (6) months of graduating meets the state standard or demonstrates required improvement.

6. The percent of graduates who complete career education programs approved by the department and are placed in occupations directly related to their training, continue their education, or are in the military within six (6) months of graduating meets the state standard or demonstrates required improvement.

APR MSIP V Standard/Indicator

Attendance Rate—The district ensures all students regularly attend school.

1. The percent of students who regularly attend school meets or exceeds the state standard or demonstrates required improvement.

Raytown Quality Schools Program Evaluation Plan ~

9

Our diverse and caring community will ensure all students the opportunity to develop an educational foundation that empowers them to create their future.

Transportation Services

Health Services

Facilities and Support Services

Human Resources

District Evaluation program

Policy Management Program

Community Relations Program

Public Information Services

Parents as Teachers Program

A+ High School Program

Community Education Program

Program Evaluated

Direct Impact:

Curriculum and Instruction Services

Assessment Services

Guidance and Counseling Services

Career and Technical Education Program

Special Education Services

MOSIS Data Reporting

Early Childhood Education

State and Federal Programs

At-Risk Services

Indirect Impact:

Technology Services

Professional Development Program

Library Media Services

Gifted/Talented Education Services

Co-Curricular Activities Program

Extra-Curricular Activities Program

Fiscal Management Program

Safety and Security Services

Nutrition Services

Transportation Services

Health Services

Facilities and Support Services

Human Resources

District Evaluation program

Policy Management Program

Community Relations Program

Public Information Services

Parents as Teachers Program

A+ High School Program

Community Education Program

APR MSIP V Standard/Indicator

Graduation Rate—The district ensures all students successfully complete high school.

1. The percent of students who complete an educational program that meet the graduation requirements as established by the board meets or exceeds the state standard or demonstrates required improvement.

Raytown Quality Schools Program Evaluation Plan ~

10

Download