Massachusetts Mathematics and Science Partnership Title IIB
Annual State-level Evaluation Report Appendices
Cohort 3 Reporting Period: September 1, 2006, through August 31, 2009
Cohort 4 Reporting Period: September 1, 2008, through August 31, 2009
Cumulative Reporting Period: February 2, 2004, through August 31, 2009
Prepared for the Massachusetts Department of Elementary and
Secondary Education
December 2010
Annual Report of the MMSP State-level Evaluation
Contents
Contents
Appendix A: Participant Background Survey – September 2008 – August 2009 ................................. 2
Appendix B: Timeline for State-level Evaluation and TA Activities ..................................................... 10
Appendix C: Results of the Participant Background Survey for 2008-2009 ....................................... 13
Appendix D: High Need District Eligibility Criteria ................................................................................ 25
Appendix E: Enrollment and Attrition Rates by Course ....................................................................... 31
Appendix F: Subject Matter Competency Demonstration Options ..................................................... 40
Appendix G: Mean Percentage Scores for Pre- & Post-course Tests ................................................. 41
Appendix H: High Need Districts for All Funding Periods, by Partnership ........................................ 50
Appendix I: Criteria that Account for Gain in Highly Qualified Status ................................................ 57
Appendix A: Participant
Background Survey – September 2008 – August 2009
Annual Report of the MMSP State-level Evaluation
UMass Donahue Institute
Research and Evaluation Group
Appendix A
3
Annual Report of the MMSP State-level Evaluation
UMass Donahue Institute
Research and Evaluation Group
Appendix A
4
Annual Report of the MMSP State-level Evaluation
UMass Donahue Institute
Research and Evaluation Group
Appendix A
5
Annual Report of the MMSP State-level Evaluation
UMass Donahue Institute
Research and Evaluation Group
Appendix A
6
Annual Report of the MMSP State-level Evaluation
UMass Donahue Institute
Research and Evaluation Group
Appendix A
7
Annual Report of the MMSP State-level Evaluation
UMass Donahue Institute
Research and Evaluation Group
Appendix A
8
Annual Report of the MMSP State-level Evaluation
UMass Donahue Institute
Research and Evaluation Group
Appendix A
9
Annual Report of the MMSP State-level Evaluation
Appendix B
Appendix B: Timeline for State-level Evaluation and TA Activities
The following is a summary timeline of state-level evaluation and technical assistance activities carried out between
February, 2004, and end of Year 6 of the MMSP.
February 2004 Held Kick-off Meeting for all partnerships and their evaluators at the Department of Education
Spring 2004
Conducted individual partnership meetings with local evaluators and partnership leaders to:
Review the Minimum Expectations document along with the local evaluation and data collection plan
And
Explore potential modifications to implementation plans to create opportunities for experimental or quasi
experimental design
Spring 2004
Developed common measures for state-level data collection
June 2004
Attended federal meeting held for MSP projects across the country
Summer 2004 Disseminated and collected end-of-course documents designed to collect course-level data for the
statewide evaluation
Fall 2004
Conducted individual partnership meetings with local evaluators and partnership leaders to:
Review the Minimum Expectations document along with the local evaluation and data collection plan
And
Review the Federal Reporting document to ensure the partnerships were collecting the data needed to
complete that report
Winter 2005
Conducted partnership meetings with the two new partnerships funded in the second round that
constitutes Cohort 2 to:
Introduce the Minimum Expectations document along with the local evaluation and data collection plan
And
Introduce the Federal Reporting document to ensure the partnerships were collecting the data needed to
complete that report
June 2005
Held Technical Assistance Meeting for all partnerships regarding the requirements of the USED Annual
report
UMass Donahue Institute
Research and Evaluation Group
10
Annual Report of the MMSP State-level Evaluation
Appendix B
June 2006
Participated in USED Annual Conference of MSP State Coordinators
August 2006
Held Technical Assistance Meeting for all partnerships regarding evaluation requirements for MMSP
Fall 2006 to
Winter 2007
Conducted partnership meetings with the new Cohort 3 partnerships to:
Introduce the Minimum Expectations document along with the local evaluation and data collection plan
And
Discuss the federal reporting requirements to ensure the partnerships were collecting the data needed to
complete federal report
December 2006 Participated in USED MSP Regional Conference
June 2007
Participated in USED Annual Conference of MSP State Coordinators
September 2007Held Technical Assistance Meeting for all partnerships regarding the requirements of the USED Annual
report
January 2008
Participated in USED MSP Regional Conference
April 2008
Participated in technical assistance workshop for bidders pursuing MSP funding for 2008-2009
April 2008
Participated in USED the Massachusetts MSP Statewide Conference
June 2008
Participated in USED MSP State Coordinators’ Meeting
October 2008
Held Technical Assistance Meeting for all partnerships regarding evaluation requirements for MMSP
Fall 2008 to
Winter 2009
Conducted partnership meetings with the new Cohort 3 partnerships to:
Discuss evaluation expectations data collection plans
And
Discuss the federal reporting requirements to ensure the partnerships were collecting the data needed to
complete federal report
March 2009
Participated in USED MSP Regional Conference
May 2009
Participated in USED the Massachusetts MSP Statewide Conference
The following activities were on going throughout the life of the project:
Disseminated and collected end-of-course documents designed to collect course-level data for the
statewide evaluation
Managed data collected from partnerships at the end of each course
UMass Donahue Institute
Research and Evaluation Group
11
Annual Report of the MMSP State-level Evaluation
Appendix B
Provided technical assistance to partnerships in support of local partnership evaluation efforts
Monitored local evaluation plans to see they include both formative and summative research questions
and corresponding activities
Monitored data collection and analysis around the basic logic model of professional development
Served as liaison to the U.S. Department of Education for evaluation and research issues including
participation in national meetings and periodic conference calls
Met with ESE MSP Team as needed to support integration of evaluation efforts with program goals
Until Steering Committee was disbanded, attended MMSP Steering Committee meetings in role of state
level evaluator and technical assistance
UMass Donahue Institute
Research and Evaluation Group
12
Annual Report of the MMSP State-level Evaluation
Appendix C
Appendix C: Results of the Participant Background Survey for 2008-2009
Cohort 3
Cohort 3
Item
2008–2009
n
%
How do you describe yourself?
American Indian or Alaskan native
Asian
Black or African American
Hispanic or Latino
Native Hawaiian or other Pacific Islander
White
Mixed Race
Other
No Response
0
13
5
11
0
404
6
11
13
<1%
3%
1%
2%
<1%
87%
1%
2%
3%
What best describes your current primary position?
Teacher (Regular Education)
Special Education Teacher (Sole Instructor)
Special Education Inclusion Teacher
Other
Department Head or Curriculum Coordinator
Principal/Asst. Principal/Headmaster
Support Specialist (counselor, librarian, etc.)
Long-term Substitute
Paraprofessional
Superintendent or Asst. Superintendent
No Response
ELL, ESL, or Sheltered English Immersion Teacher
Gifted or Talented Teacher
Title I Teacher
Math Coach (Non-Teaching)
Math Coach (Teaching)
Science Coach (Non-Teaching)
Science Coach (Teaching)
Instructional Technology Director
UMass Donahue Institute
Research and Evaluation Group
318
16
22
15
4
8
3
1
3
1
5
21
6
3
21
12
0
2
2
69%
4%
5%
3%
<1%
2%
<1%
<1%
<1%
<1%
1%
5%
1%
<1%
5%
3%
0%
<1%
<1%
13
Annual Report of the MMSP State-level Evaluation
Appendix C
Cohort 3
Item
2008–2009
n
%
What grades do you currently teach?
Pre-K
Elementary and K-8
Middle School (Grades 6-8)
High School (Grades 9-12)
Middle and High School grades
Adult Education
All levels
NA (doesn’t teach)
No Response
150
200
72
1
1
32%
43%
16%
<1%
<1%
38
1
8%
<1%
16
51
63
130
137
63
3
4%
11%
14%
28%
30%
14%
<1%
How many years have you been employed in education?
1st year
2-3 years
4-5 years
6-10 years
11-20 years
Over 20 years
0 or No Response
Note: Percentages may not total 100% due to rounding error or items in which respondents may respond to
all that apply.
Cohort 3
Item
2008–2009
n
Which of the following content areas are you currently
teaching?
Mathematics
Elementary (all subjects)
Elementary Mathematics
General Science
Biology
Physics
Earth Science
Chemistry
Any science area*
Technology/Engineering
Other
Do not teach currently
%
125
150
44
73
36
29
19
34
143
14
14
38
27%
32%
10%
16%
8%
6%
4%
7%
31%
3%
3%
8%
452
8
2
1
98%
2%
<1%
<1%
7
1
2%
<1%
In which of the following are you currently employed?
Public School/ Public Charter School
Private School
Other
No Response
Currently hold certification through the National Board for
Professional Teaching Standards.
In Mathematics
In General Science
*Number of unique participants teaching in any science area.
UMass Donahue Institute
Research and Evaluation Group
14
Annual Report of the MMSP State-level Evaluation
Appendix C
Cohort 3
Item
2008–2009
n
%
118
10
74
113
13
135
26%
2%
16%
24%
3%
29%
116
8
55
142
6
136
25%
2%
12%
31%
1%
29%
135
74
65
43
8
138
29%
16%
14%
9%
2%
30%
173
64
73
18
1
134
37%
14%
16%
4%
<1%
29%
40
153
184
30
3
53
9%
33%
40%
7%
<1%
11%
59
171
110
34
14
75
13%
37%
24%
7%
3%
16%
Approximately how many math students do you teach annually?
0 students
1-10 students
11-40 students
41-150 students
151+ students
No Response
Approximately how many science students do you teach annually?
0 students
1-10 students
11-40 students
41-150 students
151+ students
No Response
Approximately how many students do you teach annually who are
Title I students?
0 students
1-10 students
11-40 students
41-150 students
151+ students
No Response
Approximately how many students do you teach annually who are
academically advanced students?
0 students
1-10 students
11-40 students
41-150 students
151+ students
No Response
Approximately how many students do you teach annually who are
Special Education students?
0 students
1-10 students
11-40 students
41-150 students
151+ students
No Response
Approximately how many students do you teach annually who are
English Language Learners?
0 students
1-10 students
11-40 students
41-150 students
151+ students
No Response
UMass Donahue Institute
Research and Evaluation Group
15
Annual Report of the MMSP State-level Evaluation
Appendix C
Cohort 3
Item
2008–2009
n
%
466
442
218
163
124
72%
68%
34%
25%
19%
84
13%
Why did you participate in this course? *
To obtain graduate credit
To increase knowledge in content
To pursue a personal interest
To earn PDPs for recertification
To get an additional license (certification)
To prepare for the Massachusetts Test for
Educator Licensure (MTEL)
To follow an administrator’s suggestion
To obtain a first license (certification)
Other
No Response
23
13
51
10
4%
2%
8%
2%
340
119
4
73%
26%
<1%
245
116
27
28
7
40
53%
25%
6%
6%
2%
9%
High Need District
Yes
No
Unknown
Highly Qualified
Yes
No
In some, but not all areas taught
Not enough information to determine
Private School (not included)
Not applicable (not currently teaching)
*Data for this item represents the number of seats filled from all courses, rather than the
number of unique participants.
Cohort 3
Item
2008–2009
n
How many PDP hours do you have in your content area(s)?
(For SPED and ELL teachers only)
Less than 48 PDP hours
48 to 100 PDP hours
101 to 250 PDP hours
251+ PDP hours
No Response
Please select any of the following licenses you currently
hold.
Vocational Technical
Specialist Teacher
Supervisor/Director
Principal/Asst. Principal
Superintendent/Assistant Superintendent
UMass Donahue Institute
Research and Evaluation Group
%
11
9
20
11
412
2%
2%
4%
2%
89%
3
84
6
20
1
<1%
18%
1%
4%
<1%
16
Annual Report of the MMSP State-level Evaluation
Appendix C
Cohort 3 2008–2009
Item
Bachelors
n
%
Masters
n
%
CAGS
n
%
Doctorate
n
%
A degree currently held for each major.
Education
Math Education
Science Education
Math
General Science
Biology
Chemistry
Earth Science
Physics
Technology/Engineering
All science/technology combined
Other
141
4
12
25
4
38
12
9
9
16
88
123
31%
<1%
3%
5%
<1%
8%
3%
2%
2%
4%
19%
27%
180
21
20
5
4
5
1
3
4
5
22
57
39%
5%
4%
1%
<1%
1%
<1%
<1%
<1%
1%
5%
12%
6
0
1
0
1
0
1
0
0
1
3
1
1%
0%
<1%
0%
<1%
0%
<1%
0%
0%
<1%
<1%
<1%
3
0
0
0
0
0
0
0
0
0
0
<1%
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
1
<1%
2
0
1
0
1
1
0
1
0
0
3
1
<1%
0%
<1%
0%
<1%
<1%
0%
<1%
0%
0%
<1%
<1%
38
68
41
8
16
2
3
1
5
3
30
13
8%
15%
9%
2%
4%
<1%
<1%
<1%
1%
<1%
6%
3%
12
14
1
4
1
0
0
0
0
0
1
3
3%
3%
<1%
<1%
<1%
0%
0%
0%
<1%
<1%
<1%
<1%
2%
2
0
0
0
0
0
0
0
0
0
0
1
A degree currently being pursued for each major.
Education
Math Education
Science Education
Math
General Science
Biology
Chemistry
Earth Science
Physics
Technology/Engineering
All science/technology combined
Other
<1%
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
<1%
Cohort 3 2008–2009
Item
MTEL
Taken
n
%
MTEL
Passed
n
%
Scores
Unknown
n
%
MTEL tests taken
General Curriculum (formerly Elementary)
Elementary Math
Early Childhood
Mathematics
Middle School Mathematics
Middle School Mathematics/ Science
General Science
Biology
Chemistry
Physics
Earth Science
Technology/Engineering
UMass Donahue Institute
Research and Evaluation Group
74
31
10
41
62
15
42
30
18
11
4
3
16%
7%
2%
9%
13%
3%
9%
7%
4%
2%
<1%
<1%
71
27
7
33
54
13
36
28
17
9
3
3
15%
6%
2%
7%
12%
3%
8%
6%
4%
2%
<1%
<1%
1
5
3
4
5
2
3
1
0
0
1
0
<1%
1%
<1%
<1%
1%
<1%
<1%
<1%
0%
0%
<1%
0%
17
Annual Report of the MMSP State-level Evaluation
Appendix C
Cohort 3
2008–2009
Item
n
%
8
0
20
38
5
18
20
6
5
198
54
12
11
5
71
8
41
31
95
11
4
15
45
2%
0%
4%
8%
1%
4%
4%
1%
1%
43%
12%
3%
2%
1%
15%
2%
9%
7%
21%
2%
<1%
3%
10%
3%
<1%
1%
License Areas
Academically Advanced PreK-8
Adult Basic Education
Biology 5-8
Biology 8-12
Chemistry 5-8
Chemistry 8-12
Early Childhood PreK-2
Earth Science 5-8
Earth Science 8-12
Elementary 1-6
Elementary Mathematics 1-6
ELL PreK-6
ELL 5-12
General Science 1-6
General Science 5-8
Instructional Technology
Mathematics 8-12
Middle School
Middle School Mathematics 5-8
Middle School Math/Science 5-8
Physics 5-8
Physics 8-12
Students w/ Moderate Disability PreK-8
Students w/ Moderate Disability 5-12
Students w/ Severe Disability
Technology/Engineering 5-12
UMass Donahue Institute
Research and Evaluation Group
13
3
6
18
Annual Report of the MMSP State-level Evaluation
Appendix C
Cohort 4
Cohort 4
Item
2008–2009
n
%
How do you describe yourself?
American Indian or Alaskan native
Asian
Black or African American
Hispanic or Latino
Native Hawaiian or other Pacific Islander
White
Mixed Race
Other
What best describes your current primary position?
Teacher (Regular Education)
Special Education Teacher (Sole Instructor)
Special Education Inclusion Teacher
Other
Principal/Asst. Principal/Headmaster
Support Specialist (counselor, librarian, etc.)
Long-term Substitute
Paraprofessional
ELL, ESL, or Sheltered English Immersion Teacher
Gifted or Talented Teacher
Math Coach (Non-Teaching)
Math Coach (Teaching)
Science Coach (Non-Teaching)
Science Coach (Teaching)
Instructional Technology Director
UMass Donahue Institute
Research and Evaluation Group
0
12
31
11
0
262
6
5
237
27
24
11
1
1
6
4
10
1
3
3
1
6
1
0%
4%
9%
3%
0%
77%
2%
2%
70%
8%
7%
3%
<1%
<1%
2%
1%
3%
<1%
<1%
<1%
<1%
2%
<1%
19
Annual Report of the MMSP State-level Evaluation
Appendix C
Cohort 4
Item
2008–2009
n
%
What grades do you currently teach?
Pre-K
Elementary and K-8
Middle School (Grades 6-8)
High School (Grades 9-12)
NA (doesn’t teach)
No Response
3
101
174
55
7
1
<1%
30%
51%
16%
2%
<1%
23
39
48
95
83
51
2
7%
11%
14%
28%
24%
15%
<1%
How many years have you been employed in education?
1st year
2-3 years
4-5 years
6-10 years
11-20 years
Over 20 years
0 or No Response
Note: Percentages may not total 100% due to rounding error or items in which respondents may respond to
all that apply.
Cohort 4
Item
2008–2009
n
Which of the following content areas are you currently
teaching?
Mathematics
Elementary (all subjects)
Elementary Mathematics
General Science
Biology
Physics
Earth Science
Chemistry
Technology/Engineering
Any science area*
Other
Do not teach currently
%
102
150
44
98
27
17
22
17
14
138
11
7
30%
32%
10%
29%
8%
5%
7%
5%
4%
41%
3%
2%
333
7
1
98%
2%
<1%
4
3
4%
3%
In which of the following are you currently employed?
Public School (includes public charter schools)
Non-public School
Other or No Response
Currently hold certification through the National Board for
Professional Teaching Standards.
In Mathematics
In General Science
*Number of unique participants teaching in any science area.
UMass Donahue Institute
Research and Evaluation Group
20
Annual Report of the MMSP State-level Evaluation
Appendix C
Cohort 4
Item
2008–2009
n
%
99
17
88
102
7
28
29%
5%
26%
30%
2%
8%
103
9
72
122
18
17
30
3%
21%
36%
5%
5%
105
41
53
41
2
99
31%
12%
16%
12%
<1%
29%
137
44
46
14
2
98
40%
13%
14%
4%
<1%
29%
33
96
151
23
3
35
10%
28%
44%
7%
<1%
10%
72
116
54
27
6
66
21%
34%
16%
8%
2%
19%
Approximately how many math students do you teach annually?
0 students
1-10 students
11-40 students
41-150 students
151+ students
No Response
Approximately how many science students do you teach annually?
0 students
1-10 students
11-40 students
41-150 students
151+ students
No Response
Approximately how many students do you teach annually who are
Title I students?
0 students
1-10 students
11-40 students
41-150 students
151+ students
No Response
Approximately how many students do you teach annually who are
academically advanced students?
0 students
1-10 students
11-40 students
41-150 students
151+ students
No Response
Approximately how many students do you teach annually who are
Special Education students?
0 students
1-10 students
11-40 students
41-150 students
151+ students
No Response
Approximately how many students do you teach annually who are
English Language Learners?
0 students
1-10 students
11-40 students
41-150 students
151+ students
No Response
UMass Donahue Institute
Research and Evaluation Group
21
Annual Report of the MMSP State-level Evaluation
Appendix C
Cohort 4
Item
2008–2009
n
%
240
287
118
108
52
61%
73%
30%
28%
13%
45
12%
30
11
28
3
8%
3%
7%
1%
215
126
0
63%
37%
0%
Why did you participate in this course? *
To obtain graduate credit
To increase knowledge in content
To pursue a personal interest
To earn PDPs for recertification
To get an additional license (certification)
To prepare for the Massachusetts Test for
Educator Licensure (MTEL)
To follow an administrator’s suggestion
To obtain a first license (certification)
Other
No Response
High Need District
Yes
No
Unknown
Highly Qualified
Yes
No
In some, but not all areas taught
Not enough information to determine
Private School (not included)
Not applicable (not currently teaching)
188
97
25
15
7
9
55%
28%
7%
4%
2%
3%
*Data for this item represents the number of seats filled from all courses, rather than the
number of unique participants.
Cohort 4
Item
2008–2009
n
%
How many PDP hours do you have in your content area(s)?
(SPED and ELL teachers only)
Less than 48 PDP hours
48 to 100 PDP hours
101 to 250 PDP hours
251+ PDP hours
No Response
Please select any of the following licenses you currently
hold.
Vocational Technical
Specialist Teacher
Supervisor/Director
Principal/Asst. Principal
Superintendent/Assistant Superintendent
UMass Donahue Institute
Research and Evaluation Group
16
8
13
12
292
5%
2%
4%
4%
86%
0
63
2
7
0
0%
19%
<1%
2%
0%
22
Annual Report of the MMSP State-level Evaluation
Appendix C
Cohort 4 2008–2009
Item
Bachelors
n
%
Masters
n
%
CAGS
n
%
Doctorate
n
%
A degree currently held for each major.
Education
Math Education
Science Education
Math
General Science
Biology
Chemistry
Earth Science
Physics
Technology/Engineering
All science/technology combined
Other
79
5
8
18
12
37
9
5
2
11
76
98
23%
2%
2%
5%
4%
11%
3%
2%
<1%
3%
22%
29%
148
8
18
2
8
4
3
1
0
2
18
43
43%
2%
5%
<1%
2%
1%
<1%
<1%
0%
<1%
5%
13%
4
0
1
0
0
0
0
0
0
0
0
1
1%
0%
<1%
0%
0%
0%
0%
0%
0%
0%
0%
<1%
1
0
0
0
0
0
1
0
0
0
1
<1%
0%
0%
0%
0%
0%
<1%
0%
0%
0%
<1%
3
<1%
1
2
1
1
2
1
1
0
0
1
5
1
<1%
<1%
<1%
<1%
<1%
<1%
<1%
0%
0%
<1%
1%
<1%
29
42
30
5
13
3
1
1
0
1
19
9
9%
12%
9%
2%
4%
<1%
<1%
<1%
0%
<1%
6%
3%
6
10
1
1
2
0
0
0
1
1
4
2
2%
3%
<1%
<1%
<1%
0%
0%
0%
<1%
<1%
1%
<1%
2%
3
1
0
0
0
0
0
0
0
0
0
0
A degree currently being pursued for each major.
Education
Math Education
Science Education
Math
General Science
Biology
Chemistry
Earth Science
Physics
Technology/Engineering
All science/technology combined
Other
<1%
<1%
0%
0%
0%
0%
0%
0%
0%
0%
0%
0%
Cohort 4 2008–2009
Item
MTEL
Taken
n
%
MTEL
Passed
n
%
Scores
Unknown
n
%
MTEL tests taken
General Curriculum (formerly Elementary)
Elementary Math
Early Childhood
Mathematics
Middle School Mathematics
Middle School Mathematics/ Science
General Science
Biology
Chemistry
Physics
Earth Science
Technology/Engineering
UMass Donahue Institute
Research and Evaluation Group
63
12
3
27
45
14
59
20
16
9
5
1
19%
4%
<1%
8%
13%
4%
17%
6%
5%
3%
2%
<1%
62
11
3
22
40
5
50
18
10
5
4
1
18%
3%
<1%
7%
12%
1%
15%
5%
3%
2%
1%
<1%
0
0
0
0
1
2
1
0
1
0
1
0
0%
0%
0%
0%
<1%
1%
<1%
0%
<1%
0%
<1%
0%
23
Annual Report of the MMSP State-level Evaluation
Appendix C
Cohort 4
2008–2009
Item
n
%
2
0
14
24
5
11
9
5
6
140
20
8
8
9
73
5
29
21
50
7
0
8
55
<1%
0%
4%
7%
2%
3%
3%
2%
2%
41%
6%
2%
2%
3%
21%
2%
9%
6%
15%
2%
0%
2%
16%
5%
<1%
<1%
License Areas
Academically Advanced PreK-8
Adult Basic Education
Biology 5-8
Biology 8-12
Chemistry 5-8
Chemistry 8-12
Early Childhood PreK-2
Earth Science 5-8
Earth Science 8-12
Elementary 1-6
Elementary Mathematics 1-6
ELL PreK-6
ELL 5-12
General Science 1-6
General Science 5-8
Instructional Technology
Mathematics 8-12
Middle School
Middle School Mathematics 5-8
Middle School Math/Science 5-8
Physics 5-8
Physics 8-12
Students w/ Moderate Disability PreK-8
Students w/ Moderate Disability 5-12
Students w/ Severe Disability
Technology/Engineering 5-12
UMass Donahue Institute
Research and Evaluation Group
17
3
2
24
Annual Report of the MMSP State-level Evaluation
Appendix D
Appendix D: High Need District Eligibility Criteria
High Need Districts (See list below.):
1.
For proposals with a mathematics content focus: A district is considered to be a high need district if it has a
mathematics proficiency index for grades 4-8 that is below the state target for Cycle II for MMSP Year 1projects or
below the state target for Cycle III for MMSP Year 2 projects. Priority will be given to high need districts with two or
more schools identified for improvement in mathematics.
2. For proposals with a science and/or technology/engineering content focus: A district is considered to be a high need
district if it has a science proficiency index for grades 5-8 in 2003 that is at or below the 20th percentile for the state.
In addition, a high need district must demonstrate that there is a high number or percentage of teachers in the district who are
teaching in the academic subject or grade level for which they have not demonstrated subject matter competency through
licensure or completion of the professional development activities in their HOUSSE plans.
An interested district that is not identified as high need is encouraged to contact a high need district to explore becoming a
partner in the proposed program (e.g., vocational technical schools are encouraged to contact feeder school districts).
MA FY2004 High Need Districts
DISTRICT
AVON
BARNSTABLE
BOSTON
BROCKTON
CAMBRIDGE
CHELSEA
CHICOPEE
CLARKSBURG
EASTHAMPTON
EVERETT
FAIRHAVEN
FALL RIVER
FITCHBURG
FLORIDA
GARDNER
GREENFIELD
HAVERHILL
HOLBROOK
HOLYOKE
HULL
LAWRENCE
LOWELL
LYNN
MALDEN
MEDFORD
METHUEN
NEW BEDFORD
NORTH ADAMS
PITTSFIELD
PROVINCETOWN
RANDOLPH
REVERE
SALEM
SOMERVILLE
SOUTHBRIDGE
SPRINGFIELD
TAUNTON
WALTHAM
WARE
MATH



























UMass Donahue Institute
Research and Evaluation Group
SCIENCE
T/E






































DISTRICT
WAREHAM
WEBSTER
WEST SPRINGFIELD
WESTFIELD
WINCHENDON
WINTHROP
WORCESTER
ABBY KELLEY FOSTER CS
ATLANTIS CS
BENJAMIN BANNEKER CS
BOSTON RENAISSANCE CS
CONSERVATORY LAB CS
EDWARD BROOKE CS
FREDERICK DOUGLASS CS
LAWRENCE FAMILY DEV CS
LOWELL COMMUNITY CS
NEIGHBORHOOD HOUSE CS
NEW BEDFORD GLOBAL CS
NEW LEADERSHIP HMCS
NORTH CENTRAL REG CS
ROBERT M. HUGHES CS
SABIS INTERNATIONAL CS
SEVEN HILLS CS
SOMERVILLE CS
UPHAMS CORNER CS
ATHOL-ROYALSTON RSD
BERKSHIRE HILLS RSD
FRONTIER RSD
GILL-MONTAGUE RSD
HAMPSHIRE RSD
HAWLEMONT RSD
MOUNT GREYLOCK RSD
RALPH C MAHAR RSD
MATH





















SCIENCE
T/E































25
Annual Report of the MMSP State-level Evaluation
Appendix D
MA FY2005 High Need Districts
DISTRICT
Grade 5
ATTLEBORO
SCI
Grade 8 Grades 4SCI
8 Math


AVON
BOSTON



BOURNE

BROCKTON
CAMBRIDGE






CHELSEA



CHICOPEE



CLARKSBURG



DEDHAM

DRACUT

EAST BRIDGEWATER

EASTHAMPTON

EVERETT



FAIRHAVEN
FALL RIVER



FITCHBURG



FLORIDA

GARDNER

HAVERHILL


GREENFIELD



HOLBROOK
HOLYOKE


HULL


LAWRENCE



LEOMINSTER

LOWELL



LYNN



MALDEN



MEDFORD


METHUEN


NEW BEDFORD



NORTH ADAMS



ORANGE

OXFORD

QUINCY

PITTSFIELD

RANDOLPH

REVERE




Grade 5
Grade 8 Grades 4-
SCI
SCI
8 Math
SOUTHBRIDGE



SPRINGFIELD
TAUNTON
WALTHAM
WARE
WAREHAM
WEBSTER
WESTFIELD
WINCHENDON
WINTHROP
WORCESTER
ACADEMY OF STRATEGIC CS
BENJAMIN BANNEKER CS
FREDERICK DOUGLASS CS
EDWARD BROOKE CS
CONSERVATORY LAB CS
COMMUNITY DAY CS
SABIS INTERNATIONAL CS
NEIGHBORHOOD HOUSE CS
ABBY KELLEY FOSTER REG CS
SO.BOSTON HARBOR ACAD CS
ROBERT M. HUGHES ACAD CS
LAWRENCE FAMILY DEV. CS
LOWELL COMMUNITY CS
NEW LEADERSHIP HMCS
NEW BEDFORD GLOBAL HMCS
NORTH CENTRAL CS
BOSTON RENAISSANCE CS
SEVEN HILLS CS
SOMERVILLE CS
PROSPECT HILL ACADEMY CS
UPHAMS CORNER CS
ATLANTIS CS
ADAMS-CHESHIRE
ATHOL-ROYALSTON
BERKSHIRE
FREETOWN-LAKEVILLE
GATEWAY
GILL-MONTAGUE
HAMPSHIRE
HAWLEMONT
NEW SALEM-WENDELL





































































ROCKLAND
SALEM



SOMERVILLE



UMass Donahue Institute
Research and Evaluation Group
DISTRICT
26
Annual Report of the MMSP State-level Evaluation
Appendix D
MA FY2006 High Need Districts
DISTRICT
ATTLEBORO
Grade 5
SCIENCE

Grade 8
SCIENCE
Grades 4-8
MATH

AVON
DISTRICT
Grade 5
SCIENCE
WALTHAM

WARE

BOSTON

BOURNE

BROCKTON



WESTFIELD
CAMBRIDGE



WINCHENDON
CHELSEA



WINTHROP

CHICOPEE






WORCESTER
ACADEMY OF STRATEGIC
CS
BENJAMIN BANNEKER CS

CLARKSBURG


DRACUT


EASTHAMPTON

EVERETT

FAIRHAVEN
WAREHAM
WEBSTER
DEDHAM
EAST
BRIDGEWATER












EDWARD BROOKE CS

CONSERVATORY LAB CS

COMMUNITY DAY CS

SABIS INTERNATIONAL CS


NEIGHBORHOOD HOUSE CS



FALL RIVER



FITCHBURG



ABBY KELLEY FOSTER
REGIONAL CS

SOUTH BOSTON HARBOR
ACADEMY CS


ROBERT M. HUGHES
ACADEMY CS



LAWRENCE FAMILY
DEVELOPMENT CS


LOWELL COMMUNITY CS

FLORIDA

GARDNER

GREENFIELD
HAVERHILL


HOLBROOK

HOLYOKE


HULL


LAWRENCE


LEOMINSTER

LOWELL



LYNN



NORTH CENTRAL CS
MALDEN



BOSTON RENAISSANCE CS

MEDFORD


SEVEN HILLS CS

METHUEN


SOMERVILLE CS
PROSPECT HILL ACADEMY
CS

UPHAMS CORNER CS

ATLANTIS CS

ADAMS-CHESHIRE RSD

ATHOL-ROYALSTON RSD


NEW BEDFORD



NORTH ADAMS



ORANGE

OXFORD
QUINCY


PITTSFIELD

RANDOLPH

REVERE

ROCKLAND
SALEM









SOUTHBRIDGE



SPRINGFIELD



TAUNTON


SOMERVILLE
UMass Donahue Institute
Research and Evaluation Group
Grades 4-8
MATH


FREDERICK DOUGLASS CS

Grade 8
SCIENCE




NEW LEADERSHIP HMCS


NEW BEDFORD GLOBAL
HMCS












BERKSHIRE HILLS RSD
FREETOWN-LAKEVILLE RSD

GATEWAY RSD

GILL-MONTAGUE RSD

HAMPSHIRE RSD

HAWLEMONT RSD
NEW SALEM-WENDELL RSD




27
Annual Report of the MMSP State-level Evaluation
Appendix D
MA FY2007 High Need Districts
DISTRICT
Science/Tech.
Engineering
ATTLEBORO
Math

BOSTON

BROCKTON

BROOKFIELD
Science/Tech.
Engineering
Math
REVERE

ROCKLAND


SALEM


SAUGUS


SEEKONK


BARNSTABLE
DISTRICT
CAMBRIDGE


SOMERVILLE
CHELSEA


SOUTHAMPTON
CHICOPEE

SOUTHBRIDGE
CLINTON

SOUTH HADLEY
DOUGLAS

SPRINGFIELD
EASTHAMPTON

STOUGHTON

ERVING

TAUNTON

EVERETT

WALTHAM

FAIRHAVEN

WARE

FALL RIVER

WAREHAM

WEBSTER
FRAMINGHAM

WESTFIELD

FREETOWN

WESTPORT

GARDNER

WEST SPRINGFIELD

GLOUCESTER

WINCHENDON

GRANVILLE

WINTHROP

GREENFIELD

WORCESTER
HAVERHILL

EXCEL ACADEMY CS

HOLBROOK

FOUR RIVERS CS

HOLYOKE

BERKSHIRE ARTS CS


ACADEMY OF STRATEGIC
CS
FITCHBURG


HUDSON
LAWRENCE


LEE

LEICESTER



















METHUEN

MIDDLEBOROUGH

MONSON

NAHANT





NORTHAMPTON

NORTH BROOKFIELD

NORTON

OXFORD

PALMER

PITTSFIELD

QUINCY
UMass Donahue Institute
Research and Evaluation Group


MASHPEE
RANDOLPH



NORTH ADAMS

CONSERVATORY LAB CS
SABIS INTERNATIONAL
CS
ROBERT M. HUGHES
ACAD CS
LAWRENCE FAMILY DEV
CS
LOWELL COMMUNITY CS
MALDEN
NEW BEDFORD


LUDLOW
LYNN

MURDOCH MIDDLE CS
LEOMINSTER
LOWELL
SMITH LEADERSHIP
ACAD CS
BENJAMIN BANNEKER CS

NEW LEADERSHIP HMCS
NEW BEDFORD GLOBAL
CS
NORTH CENTRAL CS










PIONEER VALLEY
PERFORMING
BOSTON RENAISSANCE
CS
SALEM ACADEMY CS






SEVEN HILLS CS
PROSPECT HILL ACAD
CS
SOUTH SHORE CS

UPHAMS CORNER CS





28
Annual Report of the MMSP State-level Evaluation
DISTRICT
Science/Tech.
Engineering
Math
ATLANTIS CS

ADAMS-CHESHIRE REG.

ATHOL-ROYALSTON

BERKSHIRE HILLS

FREETOWN-LAKEVILLE

GATEWAY

GILL-MONTAGUE

HAMPSHIRE

MOHAWK TRAIL

NARRAGANSETT

PIONEER VALLEY

RALPH C MAHAR

SILVER LAKE

UMass Donahue Institute
Research and Evaluation Group
Appendix D
29
Annual Report of the MMSP State-level Evaluation
Appendix D
MA FY2008 and FY2009 High Need Districts
Criteria: A high-need district in science and technology/engineering is a district that has a grade 8 and a high school science
CPI of less than 60. A high-need district in mathematics is a district that has been identified for corrective action in
mathematics, or districts with one or more Commonwealth Priority Schools identified for mathematics.
DISTRICT
Science
Math


NEW BEDFORD

NORTH ADAMS
BOSTON
BRIDGEWATER-RAYNHAM
DISTRICT
Science
Math



BROCKTON


NORTH BROOKFIELD
CAMBRIDGE


PEABODY
CHICOPEE


PITTSFIELD
EASTHAMPTON

EVERETT


RANDOLPH


FALL RIVER


REVERE


FALMOUTH

SALEM
FITCHBURG

SOMERVILLE



SOUTHBRIDGE


SPENCER-EAST BROOKFIELD


GARDNER

GATEWAY






PLYMOUTH

GLOUCESTER

SPRINGFIELD
GREENFIELD

WAREHAM

HAVERHILL

WESTFIELD

HOLBROOK


WOBURN
HOLYOKE


WORCESTER

HULL

BERKSHIRE ARTS CS

LAWRENCE


LOWELL





MARLBOROUGH

NEW BEDFORD GLOBAL CS

MEDFORD

METHUEN



LYNN
UMass Donahue Institute
Research and Evaluation Group


BENJAMIN BANNEKER CS
COMMUNITY CS OF
CAMBRIDGE
NEW LEADERSHIP HMCS
LUDLOW



30
Annual Report of the MMSP State-level Evaluation
Appendix E
Appendix E: Enrollment and Attrition Rates by Course
Cohort 3
Enrollment and Attrition Information as Reported for Each Cohort 3 Course
Partnership
EduTron Lowell
Year
Offered
Course Title
Number of
Participants
Completed
Course
Attrition
Rate
06/07
Building a Rock Solid Math Foundation
30
30
0%
06/07
Perspectives on Elementary School
Mathematics
46
46
0%
07/08
Conceptions & Misconceptions in MS
Math
24
24
0%
07/08
Unlocking Physical Science
16
16
0%
07/08
Conceptions and Misconceptions in
Elementary School Mathematics
29
29
0%
07/08
Unlocking Biological Diversity
16
12
25%
08/09
The Arts and Sciences of Internalizing
Mathematical Connections
17
17
0%
08/09
Physical Science: Principles, Concepts,
and Their Applications
9
9
0%
08/09
Digging Deep into Elementary
Mathematics
29
29
0%
08/09
Exploring Science in Grades 3-8
19
19
0%
235
231
1%
Subtotal
EduTron Fitchburg
Number of
Participants
Enrolled First
Day
06/07
The Math Experience
36
36
0%
07/08
Conceptions and Misconceptions in
Elementary School Mathematics I
30
30
0%
07/08
Conceptions and Misconceptions in
Elementary School Mathematics II
32
32
0%
07/08
Conceptions and Misconceptions in
Elementary School Mathematics III
23
23
0%
08/09
Mini-Content Institute for Teachers of
Mathematics I
26
26
0%
08/09
Mini-Content Institute for Teachers of
Mathematics II
25
25
0%
08/09
Mini Content Institute for Teachers of
Mathematics III
33
33
0%
UMass Donahue Institute
Research and Evaluation Group
31
Annual Report of the MMSP State-level Evaluation
Appendix E
Enrollment and Attrition Information as Reported for Each Cohort 3 Course
Partnership
Year
Offered
EduTron Fitchburg
Subtotal
Course Title
Number of
Participants
Completed
Course
Attrition
Rate
205
205
0%
06/07
Math as a Second Language, Holyoke
32
29
9%
06/07
Math as a Second Language, Haverhill
35
35
0%
06/07
Math as a Second Language, Fall River
31
31
0%
98
95
3%
Subtotal – Math as a Second Language
06/07
Number Theory, Haverhill
34
30
12%
06/07
Number Theory, Holyoke
25
22
12%
06/07
Number Theory, Fall River
24
24
0%
83
76
8%
Subtotal – Number Theory
Lesley
Number of
Participants
Enrolled First
Day
06/07
Functions and Algebra, Haverhill
31
30
3%
06/07
Functions and Algebra, Holyoke
15
14
7%
06/07
Functions and Algebra, Fall River
18
18
0%
07/08
Functions and Algebra, Randolph
13
13
0%
77
75
3%
Subtotal – Functions and Algebra
07/08
Geometry and Measurement - Holyoke
22
20
9%
07/08
Geometry and Measurement - Haverhill
27
27
0%
07/08
Geometry and Measurement – Fall River
19
19
0%
07/08
Geometry and Measurement - Randolph
15
15
0%
83
81
2%
Subtotal – Geometry and Measurement
07/08
Probability and Statistics - Holyoke
22
19
14%
07/08
Probability and Statistics – Fall River
21
21
0%
07/08
Probability and Statistics – Haverhill
28
28
0%
07/08
Probability and Statistics – Randolph
14
14
0%
85
82
4%
Subtotal – Probability and Statistics
07/08
Trigonometry and Algebra II – Holyoke
16
15
6%
07/08
Trigonometry and Algebra II - Haverhill
23
22
4%
UMass Donahue Institute
Research and Evaluation Group
32
Annual Report of the MMSP State-level Evaluation
Appendix E
Enrollment and Attrition Information as Reported for Each Cohort 3 Course
Partnership
Lesley
Year
Offered
Course Title
Number of
Participants
Enrolled First
Day
Number of
Participants
Completed
Course
Attrition
Rate
07/08
Trigonometry and Algebra II – Fall River
17
17
0%
07/08
Trigonometry and Algebra II - Somerville
13
13
0%
08/09
Trigonometry and Algebra II- Randolph
16
16
0%
85
83
2%
Subtotal – Trigonometry and Algebra II
08/09
Data Analysis- Haverhill
22
21
5%
08/09
Data Analysis- Holyoke
15
15
0%
08/09
Data Analysis- Fall River
20
20
0%
08/09
Data Analysis- Somerville
16
16
0%
08/09
Data Analysis- Randolph
15
14
7%
88
86
2%
Subtotal – Data Analysis
08/09
Calculus I- Holyoke
15
15
0%
08/09
Calculus I- Haverhill
21
20
5%
08/09
Calculus I- Fall River
15
15
0%
08/09
Calculus I- Somerville
7
7
0%
08/09
Calculus I- Randolph
11
10
10%
69
67
3%
15
15
0%
Subtotal – Calculus I
08/09
Calculus II- Holyoke
08/09
Calculus II- Somerville
6
6
0%
08/09
Calculus II- Randolph
9
9
0%
08/09
Calculus II- Haverhill
Subtotal – Calculus II
08/09
Problem Solving- Haverhill
08/09
Problem Solving- Revere
Subtotal – Problem Solving
06/07
Subtotal
Exploring Numbers, Randolph
8
8
0%
38
38
0%
13
11
15%
7
7
0%
20
18
10%
28
27
4%
754
728
3%
Lesley
UMass Donahue Institute
Research and Evaluation Group
Lesley
33
Annual Report of the MMSP State-level Evaluation
Appendix E
Enrollment and Attrition Information as Reported for Each Cohort 3 Course
Partnership
Year
Offered
Course Title
Number of
Participants
Completed
Course
Attrition
Rate
06/07
Physics I: Forces, Energy & Motion
29
25
14%
07/08
Physics I: Forces, Energy & Motion
7
7
0%
08/09
Physics I: Forces, Energy, & Motion
Subtotal – Physics I
Biology I: Cell Biology and Genetics-A
06/07
Human Approach
Biology I: Cell Biology and Genetics-A
07/08
Human Approach
Biology I: Cell Biology and Genetics- A
08/09
Human Approach
Subtotal – Biology I
North Shore*
Number of
Participants
Enrolled First
Day
3
3
0%
39
35
10%
9
9
0%
11
11
0%
6
6
0%
26
26
0%
06/07
Earth Science II: The Solid Earth
0
0
N/A
07/08
Earth Science II: The Solid Earth
17
17
0%
08/09
Earth Science II: The Solid Earth
Subtotal – Earth Science II
Engineering I: From Science to
06/07
Engineering: Pre-Engineering Design
Experience
Engineering I: From Science to
07/08
Engineering: Pre-Engineering Design
Experience
Engineering I: From Science to
08/09
Engineering: Pre-Engineering Design
Experience
Subtotal – Engineering I
5
5
0%
22
22
0%
3
3
0%
13
13
0%
4
3
25%
20
19
5%
06/07
Physics II: Electricity and Magnetism
8
7
13%
07/08
Physics II: Electricity and Magnetism
8
7
13%
08/09
Physics II: Electricity and Magnetism
Subtotal – Physics II
Biology II: Ecology, Evolution, and the
06/07
Diversity of Life
Biology II: Ecology, Evolution, and the
07/08
Diversity of Life
Biology II: Ecology, Evolution, and the
08/09
Diversity of Life
Subtotal – Biology II
UMass Donahue Institute
Research and Evaluation Group
4
3
25%
20
17
15%
7
7
0%
9
9
0%
9
9
0%
25
25
0%
34
Annual Report of the MMSP State-level Evaluation
Appendix E
Enrollment and Attrition Information as Reported for Each Cohort 3 Course
Number of
Participants
Enrolled First
Day
Number of
Participants
Completed
Course
Partnership
Year
Offered
North Shore*
(continued)
06/07
Chemistry I: Particulate Nature of Matter
4
4
0%
07/08
Chemistry I: Particulate Nature of Matter
23
22
4%
27
26
4%
Course Title
Subtotal – Chemistry I
07/08
Energy I
10
10
0%
08/09
Energy I
6
6
0%
16
16
0%
6
6
0%
Subtotal –Energy I
Chemistry II: Equilibrium and
06/07
Thermodynamics
Chemistry II: Equilibrium and
08/09
Thermodynamics
Subtotal –Chemistry II
4
4
0%
10
10
0%
07/08
Earth Science I: Weather and Water
3
3
0%
08/09
Earth Science I: Weather and Water
4
4
0%
7
7
0%
2
2
0%
Subtotal –Earth Science I
Biology III: Regulation and Homeostasis
06/07
in Biological Model Systems
06/07
Chemistry III: Bio-Organic Chemistry
6
6
0%
08/09
Mathematics I
7
7
0%
08/09
Chemistry B: The Energetics of Chemical
Change
Data Not
Submitted
Data Not
Submitted
Subtotal (excluding data for 08/98 Chemistry B course)
UMass Amherst
Attrition
Rate
Data Not
Submitted
227
218
4%
06/07
Life Sciences
13
12
8%
06/07
Math, Mind and Matter
14
14
0%
06/07
Algebra/Geometry I
17
15
12%
06/07
Engineering: Making it Better
13
13
0%
07/08
Chemistry for Middle School Teachers
17
14
18%
07/08
Electricity and Magnetism
10
9
10%
13
13
0%
13
13
0%
07/08
07/08
UMass Donahue Institute
Research and Evaluation Group
Physical Science for Middle School
Teachers
Integrating Calculus and Trigonometry
into Middle School Mathematics
35
Annual Report of the MMSP State-level Evaluation
Appendix E
Enrollment and Attrition Information as Reported for Each Cohort 3 Course
Partnership
UMass Amherst
Year
Offered
Course Title
Attrition
Rate
Integrating Technology and Engineering
into Middle School
15
10
33%
08/09
Discrete Math for Middle School Teachers
15
13
13%
08/09
An Integrated Approach to Physics and
Mathematics for Middle School Teachers
15
15
0%
08/09
Robotics for Middle School Teachers
23
19
17%
08/09
Forensics for Middle School Teachers
15
15
0%
08/09
Understanding and Teaching Division and
Fractions
9
6
33%
202
171
15%
06/07
Patterns, Relations, & Algebra for MST
32
27
16%
07/08
Patterns, Relations, & Algebra for MST
14
13
7%
46
40
13%
19
0%
Subtotal – Patterns, Relations, & Algebra for MST
06/07
Data, Probability & Statistics for MST
19
07/08
Data, Probability & Statistics for MST
Data Not
Submitted
06/07
Number Systems for MST
12
11
8%
07/08
Number Systems for MST
20
18
10%
32
29
9%
Subtotal – Number Systems for MST
Data Not
Submitted
Data Not
Submitted
06/07
Geometry & Measurement for MST
10
10
0%
07/08
Geometry & Measurement for MST
20
16
20%
30
26
13%
127
114
10%
Subtotal – Geometry & Measurement for MST
Subtotal (excluding data for 07/08 Data, Probability & Statistics course)
SE/Cape
Number of
Participants
Completed
Course
07/08
Subtotal
Salem State
Number of
Participants
Enrolled First
Day
06/07
Energy and the Environment, BSC
24
24
0%
06/07
Energy and the Environment, BCC
9
8
11%
07/08
Energy and the Environment
20
18
10%
07/08
Energy and the Environment
23
22
4%
08/09
Energy and the Environment
20
19
5%
UMass Donahue Institute
Research and Evaluation Group
36
Annual Report of the MMSP State-level Evaluation
Appendix E
Enrollment and Attrition Information as Reported for Each Cohort 3 Course
Partnership
SE/Cape
Year
Offered
08/09
Course Title
Attrition
Rate
20
20
0%
Subtotal – Energy and the Environment
Topics in Earth/Space Science for Middle
07/08
School Teachers
Topics in Earth/Space Science for Middle
07/08
School Teachers
Topics in Earth/Space Science for Middle
08/09
School Teachers
Subtotal – Topics in Earth/Space Science
Special Topics in Chemistry: Chemistry of
07/08
Matter and Atoms
Special Topics in Chemistry: Chemistry of
07/08
Matter and Atoms
Special Topics in Chemistry: Chemistry of
08/09
Matter and Atoms
Special Topics in Chemistry: Chemistry of
08/09
Matter and Atoms
Subtotal – Special Topics in Chemistry
116
111
4%
25
22
12%
19
19
0%
12
12
0%
56
53
5%
13
13
0%
17
17
0%
24
20
17%
11
11
0%
65
61
6%
06/07
Chemistry
24
22
8%
08/09
Special Topics: Force and Motion
27
27
0%
288
274
5%
06/07
The Physics and Engineering of Forces
20
19
5%
07/08
The Physics of Work and Energy
13
13
0%
Subtotal
Worcester Public
Schools
Number of
Participants
Completed
Course
Energy and the Environment
Subtotal
WPI - Science
Number of
Participants
Enrolled First
Day
33
32
3%
06/07
Number Sense I (Gr 3-6)
26
23
12%
06/07
Number Sense & Algebra (Gr 3-6)
16
15
6%
06/07
Number Sense (K-2)
12
11
8%
54
49
9%
Subtotal
* The numbers of enrolled participants for some courses offered by this partnership are small due to the fact that additional participants in these courses were funded by
other sources and, therefore, not included in the evaluation of MSP.
UMass Donahue Institute
Research and Evaluation Group
37
Annual Report of the MMSP State-level Evaluation
Appendix E
Cohort 4
Enrollment and Attrition Information as Reported for Each Cohort 4 Course
Partnership
Year
Offered
Course Title
Number of
Participants
Enrolled First
Day
Number of
Participants
Completed
Course
Attrition
Rate
08/09
Number Theory (Cohort I)
20
20
0%
08/09
Number Theory (Cohort II)
17
17
0%
37
37
0%
Subtotal – Number Theory
08/09
Number and Operations (Cohort I)
13
13
0%
08/09
Number and Operations (Cohort II)
13
13
0%
26
26
12%
12
9
25%
75
72
4%
133
115
14%
69
69
0%
202
184
9%
22
22
0%
12
12
0%
18
17
6%
52
51
2%
47
47
0%
Lesley Springfield
Subtotal – Number and Operations
08/09
Functions and Algebra I (Cohort III)
Subtotal
Boston Public
Schools
08/09
Building a System of Tens
08/09
Making Meaning of Operations
Subtotal
08/09
Brockton Public
Schools
08/09
08/09
Intel Math for Teachers Parts I and II
(Bridgewater State College)
Intel Math for Teachers Parts I and II
(Bristol Community College)
Intel Math for Teachers Parts I and II
(Cape Cod Community College)
Subtotal
Gateway Regional
School District
Randolph Public
Schools
08/09
Earth Systems: Learning Science by
Doing Science
08/09
Watershed
6
6
0%
08/09
Chemistry
22
22
0%
28
28
0%
Subtotal
Springfield
College
08/09
Best Practices in Teaching Life Science
14
14
0%
08/09
Best Practices in Teaching Life Science
13
13
0%
27
27
0%
Subtotal
Boston University
08/09
Uncovering the Fundamentals of
Arithmetic
21
21
0%
08/09
PROMYS for Teachers: Number Theory
48
46
4%
69
67
3%
22
20
9%
Subtotal
Greater North
08/09
UMass Donahue Institute
Research and Evaluation Group
Mathematics I
38
Annual Report of the MMSP State-level Evaluation
Appendix E
Enrollment and Attrition Information as Reported for Each Cohort 4 Course
Partnership
Shore*
Greater North
Shore*
(continued)
Year
Offered
08/09
Course Title
Mathematics I
Subtotal – Mathematics I
Chemistry B: The Energetics of Chemical
08/09
Change
Physics II: Waves, Electricity, and
08/09
Magnetism
Biology I: Cell Biology and Genetics-A
08/09
Human Approach
Biology II: Ecology, Evolution, and the
08/09
Diversity of Life
Chemistry II: Equilibrium and
08/09
Thermodynamics
08/09
Earth Science I: Weather and Water
08/09
Engineering I: From Science to
Engineering: Pre-Engineering Design
Experience
Physics I: Forces, Energy, & Motion
08/09
Earth Science II: The Solid Earth
08/09
Subtotal (excluding data for Chemistry B course)
Number of
Participants
Enrolled First
Day
Number of
Participants
Completed
Course
7
7
29
27
Attrition
Rate
0%
7%
Data Not
Submitted
Data Not
Submitted
Data Not
Submitted
4
4
0%
6
6
0%
4
4
0%
8
6
25%
5
5
0%
3
3
0%
9
9
0%
6
5
17%
74
69
7%
* The numbers of enrolled participants for courses offered by this partnership are small due to the fact that additional participants in these courses were funded by other
sources and, therefore, not included in the evaluation of MSP.
UMass Donahue Institute
Research and Evaluation Group
39
Annual Report of the MMSP State-level Evaluation
Appendix F
Appendix F: Subject Matter Competency Demonstration Options
How do teachers demonstrate subject matter competency in Massachusetts?
Elementary teachers
Middle and secondary school teachers
may demonstrate competence in reading, writing,
mathematics, and other areas of the basic
elementary school curriculum through one of the
following:
may demonstrate subject matter competence in
each of the areas they are teaching through one of
the following:
Passing the Massachusetts Test for Educator
Licensure (MTEL) Elementary Subject Matter Test:
General Curriculum and the Foundations of Reading
Passing the Massachusetts Test for Educator
Licensure (MTEL) appropriate Subject Matter Test:
Middle School Humanities
Middle School Mathematics
Middle School Mathematics/Science
Subject Title (e.g., History, English, Physics)
Making sufficient progress* on Massachusetts High
Objective Uniform State Standard of Evaluation
(HOUSSE); prior to 2007
Making sufficient progress* on Massachusetts High
Objective Uniform State Standard of Evaluation
(HOUSSE)
Completion of an appropriate academic major
Completion of an appropriate graduate degree
Completion of comparable coursework equivalent to
an undergraduate academic major
Advanced certification or credentialing
*It is the Department's expectation that a teacher will have completed at least half [48] of the content PDPs [96 total] needed to meet HOUSSE
requirements before being considered highly qualified.
Charter School Teachers who teach core academic subjects do not need a Massachusetts license but must
hold a Bachelor's degree and demonstrate competence in the subject area in which they teach. Charter school
teachers may demonstrate subject matter competence through any one of the options available to elementary
and middle/secondary teachers.
Teachers in Vocational Schools who teach core academic courses are required to meet the definition of a
highly qualified teacher. A vocational school teacher who teaches a core academic subject must hold a
Bachelor's degree, be licensed or certified by the state, and demonstrate subject matter competence in order
to be considered highly qualified.
(information obtained from ESE, 2004)
UMass Donahue Institute
Research and Evaluation Group
40
Annual Report of the MMSP State-level Evaluation
Appendix G
Appendix G: Mean Percentage Scores for Pre- & Post-course Tests
Cohort 3
Mean Percentage Scores for Pre- & Post-course Tests: Cohort 3
Year
Offered
Institute Name – Course
N
Mean
Pre-test
Mean
Post-test
Change in
Mean
p <.05
06/07
EduTron Lowell – Building a Rock
Solid Math Foundation
28
58
73
14
Yes
06/07
EduTron Lowell – Perspectives on
Elementary School Mathematics
42
53
71
19
Yes
07/08
EduTron Lowell – Conceptions and
Misconceptions in MS Mathematics
23
58
80
22
Yes
07/08
EduTron Lowell – Unlocking Physical
Science
15
63
82
19
Yes
07/08
EduTron Lowell – Conceptions and
Misconceptions in Elementary School
Mathematics
28
50
77
26
Yes
07/08
EduTron Lowell – Unlocking
Biological Diversity
12
33
76
43
Yes
08/09
EduTron Lowell - The Arts and
Sciences of Internalizing Mathematical
Connections
17
59
82
23
Yes
08/09
EduTron Lowell – Physical Science:
Principles, Concepts, and Their
Applications
9
66
91
24
Yes
08/09
EduTron Lowell – Digging Deep into
Elementary Mathematics
29
46
74
27
Yes
08/09
EduTron Lowell – Exploring Science
in Grades 3-8
19
51
67
16
Yes
06/07
EduTron Fitchburg – The Math
Experience
33
63
76
12
Yes
07/08
EduTron Fitchburg – Conceptions and
Misconceptions in Elementary School
Mathematics I
29
70
83
12
Yes
07/08
EduTron Fitchburg – Conceptions and
Misconceptions in Elementary School
Mathematics II
31
57
81
24
Yes
07/08
EduTron Fitchburg – Conceptions and
Misconceptions in Elementary School
Mathematics III
22
74
91
17
Yes
UMass Donahue Institute
Research and Evaluation Group
41
Annual Report of the MMSP State-level Evaluation
Appendix G
Mean Percentage Scores for Pre- & Post-course Tests: Cohort 3
Year
Offered
Institute Name – Course
N
Mean
Pre-test
Mean
Post-test
Change in
Mean
p <.05
08/09
EduTron Fitchburg – Mini-Content
Institute for Teachers of Mathematics
(I)
26
NA
NA
NA
NA
08/09
EduTron Fitchburg – Mini-Content
Institute for Teachers of Mathematics
(II)
25
NA
NA
NA
NA
08/09
EduTron Fitchburg – Mini-Content
Institute for Teachers of Mathematics
(III)
33
63
85
22
Yes
06/07
Lesley C3 – Math as a Second
Language, Holyoke
26
72
79
7
Yes
32
51
65
14
Yes
28
67
77
10
Yes
06/07
06/07
Lesley C3 – Math as a Second
Language, Haverhill
Lesley C3 – Math as a Second
Language, Fall River
06/07
Lesley C3 – Number Theory, Haverhill
26
17
52
35
Yes
06/07
Lesley C3 – Functions and Algebra,
Haverhill
26
32
66
34
Yes
06/07
Lesley C3 – Number Theory, Holyoke
22
21
58
36
Yes
06/07
Lesley C3 – Number Theory, Fall
River
22
17
51
34
Yes
06/07
Lesley C3 – Functions and Algebra,
Holyoke
14
48
69
21
Yes
06/07
Lesley C3 – Functions and Algebra,
Fall River
18
39
76
37
Yes
06/07
Lesley C3 – Exploring Numbers,
Randolph
27
39
72
33
Yes
07/08
Lesley C3 – Geometry and
Measurement, Holyoke
17
32
62
30
Yes
07/08
Lesley C3 – Geometry and
Measurement, Haverhill
26
29
53
24
Yes
07/08
Lesley C3 – Geometry and
Measurement, Fall River
19
32
66
33
Yes
07/08
Lesley C3 – Functions and Algebra,
Randolph
14
32
63
31
Yes
07/08
Lesley C3 – Probability & Statistics,
Holyoke
14
52
61
9
Yes
07/08
Lesley C3 – Probability & Statistics,
Fall River
19
23
62
39
Yes
UMass Donahue Institute
Research and Evaluation Group
42
Annual Report of the MMSP State-level Evaluation
Appendix G
Mean Percentage Scores for Pre- & Post-course Tests: Cohort 3
Year
Offered
Institute Name – Course
N
Mean
Pre-test
Mean
Post-test
Change in
Mean
p <.05
07/08
Lesley C3 – Probability & Statistics,
Haverhill
23
27
54
27
Yes
07/08
Lesley C3 – Trigonometry and Algebra
II, Holyoke
12
35
66
30
Yes
07/08
Lesley C3 – Geometry and
Measurement, Randolph
13
24
46
22
Yes
07/08
Lesley C3 – Trigonometry and
Algebra II, Haverhill
21
28
69
40
Yes
07/08
Lesley C3 – Trigonometry and Algebra
II, Fall River
18
25
69
44
Yes
07/08
Lesley C3 – Trigonometry and Algebra
II, Somerville
12
13
46
33
Yes
07/08
Lesley C3 – Probability & Statistics,
Randolph
14
21
72
51
Yes
08/09
Lesley C3 – Data Analysis, Haverhill
21
6
85
79
Yes
08/09
Lesley C3 – Data Analysis, Holyoke
13
31
60
29
Yes
08/09
Lesley C3 – Data Analysis, Fall River
20
24
53
29
Yes
08/09
Lesley C3 – Data Analysis, Somerville
14
12
46
34
Yes
08/09
Lesley C3 – Trigonometry and Algebra
II, Randolph
15
24
60
36
Yes
08/09
Lesley C3 – Calculus I, Holyoke
14
35
63
27
Yes
08/09
Lesley C3 – Calculus I, Haverhill
18
3
37
35
Yes
08/09
Lesley C3 – Calculus I, Fall River
13
11
66
55
Yes
08/09
Lesley C3 – Calculus I, Somerville
5
1
35
34
No
Lesley C3 – Data Analysis, Randolph
14
24
61
37
Yes
Lesley C3 – Calculus II, Holyoke
14
22
54
32
Yes
6
2
68
66
Yes
Lesley C3 – Calculus I, Randolph
10
7
52
45
Yes
Lesley C3 – Calculus II, Randolph
9
5
51
46
Yes
08/09
08/09
08/09
08/09
08/09
Lesley C3 – Calculus II, Somerville
UMass Donahue Institute
Research and Evaluation Group
43
Annual Report of the MMSP State-level Evaluation
Appendix G
Mean Percentage Scores for Pre- & Post-course Tests: Cohort 3
Year
Offered
08/09
Institute Name – Course
N
Mean
Pre-test
Mean
Post-test
Change in
Mean
p <.05
Lesley C3 – Calculus II, Haverhill
7
4
75
71
Yes
08/09
Lesley C3 – Problem Solving,
Haverhill
9
21
51
30
Yes
08/09
Lesley C3 – Problem Solving, Revere
7
40
62
22
Yes
19
49
67
19
Yes
9
44
69
25
Yes
2
62
84
22
No
6
43
74
31
Yes
3
43
77
34
No
7
58
67
9
No
7
57
72
16
Yes
4
48
73
25
No
6
49
70
22
Yes
9
31
60
29
Yes
6
54
69
15
Yes
17
31
76
45
Yes
11
76
84
7
No
3
51
69
18
No
12
54
78
24
Yes
7
64
80
16
Yes
9
52
64
12
Yes
23
62
82
20
Yes
06/07
06/07
06/07
06/07
06/07
06/07
06/07
06/07
06/07
07/08
07/08
07/08
07/08
07/08
07/08
07/08
07/08
07/08
North Shore – Physics I: Forces,
Energy & Motion
North Shore – Biology I: Cell Biology
and Genetics-A Human Approach
North Shore – Biology III: Regulation
and Homeostasis in Biological Model
Systems
North Shore – Chemistry III: BioOrganic Chemistry
North Shore – Engineering I: From
Science to Engineering: PreEngineering Design Experience
North Shore – Physics II: Electricity
and Magnetism
North Shore – Biology II: Ecology,
Evolution, and the Diversity of Life
North Shore – Chemistry I: Particulate
Nature of Matter
North Shore – Chemistry II:
Equilibrium and Thermodynamics
North Shore – Energy I
North Shore – Physics II: Electricity
and Magnetism
North Shore – Earth Science II: The
Solid Earth
North Shore – Biology I: Cell Biology
and Genetics-A Human Approach
North Shore – Earth Science I:
Weather & Water
North Shore – Engineering I: From
Science to Engineering: PreEngineering Design Experience
North Shore – Physics I: Forces,
Energy & Motion
North Shore – Biology II: Ecology,
Evolution, and the Diversity of Life
North Shore – Chemistry I: Particulate
Nature of Matter
UMass Donahue Institute
Research and Evaluation Group
44
Annual Report of the MMSP State-level Evaluation
Appendix G
Mean Percentage Scores for Pre- & Post-course Tests: Cohort 3
Year
Offered
Institute Name – Course
08/09
North Shore – Energy I
08/09
North Shore – Mathematics I
08/09
08/09
North Shore – Chemistry B: The
Energetics of Chemical Change
North Shore – Physics II: Waves,
Electricity, and Magnetism
Mean
Pre-test
Mean
Post-test
Change in
Mean
p <.05
5
51
73
22
No
19
59
76
18
Yes
20
32
70
38
Yes
3
72
85
13
No
N
08/09
North Shore – Mathematics I
5
83
88
4
No
08/09
North Shore – Biology I
3
75
85
10
No
08/09
North Shore – Biology II
8
60
73
13
Yes
08/09
North Shore – Chemistry II
1
NA
NA
NA
NA
08/09
North Shore – Earth Science I
4
56
75
19
No
08/09
North Shore – Engineering I
3
58
74
15
No
08/09
North Shore – Physics I
3
62
83
22
No
08/09
North Shore – Earth Science II
5
65
76
11
No
06/07
UMass Amherst C3 – Life Sciences
12
67
83
16
Yes
14
85
92
8
No
15
35
79
45
Yes
13
60
92
33
Yes
14
42
80
39
Yes
8
73
83
10
No
13
49
63
14
Yes
13
29
79
50
Yes
10
13
89
76
Yes
13
34
78
44
Yes
06/07
06/07
06/07
07/08
07/08
07/08
07/08
07/08
08/09
UMass Amherst C3 – Math, Mind and
Matter
UMass Amherst C3 –
Algebra/Geometry I
UMass Amherst C3 – Engineering:
Making it Better
UMass Amherst C3 – Chemistry for
Middle School Teachers
UMass Amherst C3 – Electricity and
Magnetism
UMass Amherst C3 – Physical Science
for Middle School Teachers
UMass Amherst C3 – Integrating
Calculus and Trigonometry into
Middle School Mathematics
UMass Amherst C3 – Integrating
Technology & Engineering into Middle
School
UMass Amherst C3 – Discrete Math
for Middle School Teachers
UMass Donahue Institute
Research and Evaluation Group
45
Annual Report of the MMSP State-level Evaluation
Appendix G
Mean Percentage Scores for Pre- & Post-course Tests: Cohort 3
Year
Offered
08/09
08/09
08/09
08/09
06/07
06/07
06/07
06/07
07/08
07/08
07/08
Institute Name – Course
UMass Amherst C3 – An Integrated
Approach to Physics and Mathematics
for Middle School Teachers
UMass Amherst C3 – Robotics for
Middle School Teachers
UMass Amherst C3 – Forensics for
Middle School Teachers
UMass Amherst C3 – Understanding
and Teaching Division and Fractions
Salem C3 – Patterns, Relations, &
Algebra for MST
Salem C3 – Data, Probability &
Statistics for MST
Salem C3 – Number Systems for MST
Salem C3 – Geometry & Measurement
for MST
Salem C3 – Patterns, Relations, &
Algebra for MST
Salem C3 – Geometry & Measurement
for MST
Salem C3 – Number Systems for MST
N
Mean
Pre-test
Mean
Post-test
Change in
Mean
p <.05
15
51
77
26
Yes
19
27
74
46
Yes
14
52
74
22
Yes
6
62
80
19
No
25
-0.1
0.3
0.4
Yes
19
29
85
56
Yes
11
26
87
61
Yes
10
39
83
44
Yes
11
55
75
21
Yes
16
33
79
47
Yes
18
26
91
65
Yes
Salem C3 – Data, Probability &
Statistics for MST
SE/Cape – Energy and The
Environment, BSC
SE/Cape – Energy and The
Environment, BCC
6
18
87
69
Yes
23
36
59
23
Yes
8
40
75
34
Yes
06/07
SE/Cape – Chemistry
21
55
65
10
Yes
07/08
SE/Cape – Energy and The
Environment
18
44
73
29
Yes
07/08
SE/Cape – Topics in Earth/Space
Science for Middle School Teachers
18
55
72
18
Yes
07/08
SE/Cape – Special Topics in
Chemistry: Chemistry of Matter and
Atoms
13
70
83
14
Yes
07/08
SE/Cape – Energy and The
Environment
22
40
74
34
Yes
07/08
SE/Cape – Topics in Earth/Space
Science for Middle School Teachers
16
60
76
16
Yes
07/08
06/07
06/07
UMass Donahue Institute
Research and Evaluation Group
46
Annual Report of the MMSP State-level Evaluation
Appendix G
Mean Percentage Scores for Pre- & Post-course Tests: Cohort 3
Year
Offered
Institute Name – Course
N
Mean
Pre-test
Mean
Post-test
Change in
Mean
p <.05
07/08
SE/Cape – Special Topics in
Chemistry: Chemistry of Matter and
Atoms
17
63
82
19
Yes
08/09
SE/Cape – Chemistry of Matter and
Atoms
19
54
77
23
Yes
19
52
82
30
Yes
11
46
73
27
Yes
11
70
90
21
Yes
19
45
76
31
Yes
27
41
62
21
Yes
19
47
74
28
Yes
13
61
82
20
Yes
18
57
76
19
Yes
18
50
72
22
Yes
15
52
81
29
Yes
11
59
79
20
Yes
08/09
08/09
08/09
08/09
08/09
06/07
07/08
08/09
06/07
06/07
06/07
SE/Cape – Energy and the
Environment
SE/Cape – Topics in Earth/ Space
Science for Middle School Teachers
SE/Cape – Chemistry of Matter and
Atoms
SE/Cape – Energy and the
Environment
SE/Cape – Special Topics: Force and
Motion
WPI Science - The Physics and
Engineering of Forces
WPI Science – The Physics of Work
and Energy
WPI Science – The Power of
Electricity and Magnetism
Worcester Public Schools – Number
Sense I (Gr 3-6)
Worcester Public Schools – Number
Sense & Algebra (Gr 3-6)
Worcester Public Schools – Number
Sense (K-2)
UMass Donahue Institute
Research and Evaluation Group
47
Annual Report of the MMSP State-level Evaluation
Appendix G
Cohort 4
Mean Percentage Scores for Pre- & Post-course Tests: Cohort 4
Year
Offered
08/09
08/09
08/09
08/09
08/09
08/09
08/09
08/09
08/09
08/09
08/09
08/09
08/09
08/09
08/09
08/09
08/09
08/09
Institute Name – Course
Lesley C4 – Number Theory (Section
1)
Lesley C4 – Number Theory (Section
2)
Lesley C4 – Number and Operations
(Section 1)
Lesley C4 – Functions and Algebra I
(Section 3)
Lesley C4 – Number and Operations
(Section 2)
Boston Public Schools C4 – Building a
System of Tens and Making Meaning
of Operations
Boston Public Schools C4 –Making
Meaning of Operations
Brockton Public Schools C4 – Intel
Math for Teachers Parts I and II,
Bridgewater State College
Brockton Public Schools C4 – Intel
Math for Teachers Parts I and II,
Bristol Community College
Brockton Public Schools C4 – Intel
Math for Teachers Parts I and II, Cape
Cod Community College
Gateway Regional School District C4 –
Earth Systems: Learning Science by
Doing Science
Randolph Public Schools C4 –
Watershed
Randolph Public Schools C4 –
Chemistry
Springfield College C4 – Best Practices
in Teaching Life Science
Springfield College C4 – Best Practices
in Teaching Life Science
Boston University Trustees C4 –
Uncovering the Fundamentals of
Arithmetic
Boston University Trustees C4 –
PROMYS for Teachers Number
Theory
Greater North Shore C4 – Mathematics
I
UMass Donahue Institute
Research and Evaluation Group
N
Mean
Pre-test
Mean
Post-test
Change in
Mean
p <.05
17
17
45
28
Yes
13
13
41
28
Yes
13
32
73
41
Yes
8
68
81
13
Yes
12
38
67
29
Yes
25
0
45
45
Yes
NA
NA
NA
NA
NA
22
52
79
26
Yes
12
61
81
20
Yes
17
68
82
15
Yes
45
57
66
9
Yes
6
18
72
54
Yes
22
68
82
13
Yes
14
55
75
20
Yes
11
59
67
8
No
21
65
75
10
No
5
82
74
-8
No
20
52
68
15
Yes
48
Annual Report of the MMSP State-level Evaluation
Appendix G
Mean Percentage Scores for Pre- & Post-course Tests: Cohort 4
Year
Offered
08/09
Institute Name – Course
N
Mean
Pre-test
Mean
Post-test
Change in
Mean
p <.05
20
17
56
39
Yes
4
50
66
16
No
6
63
72
8
No
6
51
69
18
No
08/09
Greater North Shore C4 – Chemistry
B: The Energetics of Chemical Change
Greater North Shore C4 – Physics II:
Waves, Electricity, and Magnetism
Greater North Shore C4 – Mathematics
I
Greater North Shore C4 – Biology I
08/09
Greater North Shore C4 – Biology II
4
56
69
13
No
08/09
Greater North Shore C4 – Chemistry II
8
44
67
23
Yes
08/09
Greater North Shore C4 – Earth
Science I
Greater North Shore C4 – Engineering
I
Greater North Shore C4 – Physics I
4
69
72
3
No
3
56
91
35
No
9
71
91
21
Yes
5
60
82
21
No
08/09
08/09
08/09
08/09
08/09
Greater North Shore C4 – Earth
Science II
UMass Donahue Institute
Research and Evaluation Group
49
Annual Report of the MMSP State-level Evaluation
Appendix H
Appendix H: High Need Districts for All Funding Periods, by Partnership
High Need Districts for All Funding Periods, by Partnership
Number of Participants from High Need Districts
Partnership
EduTron (M)
High Need
Districts
Lesley University (M)
Fitchburg
Gardner
Subtotal
Boston
Boston Renaissance
CS
Cambridge
Fall River
Lowell
Malden
New Bedford
Somerville
Somerville CS/
Prospect Hill
Academy
Southbridge
Subtotal
Malden
MCLA – Science (S)
Adams-Cheshire
Harvard University (M)
Clarksburg
Florida
Mount Greylock
North Adams
UMass Donahue Institute
Research and Evaluation Group
Feb04–
Aug04
37
14
51 (79%)
1
Sep04–
Aug05
53
4
57 (88%)
3
Sep05–
Aug06
28
9
37 (84%)
10
Sep06–
Aug07
Cohorts
1&2
N/A
N/A
N/A
0
Sep06–
Aug07
Cohort 3
Sep07–
Aug08
Cohort 3
Sep08–
Aug09
Cohort 3
Sep08–
Aug09
Cohort 4
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
3
2
0
2
N/A
N/A
N/A
N/A
5
0
0
0
0
0
4
0
1
0
1
2
9
4
0
3
0
4
3
4
0
1
0
2
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
0
5
0
1
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
0
9 (39%)
21 (21%)
Planning
Year
0
18 (33%)
16 (19%)
1
31 (39%)
14 (19%)
0
13 (54%)
3 (25%)
6
5
5
N/A
N/A
N/A
N/A
1
2
0
5
1
1
0
3
1
2
2
3
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
50
Annual Report of the MMSP State-level Evaluation
Appendix H
High Need Districts for All Funding Periods, by Partnership
Number of Participants from High Need Districts
Partnership
MCLA – Science (S)
Salem State College (M)
Springfield/Holyoke
Public Schools (S)
Wareham PS (M)
WPI – Math (M)
High Need
Districts
Subtotal
Boston
Chelsea
Haverhill PS
Lynn
Salem
Somerville
Subtotal
Holyoke
Holyoke Comm. CS
Springfield
Subtotal
Wareham
Abby Kelley Foster
CS
Athol-Royalston
Berkshire Hills
Boston
Brockton
Cambridge
Chicopee
Fall River
Fitchburg
Lawrence Fam.
Devt. CS
Lowell
Community CS
New Bedford
North Adams
Pittsfield
UMass Donahue Institute
Research and Evaluation Group
Feb04–
Aug04
0
0
1
32
18
0
51 (93%)
6
0
32
38(100%)
17 (46%)
Sep04–
Aug05
14(100%)
0
1
20
32
16
0
69 (86%)
17
0
31
48(100%)
11 (61%)
Sep05–
Aug06
10 (100%)
1
1
16
41
14
0
73 (79%)
19
0
28
47 (96%)
N/A
Sep06–
Aug07
Cohorts
1&2
13(93%)
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
Sep06–
Aug07
Cohort 3
Sep07–
Aug08
Cohort 3
Sep08–
Aug09
Cohort 3
Sep08–
Aug09
Cohort 4
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
0
2
3
N/A
N/A
N/A
N/A
N/A
1
0
0
0
0
4
0
0
0
1
0
1
0
1
1
0
0
0
1
0
1
2
0
1
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
0
0
3
N/A
N/A
N/A
N/A
N/A
0
0
1
N/A
N/A
N/A
N/A
N/A
2
2
0
4
0
0
0
0
2
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
51
Annual Report of the MMSP State-level Evaluation
Appendix H
High Need Districts for All Funding Periods, by Partnership
Number of Participants from High Need Districts
Partnership
WPI – Math (M)
MCLA – Math (M)
High Need
Districts
Ralph C. Mahar
Seven Hills CS
Somerville
Webster
Winchendon
Worcester
Subtotal
Adams-Cheshire
North Adams
Pittsfield
Subtotal
UMass Amherst (M)
Athol-Royalston
EduTron Lowell (M/S)
EduTron Fitchburg (M)
Chicopee
Easthampton
Gateway
Gill-Montague
Greenfield
Holyoke
Holyoke
Community CS
Ludlow
North Adams
Ralph C. Mahar
Springfield
Westfield
Subtotal
Lowell
Fitchburg
UMass Donahue Institute
Research and Evaluation Group
Feb04–
Aug04
2
0
0
0
0
4
15(63%)
Started in
Year 2
N/A
N/A
N/A
Started in
Year 2
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
Sep04–
Aug05
0
0
1
1
8
7
27 (41%)
Planning
Year
N/A
N/A
N/A
Sep05–
Aug06
0
2
0
0
6
10
32 (43%)
Sep06–
Aug07
Cohorts
1&2
N/A
N/A
N/A
N/A
N/A
N/A
N/A
Sep06–
Aug07
Cohort 3
Sep07–
Aug08
Cohort 3
Sep08–
Aug09
Cohort 3
Sep08–
Aug09
Cohort 4
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
0
3
N/A
N/A
N/A
N/A
1
0
1 (9%)
2
1
6 (86%)
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
0
0
1
N/A
N/A
N/A
N/A
0
0
0
0
2
5
2
0
0
0
0
5
1
1
1
2
0
3
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
0
0
1
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
54(100%)
17
N/A
N/A
N/A
N/A
N/A
N/A
66(100%)
20
N/A
N/A
N/A
N/A
N/A
N/A
72(100%)
19
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
0
0
0
7
2
16 (64%)
N/A
N/A
0
0
0
4
2
13 (37%)
N/A
N/A
2
1
1
7
2
23 (34%)
N/A
N/A
52
Annual Report of the MMSP State-level Evaluation
Appendix H
High Need Districts for All Funding Periods, by Partnership
Number of Participants from High Need Districts
Partnership
EduTron Fitchburg (M)
Lesley University (M)
North Shore (S)
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
Sep06–
Aug07
Cohorts
1&2
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
7
10
34 (100%)
0
13
3
26
29
29
1
0
4
N/A
13
0
2
N/A
7
26
53 (98%)
1
3
1
18
23
18
0
0
0
N/A
14
2
5
N/A
12
34
65 (97%)
1
5
1
15
22
17
1
1
0
1
11
8
3
1
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
0
N/A
0
120 (94%)
N/A
1
11
N/A
1
97 (90%)
N/A
0
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
17
2
0
106 (95%)
4
1
1
0
8
13
0
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
High Need
Districts
Feb04–
Aug04
Sep04–
Aug05
Sep05–
Aug06
Gardner
Leominster
Subtotal
Attleboro
Brockton
Fairhaven
Fall River
Haverhill PS
Holyoke
Malden
Middleborough
New Bedford
Northampton
Randolph
Revere
Saugus
Silver Hill Charter
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
Somerville
Taunton
Ware
Subtotal
Boston
Fitchburg
Holyoke
Lynn
Revere
Somerville
Lowell Comm. CS
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
UMass Donahue Institute
Research and Evaluation Group
Sep06–
Aug07
Cohort 3
0
0
16
0
Sep07–
Aug08
Cohort 3
3
9
14
1
Sep08–
Aug09
Cohort 3
Sep08–
Aug09
Cohort 4
53
Annual Report of the MMSP State-level Evaluation
Appendix H
High Need Districts for All Funding Periods, by Partnership
Number of Participants from High Need Districts
Partnership
UMass Amherst C3 (M/S)
Salem State College
High Need
Districts
Subtotal
Athol Royalston
Chicopee
Easthampton
Gateway
Greenfield
Gill-Montague
Holyoke
Ludlow
Lynn
New Leadership LS
North Adams
Pittsfield
South Hadley
Springfield
West Springfield
Subtotal
Boston
Chelsea
Everett
Gloucester
Haverhill PS
Lynn
Malden
Methuen
Peabody
Revere
Salem
UMass Donahue Institute
Research and Evaluation Group
Feb04–
Aug04
Sep04–
Aug05
Sep05–
Aug06
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
Sep06–
Aug07
Cohorts
1&2
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
Sep06–
Aug07
Cohort 3
17 (41%)
1
5
0
1
1
0
3
2
0
1
0
0
2
3
3
22 (46%)
1
1
3
6
4
10
1
0
0
0
3
Sep07–
Aug08
Cohort 3
27 (40%)
0
3
1
0
0
1
4
0
0
0
1
1
0
9
0
19 (38%)
0
0
1
3
3
10
2
1
2
1
3
Sep08–
Aug09
Cohort 3
27 (53%)
0
3
1
1
0
1
2
0
1
0
1
2
0
12
1
25 (47%)
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
Sep08–
Aug09
Cohort 4
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
54
Annual Report of the MMSP State-level Evaluation
Appendix H
High Need Districts for All Funding Periods, by Partnership
Number of Participants from High Need Districts
Partnership
Salem State College
SE/Cape (S)
WPI – Science (S)
Worcester PS (M)
Boston PS (M)
Brockton PS (M)
Gateway RSD
Lesley Springfield (M)
High Need
Districts
Feb04–
Aug04
Sep04–
Aug05
Sep05–
Aug06
Winthrop
Worcester
Subtotal
Barnstable
Brockton
Fall River
Horace Mann CS
Lawrence
New Bedford
Subtotal
Worcester
Southbridge
Subtotal
Worcester
Boston
Brockton
Fall River
Subtotal
Easthampton
Gateway
Holyoke
Springfield
Subtotal
Chicopee
Holyoke
Springfield
Westfield
Subtotal
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
UMass Donahue Institute
Research and Evaluation Group
Sep06–
Aug07
Cohorts
1&2
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
Sep06–
Aug07
Cohort 3
1
1
41 (82%)
1
20
0
2
0
8
31 (66%)
3 (16%)
0
3 (16%)
34 (83%)
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
Sep07–
Aug08
Cohort 3
0
0
26 (65%)
5
22
5
0
0
8
40 (51%)
7 (54%)
0
7 (54%)
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
Sep08–
Aug09
Cohort 3
N/A
N/A
N/A
0
32
10
0
1
2
45 (50%)
3
1
4 (22%)
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
Sep08–
Aug09
Cohort 4
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
40 (100%)
21
9
30 (59%)
1
6
2
8
17 (39%)
1
9
35
4
49 (94%)
55
Annual Report of the MMSP State-level Evaluation
Appendix H
High Need Districts for All Funding Periods, by Partnership
Number of Participants from High Need Districts
Partnership
Greater North Shore (S)
Randolph PS (S)
Springfield College (S)
Boston University (M)
High Need
Districts
Feb04–
Aug04
Sep04–
Aug05
Sep05–
Aug06
Boston
Lynn
Pioneer Charter
School of Science
Randolph
Subtotal
Randolph
Springfield
Boston
Falmouth
Haverhill
Lawrence
Salem
Worcester
Subtotal
N/A
N/A
N/A
N/A
N/A
N/A
Sep06–
Aug07
Cohorts
1&2
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
UMass Donahue Institute
Research and Evaluation Group
Sep06–
Aug07
Cohort 3
Sep07–
Aug08
Cohort 3
Sep08–
Aug09
Cohort 3
Sep08–
Aug09
Cohort 4
N/A
N/A
N/A
N/A
N/A
N/A
26
3
N/A
N/A
N/A
N/A
1
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
N/A
1
31
6
26
3
2
2
7
1
1
16
(50%)
(25%)
(96%)
(39%)
56
Annual Report of the MMSP State-level Evaluation
Appendix I
Appendix I: Criteria that Account for Gain in Highly Qualified Status
Criteria that Account for Gain in Highly Qualified Status
All unique participants to date*
Criteria Accounting for
Gains in Highly
Qualified Status
Gained
HQ
status
during
Year 1
Gained HQ
status during
Year 2
Cohort Cohort
1
2
Gained HQ
status during
Year 3
Cohort Cohort
1
2
Gained HQ
status during
Year 4
Cohort Cohort
2
3
Gained HQ
status during
Year 5
Cohort
3
Gained HQ
status during
Year 6
Cohort Cohort
3
4
TOTAL
became HQ
over course of
project
MTEL
3
3
0
2
0
0
1
4
5
1
19
National Certification
0
0
0
0
0
0
0
0
0
0
0
Degree in Content Area
0
0
2
0
0
0
0
0
0
0
0
2
0
0
0
1
0
1
0
1
0
3
10
46
0
12
1
0
1
0
0
0
70
Earned Teaching License
0
1
0
2
0
0
0
1
4
1
9
Changed area or position
MTEL/Undergrad Equiv
combined
MTEL/HOUSSE combined
MTEL/Earned Teaching
License combined
MTEL/changed area or
position combined
Degree/changed area or
position combined
Undergrad Equiv /changed
area or position combined
0
1
0
3
1
0
0
5
5
3
18
0
4
0
1
0
0
0
0
0
0
5
0
2
0
0
0
0
0
0
0
0
2
0
0
0
0
0
0
0
0
1
0
1
0
1
0
2
0
0
0
2
0
0
5
0
0
0
1
1
0
1
0
0
0
3
0
0
0
2
0
0
0
0
0
0
2
13
58
1
27
3
0
4
12
16
5
139
Undergrad Equivalent
HOUSSE
TOTAL
*Participants who took courses across multiple cohorts were included within the first cohort in which they participated, unless it was determined that they gained their HQ status during Year 4 while taking Cohort 3 courses.
UMass Donahue Institute
Research and Evaluation Group
57