Commission on Teacher Credentialing Biennial Report Academic Years 09-10 and 10-11

advertisement
Commission on Teacher Credentialing
Biennial Report
Academic Years 09-10 and 10-11
Institution: California State University, Chico
Date report is submitted: September 15, 2011
Date of last Site Visit: April, 2007
Programs documented in this report:
Multiple Subject Program
Multiple Subject Internship Program
Bilingual Multiple Subject Program
Concurrent Multiple Subject/Education Specialist Program
Single Subject Program
Single Subject Internship Program
Bilingual Single Subject Program
Agriculture Specialist Program
Adapted Physical Education Program
Level I Education Specialist Program
Level I Education Specialist Internship Program
Educational Leadership Administration Program
School Psychology Program
Communication Sciences and Disorders Program
Credentials awarded:
Multiple Subject
Multiple Subject with BCLAD Emphasis
Single Subject
Single Subject with BCLAD Emphasis
Agriculture Specialist
Adapted Physical Education
Education Specialist I Mild/Moderate
Education Specialist I Moderate/Severe
Education Specialist II Mild/Moderate
Education Specialist II Moderate/Severe
Preliminary Administrative Services
Pupil Personnel Services: School Psychology
Clinical Rehabilitative Services: Speech, Language and Hearing
Is this program offered at more than one site?
Yes
No
Program Contact: Dr. Deborah Summers
Phone #: 530-898-6484
E-Mail: dsummers@csuchico.edu
MULTIPLE SUBJECT TEACHER CREDENTIAL PROGRAM
SECTION A – CREDENTIAL PROGRAM SPECIFIC INFORMATION
I – Contextual Information
School of Education Multiple Subject Pathways
Multiple Subject
Multiple Subject
Internship
Integrated Teacher Core
Dr. Lynne Bercaw
530-898-5278
lbercaw@csuchico.edu
Multiple Subject with
BCLAD Authorization
Dr. Esther Larocco
530-898-5802
elarocco@csuchico.edu
Concurrent (MS/ES I)
Dr. Kathleen Gabriel
530-898-5025
kgabriel@csuchico.edu
The School of Education offers multiple pathways leading to initial credentials in Multiple
Subject. Although each program pathway includes a variety of assessments, we have
chosen to focus on key assessments that all pathways have in common. In some cases,
there is variation in evaluation processes for similar assessments. In those cases, separate
data tables are provided. See institutional summary for changes since our last submission in
February of 2011.
Multiple Subject: This is the largest of the multiple subject program pathways. The
candidates considered to be part of this program include those in the regular Multiple
Subject Program, the internship program and the Integrated Teacher Core, a blended
Liberal Studies, Multiple Subject program. This program and the internship program are the
only MS pathways that admit candidates both fall and spring.
Multiple Subject Internship: The Internship Program is an alternative pathway to earning a
credential that links the Multiple Subject Program with employment as a beginning teacher.
Interns take the same set of courses and complete the same assessments as traditional
program candidates. For this reason, assessment data for interns is included with the traditional
Multiple Subject Program data.
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11)
2
Integrated Teacher Core (ITC): This is a four-year, undergraduate, blended program leading to
a bachelor’s degree in Liberal Studies and a Multiple Subject Credential. Candidates in this
program complete the same assessments as traditional Multiple Subject Program candidates.
For this reason, assessment data for these candidates is included with the Multiple Subject
Program data.
The Multiple Subject with BCLAD Authorization: The Multiple Subject Program with BCLAD
emphasis prepares candidates to teach in bilingual/cross-cultural classrooms and in a variety of
educational settings with students from culturally and linguistically diverse backgrounds. Prior to
completion of the program leading to a teaching credential, candidates must demonstrate
proficiency in the target language and knowledge of the target culture. Candidates participate in
bilingual/multicultural classrooms and in classrooms promoting academic language
development and conceptual understanding for linguistically diverse students.
Concurrent Multiple Subject/Education Specialist: The Concurrent/Education Specialist
Program is a three-semester program in which candidates may obtain both Multiple Subject
and Preliminary Education Specialist, Level I, Mild/Moderate credentials (“concurrent”
candidates) or a Preliminary Education Specialist, Level I, Moderate/Severe credential (ES
only candidates). Data presented in this section of the report will be applicable to the
Multiple Subject portion of their preparation program.
Academic Year
2009-2010
2010-2011
2009-2010
2010-2011
2009-2010
2010-2011
2009-2010
2010-2011
2009-2010
2010-2011
Program Specific Candidate Information
Number of Candidates
Number of
Completers/Graduates
Multiple Subject/ITC/TPP
147
107
124
91
Multiple Subject Internship
1
1
2
2
Multiple Subject - BCLAD
13
8
13
11
Concurrent Multiple Subject/Ed. Specialist I
26
25
24
23
Totals - Multiple Subject
187
141
163
127
SECTION A – CREDENTIAL PROGRAM SPECIFIC INFORMATION
II. Candidate Assessment/Performance and Program Effectiveness Information
Part A: Primary Candidate Assessments
Data collected during 2009-2011 comes from the following Key Assessments:
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11)
3
Key Assessment #1: Performance Assessment of California Teachers (PACT)
Key Assessment #2: Content Area Tasks (CATs)
Key Assessment #3: Student Teaching Evaluations
Key Assessment #4: Dispositions Evaluations
Key Assessment #1: Performance Assessment of California Teachers (PACT)
The PACT Teaching Event assesses candidate performance in five areas: Planning (P),
Instruction (I), Assessment (A), Reflection (R) and Academic Language (AL). Candidates’
performance in these areas is evaluated on twelve rubrics represented in the charts below.
Candidates submit the PACT Teaching Event during the student teaching (Teaching Practicum
II) semester. Teaching events are evaluated on a four-point scale. A score of 1 is considered a
failing score.
Please note that no modifications have been made to assessor selection, training or
recalibration since the submission of Standards 19-21 in 2008-2009.
*Note: PACT Data reflects the final score for each candidate after any resubmits.
PACT 2009-2010,Multiple Subject/Internship/Tri-Placement (x = 109)
Mean
Median
Minimum
Maximu
m
# Level
1s
% Failure
Planning
P1
P2
P3
2.8
2.6
2.6
3
3
3
2
2
1
Instruction
I1
I2
2.4
2.4
2
2
1
1
Assessment
A1
A2
A3
2.6
2.5
2.7
3
2
3
1
1
1
Reflection
R1
R2
2.5
2.4
3
2
1
1
Academic
Language
AL1
AL2
2.3
2.5
2
2
1
2
4
4
4
4
4
4
4
4
4
4
4
4
0
0%
0
0%
2
2%
6
6%
7
6%
3
3%
3
3%
3
3%
2
2%
5
5%
4
4%
0
0%
PACT 2010-2011, Multiple Subject/Internship (n=89)
Mean
Median
Minimum
Maximu
m
# Level
1s
% Failure
Planning
P1
P2
P3
2.6
2.5
2.5
3
2
2
2
2
2
Instruction
I1
I2
2.3
2.2
2
2
1
1
Assessment
A1
A2
A3
2.5
2.3
2.3
2
2
2
2
1
1
Reflection
R1
R2
2.4
2.3
2
2
1
1
Academic
Language
AL1
AL2
2.1
2.4
2
2
1
1
4
4
4
4
4
4
4
4
4
4
4
4
0
0%
0
0%
0
0%
5
6%
3
3%
0
0%
2
2%
11
12%
2
2%
9
10%
2
2%
1
1%
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11)
4
PACT 2009-2010, Multiple Subject Concurrent (n=26)
Mean
Median
Minimum
Maximu
m
# Level
1s
% Failure
P1
2.7
3
2
Planning
P2
P3
2.5
2.6
2
2.5
1
2
Instruction
I1
I2
2.4
2.1
2
2
1
1
Assessment
A1
A2
A3
2.3
2.1
2.2
2
2
2
2
1
1
Reflection
R1
R2
2.5
2.4
2.5
2
2
2
Academic
Language
AL1
AL2
2.0
2.5
2
2
1
2
4
4
4
4
3
4
4
3
3
4
3
3
0
0%
2
8%
0
0%
1
4%
1
4%
0
0%
4
15%
2
8%
0
0%
0
0%
3
12%
0
0%
PACT 2010-2011, Multiple Subject Concurrent (n=20)
Mean
Median
Minimum
Maximu
m
# Level
1s
% Failure
P1
2.8
3
2
Planning
P2
P3
2.5
2.6
2
3
2
2
Instruction
I1
I2
2.4
2.3
2
2
1
2
Assessment
A1
A2
A3
2.4
2.4
2.6
2
2
2
1
2
1
Reflection
R1
R2
2.5
2.1
2
2
2
1
Academic
Language
AL1
AL2
2.2
2.4
2
2
1
1
4
4
4
4
4
4
4
4
4
4
3
3
0
0%
0
0%
0
0%
1
5%
0
0%
1
5%
0
0%
1
5%
0
0%
2
10%
1
5%
1
5%
PACT 2009-2010, Multiple Subject Bilingual (n=8)
Mean
Median
Minimum
Maximu
m
# Level
1s
% Failure
Planning
P1
P2
P3
3.0
2.9
2.8
3
3
3
2
2
2
Instruction
I1
I2
2.8
2.8
3
2.5
2
2
Assessment
A1
A2
A3
3.0
3.0
2.4
3
3
2.5
2
2
1
Reflection
R1
R2
2.8
2.9
2.5
3
2
1
Academic
Language
AL1
AL2
2.6
2.8
2.5
3
1
2
4
4
4
4
4
4
4
4
4
4
4
4
0
0%
0
0%
0
0%
0
0%
0
0%
0
0%
0
0%
3
38%
0
0%
1
13%
1
13%
0
0%
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11)
5
PACT 2010-2011, Multiple Subject Bilingual (n=10)
Mean
Median
Minimum
Maximu
m
# Level
1s
% Failure
P1
2.6
2.5
2
Planning
P2
P3
2.9
2.9
3
3
2
2
Instruction
I1
I2
2.5
2.3
2
2
2
2
Assessment
A1
A2
A3
2.8
2.4
2.5
3
2
2.5
2
2
2
Reflection
R1
R2
2.4
2.4
2
2
2
1
Academic
Language
AL1
AL2
2.2
2.2
2
2
2
2
4
4
4
4
3
4
3
3
4
4
3
3
0
0%
0
0%
0
0%
0
0%
0
0%
0
0%
0
0%
0
0%
0
0%
1
10%
0
0%
0
0%
Key Assessment #2: Content Area Tasks (CATs) – 2008-09
Multiple Subject candidates are required to complete Content Area Tasks (CATs) in the three
additional core subject areas: math, science and social studies. For each of these subject areas,
candidates submit a Planning Instruction and Assessment task. Each CAT is evaluated on one
of the three rubrics for the Planning Instruction and Assessment Planning Instruction and
Assessment task as follows: Math: Establishing a Balanced Instructional Focus, Science:
Making Content Accessible, and Social Studies: Designing Effective Assessments. Faculty
scoring CATs are trained and calibrated, and 15% of the CATs are double-scored.
CATs Multiple Subject/Internship/TPP Fall 2009, Spring 2010 (n=108)
History
Science
Math
2.9
2.8
2.9
Median
3
3
3
Min
2
1
1
Max
4
4
4
Mean
CATs Multiple Subject/Internship Fall 2010, Spring 2011
History (n=90)
Science (n=103)
Math (n=86)
2.7
2.6
2.5
Median
3
3
2
Min
2
2
1
Max
4
4
4
Mean
CATs Concurrent Fall 2009 (n=25)
History
Science
Math
2.2
2.4
2.2
Median
2
2
2
Min
2
2
2
Max
3
3
3
Mean
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11)
6
CATs Concurrent Fall 2010 (n=20)
History
Science
Math
2.3
2.4
2.6
Median
2
2
3
Min
2
2
2
Max
3
3
3
Mean
CATs Bilingual Fall 2009 (n=12)
History
Science
Math
2.7
2.8
2.5
Median
3
3
2.5
Min
2
2
2
Max
3
3
3
Mean
CATs Bilingual Fall 2010 (n=8)
History
Science
Math
2.9
2.8
2.6
Median
3
2.5
2.5
Min
2
2
2
Max
4
4
4
Mean
Key Assessment #3: Student Teaching Evaluations
Each program pathway conducts evaluations of candidates in both student teaching semesters.
While all MS pathways base their evaluations on the TPEs, pathways in PSED organize the
TPEs into the six domains of the CSTPs. Additionally, the EDUC pathways use a three-point
scale, while the PSED pathways use a four-point scale for the evaluations.
Multiple Subject Field Evaluation Teaching Practicum I, 2009-2010 (n=91)
T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 T11 T12 T13
Mean 2.8 3.0 2.7 2.9 3.0 2.9 2.7 2.9 2.9 2.9 2.9 2.9 2.9
Median
3
3
3
3
3
3
3
3
3
3
3
3
3
Min
2
2
2
2
2
2
1
2
2
2
2
1
1
Max
3
3
3
3
3
3
3
3
3
3
3
3
3
Multiple Subject Field Evaluation Teaching Practicum I, 2010-2011 (n=86)
T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 T11 T12 T13
Mean 2.9 3.0 2.7 2.9 2.9 2.9 2.7 2.9 2.9 2.8 2.8 2.9 2.9
Median
3
3
3
3
3
3
3
3
3
3
3
3
3
Min
2
2
2
2
2
2
2
2
1
2
2
2
2
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11)
7
Max
3
3
3
3
3
3
3
3
3
3
3
3
3
Multiple Subject Field Evaluation Teaching Practicum II, 2009-2010 (n=99)
T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 T11 T12 T13
Mean 2.9 3.0 2.9 2.9 3.0 2.9 2.9 3.0 2.9 3.0 2.9 3.0 3.0
Median
3
3
3
3
3
3
3
3
3
3
3
3
3
Min
1
2
2
2
2
2
2
2
2
2
2
2
2
Max
3
3
3
3
3
3
3
3
3
3
3
3
3
Multiple Subject Field Evaluation Teaching Practicum II, 2010-2011 (n=85)
T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 T11 T12 T13
Mean 3.0 3.0 2.9 3.0 3.0 3.0 2.9 3.0 3.0 3.0 2.9 3.0 3.0
Median
3
3
3
3
3
3
3
3
3
3
3
3
3
Min
2
2
2
2
1
1
2
2
2
2
1
2
2
Max
3
3
3
3
3
3
3
3
3
3
3
3
3
Bilingual Multiple Subject Field Evaluations, 2009-2010
Teaching Practicum I (n=12)
Teaching Practicum II (n=8)
Domain F TPEs 12, 13
Domain E TPEs 10, 11
Domain D TPEs 8, 9
TPEs 4, 5, 6,
7
Domain C
TPE 1
Domain B TPEs 2, 3
Domain A
Domain F TPEs 12, 13
Domain E TPEs 10, 11
Domain D TPEs 8, 9
TPEs 4, 5, 6,
7
Domain C
TPE 1
Domain B TPEs 2, 3
Domain A
Mean
2.9
2.8
2.9
2.9
2.9
2.6
Mean
3.1
3.0
3.1
3.2
3.2
3.3
Median
3
3
3
3
3
2.75
Median
3
3
3
3
3
3
Min
2
2
2
2
2
2
Min
3
3
3
3
3
3
Max
4
4
4
4
4
3
Max
4
3
4
4
4
4
Bilingual Multiple Subject Field Evaluations, 2010-2011
Teaching Practicum I (n=9)
Teaching Practicum II (n=10)
Domain F TPEs 12, 13
Domain E TPEs 10, 11
Domain D TPEs 8, 9
TPEs 4, 5, 6,
7
Domain C
TPE 1
Domain B TPEs 2, 3
Domain A
Domain F TPEs 12, 13
Domain E TPEs 10, 11
Domain D TPEs 8, 9
TPEs 4, 5, 6,
7
Domain C
TPE 1
Domain B TPEs 2, 3
Domain A
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11)
8
Mean
3.1
2.7
2.8
3.1
2.9
3.0
Mean
3.3
3.1
3.6
3.6
3.3
3.4
Median
3
3
3
3
3
3
Median
3
3
4
4
3
3
Min
2
2
2
2
2.5
3
Min
3
3
3
3
3
3
Max
4
3
4
4
3
3
Max
4
4
4
4
4
4
Concurrent MS Field Evaluations, Fall 2009 (n=25)
2.4
2.3
2
3
2.4
2.3
2
3
Domain F TPEs 12, 13
2.2
2
2
3
Domain E TPEs 10, 11
Domain D TPEs 8, 9
TPEs 4, 5, 6,
7
2.4
2.3
2
3
Domain C
TPE 1
Domain B TPEs 2, 3
Domain A
Mean
Median
Min
Max
2.3
2.3
2
3
2.6
2.5
2
3
Concurrent MS Field Evaluations, Fall 2010 (n=19)
2.9
2
2
3.5
2.9
2
2
3.5
Domain F TPEs 12, 13
2.9
2
2
3.5
Domain E TPEs 10, 11
Domain D TPEs 8, 9
TPEs 4, 5, 6,
7
2.9
2
2
3.5
Domain C
TPE 1
Domain B TPEs 2, 3
Domain A
Mean
Median
Min
Max
3.0
2
2
4
3.0
2
2
4
Key Assessment #4: Dispositions Evaluations
The dispositions development process engaged faculty, administration, and k-12 partners in a
series of activities designed to identify a shared core of beliefs about the knowledge, skills and
dispositions of professional educators. The deliberations were informed by the unit’s conceptual
framework and the ten principles of the INTASC standards, and led to the identification of five
dispositions focusing on (D1) diversity, (D2) support for all students, (D3) life-long learning, (D4)
collaboration, and (D5) democratic values. A focus group of public school teachers and
university supervisors was then formed to translate these dispositions into observable
behaviors. The resulting rubric describes specific behaviors associated with each of the five
dispositions. Candidates are assessed on dispositions in both teaching practica.
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11)
9
Multiple Subject Dispositions, 2009-2010
Teaching Practicum I (n=85)
D1
D2
D3
Teaching Practicum II (n=90)
D4
D5
D1
D2
D3
D4
D5
Mean
2.9
2.9
2.9
2.9
2.9
Mean
3.0
3.0
3.0
3.0
3.0
Median
3
3
3
3
3
Median
3
3
3
3
3
Min
2
2
2
2
2
Min
2
2
2
2
2
Max
3
3
3
3
3
Max
3
3
3
3
3
Multiple Subject Dispositions, 2010-2011
Teaching Practicum I (n=83)
D1
D2
D3
Teaching Practicum II (n=85)
D4
D5
D1
D2
D3
D4
D5
Mean
2.9
2.9
2.8
2.9
2.9
Mean
3.0
3.0
3.0
2.9
3.0
Median
3
3
3
3
3
Median
3
3
3
3
3
Min
2
2
2
2
2
Min
2
2
2
2
2
Max
3
3
3
3
3
Max
3
3
3
3
3
Bilingual Multiple Subject Dispositions, 2009-2010
Teaching Practicum I (n=12)
D1
D2
D3
D4
Teaching Practicum II (n=8)
D5
D1
D2
D3
D4
D5
Mean
3.2
3.1
3.0
3.2
3.3
Mean
3.1
3.1
3.1
3.1
3.1
Median
3
3
3
3
3
Median
3
3
3
3
3
Min
2
2
2
2
2
Min
3
3
3
3
3
Max
4
4
4
4
4
Max
4
4
4
3.5
4
Bilingual Multiple Subject Dispositions, 2010-2011
Teaching Practicum I (n=8)
D1
D2
D3
Teaching Practicum II (n=10)
D4
D5
D1
D2
D3
D4
D5
Mean
3.1
3.1
3.0
3.0
3.0
Mean
3.3
3.4
3.7
3.4
3.1
Median
3
3
3
3
3
Median
3
3
4
3
3
Min
3
3
3
3
3
Min
3
3
3
3
3
Max
4
4
3
3
3
Max
4
4
4
4
4
Concurrent Multiple Subject Dispositions, 2009-2010
Teaching Practicum I (n=25)
D1
D2
D3
D4
D5
Teaching Practicum II (n=25)
D1
D2
D3
D4
D5
Mean
2.6
2.6
2.6
2.6
2.6
Mean
2.7
2.7
2.6
2.6
2.7
Median
3
3
3
3
3
Median
3
3
3
3
3
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 10
Min
Max
2
3
2
3
2
3
2
3
2
3
Min
Max
2
3
2
3
2
3
2
3
Concurrent Multiple Subject Dispositions, 2010-2011
Teaching Practicum I (n=19)
Teaching Practicum II (n=19)
D1
D2
D3
D4
D5
D1
D2
D3
D4
Mean
Median
Min
Max
2.8
3
2
3
2.8
3
2
3
2.8
3
2
3
2.8
3
2
3
2.8
3
2
3
Mean
Median
Min
Max
2.8
3
2
3
2.8
3
2
3
2.8
3
2
3
2.8
3
2
3
2
3
D5
2.8
3
2
3
Part B: Additional information about candidate and program completer performance or
program effectiveness
Additional data collected on candidate performance during academic years 2009-10 and 201011 was taken from the following sources:
Assessment #5: Reading Instruction Competence Assessment (RICA)
Assessment #6: CSU System-wide Exit Survey
Assessment #7: CSU System-wide Evaluation of first year teachers
Assessment #5: Reading Instruction Competence Assessment (RICA)
The purpose of the RICA is to ensure that California-trained candidates for Multiple Subject
Teaching Credentials and Education Specialist Instruction Credentials (special education)
possess the knowledge and skills important for the provision of effective reading instruction to
students. The pass rates displayed below are for candidates from all multiple subject and
education specialist credential pathways combined.
Year
Number Tested
2009-10
2010-11
145
Data Not
Available
Number
Passed
140
Data Not
Available
Pass Rate
97%
Data Not
Available
Statewide
Pass Rate
89%
Data Not
Available
Assessment #6: CSU System-wide Exit Survey
Beginning in Fall 2005, all campuses within the California State University (CSU) system have
participated in a system-wide exit survey of initial credential program graduates. At CSU, Chico
participation in the survey is a requirement for all credential program completers. Each year, the
CSU Center for Teacher Quality provides the individual campuses aggregated data
electronically preformatted with statistical computations complete. The data below reflect the
responses of 2009-10 and 2010-11 completers from all multiple subject program pathways
combined.
MS Teacher Preparation Exit Survey
As a new teacher, I am (choose preparedeness level) ...
...to meet the instructional needs of students who are English language
Well or Adequately
Prepared
2009-10
2010-11
94%
84%
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 11
learners.
...to meet the instructional needs of students from diverse cultural
backgrounds.
...to meet the instructional needs of students with special learning needs.
...to know about resources in the school & community for at-risk students
and families.
...to know and understand the subjects of the curriculum at my grade
level(s).
...to teach reading-language arts according to California Content
Standards in reading.
...to teach mathematics according to California Content Standards in
math.
...to teach science according to California State Content Standards in
science.
...to teach history and social studies according to California Content
Standards.
...to assist individual students in areas of their instructional needs in
reading and math.
94%
87%
86%
80%
92%
85%
98%
96%
97%
96%
95%
93%
98%
91%
97%
91%
99%
n=83
97%
n=96
Assessment #6: CSU System-wide Evaluation of First Year Teachers
The CSU System-wide Evaluation of Teacher Preparation, administered by the Center for
Teacher Quality, provides the results of surveys administered to both graduates of initial
credential programs completing their first year as in-service teachers and their employers on
their perceptions of the quality of preparation they received in their programs. The results for
each campus are provided as composite scores on groups of questions substantively related to
each other. The data below reflect the responses of 2007-08 and 2008-09 program completers
from all multiple subject program pathways combined. Shading indicates teacher and supervisor
responses on like items.
CSU System-wide Survey One-Year Out: Multiple Subject Supervisors and First Year
Teachers From CSU-Chico Composite Graphs
% Adequately or Well Prepared
K-8 Supervisors Assess the
Overall Effectiveness of CSU
Multiple Subject Credential
Supervisor Programs
First Year Multiple Subject
Teachers Assess the Overall
Effectiveness of Their CSU
Teacher
Credential Programs
20082009
CSU,
Chico
Graduating Year
200820092009
2010
SystemCSU,
wide
Chico
20092010
Systemwide
74%
82%
Data Not
Available
Data Not
Available
77%
80%
Data Not
Available
Data Not
Available
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 12
Supervisor
Teacher
Supervisor
Teacher
Supervisor
Teacher
Supervisor
Teacher
Supervisor
Teacher
Supervisor
Teacher
Supervisor
K-8 Supervisors Assess CSU
Preparation of Multiple Subject
Teachers for Reading Language
Arts Instruction (K-8)
First Year Multiple Subject
Teachers Assess Their CSU
Preparation for ReadingLanguage Arts Instruction (K-8)
K-8 Supervisors Assess CSU
Preparation of Multiple Subject
Teachers for Mathematics
Instruction (K-8)
First Year Multiple Subject
Teachers Assess Their CSU
Preparation for Mathematics
Instruction (K-8)
Supervisors Assess CSU
Preparation to Teach Subjects
Other than Reading & Math (K-8)
Multiple Subject Teachers Assess
Their CSU Preparation to Teach
Subjects Other than Reading and
Math (K-8)
School Supervisors Assess
Preparation of Teachers for Equity
and Diversity in Teaching
First-Year Teaching Graduates of
the CSU Assess Their
Preparation for Equity and
Diversity in Teaching
Primary-Grade Supervisors
Assess CSU Preparation of
Teachers to Teach Young
Children (K-3)
Multiple-Subject Teachers in
Grades K-3 Assess Their CSU
Preparation to Teach Young
Children
School Supervisors Assess CSU
Preparation of Teachers to Teach
English Learners
First-Year Teaching Graduates of
the CSU Assess Their CSU
Preparation to Teach English
Learners
School Supervisors Assess CSU
Preparation of Multiple Subject
Teachers to Teach Special
Learners in Inclusive Schools
83%
81%
Data Not
Available
84%
87%
Data Not
Available
Data Not
Available
81%
85%
Data Not
Available
Data Not
Available
76%
86%
Data Not
Available
Data Not
Available
73%
77%
Data Not
Available
Data Not
Available
65%
68%
Data Not
Available
Data Not
Available
80%
Data Not
Available
Data Not
Available
81%
79%
Data Not
Available
Data Not
Available
69%
85%
Data Not
Available
Data Not
Available
85%
83%
Data Not
Available
Data Not
Available
69%
79%
Data Not
Available
Data Not
Available
81%
81%
Data Not
Available
Data Not
Available
69%
79%
Data Not
Available
Data Not
Available
70%
Data Not
Available
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 13
Teacher
Teacher
First-Year Multiple Subject
Teachers Assess Their CSU
Preparation to Teach Special
Learners in Inclusive Schools
CSU Teachers Assess the Overall
Value of Professional Coursework
in Their First Year of Teaching
81%
76%
Data Not
Available
85%
82%
Data Not
Available
Data Not
Available
Data Not
Available
SECTION A – CREDENTIAL PROGRAM SPECIFIC INFORMATION
III.
Analysis of Candidate Assessment Data
Performance Assessment of California Teachers (PACT)
The overall pass rate on the first submission for candidates across all multiple subject pathways
was 96.5% in 2008-2009 and 94.2% in 2010-2011. After successful resubmissions by
candidates, the pass rate was 100%. The data shown in Section A II includes scores for each
candidate’s successful attempt. The Institutional Summary and Plan of Action discusses plans
to include first attempt failures in the data set.
While results across programs vary, there are some common areas of strength and challenge.
Across all programs, candidates’ scores were highest on elements related to Planning (P1, P2
and P3: Planning—Establishing a Balanced Instructional Focus, Making Content Accessible,
and Designing Assessments).
Multiple Subject. When comparing PACT scores between the 2009-2010 and 2010- 2011 data
sets, item failure rates remained steady or increased slightly in all but two areas. The two areas
that appear to have posed the greatest challenges in 2010-2011 were Assessment (A3:
Assessment—Using Feedback to Promote Student Learning) with a 12% failure rate and
Reflection (R2: Reflection—Reflecting on Learning) with a 10% failure rate. A third area of
challenge is I1: Engaging students in learning with a 6% failure rate in 2010 and 2011.
Bilingual.
All Bilingual Multiple Subject candidates passed the PACT in 2009-2010 and in 2010-2011.
Overall the 2009-2010 candidates performed better than the 2010-2011 candidates. The means
ranged between 2.3 – 3.0in2009-2010. For 2010-2011, the means ranged between 2.2 - 2.9.
The following two areas received the highest mean scores both years:
P2: Making content accessible (Mean-2.9/2.9)
A1: Analyzing student work from an assessment (Mean-3.0/2.8)
Based on PACT, the three areas needing more emphasis in the program are:
A3: Using feedback to promote student learning (Mean-2.4/2.5)
R2: Reflecting on learning
AL1: Understanding language demands and resources (Mean-2.6/2.2)
Concurrent. Overall, item failure rates were lower in 2009-2010 than in 2010-2011. Data show
gains in the areas of Assessment and Academic Language. The failure rate for A2: Using
Assessment to Inform Teaching decreased from 15% in 2009-2010 to 0% in 2010-2011. For
AL1: Understanding Language Demands and Resources the failure rate decreased from 12% to
5%. The area of greatest challenge appears to be in the Reflection category. On R2: Reflecting
on Learning there was a 10% failure rate in 2010-2011.
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 14
Content Area Tasks (CATs)
The mean scores and failure rates indicate that candidates across pathways in the Multiple
Subject Program were successful in all three content areas (Mathematics, Science and Social
Science). However, Multiple Subject pathways differed in content area strengths and areas for
improvement. Across all pathways, scores on the CATs indicate that candidates are doing well
in the area of planning. The omission of initial non-passing scores limits a rich interpretation of
data. This issue will be addressed in the Institutional Summary and Plan of Action.
Multiple Subject. In the Multiple Subject pathway, mean scores decreased slightly from the
2009-2010 to the 2010-2011 academic year. Students earned the lowest mean cores in the
Math CATs, with an average of 2.5 out of 4.
Concurrent. Candidate performance increased slightly from Fall 2009 to Fall 2010. Of the three
CATs, performance in History was lowest, with a mean of 2.2 in 2009 and a mean of 2.3 in
2010.
Bilingual. Candidate performance increased slightly from Fall 2009 to Fall 2010. Of the three
CATs means, Mathematics was lowest both semesters, with a mean of 2.5 in Fall 2009 and a
2.6 in Fall 2010.
Student Teaching Evaluations
Across all programs, candidates show growth on TPEs over the course of the two teaching
practica. By the end of the second teaching practicum, they are able to demonstrate proficiency
across all competencies.
The use of a three-point rubric allows for inadequate discrimination among candidates in
Student Teaching Evaluations. In addition, the use of a three-point rubric for some pathways,
and a four-point rubric for others, has created difficulty in interpreting data for the purposes of
program improvement. This issue will be addressed in the subsequent Institutional Summary
and Plan of Action.
Multiple Subject. The lowest mean scores were for TPE 3: Interpretation and Use of
Assessments and TPE 7: Teaching English Learners. In Practicum I, the mean for TPEs 3 and
7 was 2.7 out of 3 for data sets from both 2009-2010 and 2010-2011. In Practicum II, the mean
rose to 2.9 out of 3 in each academic year.
Bilingual. Bilingual pathway candidates are required to have a minimum score of 2 (of 4) at the
end of Teaching Practicum I and a minimum score of 3 (of 4) at the end of Teaching Practicum
II. Domain B, which includes TPE 2: Monitoring Student Learning During Instruction and TPE 3:
Interpretation and Use of Assessment, had the lowest means both semesters in both years. For
Practicum I, mean scores were 2.8 in 2009-2010 and 2.7 in 2010-2011. For Practicum II, mean
scores were 3.0 in 2009-2010 and and 3.1 in 2010-2011.
Concurrent. For the fall semester, Concurrent candidates are placed in general education
(multiple subject) classrooms. Data shows the area of greatest challenge is Domain B,
which includes TPE 2: Monitoring Student Learning During Instruction and TPE 3:
Interpretation and Use of Assessment. Mean scores for Domain B were 2.2 out of 4 in Fall
2009 and 2.9 out of 4 in Fall 2010.
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 15
Dispositions Evaluations
Data show some candidate growth across all dispositions over the course of their preparation
programs. These data suggest that in all pathways, evaluators observed behaviors that would
indicate well-developed dispositions early in their credential programs. These dispositions
continued to develop through the program.
The data show no consistent area of challenge among pathways.
The use of a three-point rubric allows for inadequate discrimination among candidates in
Disposition Evaluations. In addition, the use of a three-point rubric for some pathways, and a
four-point rubric for others, has created difficulty in interpreting data for the purposes of program
improvement. This issue will be addressed in the Institutional Summary and Plan of Action.
CSU System-wide Exit Survey
The data for the CSU System-wide Exit Survey combines all Multiple Subject pathways. Data
indicate that graduates of our programs are confident that they are prepared to address most of
the challenges of teaching. In 2009-2010 98% of students felt well or adequately prepared to
“know and understand the subjects of the curriculum” at their grade levels, and in 2010-2011
that assessment by candidates stayed strong at 96%. Both years, they were confident in their
preparation to “teach reading/language arts according to the California Content Standards”
(97% in 09-10 and 96% in 10-11) and “to assist individual students in their instructional needs in
reading and math (99% in 09-10 and 97% in 10-11).
However, overall satisfaction with the preparation received was lower in 2010-2011 than in
2009-2010. Four areas appear to present the biggest challenges. The percent of students who
felt well or adequately prepared “to meet the instructional needs of students who are English
language learners” fell from 94% in 2009-2010 to 84% in 2010-2011). In addition, candidate
confidence in preparation to teach students with special needs fell from 87% in 2009-2010 to
80% in 2010-2011 and their confidence in preparation to teach students from diverse
backgrounds fell from 94% to 86% over the two years. In addition, the percent of students who
feel well or adequately prepared to students prepared to know about resources in the school &
community for at-risk students and families fell from 92% in 2009-2010 to 85% in 20102011.These four areas are also targeted for systemwide growth.
CSU System-wide Evaluation of First Year Teachers
Across all pathways, there is a discrepancy between teacher and supervisor perceptions of
preparedness. Ratings by supervisors were typically lower than the ratings by the teachers
themselves and lower than the CSU average.
Data indicate some strengths, including preparedness to teach children and preparation in
reading/language arts. For 2008-2009 graduates, 85% felt adequately or well prep to teach
young children (grades K-3), which is higher than the CSU average (83%). In addition,
supervisors reported that 83% of Chico graduates were adequately or well prepared to teach
reading/language arts, compared to 81% systemwide.
Data reveal some areas for growth, particularly in teaching English Learners and teaching
students with special learning needs in inclusive classrooms. Sixty-nine percent of supervisors
rated graduates adequately or well prepared to teach English Learners, compared to 79%
systemwide. In addition, for the item regarding teaching special learners in inclusive settings,
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 16
69% of supervisors felt that CSU Chico graduates were adequately or well prepared, compared
to 79% systemwide.
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 17
SECTION A – CREDENTIAL PROGRAM SPECIFIC INFORMATION
PART IV: Use of Assessment Results to Improve Candidate and Program Performance
Unit Institutional Summary and Action Plan
As a unit, program pathway coordinators met and identified nine common Student Learning
Outcomes (SLOs) based upon California Teaching Expectations, and the conceptual
framework, mission and vision of the School of Education. Each program analyzed data from six
data sources, and identified strengths and areas for improvement. The coordinators met and
reached consensus on areas for improvement common to all pathways in the unit. The Unit
Action Plan shows goals and plans of action for each goal. If applicable, individual pathways
have attached specific pathway action plans as addendums to the Unit Action Plan.
Unit Goal 1: Candidates effectively support students with special needs
in inclusive classrooms.
Data Source
Plan of Action or Proposed Changes Made



Exit survey
CSU survey





Hold Curriculum Committee meetings to articulate ways
in which coursework currently supports teaching
students with special learning needs across initial
credential pathways.
Incorporate a systematic use of IRIS modules in
coursework and train faculty in use of the modules.
Involve education specialist faculty, k-12 teachers and
master’s students in bringing education specialist
content to prepare general educators to work in
inclusive classrooms.
Revise course delivery to pair general education faculty
with education specialist faculty to 1) seamlessly
integrate methods that teach students with special
learning needs and 2) model co-teaching that occurs in
inclusive delivery models.
Expand the Assistive Technology Faire, current just for
Ed Specialist candidates, for all credential candidates to
learn about new assistive technologies and their
appropriate use.
Strengthen the special needs section of the field
observation form so that teaching behaviors that
support special learners will be more clearly identified in
the field.
Applicable
Program or
Common
Standard(s)
TPE 4,5,6
(SLO 7)
Disp 1
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 18
Unit Goal 2: Candidates use a variety of formative and summative assessments to
determine pupils’ progress, provide feedback and plan instruction.
Data Source
Plan of Action or Proposed Changes Made
PACT rubric

items A1, A2 and
A3






Hold Curriculum Committee meetings to articulate ways
in which coursework currently supports helping
candidates use a variety of formative and summative
assessments to inform instruction, and identify
additional course components that strengthen the
assessment strand.
In coursework, create communities of practice in which
candidates examine k-12 student work for evidence of
student learning.
Create additional assignments asking candidates to
bring their student work to class to analyze for patterns
of student learning. Provide models of effective verbal
and written feedback and guidance in determining next
instructional steps.
In fieldwork, modify supervision observation form to
include indicators for 1) use of student work as
evidence of student learning and 2) providing feedback
to students. Focus on these indicators at postobservation conferences.
Supervision focus on how ST provide feedback to
students
Provide supervisors with professional development
about using student work as evidence of teaching
effectiveness.
Confer with other universities regarding best practices
for observation practices that focus on K-12 student
learning outcomes.
Applicable
Program or
Common
Standard(s)
TPE 2,3
(SLO 2)
Multiple Subject Program Action Plan
In addition to the goals listed in the Unit Action Plan, all Multiple Subject Program pathways
share a common goal.
Multiple Subject Program Goal 1: Candidates use research, theory, and reflections on
teaching and learning to guide practice.
Data Source
Plan of Action or Proposed Changes Made
Applicable
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 19
PACT rubric
items R1 and R2


On the “rationale” section of written lesson plans,
require candidates to link research and theory to the
learning objective(s).
In observations of fieldwork, supervisors help
candidates identify connections between research,
observed teaching behaviors, and patterns of student
learning.
Program or
Common
Standard(s)
TPE 13
SLO 8
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 20
Pathway Action Plans
In addition to the Unit and Program goals and actions, some pathways have identified additional
goals and actions.
Bilingual Pathway
Area of
Growth
Data
Source
Assessment PACT
Plan of Action or Proposed
Changes Made


ELs:
Academic
Language
PACT

CSU Exit
Survey

CSU Eval
of 1st Yr.
Tchrs


ELs:
Equity
and
Diversity
Special
Needs
CSU Exit
Survey
CSU Eval
of 1st Yr.
Tchrs
CSU Exit
Survey


CSU Eval
of 1st Yr.
Tchrs

develop a separate
Assessment course – EDTE
676B
Supervision focus on how ST
provide feedback to students
Change textbook for EDTE 673
to new CDE publication
EDTE 673 – focus on
candidates’ articulation why
instructional strategies and
language choice are likely to
support specific aspects of
students’ language
development for different levels
of language proficiency.
EDTE 575 - Make academic
language clearer on field
observation form
Require BIM for informal
observation; provide feedback
on academic language
Applicable Program
or Common
Standard(s)
 TPE 3 (SLO 2)

TPE 4 (SLO 3)

TPE 4 (SLO 3)

TPE 7 (SLO 6)
EDTE 673 & EDTE 676A –
Assigned Readings - include
readings on culturally
responsive practices
TPE 8 (SLO 5)
EDTE 574 – Modify an existing
course assignment where
students need to identify
resources available to support
at-risk students within schools
and in the community
TPE 4 (SLO 3)
TPE 11 (SLO 3)
TPE 5 (SLO 3, 7)
EDTE 575 – Strengthen
special needs area on field
observation forms
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 21

EDTE 673 – require in EL
Case Study the identification of
resources available to support
at-risk students within schools
and in the community
SINGLE SUBJECT TEACHER CREDENTIAL PROGRAM
SECTION A – CREDENTIAL PROGRAM SPECIFIC INFORMATION
I – Contextual Information
Credentials awarded: Single Subject
Single Subject with BCLAD Emphasis
Single Subject Intern
Agriculture Specialist
Adapted Physical Education
Program Contacts:
Single Subject
Al Schademan
530-898-4534
aschademan@csuchi
co.edu
Single Subject with
BCLAD Emphasis
Agriculture
Specialist (AGRI)
Chuck Zartman
530-898czartman@csuchico.e
du
Brad Dodson
530-898
bdodson@csuchico.e
du
Adapted Physical
Education
Specialist (KINE)
Marci Pope
530-898
mpope@csuchico.e
du
Contextual Information
The School of Education offers multiple pathways leading to initial credentials in Single
Subject. Two of the Single Subject programs being offered jointly with the department of
Kinesiology and the College of Agriculture. A 4-year blended math education and credential
program will be offered jointly with the department of mathematics, however, freshman
began the program in fall 2010, but are not yet engaged in any portion of their credential
assessments.
Single Subject: The candidates considered to be part of this program include those in the
regular Single Subject Program, and the internship program. This program and the
internship program admit candidates both fall and spring.
Single Subject Internship: The Internship Program is an alternative pathway to earning a
credential that links the Single Subject Program with employment as a beginning teacher.
Interns take the same set of courses and complete the same assessments as traditional
program candidates. For this reason, assessment data for interns is included with the traditional
Single Subject Program data.
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 22
Single Subject with BCLAD Emphasis: This program prepares candidates to teach in
bilingual/cross-cultural classrooms and in a variety of educational settings with students from
culturally and linguistically diverse backgrounds. Prior to completion of the program leading to a
teaching credential, candidates must demonstrate proficiency in the target language and
knowledge of the target culture. Candidates participate in bilingual/multicultural classrooms and
in classrooms promoting academic language development and conceptual understanding for
linguistically diverse students.
Single Subject Agriculture and Agriculture Specialist: The professional preparation
component of the Single Subject Agriculture Credential is administered by the Department of
Education. The requirements for the Specialist Credential in Agriculture include a series of
agricultural education courses and a student teaching experience. These courses are included
in the Agriscience and Education Option. Student teaching is combined with the student
teaching experience required for the Single Subject Credential in Agriculture. Data for these
candidates are included with those for Single Subject candidates, except for one key
assessment specific to Agriculture Specialist candidates.
Adapted Physical Education Specialist: In order to complete the specialist credential in
adapted physical education, students must obtain or be working toward a credential through a
Single Subject Program that authorizes them to teach physical education. This credential allows
future physical education teachers to instruct individuals with disabilities in the public schools.
Data for these candidates are included with those for Single Subject candidates, except for the
one key assessment specific to Adapted Physical Education Specialist candidates.
Program Specific Candidate Information
Academic Year
Number of Candidates
Number of
Completers/Graduates
Single Subject
2009-2010
124
79
2010-2011
101
54
Single Subject Internship
2009-2010
10
10
2010-2011
2
2
Single Subject – BCLAD
2009-2010
7
4
2010-2011
4
3
Agriculture Specialist
2009-2010
12
8
2010-2011
17
13
Adapted Physical Education Specialist
2009-2010
22
15
2010-2011
25
12
Totals – Single Subject
2009-2010
175
116
2010-2011
149
84
SECTION A – CREDENTIAL PROGRAM SPECIFIC INFORMATION
II. Candidate Assessment/Performance and Program Effectiveness Information
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 23
Part A: Primary Candidate Assessments
Data collected during 2009-2010 and 2010-2011 comes from the following Key Assessments:
Key Assessment #1: Performance Assessment of California Teachers (PACT)
Key Assessment #2: Student Teaching Evaluations
Key Assessment #3: Dispositions Evaluations
Key Assessment #4:
a: Single Subject/Single Subject Intern: Unit Plan
b: Agriculture Specialist: Final Student Evaluation Plan
c: Adapted Physical Education Specialist: APE Portfolio
Key Assessment #1: Performance Assessment of California Teachers (PACT)
The PACT Teaching Event assesses candidate performance in five areas: Planning (P),
Instruction (I), Assessment (A), Reflection (R) and Academic Language (AL). Candidates’
performance in these areas is evaluated on twelve rubrics represented in the charts below.
Candidates submit the PACT Teaching Event during the student teaching (Teaching Practicum
II) semester. Teaching events are evaluated on a 4-point scale. A score of 1 is considered a
failing score.
Please note that no modifications have been made to assessor selection, training or
recalibration since the submission of Standards 19-21 in 2008-2009.
*Note: PACT data reflects the final score after any resubmits for each student.
Single Subject PACT 2009-2010 (n=84)
PACT Element
Mean
Median
Minimum
Maximum
Level 1s
% Failure
P1
2.8
3
1
4
1
1%
Planning
P2
2.6
3
2
4
0
0%
P3
2.7
3
2
4
0
0%
Instruction
I1
I2
2.3
2.3
2
2
1
1
4
4
5
4
6%
5%
Assessment
A1
A2
A3
2.6
2.4
2.5
2.5
2
2
1
1
1
4
4
4
1
7
4
1%
8%
5%
Reflection
R1
R2
2.4
2.5
2
2
1
1
4
4
2
2
2%
2%
Academic
Language
AL1 AL2
2.2
2.4
2
2
1
1
4
4
6
3
7%
4%
Reflection
R1
R2
2.3
2.4
2
2
1
1
4
4
1
2
2%
3%
Academic
Language
AL1 AL2
2.2
2.2
2
2
1
1
4
3
3
3
5%
5%
Single Subject PACT 2010-2011 (n=58)
PACT Element
Mean
Median
Minimum
Maximum
Level 1s
% Failure
Planning
P1
P2
P3
2.8
2.5
2.6
3
2
3
2
1
2
4
4
4
0
1
0
0%
2%
0%
Instruction
I1
I2
2.2
2.3
2
2
1
1
4
4
4
4
7%
7%
Assessment
A1
A2
A3
2.6
2.2
2.4
3
2
2
1
1
1
4
3
4
2
6
4
3% 10%
7%
Bilingual Single Subject PACT 2009-2010 (n=5)
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 24
PACT Element
Mean
Median
Minimum
Maximum
Level 1s
% Failure
P1
2.8
3
2
3
0
0%
Planning
P2
P3
2.6
2.0
3
2
2
1
3
3
0
1
0%
20%
Instruction
I1
I2
2.4
2.2
2
2
2
2
3
3
0
0
0%
0%
Assessment
A1
A2
A3
2.2
1.8
2.0
2
2
2
2
1
2
3
2
2
0
1
0
0%
20%
0%
Reflection
R1
R2
2.2
2.4
2
3
2
1
3
3
0
1
0%
20%
Academic
Language
AL1 AL2
2.0
2.5
2
2.5
2
2
2
3
0
0
0%
0%
Bilingual Single Subject PACT 2010-2011 (n=3)
PACT Element
Mean
Median
Minimum
Maximum
Level 1s
% Failure
Planning
P1
P2
P3
2.7
2.3
2.3
3
2
2
2
2
2
3
3
3
0
0
0
0%
0%
0%
Instruction
I1
I2
2.3
2.0
2
2
2
1
3
3
0
1
0% 33%
Assessment
A1
A2
A3
2.3
2.0
2.0
2
2
2
2
1
1
3
3
3
0
1
1
0% 33% 33%
Reflection
R1
R2
2.3
2.3
2
2
2
2
3
3
0
0
0%
0%
Academic
Language
AL1 AL2
2.0
2.0
2
2
2
2
2
2
0
0
0%
0%
Agriculture Single Subject PACT 2009-2010 (n=10)
PACT Element
Mean
Median
Minimum
Maximum
Level 1s
% Failure
P1
2.6
3
2
3
0
0%
Planning
P2
2.5
2.5
2
3
0
0%
P3
2.6
3
2
3
0
0%
Instruction
I1
I2
2.3
2.2
2
2
1
1
3
3
1
1
10% 10%
Assessment
A1
A2
A3
2.1
2.1
2.5
2
2
2.5
2
1
2
3
3
3
0
1
0
0%
10%
0%
Reflection
R1
R2
2.2
1.9
2
2
1
1
3
3
1
2
10% 20%
Academic
Language
AL1 AL2
2.2
2.2
2
2
2
2
3
3
0
0
0%
0%
Agriculture Single Subject PACT 2010-2011 (n=13)
PACT Element
Mean
Median
Minimum
Maximum
Level 1s
% Failure
Planning
P1
P2
P3
2.6
2.4
2.4
3
2
2
2
2
1
3
3
3
0
0
1
0%
0%
8%
Instruction
I1
I2
2.6
2.6
3
3
2
2
4
4
0
0
0%
0%
Assessment
A1
A2
A3
2.4
2.0
2.3
2
2
2
2
1
1
3
3
3
0
2
1
0% 15%
8%
Reflection
R1
R2
2.4
2.4
2
2
2
2
3
3
0
0
0%
0%
Academic
Language
AL1 AL2
2.2
2.3
2
2
2
2
3
3
0
0
0%
0%
Physical Education Single Subject PACT 2009-2010 (n=15)
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 25
PACT Element
Mean
Median
Minimum
Maximum
Level 1s
% Failure
P1
2.3
2
2
3
0
0%
Planning
P2
2.3
2
2
3
0
0%
P3
2.5
3
2
3
0
0%
Instruction
I1
I2
2.1
2.1
2
2
2
1
3
3
0
2
0%
13%
Assessment
A1
A2
A3
2.2
2.3
2.1
2
2
2
2
1
1
3
3
3
0
2
2
0%
13% 13%
Reflection
R1
R2
2.1
2.1
2
2
1
1
3
3
2
1
13%
7%
Academic
Language
AL1 AL2
2.0
2.0
2
2
1
1
3
3
1
2
7%
13%
Physical Education Single Subject PACT 2010-2011 (n=15)
PACT Element
Mean
Median
Minimum
Maximum
Level 1s
% Failure
Planning
P1
P2
P3
2.3
2.1
2.5
2
2
2
2
1
2
3
3
3
0
1
0
0%
7%
0%
Instruction
I1
I2
2.3
2.1
2
2
2
1
3
3
0
1
0%
7%
Assessment
A1
A2
A3
2.2
2.4
2.3
2
2
2
1
2
2
3
3
3
1
0
0
7%
0%
0%
Reflection
R1
R2
2.1
2.2
2
2
1
2
3
3
2
0
13%
0%
Academic
Language
AL1 AL2
1.9
2.1
2
2
1
2
2
3
1
0
7%
0%
Key Assessment #2: Student Teaching Evaluations
Each program pathway conducts evaluations of candidates in both student teaching semesters.
While all Single Subject pathways base their evaluations on the Teaching Performance
Expectations (TPEs), the BCLAD Single Subject Program organizes the TPEs into the six
domains of the California Standards for the Teaching Profession (CSTPs). Additionally, the
Single Subject Program uses a three-point scale, while the BCLAD Single Subject Program
uses a four-point scale for the evaluations.
Single Subject Field Evaluation Teaching Practicum I, 2009-2010 (n=95)
T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 T11 T12 T13
Mean 2.8 2.7 2.5 2.9 2.8 2.7 2.4 2.7 2.8 2.7 2.7 2.7 2.7
Median
3
3
3
3
3
3
2
3
3
3
3
3
3
Min
1
1
2
2
1
0
1
2
1
0
1
2
2
Max
3
3
3
3
3
3
3
3
3
3
3
3
3
Single Subject Field Evaluation Teaching Practicum I, 2010-2011 (n=100)
T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 T11 T12 T13
Mean 2.8 2.6 2.5 2.7 2.6 2.7 2.3 2.6 2.7 2.7 2.6 2.7 2.7
Median
3
3
3
3
3
3
2
3
3
3
3
3
3
Min
1
1
1
1
1
1
1
1
1
1
1
1
1
Max
3
3
3
3
3
3
3
3
3
3
3
3
3
Single Subject Field Evaluation Teaching Practicum II, 2009-2010 (n=110)
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 26
T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 T11 T12 T13
Mean 2.9 2.9 2.7 2.9 2.9 2.9 2.7 2.9 2.9 2.8 2.8 2.9 2.8
Median
3
3
3
3
3
3
3
3
3
3
3
3
3
Min
1
2
2
2
2
2
2
2
2
2
2
2
2
Max
3
3
3
3
3
3
3
3
3
3
3
3
3
Single Subject Field Evaluation Teaching Practicum II, 2010-2011 (n=78)
T1 T2 T3 T4 T5 T6 T7 T8 T9 T10 T11 T12 T13
Mean 2.8 2.7 2.6 2.8 2.8 2.7 2.4 2.8 2.7 2.8 2.7 2.8 2.8
Median
3
3
3
3
3
3
2
3
3
3
3
3
3
Min
2
2
2
2
1
2
1
1
2
2
1
2
2
Max
3
3
3
3
3
3
3
3
3
3
3
3
3
Bilingual Single Subject Field Evaluations, 2009-2010
Teaching Practicum I (n=7)
Teaching Practicum II (n=5)
Domain F TPEs 12, 13
Domain E TPEs 10, 11
Domain D TPEs 8, 9
TPEs 4, 5, 6,
7
Domain C
TPE 1
Domain B TPEs 2, 3
Domain A
Domain F TPEs 12, 13
Domain E TPEs 10, 11
Domain D TPEs 8, 9
TPEs 4, 5, 6,
7
Domain C
TPE 1
Domain B TPEs 2, 3
Domain A
Mean
2.4
2.3
2.4
2.3
2.6
2.3
Mean
3.0
3.0
3.0
3.0
2.8
2.8
Median
2
2
2
2
3
2
Median
3
3
3
3
3
3
Min
2
2
2
2
2
2
Min
2
2
2
2
2
2
Max
3
3
3
3
3
3
Max
4
4
4
4
3
3
Bilingual Single Subject Field Evaluations, 2010-2011
Teaching Practicum I (n=3)
Teaching Practicum II (n=3)
Domain F TPEs 12, 13
Domain E TPEs 10, 11
Domain D TPEs 8, 9
TPEs 4, 5, 6,
7
Domain C
TPE 1
Domain B TPEs 2, 3
Domain A
Domain F TPEs 12, 13
Domain E TPEs 10, 11
Domain D TPEs 8, 9
TPEs 4, 5, 6,
7
Domain C
TPE 1
Domain B TPEs 2, 3
Domain A
Mean
2.8
2.6
2.7
2.8
2.7
3.0
Mean
3.7
3.3
3.7
3.3
3.3
3.3
Median
3
3
3
3
3
3
Median
4
3
4
3
3
3
Min
2
2
2
2
2
2
Min
4
3
4
3
3
3
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 27
Max
3
3
3
3
3
4
Max
4
4
4
4
4
4
Key Assessment #3: Dispositions Evaluations
The dispositions are based on the unit’s conceptual framework and the ten principles of the
INTASC standards. The five dispositions focus on (D1) diversity, (D2) support for all students,
(D3) life-long learning, (D4) collaboration, and (D5) democratic values. The rubric, designed by
a group of public school teachers and university supervisors, describes specific behaviors
associated with each of the five dispositions.
Single Subject Dispositions, 2009-2010
Teaching Practicum I (n=95)
D1
D2
D3
D4
Teaching Practicum II (n=109)
D5
D1
D2
D3
D4
D5
Mean
2.8
2.9
2.7
2.7
2.8
Mean
2.9
2.9
2.9
2.8
2.9
Median
3
3
3
3
3
Median
3
3
3
3
3
Min
2
1.5
1.5
2
2
Min
2
2
1
2
1
Max
3
3
3
3
3
Max
3
3
3
3
3
Single Subject Dispositions, 2010-2011
Teaching Practicum I (n=99)
D1
D2
D3
D4
Teaching Practicum II (n=78)
D5
D1
D2
D3
D4
D5
Mean
2.6
2.8
2.7
2.7
2.8
Mean
2.9
2.9
2.8
2.8
2.8
Median
3
3
3
3
3
Median
3
3
3
3
3
Min
1
1
1
1
1
Min
2
2
2
1
2
Max
3
3
3
3
3
Max
3
3
3
3
3
Bilingual Single Subject Dispositions, 2009-2010
Teaching Practicum I (n=7)
D1
D2
D3
Teaching Practicum II (n=5)
D4
D5
D1
D2
D3
D4
D5
Mean
2.6
2.6
2.3
2.4
2.4
Mean
3.0
2.8
2.8
2.8
2.8
Median
2
3
2
2
2
Median
3
3
3
3
3
Min
2
2
2
2
2
Min
2
2
2
2
2
Max
4
3
3
3
3
Max
4
3
3
3
3
Bilingual Single Subject Dispositions, 2010-2011
Teaching Practicum I (n=3)
D1
D2
D3
Teaching Practicum II (n=3)
D4
D5
D1
D2
D3
D4
D5
Mean
3
3
3
3
3
Mean
4
4
4
3.5
3.5
Median
3
3
3
3
3
Median
4
4
4
3
3
Min
2
2
2
2
2
Min
4
3
3
3
3
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 28
Max
4
4
4
4
4
Max
4
4
4
4
4
Key Assessment #4A: Single Subject Unit Plan
Students write a unit plan for EDTE 533: Subject Area Pedagogy I, a course that runs
concurrently with the Practicum I teaching experience. The assessment measures candidates’
ability to: 1) plan a series of coherent lessons aligned with state academic content standards; 2)
write and align unit goals, objectives, and assessments, 3) design formative and summative
assessments, 4) apply varied and appropriate instructional strategies, 5) and apply SDAIE
strategies to support ELLs. The unit is evaluated using 13 performance items (e.g., rationale,
goals, objectives, assessments) and candidates earn a score out of 100 points.
Single Subject Unit Plan
2009-2010 (n=91)
89.8
90
78
100
Mean
Median
Min
Max
2010-2011 (n=102)
89.5
89.5
70
100
Key Assessment #4B: Agriculture Specialist: Final Student Evaluation
This instrument is one of the summative evaluations for the Agricultural Specialist program
completers. The instrument is completed by the lead cooperating teacher at the Practicum
student teaching site at the end of the semester and submitted along with the other assessment
documents required.
The instrument is organized into nine sections including:
 Productive Teaching Techniques (PTT)
 Effective Classroom Management (ECM)
 Positive Interpersonal Relationships (PIR)
 Professional Responsibility (PR)
 Future farmers of America (FFA)
 Supervised Agricultural Experience Program (SAEP)
 Department Management (DM)
 Personality and Personal Characteristics (PPC)
 Technical Knowledge (in animal and plant sciences, agricultural mechanics, ornamental
horticulture, natural resources/forestry, and agribusiness) (TK)
For each competency, the candidate is rated on a Likert scale with 4 = Exceptional, 3 = Strong,
2 = Satisfactory, 1 = Weak, and NA = Not Applicable. The candidate must score at least a
satisfactory on all competencies.
Agriculture Final Student Teacher Evaluation Form (2009-2010)
Key Assessment Section
n= 9
Mean
PTT
3.4
ECM
3.5
PIR
3.8
PR
3.7
FFA
3.4
SAEP
3.0
DM
3.0
PPC
3.7
TK
3.0
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 29
Median
3
4
4
4
3
3
3
4
3
Min
2
2
3
3
3
3
3
2
2
Max
4
4
4
4
4
4
4
4
4
Agriculture Final Student Teacher Evaluation Form (2010-2011)
Key Assessment Section
n= 13
PTT
ECM
PIR
PR
FFA
SAEP
DM
PPC
TK
Mean
3.7
3.6
3.7
3.7
3.6
3.5
3.2
3.8
3.2
Median
4
4
4
4
4
4
3
4
3
Min
2
1
2
1
1
2
2
1
2
Max
4
4
4
4
4
4
4
4
4
Key Assessment #4C: Adapted Physical Education Specialist: APE Portfolio
Semester
completed
Fall 09
Exemplary
5
Met
Criteria
0
Still in
Progress
3
Spring 10
6
6
6
Fall 10
Spring 11
1
2
3
3
5
8
Comments
3/3 in progress completed
S-10. Numbers in Spring 10
reflect those completing that
semester.
2/6 in progress complete. 1
in F -10, 1 in S-11
Part B: Additional information about candidate and program completer performance or
program effectiveness
Assessment #5: CSU System-wide Exit Survey
Assessment #6: CSU System-wide Evaluation of first year teachers
Assessment #5: CSU System-wide Exit Survey
Beginning in Fall 2005, all campuses within the California State University (CSU) system have
participated in a system-wide exit survey of initial credential program graduates. At CSU, Chico
participation in the survey is a requirement for all credential program completers. Each year, the
CSU Center for Teacher Quality provides the individual campuses aggregated data
electronically preformatted with statistical computations complete. The data below reflect the
responses of 2009-10 and 2010-11 completers from all single subject program pathways
combined.
SS Teacher Preparation Exit Survey
As a new teacher, I am (choose preparedeness level) ...
Well or
Adequately
Prepared
2009- 2010-
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 30
...to prepare lesson plans and make prior arrangements for students' class
activities.
...to organize and manage student behavior and discipline satisfactorily.
...to meet the instructional needs of students who are English language
learners.
...to meet the instructional needs of students from diverse cultural
backgrounds.
...to meet the instructional needs of students with special learning needs.
...to learn about my students' interests and motivations, and how to teach
accordingly.
...to use computer-based technology to help students learn subjects of the
curriculum.
...to assess pupil progress by analyzing a variety of evidence including exam
scores.
...to know about resources in the school & community for at-risk students and
families.
...to evaluate and reflect on my own teaching and to seek out assistance that
leads to professional growth.
...to know and understand the subject(s) in which I earned my teaching
credential(s).
...to teach my primary subject according to State Academic Standards in my
grade(s)
...to contribute to students' reading skills including comprehension in my
subject area.
10
11
100%
90%
97%
76%
97%
79%
96%
90%
82%
68%
97%
89%
80%
74%
96%
82%
87%
76%
93%
100%
100%
97%
100%
97%
93%
n=30
92%
n=38
Assessment #6: CSU System-wide Evaluation of First Year Teachers
The CSU System-wide Evaluation of Teacher Preparation, administered by the Center for
Teacher Quality, provides the results of surveys administered to both graduates of initial
credential programs completing their first year as in-service teachers and their employers on
their perceptions of the quality of preparation they received in their programs. The results for
each campus are provided as composite scores on groups of questions substantively related to
each other. The data below reflect the responses of 2007-08 and 2008-09 program completers
from all single subject program pathways combined. Shading indicates teacher and supervisor
responses on like items.
CSU System-wide Survey One-Year Out: Single Subject Supervisors and First Year
Teachers From CSU-Chico Composite Graphs
Graduating Year
200820092009
2008-2009 2010
2009-2010
CSU,
SystemCSU,
System% Adequately or Well Prepared
Chico
wide
Chico
wide
Secondary Supervisors Assess
the Overall Effectiveness of CSU
Single Subject Credential
Data Not Data Not
Supervisor Programs
86%
80%
Available Available
First-Year Single Subject
Data Not Data Not
Teacher
Teachers Assess the Overall
86%
77%
Available Available
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 31
Supervisor
Teacher
Supervisor
Teacher
Supervisor
Teacher
Supervisor
Teacher
Supervisor
Teacher
Supervisor
Teacher
Supervisor
Effectiveness of Their CSU
Credential Programs
Secondary School Supervisors
Assess CSU Preparation of Single
Subject Teachers of English (712)
Single Subject Teachers of
English Assess Their CSU
Preparation for English Instruction
(7-12)
Secondary School Supervisors
Assess CSU Preparation of Single
Subject Teachers of Math (7-12)
Single Subject Teachers of Math
Assess Their CSU Preparation for
Math Instruction (7-12)
Secondary School Supervisors
Assess CSU Preparation of Single
Subject Teachers of Science (712)
Single Subject Teachers of
Science Assess Their CSU
Preparation for Science
Instruction (7-12)
Secondary School Supervisors
Assess CSU Preparation of Single
Subject Teachers of History (7-12)
Single Subject Teachers of
History Assess Their CSU
Preparation for History Instruction
(7-12)
Secondary School Supervisors
Assess CSU Preparation to Teach
Subjects Other than Four Core
Subjects (7-12)
Single Subject Teachers Assess
Their CSU Preparation to Teach
Subjects Other than Four Core
Subjects (7-12)
Secondary School Supervisors
Assess CSU Preparation to
Develop Reading Skills in Content
Classes (7-12)
Single Subject Teachers Assess
Their CSU Preparation to Develop
Reading Skills in Content Classes
(7-12)
School Supervisors Assess CSU
Preparation of Teachers to Plan
Instruction
89%
91%
Data Not
Available
Data Not
Available
83%
78%
Data Not
Available
Data Not
Available
100%
85%
Data Not
Available
Data Not
Available
91%
84%
Data Not
Available
Data Not
Available
85%
Data Not
Available
Data Not
Available
N/A
83%
Data Not
Available
Data Not
Available
87%
93%
Data Not
Available
Data Not
Available
91%
83%
Data Not
Available
Data Not
Available
93%
91%
Data Not
Available
Data Not
Available
88%
88%
Data Not
Available
Data Not
Available
78%
75%
Data Not
Available
Data Not
Available
78%
74%
Data Not
Available
Data Not
Available
85%
Data Not
Available
Data Not
Available
N/A
93%
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 32
Teacher
Supervisor
Teacher
Supervisor
Teacher
Supervisor
Teacher
Supervisor
Teacher
Supervisor
Teacher
Supervisor
Teacher
Supervisor
Teacher
Supervisor
First-Year Teaching Graduates of
the CSU Assess Their Preparation
to Plan Instruction
School Supervisors Assess CSU
Preparation of Teachers to
Motivate Students
First-Year Teaching Graduates of
the CSU Assess Their Preparation
to Motivate Students
School Supervisors Assess CSU
Preparation of Teachers to
Manage Instruction
First-Year Teaching Graduates of
the CSU Assess Their Preparation
to Manage Instruction
School Supervisors Assess CSU
Preparation of Teachers to Use
Education Technology
First-Year Teaching Graduates of
the CSU Assess Their Preparation
to Use Education Technology
School Supervisors Assess CSU
Preparation of Teachers for
Pedagogy Across the Curriculum
First-Year Teaching Graduates of
the CSU Assess Their Preparation
for Pedagogy Across the
Curriculum
School Supervisors Assess CSU
Preparation of Teachers to
Assess and Reflect on Instruction
First-Year Teaching Graduates of
the CSU Assess Their Preparation
to Assess and Reflect on Their
Instruction
School Supervisors Assess CSU
Preparation of Teachers for Equity
and Diversity in Teaching
First-Year Teaching Graduates of
the CSU Assess Their Preparation
for Equity and Diversity in
Teaching
Middle-Grade Supervisors Assess
CSU Preparation of Teachers to
Teach Middle-Grade Pupils (4-8)
Teaching Graduates in Grades 48 Assess Their CSU Preparation
to Teach Middle-Grade Students
High School Supervisors Assess
92%
81%
Data Not
Available
Data Not
Available
85%
80%
Data Not
Available
Data Not
Available
86%
78%
Data Not
Available
Data Not
Available
82%
81%
Data Not
Available
Data Not
Available
90%
76%
Data Not
Available
Data Not
Available
99%
90%
Data Not
Available
Data Not
Available
82%
68%
Data Not
Available
Data Not
Available
87%
83%
Data Not
Available
Data Not
Available
86%
78%
Data Not
Available
Data Not
Available
92%
81%
Data Not
Available
Data Not
Available
86%
78%
Data Not
Available
Data Not
Available
80%
77%
Data Not
Available
Data Not
Available
81%
74%
Data Not
Available
Data Not
Available
99%
81%
Data Not
Available
Data Not
Available
89%
85%
79%
80%
Data Not
Available
Data Not
Data Not
Available
Data Not
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 33
CSU Preparation of Teachers to
Teach High School Students (912)
Single Subject Teachers in
Grades 9-12 Assess Their CSU
Preparation to Teach High School
Teacher
Students
School Supervisors Assess CSU
Preparation of Teachers to Teach
Supervisor English Learners
First-Year Teaching Graduates of
the CSU Assess Their CSU
Preparation to Teach English
Teacher
Learners
School Supervisors Assess CSU
Preparation of MS-SS Teachers to
Teach Special Learners in
Supervisor Inclusive Schools
First-Year MS-SS Teachers
Assess Their CSU Preparation to
Teach Special Learners in
Teacher
Inclusive Schools
CSU Teachers Assess the Overall
Value of Professional Coursework
Teacher
in Their First Year of Teaching
CSU Teachers Assess the Overall
Value of Credential Program
Fieldwork in Their First Year of
Teacher
Teaching
Available
Available
87%
76%
Data Not
Available
Data Not
Available
84%
78%
Data Not
Available
Data Not
Available
82%
76%
Data Not
Available
Data Not
Available
81%
77%
Data Not
Available
Data Not
Available
82%
73%
Data Not
Available
Data Not
Available
86%
79%
Data Not
Available
Data Not
Available
89%
81%
Data Not
Available
Data Not
Available
SECTION A – CREDENTIAL PROGRAM SPECIFIC INFORMATION
II.
Analysis of Candidate Assessment Data
The following analysis of data includes all pathways in the Single Subject Program. All
assessments except for Key Assessment 4 are common to the various pathways.
Performance Assessment of California Teachers (PACT)
The overall event pass rate on the first submission for candidates across all Single Subject
pathways was 87.1% in 2009-10 and 96.6% in 2010-11. Including successful resubmissions,
the pass rate was 97.4% in 2009-10 and 98.9% in 2010-11. The data shown in Section A II
includes scores for each candidate’s successful attempt. The Action Plan discusses plans to
include first attempt failures in the data set.
Overall candidates show competence in Planning, Instruction, Reflection and Academic
Language with failure rates from 0-6% across all PACT categories. While results vary across
programs, one area of challenge is indicated by scores on rubric A2: Using Assessment to
Inform Instruction, with 9.65% failing this section in 2009-10 and 10.65% failing this section in
2010-11. This area will be addressed in the Institutional Summary and Plan of Action.
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 34
Student Teaching Evaluations
Across all programs, candidates show growth on TPEs over the course of the two teaching
practica and are able to demonstrate proficiency across the competencies by the end of the
second practicum. In the Single Subject Programs in 2009-10, students show improvement
in TPE 7 Teaching English Learners, with candidates scoring 2.4 in Practicum I and a 2.7 in
Practicum II. Gains were more modest for TPE 7 in 2010-11, with Practicum I candidates
scoring a 2.3 and PII candidates scoring a 2.4.
The use of a three-point rubric allows for inadequate discrimination among candidates in
Student Teaching Evaluations. This issue will be addressed in the subsequent Institutional
Summary and Plan of Action.
Dispositions Evaluations
While areas of initial strength and weakness vary across pathways, data show some candidate
growth across all dispositions over the course of their preparation. These data show that in all
programs, evaluators observed behaviors that indicated well-developed dispositions early in
their credential programs. These dispositions continued to develop through the program. The
data show no consistent area of challenge among pathways.
The use of a three-point rubric allows for inadequate discrimination among candidates in
Disposition Evaluations. This issue will be addressed in the subsequent Action Plan.
Key Assignment 4
Single Subject Unit Plan
For 2009-2010 and 2010-2011, the mean score for the unit plan was 89.5% out of 100%. These
scores indicate that students are able to develop comprehensive unit plans that meet the needs
of diverse students. However, the single mean score tells us little about the variation on
different aspects of the unit plan. This issue will be addressed in the Institutional Summary and
Plan of Action.
Agriculture Specialist: Final Student Evaluation
Overall, cooperating teachers indicated Ag Specialist candidates demonstrated strong to
exceptional competence in all areas addressed on the Agricultural Specialist: Final Evaluation
Plan in 2010 – 2011. The range of the means for the nine areas was from 3.2 (3.0 = strong) to
3.7 (4.0 = exceptional). Especially encouraging was the fact that improvement was made from
the 2009 - 2010 to the 2010 – 2011 year, in all areas except “Positive Interpersonal relationships
(PIR) with the mean decreased by only one tenth (3.8 to 3.7). Two areas in which the program
faculty will continue to focus are Departmental Management and Technical Knowledge,
specifically in the areas of Ornamental Horticulture and Agricultural Mechanics.
Adapted Physical Education Specialist: APE Portfolio
For 2009-2010 all completers met criteria or were exemplary in their ability to show competency
to write comprehensive assessment reports in the field. An assessment report is one of the
components of the portfolio. All students must meet acceptable criteria for each competency to
obtain an authorization for an adapted physical education credential. Portfolios are reviewed by
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 35
Adapted Physical Education program staff and faculty at the completion of their teaching
practicum. Data from the APE portfolio could be made more powerful by evaluating a student
competency on each section of the portfolio instead of evaluating the portfolio as a whole. This
could yield more specific information from data collection showing areas of need.
CSU System-wide Exit Survey
Data indicate that graduates of our Single Subject Programs are confident that they are
prepared to address most of the challenges of teaching. In 2010-2011, 100% of students felt
adequately or well prepared to reflect on their teaching. Ninety-seven percent felt adequately or
well prepared to plan lessons, to teach in their subject areas, and to teach according to the
California content standards.
Whereas the data for 2009-10 overall indicate strong confidence among candidates as they
leave their single subject programs to address most of the challenges of secondary teaching,
the scores indicate less confidence in 2010-11 for almost all categories. Meeting the needs of
students with special learning needs appears to be one area of weakness, with 68% of the
students rating themselves adequately to well prepared in this area. This area will be addressed
in the Action Plan.
CSU System-wide Evaluation of First Year Teachers
Overall, the percentages of supervisors rating graduates as adequately to well prepared are
near the average for the CSU System. Comparing the two years of data, the responses from
the First Year Teachers show decreases in the percent of teachers feeling prepared in almost
all categories. However, Supervisors tended to rate preparedness higher than First Year
Teachers in almost all categories. According to responses by First Year Teachers, the biggest
areas for improvement appear to be in Preparation to Use Education Technology (68% in 201011) and Preparation to Teach Special Learners in Inclusive Schools (73% in 2010-11).
SECTION A – CREDENTIAL PROGRAM SPECIFIC INFORMATION
PART IV: Use of Assessment Results to Improve Candidate and Program Performance
Unit Action Plan
As a unit, program pathway coordinators met and identified nine common Student Learning
Outcomes (SLOs) based upon California Teaching Expectations, and the conceptual
framework, mission and vision of the School of Education. Each program analyzed data from six
data sources, and identified strengths and areas for improvement. The coordinators met and
reached consensus on areas for improvement common to all pathways in the unit. The Unit
Action Plan shows goals and plans of action for each goal. If applicable, individual pathways
have attached specific pathway action plans as addendums to the Unit Action Plan.
Unit Goal 1: Candidates effectively support students with special needs
in inclusive classrooms.
Data Source
Plan of Action or Proposed Changes Made


Exit survey
Hold Curriculum Committee meetings to articulate ways
Applicable
Program or
Common
Standard(s)
TPE 4,5,6
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 36

CSU survey





in which coursework currently supports teaching
students with special learning needs across initial
credential pathways.
Incorporate a systematic use of IRIS modules in
coursework and train faculty in use of the modules.
Involve education specialist faculty, k-12 teachers and
master’s students in bringing education specialist
content to prepare general educators to work in
inclusive classrooms.
Revise course delivery to pair general education faculty
with education specialist faculty to 1) seamlessly
integrate methods that teach students with special
learning needs and 2) model co-teaching that occurs in
inclusive delivery models.
Hold an Assistive Technology Faire for all credential
candidates to learn about new assistive technologies
and their appropriate use.
Strengthen the special needs section of the field
observation form so that teaching behaviors that
support special learners will be more clearly identified in
the field.
(SLO 7)
Disp 1
Unit Goal 2: Candidates use a variety of formative and summative assessments to
determine pupils’ progress, provide feedback and plan instruction.
Data Source
Plan of Action or Proposed Changes Made
PACT rubric

items A1, A2 and
A3



Hold Curriculum Committee meetings to articulate ways
in which coursework currently supports helping
candidates use a variety of formative and summative
assessments to inform instruction, and identify
additional course components that strengthen the
assessment strand.
In coursework, create communities of practice in which
candidates examine k-12 student work for evidence of
student learning.
Create additional assignments asking candidates to
bring their student work to class to analyze for patterns
of student learning. Provide models of effective verbal
and written feedback and guidance in determining next
instructional steps.
In fieldwork, modify supervision observation form to
include indicators for 1) use of student work as
evidence of student learning and 2) providing feedback
Applicable
Program or
Common
Standard(s)
TPE 2,3
(SLO 2)
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 37



to students. Focus on these indicators at postobservation conferences.
Supervision focus on how ST provide feedback to
students
Provide supervisors with professional development
about using student work as evidence of teaching
effectiveness.
Confer with other universities regarding best practices
for observation practices that focus on K-12 student
learning outcomes.
Adapted Physical Education Program improvements to be implemented:
As of July 2011, the CTC accepted new standards for the added authorization to teach adapted
physical education. These new standards will be used to evaluate the Adapted Physical
Education program and candidates in the future. The program is currently transitioning to the
new standards for Fall 2012. Data from the APE portfolio could be made more powerful by
evaluating a student competency on each section of the portfolio instead of evaluating the
portfolio as a whole. This could yield more specific information from data collection showing
areas of need.
Agriculture Specialist Program improvements to be implemented:
Since the February 2011 submission, the program continues to work on enhancing of curriculum
in Horticulture and Agricultural Mechanics by addition of a teaching methods in horticulture
course, offering a short course in Basic Welding, and assuring that the courses including in the
Subject Matter Competency waiver program adequately prepares our students. A second area
of focus is the coordination of methods courses, as the program currently offers three methods
courses, taught by three different instructors, we have begun meeting on several occasions to
coordinate curriculum, minimize duplication of efforts and emphasize key outcomes.
EDUCATION SPECIALIST CREDENTIAL PROGRAM
SECTION A – CREDENTIAL PROGRAM SPECIFIC INFORMATION
I – Contextual Information
Credentials awarded: Education Specialist Level I (Mild/Moderate)
Education Specialist Level I (Moderate/Severe)
Education Specialist Level II (Mild/Moderate)
Education Specialist Level II (Moderate/Severe)
Program Contacts: Dr. Michelle Cepello
530-898-6281
mcepello@csuchico.edu
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 38
Contextual Information
The Preliminary Level I Education Specialist Program Prepares candidates to teach
students with Mild to Moderate (M/M) or Moderate to Severe (M/S) disabilities. Within this
program, candidates can complete their field experience in a variety of pathways that best meet
program competencies and candidates’ individual goals in an authentic setting. Each of these
pathways provides a highly structured, organized and sequential learning experience.
The Level II Education Specialist Program is typically a one-year program that can be
completed anytime during a five-year period after the candidate begins teaching under the Level
I Preliminary Credential. Due to this five-year range of completion, enrollment in courses and
completion numbers fluctuate. Candidates complete the program with either a Level II
Mild/Moderate or Moderate/Severe Education Specialist Credential. Employers are responsible
for verification of Level II Competencies as applied to the field. In June 2010, all candidates
admitted to the Level II program were notified in writing that they would need to complete
program requirements by Spring 2011. This notification resulted in an increase of number of
candidates and completers in comparison to the previous 07-08 and 08-09 Biennial data. A
record of those students who completed program requirements before Fall 2011 has been
maintained and completed candidate files have been sent to the Credential Analyst for her
review for credential recommendation. It is our understanding that as of Fall 2011 candidates
will no longer be enrolled in the Level II Education Specialist Program or recommended for the
credential. A written request for approval to withdraw the Level II Education Specialist Program
was submitted to the Commission on August 15, 2010.
Academic Year
2009-2010
2010-2011
2009-2010
2010-2011
2009-2010
2010-2011
2009-2010
2010-2011
Program Specific Candidate Information
Number of Candidates
Number of
Completers/Graduates
Education Specialist Level I (Mild/Moderate)
29
14
29
13
Education Specialist Level I (Moderate/Severe)
21
12
29
19
Education Specialist Level II (Mild/Moderate )
28
10
14
14
Education Specialist Level II (Moderate/Severe)
5
1
5
5
SECTION A – CREDENTIAL PROGRAM SPECIFIC INFORMATION
II.
Candidate Assessment/Performance and Program
Part A: Primary Candidate Assessments
A. PRELIMINARY LEVEL I EDUCATION SPECIALIST INTERN PROGRAM
Data collected during 2009-11 comes from the following Key Assessments:
Key Assessment #1: Education Specialist Portfolio
Key Assessment #2: Field Evaluations
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 39
Key Assessment #3: Dispositions Evaluations
Key Assessment #1: Level I Education Specialist Portfolio
Candidates submit a summative electronic portfolio that is completed at the end of their
Education Specialist Program. The portfolio includes six Key Assessments and candidates are
evaluated on them using a three-point rubric: Level 1: Needs Improvement; Level 2: Meets
Requirements; Level 3: Exceeds Requirements. A score of Level 2 is passing.
KA1: Making Subject Matter Comprehensible to Students:
Assessment 1 in the portfolio includes a sequence of three lesson plans that are developed in
the creation of a Service Learning Project.
KA2: Assessing Student Learning:
Assessment 2 in the portfolio includes an Assessment Case Study that documents how
baseline assessment data was gathered, analyzed, and applied to individualized instruction.
The purpose is to demonstrate of knowledge about assessment and to implement formal and
informal assessments.
KA3: Engaging and Supporting Students in Learning:
Assessment 3 in the portfolio asks candidates to apply the Sheltered Instruction Observation
Protocol (SIOP) data in three lesson plans. These plans demonstrate the ability of candidates to
infuse technology for students with special needs into the classroom setting.
KA4: Planning Instruction and Designing Learning Experiences for Students:
Assessment 4 in the portfolio is a Field Experience and Analysis Reflection that includes a
selection and reflection of 3-5 key lessons that represent a concept or skill that is taught from
beginning to end.
KA5: Creating and Maintaining Effective Environments for Student Learning:
Assessment 5 in the portfolio is a classroom management synthesis that demonstrates each
candidate’s ability to analyzing students’ behavioral needs and developing a Behavior
Intervention Plan (BIP).
KA6: Developing as a Professional Educator:
Assessment 6 is a descriptive account of professional growth made during the program. In it,
candidates connect professional growth in home, school and community relationships in general
and special education to two Education Specialist Standards.
Table A.1 depicts the number of candidates who exited and the number of candidates achieving
at each level. All Key Assessments were scored using an individual assessment, three point
rubric. Table cells indicate how many candidates scored at that rubric level. The “R1” indicates
that there was one student who scored at Level 1 in KA4, but after a successful resubmit, the
candidate’s scores were added to the composite results.
Table A.1: Key Assessments Results KA1- KA6 - 2009-10
N= 26
Level 3
Level 2
R=Resubmit
KA-1
KA-2
7 (27%)
7 (27%)
Level 1
19 (73%)
19 (73%)
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 40
KA-3
KA-4
KA-5
KA-6
5 (19%)
4 (15%)
5 (19%)
7 ( 27%)
21 (81%)
22 (85%)
21 (81%)
19 (73%)
R1
Table A.2 records the number of candidates who exited and the number of candidates achieving
at each level. Table cells indicate how many candidates scored at that level initially and then
added the candidates scoring at that level after one resubmit. All Key Assessments are scored
using a three-point rubric.
Table A.2: Key Assessments Results KA1- KA6 - 2010-2011
N=30
Level 3
Level 2
Level 1
R=Resubmit
KA-1
8 (27%)
22(73%)
KA-2
7 (23%)
23 (77%)
KA-3
6 (20%)
24 (80%)
KA-4
4 (13%)
26 (87%)
KA-5
7 (23%)
23 (77%)
KA-6
7 (23%)
23 (77%)
Please note that the total number of assessed candidates (30) does not match the total
completers (32) listed in the Program Specific Candidate Information table. Two of these
completers were pursuing both a M/M and M/S credential and submitted one portfolio that
addressed the Key Assessments.
Key Assessment #2: Field Evaluations
Duration of the Internship varies from one to two years based on the candidate’s prior
experience and individual rate of professional development. Table A.3 reflects university
supervisors’ ratings of candidate performance at the end of the candidates’ program year 20092010. Ratings are based on Level I Education Specialist Standards. Table A.4 reflects
university supervisor’s ratings of candidate performance based on TPE Domains that address
revised Education Specialist Standards.
Table A.3: Field Evaluation Results - 2009-10
Standard 10
Professional,
Legal and Ethical
Practice
1
(4%)
21
(81%)
Total Completed
Exceptional
Practice
Level 4
Proficient
Practice
Level 3
Novice Practice
Level 2
N= 26
MM= 14
MS= 12
Field Evaluations 2009-10
Below Novice
Practice
Level I
Level I
Education
Specialist
Program
Mild/Moderate and
Moderate/Severe
5
(19%)
26
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 41
Standard 12
Educating Diverse
Learners
Standard 13
Spec Ed Field Ex
with Diverse
Learners
Standard 15
Managing
Learning
Environments
Standard 16
Effective
Communication &
Collaborative
Partnerships
Standard 17
Assessment,
Curriculum &
Instruction
Standard 22
Assessment &
Eval of Students
Standard 23
Planning &
Implementing C&I
Standard 24
Positive Behavior
Supports
Standard 25
Characteristics &
Needs of Indiv w
/M/M Disabilities
Standard 25
Communication &
Social Networks
(M/S)
Standard 26
C&I (M/S)
Standard 27
Movement,
Mobility, Sensory
& Spec. Health
Care (M/S)
2
(8%)
20
(77%)
4
(15%)
26
2
(8%)
20
(77%)
4
(15%)
26
2
(8%)
15
(58%)
9
(34%)
26
2
(8%)
22
(84%)
2
(8%)
26
2
(8%)
21
(81%)
3
(11%)
26
2
(8%)
22
(84%)
2
(8%)
26
2
(8%)
21
(81%)
3
(11%)
26
2
(8%)
18
(69%)
6
(23%)
26
1
(7%)
9
(64%)
4
(29%)
14
(M/M only)
2
(17%)
9
(75%)
1
(8%)
12
(M/S only)
2
(17%)
6
(50%)
4
(33%)
12
(M/S only)
2
(17%)
8
(66%)
2
(17%)
12
(M/S only)
Table A.4: Field Evaluation Results - 2010-2011
Level I
Education
Field Evaluations 2010-2011
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 42
Total Completed
Exceptional Practice
Level 4
Proficient Practice
Level 3
Novice Practice
Level 2
N= 32
M/M = 13
M/S = 19
PS=Program
Standard
M/M = Mild/Mod
Stand
M/S=Mod/Sev
Stand
Domain A: Making
Subject Matter
Comprehensible
PS 9;M/M3,5; MS4
Domain B:
Assessing
Student Learning
PS 5; M/M 2;M/S
2,4
Domain C:
Engaging and
Supporting
Students
PS 3,6,10;M/M 5;
M/S 2,3,5
Domain D:
Planning
Instruction/Learni
ng
PS 6,11; M/M 1,3,5;
M/S 1,2,4,8
Domain E:
Creating Effective
Learning
Environments
PS 6;M/M 4; M/S
3,6
Domain F:
Developing as an
Educator
PS 2
Domain G (not
TPE)
Collaboration &
Case Management
PS 4,7,8; M/M
Below Novice Practice
Level I
Specialist
Program
Mild/Moderate and
Moderate/Severe
1
(3%)
19
(59%)
12
(38%)
32
2
(6%)
20
(63%)
10
(31%)
32
1
(3%)
16
(50%)
15
(47%)
32
1
(3%)
20
(63%)
11
(34%)
32
1
(3%)
18
(56%)
13
(41%)
32
1
(3%)
18
(56%)
13
(41%)
32
21
(66%)
11
(34%)
30
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 43
6;M/S 7
Key Assessment #3: Dispositions
Duration of the Internship varies from one to two years based on the candidate’s prior
experience and individual rate of professional development. Table A.5 and Table A.6 reflect
university supervisors’ ratings of candidate dispositions at the end of the candidates’ program
year for years 2009-2010 and 2010-2011 respectively.
Candidate Dispositions
Professional Dispositions
Disposition 1 (D1) = Appreciates and values human diversity
Disposition 2 (D2) = Believes all children can learn
Disposition 3 (D3) = Is committed to continuous self-directed learning and reflective
practice
Disposition 4 (D4) = Takes pride in the education profession
Disposition 5 (D5) = Is committed to the use of democratic values
Table A.5: Results of Disposition Evaluations - 2009-10
Education Specialist Level I Disposition Evaluations, 2009-10 (N=26)
N= 26
Below
Novice
Novice
Proficient
Exceptional Total
Practice
Practice
Practice
Practice
Level I
Level 2
Level 3
Level 4
D1
2 (8%)
10 (38%)
14 (53%)
26
D2
2 (8%)
7 (32%)
17 (65%)
26
D3
2 (8%)
8 (31%)
16 (61%)
26
D4
2 (8%)
9 (35%)
15 (57%)
26
D5
2 (8%)
9 (35%)
15 (58%)
26
Table A.6: Results of Disposition Evaluations - 2010-2011
Education Specialist Level I Disposition Evaluations, 2008-09 (N=32)
N= 32
Below
Novice
Novice
Proficient
Exceptional Total
Practice
Practice
Practice
Practice
Level I
Level 2
Level 3
Level 4
D1
2 (6%)
12 (37%)
18 (57%)
32
D2
2 (6%)
11 (35%)
19 (59%)
32
D3
2 (6%)
10 (32%)
20 (62%)
32
D4
2 (6%)
12 (37%)
18 (57%)
32
D5
2 (6%)
10 (32%)
20 (62%)
32
Please note that the total number of assessed candidates (30) do not match the total
completers (32) in listed in the Program Specific Candidate Information table as two of these
completers were pursuing both a M/M and M/S credential and only submitted one portfolio.
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 44
Part B: Additional information about candidate and program completer performance or
program effectiveness
Assessment #4: CSU System-wide Exit Survey
Assessment #5: CSU System-wide Evaluation of first year teachers
Key Assessment #4: CSU Exit Survey
Program finishers complete the California State University (CSU) Candidate Exit Survey. This
system-wide survey is completed online and submitted directly to the CSU Center for Teacher
Quality. This survey addresses various aspects of instruction, classroom management,
assessment, and teacher preparation in general. Results for the CSU Exit survey for 2009-10
and 2010-2011 are summarized in Table A.7.
Table A.7: Results of CSU Exit Survey
CSU Exit Survey
As a new teacher, I am (choose preparedness level) ...
...to use computer-based technology to help students learn subjects of
the curriculum.
...to use computer-based technology for instruction, research, and record
keeping.
...to adhere to principles of educational equity in the teaching of all
students.
...to meet the instructional needs of students who are English language
learners.
...to meet the instructional needs of students from diverse cultural
backgrounds.
...to meet the instructional needs of students with special learning needs.
...to know and understand federal and state laws that govern special
education.
...to develop and implement IEPs with parents, teachers and
administrators.
...to plan instructional activities in integrated settings for pupils with
disabilities.
...to develop student assessments that indicate progress toward IEP
objectives.
...to collaborate with para-educators in meeting students' instructional
needs.
...to consult with regular-ed. teachers about teaching special education
students.
...to conduct educational assessments as defined in students'
assessment plans.
...to use disability-specific teaching strategies and activities, when
appropriate.
...to teach disability-specific curriculum when applicable to my specialty
area.
Well or
Adequately
Prepared
2009201010
2011
77%
79%
82%
82%
91%
92%
88%
91%
91%
94%
94%
97%
88%
88%
89%
92%
94%
89%
91%
89%
95%
91%
88%
89%
92%
91%
94%
88%
92%
88%
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 45
...to develop and implement transition plans for special education
students.
76%
n=35
82%
x=34
Key Assessment #5: CSU System-wide Evaluation of First Year Teachers
The CSU System-wide Evaluation of Teacher Preparation, administered by the Center for
Teacher Quality, provides the results of surveys administered to both graduates of initial
credential programs completing their first year as in-service teachers and their employers on
their perceptions of the quality of preparation they received in their programs. The results for
each campus are provided as composite scores on groups of questions substantively related to
each other. Table A.8 includes the responses of 2004-05 through 2008-09 program completers
from all Education Specialist I program pathways combined. In order to provide significant
analysis of the data, the low numbers of annual respondents have been aggregated for years
2004-2009. Shading indicates teacher and supervisor responses on like items.
Table A.8: Results of CSU System-wide Evaluation
CSU System-wide Survey One-Year Out: Education Specialist Supervisors and First
Year Teachers From CSU-Chico Composite Graphs
Graduating
Year
2004-2009
% Adequately or Well Prepared
Supervisor
Special Education Supervisors Assess the Overall Effectiveness
of CSU Single Subject Credential Programs
92%
Teacher
First-Year Education Specialist Teachers Assess the Overall
Effectiveness of Their CSU Credential Programs
83%
Supervisor
K-8 Supervisors Assess CSU Preparation of Multiple-Subject
Teachers for Reading-Language Arts Instruction (K-8)
90%
Teacher
First-Year Teachers Assess Their CSU Preparation for ReadingLanguage Arts Instruction (K-8)
82%
Supervisor
Teacher
Supervisor
Teacher
Supervisor
Teacher
K-8 Supervisors Assess CSU Preparation of Multiple-Subject
Teachers for Mathematics Instruction (K-8)
First-Year Multiple-Subject Teachers Assess Their CSU
Preparation for Mathematics Instruction (K-8)
School Supervisors Assess CSU Preparation of Teachers to Plan
Instruction
First-Year Teaching Graduates of the CSU Assess Their
Preparation to Plan Instruction
School Supervisors Assess CSU Preparation of Teachers to
Motivate Students
First-Year Teaching Graduates of the CSU Assess Their
Preparation to Motivate Students
90%
70%
94%
88%
93%
87%
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 46
Supervisor
Teacher
Supervisor
Teacher
Supervisor
Teacher
Supervisor
Teacher
Supervisor
School Supervisors Assess CSU Preparation of Teachers to
Manage Instruction
First-Year Teaching Graduates of the CSU Assess Their
Preparation to Manage Instruction
School Supervisors Assess CSU Preparation of Teachers to Use
Education Technology
First-Year Teaching Graduates of the CSU Assess Their
Preparation to Use Education Technology
School Supervisors Assess CSU Preparation of Teachers for
Pedagogy Across the Curriculum
First-Year Teaching Graduates of the CSU Assess Their
Preparation for Pedagogy Across the Curriculum
School Supervisors Assess CSU Preparation of Teachers to
Assess and Reflect on Instruction
First-Year Teaching Graduates of the CSU Assess Their
Preparation to Assess and Reflect on Their Instruction
School Supervisors Assess CSU Preparation of Teachers for
Equity and Diversity in Teaching
92%
87%
86%
71%
94%
83%
92%
90%
92%
Teacher
First-Year Teaching Graduates of the CSU Assess Their
Preparation for Equity and Diversity in Teaching
School Supervisors Assess CSU Preparation of Teachers to
Teach English Learners
First-Year Teaching Graduates of the CSU Assess Their CSU
Preparation to Teach English Learners
Supervisor
Special Education Supervisors Assess CSU Level I Preparation
to Teach Special Learners in Special Education
91%
Teacher
Education Specialists Assess Their CSU Level I Preparation to
Teach Special Learners in Special Education
87%
Teacher
CSU Teachers Assess the Overall Value of Professional
Coursework in Their First Year of Teaching
86%
Teacher
CSU Teachers Assess the Overall Value of Credential Program
Fieldwork in Their First Year of Teaching
89%
Teacher
Supervisor
III.
85%
92%
88%
Analysis of Candidate Assessment
Level I Education Specialist Portfolio
100% of the 09-10 and 10-11 candidate completers scored at level 2 (Meets Requirements) or
above on the six key assessments that make up the Level I Education Specialist Portfolio.
Although there was some small variation in scores over the two years, including one candidate
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 47
receiving a Level 1 (Needs Improvement) score on the individual assessment on the initial
submission, there is no discernible pattern of change.
Field Evaluations
In 2009-10, 100% of Education Specialist I candidates received scores of proficient to
exceptional on all standards assessed as part of their Field Evaluations. In 2020-11, field
evaluations were revised to reflect the revised Education Specialist Standards. Because of this
revision, a direct comparison of scores between the candidates across the two academic years
would not result in an accurate analysis.
Dispositions Evaluations
The data from Dispositions Evaluations appear to show that evaluators observed behaviors that
would indicate well-developed dispositions across program years 2009-10 and 2010-11.
CSU Exit Survey
The CSU, Exit Survey indicates an overall satisfaction with candidates’ preparedness to teach
students with special needs. Lowest scores fell in the area of using computer-based technology
to help students learn subjects of the curriculum (77%) and developing and implementing
transition plans for special education students (76%). Both areas of lower satisfaction may stem
from the growing numbers of students being diagnosed with Autism Spectrum Disorder and the
need for complex instructional strategies, effective case management skills in coordinating
transition services and resources in the area augmentative communication.
CSU System-wide Evaluation
The results of the CSU System-wide Evaluation show that candidates were very confident in
their preparation to be effective special educators. Eighty-seven percent of Education Specialist
candidates indicated that they felt adequately or well prepared to teach special learners.
Ninety-two percent of the Education Specialist candidates were satisfied with the overall
effectiveness of the program. Lowest scores of satisfaction fell within the area of math
competency (70%) and educational technology (71%).
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 48
IV. Use of Assessment Results to Improve Candidate and Program Performance
Preliminary Level I Education Specialist Intern Program
Unit Action Plan
As a unit, program pathway coordinators met and identified nine common Student Learning
Outcomes (SLOs) based upon California Teaching Expectations, and the conceptual
framework, mission and vision of the School of Education. Each program analyzed data from six
data sources, and identified strengths and areas for improvement. The coordinators met and
reached consensus on areas for improvement common to all pathways in the unit. The Unit
Action Plan shows goals and plans of action for each goal. If applicable, individual pathways
have attached specific pathway action plans as addendums to the Unit Action Plan.
Unit Goal 1: Candidates effectively support students with special needs
in inclusive classrooms.
Data Source
Plan of Action or Proposed Changes Made



Exit survey
CSU survey





Hold Curriculum Committee meetings to articulate ways
in which coursework currently supports teaching
students with special learning needs across initial
credential pathways.
Incorporate a systematic use of IRIS modules in
coursework and train faculty in use of the modules.
Involve education specialist faculty, k-12 teachers and
master’s students in bringing education specialist
content to prepare general educators to work in
inclusive classrooms.
Revise course delivery to pair general education faculty
with education specialist faculty to 1) seamlessly
integrate methods that teach students with special
learning needs and 2) model co-teaching that occurs in
inclusive delivery models.
Hold an Assistive Technology Faire for all credential
candidates to learn about new assistive technologies
and their appropriate use.
Strengthen the special needs section of the field
observation form so that teaching behaviors that
support special learners will be more clearly identified in
the field.
Applicable
Program or
Common
Standard(s)
TPE 4,5,6
(SLO 7)
Disp 1
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 49
Unit Goal 2: Candidates use a variety of formative and summative assessments to
determine pupils’ progress, provide feedback and plan instruction.
Data Source
Plan of Action or Proposed Changes Made
PACT rubric

items A1, A2 and
A3






Hold Curriculum Committee meetings to articulate ways
in which coursework currently supports helping
candidates use a variety of formative and summative
assessments to inform instruction, and identify
additional course components that strengthen the
assessment strand.
In coursework, create communities of practice in which
candidates examine k-12 student work for evidence of
student learning.
Create additional assignments asking candidates to
bring their student work to class to analyze for patterns
of student learning. Provide models of effective verbal
and written feedback and guidance in determining next
instructional steps.
In fieldwork, modify supervision observation form to
include indicators for 1) use of student work as
evidence of student learning and 2) providing feedback
to students. Focus on these indicators at postobservation conferences.
Supervision focus on how ST provide feedback to
students
Provide supervisors with professional development
about using student work as evidence of teaching
effectiveness.
Confer with other universities regarding best practices
for observation practices that focus on K-12 student
learning outcomes.
Applicable
Program or
Common
Standard(s)
TPE 2,3
(SLO 2)
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 50
Education Specialist Program Action Plan
In addition to the goals listed in the Unit Action Plan, the Education Specialist Program has
chosen to focus on one additional goal.
Education Specialist Program Goal 1: Preparation for Mathematics Instruction in
Inclusive Classrooms
Data Source
Plan of Action or Proposed Changes Made
Applicable
Program or
Common
Standard(s)
CSU SystemSLO1
 Develop a math course that is taught by a general
wide Evaluation
education (math specialist) faculty member with
education specialist faculty to seamlessly integrate
math methods that address students with special
needs.
 Develop a lesson plan for a math unit that includes
differentiation for students with mild/moderate/severe
disabilities.
 In fieldwork, supervisors observe math lessons for
indicators that candidate uses strategies to differentiate
math content for students with mild/moderate/severe
disabilities.
PRELIMINARY ADMINISTRATIVE SERVICES
CREDENTIAL PROGRAM
SECTION A – CREDENTIAL PROGRAM SPECIFIC INFORMATION
I – Contextual Information
Program Contacts: Rick Stout
530-898-5532
rstout@csuchico.edu
Contextual Information
The Preliminary Administrative Services Credential program is a combined Preliminary
Administrative Services Credential and master’s degree in education, option in Educational
Leadership and Administration. Typically, candidates complete the program in two years.
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 51
Depending on demand, a new cohort of approximately 20-25 candidates begins every one-totwo years.
Academic Year
2009-2010
2010-2011
Program Specific Candidate Information
Number of Candidates
Number of
Completers/Graduates
34
16
33
14
SECTION A – CREDENTIAL PROGRAM SPECIFIC INFORMATION
IV.
Candidate Assessment/Performance and Program
Effectiveness Information
Part A: Primary Candidate Assessments
Data collected during 2009-2010 and 2010-2011 comes from the following key assessments:
Key Assessment #1: Mid-Program Review
Key Assessment #2: Field Evaluation
Key Assessment #3: Portfolio
Key Assessment #1: Mid-Program Review
Candidates present oral and written documentation of completed courses in the program to date, a
review of accomplishments towards their Professional Growth Plans, a summary of their strengths
and areas for professional growth, and a review of their Portfolios, including progress in fieldembedded coursework, and documentation of meeting CPSELS and CCTC Administrative
Standards.
Year
2009-10 (n=19)
2010-11 (n=20)
Mid-Program Evaluation 2009-2010 and 2010-2011
Level 1
Level 2
Level 3
Evaluation not yet in place—No data
8
8
Level 4
4
Key Assessment #2: Field Evaluation
At the conclusion of the field experience, candidates review their experiences and their journal
and write a synthesis of their learning and an analysis of areas for further growth. This
document forms the basis for an oral review of the field experience with both site and university
supervisors. Each project is evaluated out of 40 points, then converted to a four-point scale, with
4 being the highest score.
Year
2009-10 (n=19)
2010-11 (n=17)
Field Evaluation 2009-10 and 2010-2011
Level 1
Level 2
Level 3
1
3
1
3
Level 4
15
13
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 52
Key Assessment #3: Portfolio Evaluation
The portfolio is compiled throughout the program and includes a number of course-embedded
assignments linked to the candidates’ field-based experiences. The portfolio is evaluated on a
four-point scale, with 4 being the highest score. The elements of the portfolio include:
 Developing a Vision for Learning: Theory to Practice
 Community/School Site Demographic Study
 Crisis Response: Oral and Written
 Management of Funds and Facilities
 Staff Development Plan
 Using Research
 Leadership for Diversity
Year
2009-10 (n=19)
2010-11 (n=17)
Portfolio Evaluation 2009-10 and 2010-2011
Level 1
Level 2
Level 3
0
0
14
0
0
16
Level 4
5
1
Part B: Additional Information about Candidate and Program Completer
Performance or Program Effectiveness
The exit survey that was administered in previous years was suspended during 2009 to allow
time for redesign of the instrument, as well as the survey administration and data collection and
management processes. The survey has been revised and administered electronically to the
2010-2011 finishers. Survey items are based upon CPSEL and program standards.
Preliminary Administrative Services Finisher Survey (n=10)
The vision of the program was clearly articulated and shapes its design and
delivery. (C-Std. 1)
Sufficient resources (in areas such as library, media, and computer facilities)
were allocated throughout my program to support my progress. (C-Std. 2)
The quality of teaching was outstanding.(C-Std. 3)
The faculty reflect cultural, ethnic, and gender diversity.(C-Std. 3)
The faculty are knowledgeable about cultural, ethnic, and gender diversity. (CStd. 3)
Based on background and experience, the instructors were qualified to teach
program courses.(C-Std. 3)
Meaningful opportunities were provided to become involved in program design,
development, and evaluation activities.(C-Std. 4)
The admission process had clearly defined criteria and procedures that were
rigorous and fair.(C-Std. 5)
Program advising included academic, personal, and professional
development.(C-Std. 6)
The fieldwork/clinical experiences were sequenced and planned collaboratively
with school districts and university program personnel.(C-Std. 7)
University supervisors provided me with useful feedback and appropriate
activities for professional growth.(C-Std. 8)
Courses provided extensive opportunities to analyze, implement, and reflect on
% SA
or A
90%
100%
100%
60%
90%
100%
90%
100%
50%
60%
70%
100%
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 53
the relationships between theory and practice concerning leadership, teaching
and learning in the context of contemporary school issues in California.(P-Std. 1)
The program offered exposure to the essential themes, concepts and skills
related to the performance of administrative services (i.e.: communication skills,
leadership theories, curriculum).(P-Std. 3)
The program provided opportunities to examine personal attitudes toward issues
of race, gender, and socioeconomic status.(P-Std. 4)
The program provided opportunities to learn about issues of race, gender, and
socioeconomic status and ways to ensure equity for all members of the school
community.(P-Std. 4)
The program provided an opportunity to examine the principles of democratic
education from a historical and policy perspective.(P-Std. 5)
Courses provided multiple opportunities to learn, practice, and reflect on the role
of instructional leaders.(P-Std. 6)
The program provided feedback on performance through formative and
summative assessments.(C-Std. 9)
The program helped me learn how to promote the success of all students at my
school through the development of a shared vision of learning.(C-Std. 10)
The program helped me learn how to promote the success of all students at my
school through advocating, nurturing, and sustaining a school cultural conducive
to student learning.(C-Std. 11)
The program helped me learn how to promote the success of all students at my
school by ensuring a safe, efficient, and effective learning environment.(C-Std.
12)
The program helped me learn how to promote the success of all students
through working with diverse families and communities.(C-Std. 13)
The program helped me learn how to promote the success of all students by
developing personal ethics in a leadership capacity.(C-Std. 14)
The program helped me learn how to promote the success of all students by
understanding, responding to and influencing the larger political, social,
economic, legal, and cultural context.(C-Std. 15)
100%
100%
100%
100%
100%
50%
100%
100%
100%
90%
90%
100%
SECTION A – CREDENTIAL PROGRAM SPECIFIC INFORMATION
III.
Analysis of Candidate Assessment Data
1. The data from three key assessments (mid-program evaluation, field evaluation and portfolio
evaluation) show good to excellent performance by all candidates on all assessments. Midprogram key assessment mean is 2.8 out of 4. Field Evaluation means for both 09-10 and 10-11
are 3.6. Portfolio mean scores are 3.2 out of 4 for 2009-2010 and slightly lower at 2.9 for 20102011. However, while candidates receive written feedback, the single 4-level score tells us little
about candidate performance on specific CPSEL standards and program competencies. This
issue will be addressed in the subsequent Action Plan. A revised mid-program evaluation tool
will be implemented fall 2011.
2. The finisher survey is now aligned to program outcomes, CPSELS, and CCTC standards and is
now collected electronically and reported in that manner. Results of that survey show that
candidates agreed or strongly disagreed with most items. For example, 90-100% of candidates
agreed or strongly agreed that “The vision of the program was clearly articulated and shapes its
design and delivery” (90%), “The quality of teaching was outstanding”(100%), and the “courses
provided multiple opportunities to learn, practice, and reflect on the role of instructional leaders
(100%). Lowest scores of satisfaction fell within the area of feedback, both in the area of
performance (50%) and useful feedback on activities for professional growth (70%), and the
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 54
quality of fieldwork/clinical experiences (60%). These growth areas will become goals in the
subsequent Action Plan.
SECTION A – CREDENTIAL PROGRAM SPECIFIC INFORMATION
PART IV: Use of Assessment Results to Improve Candidate and Program
Performance
Since the last submission, faculty have made changes to improve data collection and
address goals. An exit survey aligned to CPSELs and standards is now administered to
program finishers. A rubric aligned to the five leadership strands of the program and the
CPSELs and standards has been developed and will be implemented in fall 2011 for the
mid-program review. For mid program and for end of program reviews, the feedback
panel now consists of both university faculty and CSU, Chico Ed Leadership program
graduates who currently hold positions in school or district level and county office of
education in the region. In order to enhance learning in diversity, candidates have been
provided the opportunity to attend two “Diversity Field Trips” to the Butte County Court
school. Additionally, a “Field Trip” in class took place this summer in EDAD 615. A
panel from local tribes provided a presentation to Candidates followed by an intense 3
hour group discussion. Prior to each Diversity field trip, candidates identified their own
assumptions and espoused theories of action about the learning potential of courts school
or Native students. Following the experience, candidates reflected on and revised their
espoused theories and discussed ways to integrate their new perspectives into school
leadership roles.
Analysis of data, particularly from the exit survey, has yielded several areas for further study and
the following plans for improvement:
Goal 1: Improve feedback to candidates, both in the area of performance and useful
feedback on activities for professional growth
Data Source
Plan of Action or Proposed Changes Made
Applicable
Program or
 Attend training on new grading feature of
Common
Finisher Survey
BlackBoard Learn gradebook to provide ongoing
Standard(s)
electronic grading
(C-Std. 6)
 Incorporate Zotero research tool for use in all
(C-Std. 8)
program courses
 Expose program faculty to contents of the
program’s professional and technical research
writing course to Ensure that candidates’
professional writing experiences become part of all
courses
 Incorporate professional growth components into
coursework, such as advising sessions and resume
workshops into program courses
 Upload online handbook and portfolio template
 Set regular advising meetings with graduate coordinator
 Incorporate all graduate dates and responsibilities into
course syllabi
Goal 2: Strengthen fieldwork/clinical experiences
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 55

Finisher Survey


Sequence and coordinate collaboratively with school
districts and university program personnel.
(C-Std. 7)
Continue to hold mentor meetings and provide for
ongoing opportunities for mentors and candidates to
collaborate during coursework (EDAD 612)
Enhance learning in diversity by providing additional
and expanded opportunities to attend “Diversity
Field Trips”
PUPIL PERSONAL SERVICES: SCHOOL PSYCHOLOGY
CREDENTIAL PROGRAM
Program Contacts: Dr. Leesa Huang
530-898-5164
lvhuang@csuchico.edu
Dr. James Wolfe
(530)898-4093
jwolfe@csuchico.edu
SECTION A – CREDENTIAL PROGRAM SPECIFIC INFORMATION
I.
Contextual Information
The School Psychology/PPS program at California State University, Chico is based on a
philosophy of preparation derived from a model which combines systems theory with a
preventive approach to service delivery. This model combines three levels of service delivery,
consisting of primary prevention, secondary intervention, and tertiary intervention, with five
systemic levels, ranging from specific individuals to the community at large. The PPS program is
based on the belief that pupil personnel services should be proactive and prevention-oriented in
order to reduce the potential for academic, emotional, and social problems of children and
adolescents.
The PPS program is composed of a logical sequence of coursework and field experience,
closely supervised by faculty whose primary professional identification and training is in the field
of school psychology. A knowledge base in the psychological foundations of school psychology
is provided through graduate coursework in developmental psychology, human learning, and
research and statistical methods. A three-course sequence in professional service delivery
covers a variety of topics including basic professional roles and standards, preventive programs,
exceptionalities, biological and educational foundations for school psychology, legal codes and
ethical decision-making. Strands of coursework provide substantial supervised practice in the
professional skills of counseling, assessment and consultation. In practica and internship, skills
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 56
and knowledge are applied, practiced and polished. The emphasis is on instruction that forms a
cohesive program rather than a collection of individual courses. Instruction is sequenced so that
students will matriculate effectively from one experience to another, and receive intensive
supervision and feedback in all applied work.
The total program consists of 68-71units and three years of training, with courses providing the
knowledge base placed early in the program; nevertheless, more than half the coursework
during the first two years involves practical experience. The master schedule of required
courses is provided below.
Fall, Year 1
PSYC 605 Advanced Human Learning
PSYC 573 Counseling Psychology
PSYC 680 School Psychology: Introduction to the Profession, the Education System, and
Prevention
PSYC 600 Research and Evaluation Methods
Spring, Year 1
PSYC 681 School Psychology: Study of Childhood Exceptionalities
PSYC 660 Instructionally Focused Assessment in the Schools
PSYC 670 Seminar in Group Counseling
PSYC 673A Practicum in Individual Counseling
Fall, Year 2
PSYC 661 Assessment of Intelligence and Cognition
PSYC 661P Practicum in Assessment of Intelligence and Cognition
PSYC 672 Cross Cultural Issues in Counseling and Research
PSYC 634 Practicum in School Counseling Interventions
PSYC 636 Practicum in Behavioral Consultation in Schools
Spring, Year 2
PSYC 603 Advanced Developmental Psychology
PSYC 662 Social and Emotional Assessment
PSYC 662P Practicum in Social and Emotional Assessment
PSYC 682 School Psychology: Legal and Ethical Principles and Preventive Service Delivery
PSYC 688 Practicum in School Psychology
Fall, Year 3
PSYC 663 Advanced Supervision in Psychological Assessment
PSYC 639 Practicum in Academic Intervention
PSYC 689A Internship in School Psychology I
* PSYC 699T Master’s Thesis
Spring, Year 3
PSYC 689B Internship in School Psychology II (4 days a week)
* PSYC 699T Master’s Thesis OR
* PSYC 696 School Psychology: Comprehensive Exam
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 57
Skill building begins in the first semester with an introductory counseling class followed by group
counseling and individual practica in the spring. This provides a base for child counseling and
assessment activities in the spring. During the second year, students serve in a school
placement two days per week, with extensive supervision through practica in behavioral
consultation, and school interventions. Their awareness and practice are enhanced by a
seminar in cross-cultural counseling in the fall. During the following semester, they continue
their two days per week assignment during their practicum in school psychology where they
continue to engage in a wide array of activities including consultation, counseling and
assessment. Similarly, refinement of advanced skills in assessment and instructional
intervention are supported by practica during the first semester of the school psychology
internship in the third year. These practica build on previous seminars and minor practica in
assessment and report writing and consultation skills learned the previous year. Primary
prevention and interdisciplinary collaboration occur as themes throughout the training sequence,
but are central to the professional services courses. Students are more formally introduced to
the area of special education, the special education referral process, and high and low
incidence handicapping conditions in the course on childhood exceptionalities. Program
evaluation and research skills begin with a graduate course in research methods and statistics,
followed by applications of program evaluation skills in other courses. As a culminating program
activity, students have the option of taking a comprehensive exam or completing a master’s
thesis. Each course is master scheduled to effectively track students throughout the training
sequence.
Each required course has assigned standards or competencies, guiding instruction and used to
determine the student’s satisfactory performance. Student performance on these competencies
is examined particularly closely in the applied coursework, so that we are assured that our
trainees are providing effective professional services and have the necessary skills to receive a
credential. No credential is recommended for any student until all competencies in all required
courses have been met.
Program Specific Candidate Information
Academic Year
2009-2010
2010-2011
Number of
Candidates
23
22
Number of
Completers/Graduates
11
7
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 58
V.
Candidate Assessment/Performance and Program Effectiveness Information
Part A: Primary Candidate Assessments
Data collected during 2009-2011 comes from the following Key Assessments:
Key Assessment #1: School Psychology Practicum Field Site Evaluations (PSY 688)
Key Assessment #2: School Psychology Internship Field Site Evaluations (PSY 689B)
Key Assessment #3: Culminating Activity: Comprehensive Exam (PSY 696) or Thesis (PSY
699T)
Key Assessment #4: National School Psychology Exam (Praxis II)
School Psychology Practicum Field Site Evaluations (PSY 688)
In the second year of the program, students are assigned to a school or schools for two
days/week. In the fall of that year, students provide group and individual counseling, classroom
skill development units, and behavioral consultation to students and teachers. During this time
they are supervised by a credentialed school psychologist on site and also receive support and
supervision on campus from their instructors in PSYC 634 (School Counseling and
Interventions) and PSYC 636 (Behavioral Consultation). In the spring of year 2, students
continue to work in the schools during their School Psychology Practicum (PSYC 688), but
broaden their roles to include more activities related to school psychology service delivery. They
are again supervised by credentialed school psychologists on site and attend a three-hour
seminar on campus once weekly where, together with school psychology internship students,
they discuss cases, share experiences, present on various topics, and offer support to one
another. As one way to monitor student progress and to evaluate the professional skills,
knowledge, dispositions and professional work characteristics of each candidate, the Field
Supervisor Rating for School Psychology Practicum students is completed by each candidate’s
field-site supervisor.
The table below provides aggregated data on the field supervisor ratings for school psychology
practicum students for spring 2010 and 2011 cohorts. The mean ratings for school psychology
practicum students in each area and the overall ratings indicate that, as judged by their
supervisors, the competency of the practicum students has been at or approaching an
independent level by the end of the spring semester. The overall ratings are 3.87 and 3.36, for
the 2010 and 2011 years, respectively, indicating that both cohorts, as groups, were performing
their duties very effectively.
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 59
School Psychology Practicum - PSYC 688
Mean Rating
Spring
2010
(n = 7)
Spring
2011
(n = 6)
1. Personal and Professional Qualities
3.83
3.46
2. Communication/Rapport
3.38
3.27
3. Consultation (both formal & informal)
3.21
3.37
4. Counseling
3.87
3.69
5. Assessment
2.91
3.14
6. Intervention/In-service
3.82
3.32
7. Program Development/ Skill Development Units
3.73
3.33
8. Ethical Practices
3.88
3.81
9. Overall Rating of Practicum Student
3.24
3.36
Domain
Number:
1 – Competence is currently limited. Close supervision and instruction are required.
2 – Competence is progressing satisfactorily. Moderate supervision and more experience is
required.
3 – Competence is approaching an independent level. Little supervision is required.
4 – Competence is very well developed and reflects a capacity for independent functioning
with little or no supervision required.
ND – No data or insufficient information is available to make a rating at this time.
School Psychology Internship Field Site Evaluations (PSY 689B)
The next table summarizes data on the second key assessment - field-site supervisor ratings of
students near completion of internship (PSYC 689B). A similar rating form to that noted above,
but more specific to the internship, is used by supervisors in conjunction with 689B
competencies to rate students. Both rating form and competencies are included with the
syllabus for PSYC 689B. Students are rated on a scale from 1 to 4 on various elements of 11
different domains including an “overall” performance rating. Ratings on all of the elements from
each domain are then averaged, and a mean score for the entire cohort on each domain is
derived. The mean “overall” performance rating was 3.47 with a range of ratings of 3.33 to 3.82
among the 11 domains for the 2010 cohort and 3.89 with a range of ratings of 3.99 to 4.00
among the 11 domains for the 2011 cohort. Again, there was little variance among the domains
assessed and no areas of significant concern reflected in the data.
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 60
School Psychology Internship II - PSYC 689B
Mean Rating
Spring
2010
(n = 11)
Spring
2011
(n = 7)
1. Personal and Professional Qualities
3.71
3.94
2. Communication/Rapport
3.63
3.95
3. Evaluation/Assessment
3.59
3.98
4. Consultation
3.33
3.93
5. Counseling
3.76
4.00
6. Intervention
3.64
3.98
7. Ethical Practices
3.82
4.00
8. Presentation of Skill Development Units
3.65
3.89
9. Community Collaboration
3.81
3.88
10. In-service Training
3.58
4.00
11. Overall Rating of Intern
3.47
3.89
Domain
Number:
1 – Competence is currently limited. Close supervision and instruction are required.
2 – Competence is progressing satisfactorily. Moderate supervision and more experience is
required.
3 – Competence is approaching an independent level. Little supervision is required.
4 – Competence is very well developed and reflects a capacity for independent functioning
with little or no supervision required.
ND – No data or insufficient information is available to make a rating at this time.
Culminating Activity – Comprehensive Exam (PSY 696) or Thesis (PSY 699T)
The third key program assessment is performance on a culminating activity – either the
comprehensive exam (PSYC 696) or thesis (PSYC 699T) to be completed in the spring
semester of the third year. Ten of eleven candidates in the 2010 graduating cohort elected to
take the comprehensive exam while one student successfully completed and defended a thesis.
All students in the 2011 cohort took the exam.
Results of student performance on the comprehensive exam are summarized below. Five
questions covering acquired and applied knowledge of the profession as well as individual case
studies were asked of students. Two instructors, who rated responses as “unacceptable,”
“acceptable” or “superior” following a specific rubric, independently scored each response.
Students needed to pass four of five questions with a rating of “acceptable” or above in order to
pass the written portion of the exam. The mean number of questions passed by the students
was 4.80 of 5 for the 2010 cohort and 4.71 for the 2011 cohort. The mean number of “superior”
ratings for students was 4.60 and 3.71 out of 10 (5 questions X 2 evaluators), for the 2010 and
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 61
2011 cohorts respectively. A range of “superior” ratings from 0 to 10 per individual student in the
2010 cohort and from 2 to 7 per individual student in the 2011 cohort suggests a fair amount of
variability among students with respect to the quality of their responses. Students who correctly
completed 4 of 5 questions were further required to clarify their response to the incorrect
question during the oral portion of the exam. All students in both cohorts went on to pass the
exam.
Spring
2010
Spring
2011
10
7
Mean number of questions passed
(out of 5)
4.80
4.71
Mean number of superior ratings
(out of 10)
4.60
3.71
Range
0–10
2-7
Number of students passed exam
10/10
7/7
Number of students successfully
completing and defending thesis
1/1
0/0
Course
Criteria
PSYC 696 –
School
Psychology
Comprehensive
Exam
Number of students
PSYC 699T –
Thesis
National School Psychology Exam (Praxis II)
Students in the state of California do not have a state credentialing exam and are not required
to take the national credentialing exam in order to receive their Pupil Personnel Services
credential in School Psychology. In the past, although we have encouraged our students to take
the national exam (PRAXIS II), and many have, we have not required it as a part of program
completion until spring, 2007. Below are listed domains of practice assessed by the PRAXI II
and aggregated data from our 2010 and 2011 graduating cohorts. All students from both cohorts
passed the exam. A passing score for both cohorts was 165. The mean scores were 177 and
176, for cohorts 2010 and 2011, respectively.
Domains of Practice assessed by PRAXIS II
1.
Data-Based Decision Making
2.
Research-Based Academic Practices
3.
Research-Based Behavioral and Mental Health Practices
4.
Consultation and Collaboration
5.
Applied Psychological Foundation
6.
Ethical/Legal and Professional Foundations
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 62
National School Psychology Credentialing Exam (PRAXIS II)
Spring 2010
Spring 2011
N
11
7
% Passed
100
100
Passing
Score
165
165
177 (± 4.71)
176 (± 1.98)
171 – 186
174 – 179
Mean (SD)
Range
Part B: Additional Information/Assessments
Data collected during 2009-2011 comes from the following Additional Assessments:
Assessment #5: School Psychology Committee Evaluation of Practicum Students
Assessment #6: School Psychology Committee Evaluation of Internship Students
Assessment #7: Portfolio Assessment
Assessment #8: Exit Interviews
School Psychology Committee Evaluation of Practicum Students
At the end of their school psychology practicum (PSYC 688), in the spring of year two of the
program, candidates are evaluated by the School Psychology/PPS subcommittee made up of
five professors who teach in the school psychology program. The committee considers field-site
supervisor evaluation of candidates, both verbal and written (mean field-site ratings were for
areas directly assessed by supervisors in the field ranged from 1 indicating limited competence
to 4 denoting near or at independence); course grades; progress on competencies/objectives;
candidate logs; observations and personal interviews in their ratings of candidates. All elements
of Standards One and Four as well as those of the Conceptual Framework with the exception of
“Civic Engagement” are addressed at this time
The results of the School Psychology/PPS committee evaluation of the spring, 2010 and spring,
2011 practicum students are summarized below. A rating of “Acceptable” or higher is
considered to be passing. All seven students in the 2010 cohort successfully completed their
practicum with three students demonstrating acceptable overall development and four
demonstrating a level of competence either approaching or at independence. All six students in
the 2011 cohort successfully completed their practicum. As can be seen, both sets of practicum
students were rated as progressing nicely with respect to their professional development.
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 63
School Psychology Practicum – PSYC 688
Spring 2010
(n = 7)
Domains
LD
AD
AT
TA
Professional knowledge base
2
1
4
Personal & professional
qualities
1
2
4
Communication/rapport
2
3
2
Behavioral consultation &
intervention
2
2
Counseling & wellness
promotion
2
Evaluation/assessment
Spring 2011
(n = 6)
AD
AT
TA
2
1
3
1
1
1
3
1
1
1
3
3
2
2
2
1
4
1
1
3
3
3
1
3
1
2
Program development
1
3
3
3
3
Appreciation of and
experience with diverse
populations
2
3
2
3
3
Ethical practices
2
5
Effective use of research and
technology
3
4
Overall rating of practicum
student
3
4
Successful completion of
practicum
7
ND
LD
1
5
2
2
2
2
2
2
ND
6
Key:
Competence is limited. Additional instruction and/or
supervision is still required.
Competence is progressing satisfactorily. Some fineAcceptable Development (AD) –
tuning of knowledge base or skill development is
recommended.
Competence is approaching an independent
Approaching Target Development (AT) –
level.
Competence is at an independent level. Little
Target Development Achieved (TA) –
supervision is required.
No data or insufficient information is available to rate candidate at this
No Data (ND) –
time.
Limited Development (LD) –
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 64
School Psychology Committee Evaluation of Internship Students
Candidates are again evaluated by the School Psychology/PPS subcommittee at the completion
of their internship (PSYC 689B), in the spring of their third year of the program. School
Psychology/PPS committee evaluations of both 2010 and 2011 cohorts are presented below.
Together with field-site supervisor evaluation of candidates during semester two of their
internship (mean field-site ratings were for areas directly assessed by supervisors in the field
ranged from 1 indicating limited competence to 4 denoting near or at independence) and other
data including course grades, progress on competencies/objectives, performance on
culminating activity, candidate logs, observations and personal interviews with candidates are
used to determine whether candidates have met all program competencies and will be
recommended for a credential. In order to be recommended students must receive an overall
committee rating of “acceptable” or higher. The table below indicates that all students in both
cohorts were recommended for a credential. All candidates in the 2010 cohort were performing
at an acceptable level or better with eight of the eleven students at or approaching an
independent level. All candidates in the 2011 cohort also were performing at an acceptable level
or better with six of the seven at or approaching an independent level.
School Psychology Internship II – 689B
Spring 2010
(n = 11)
Domains
LD
AD
AT
TA
Professional knowledge base
2
3
Personal & professional
qualities
3
Communication/rapport
2
Spring 2011
(n = 7)
AT
TA
6
1
6
2
6
1
6
2
7
Instructional consultation &
intervention
4
7
Behavioral consultation &
intervention
5
6
3
7
7
2
9
7
3
2
4
1
6
4
1
6
1
6
Appreciation of and
experience with diverse
populations
4
7
2
5
Ethical practices
2
9
7
Effective use of research and
technology
2
9
7
Home/school/community
collaboration
1
Counseling & wellness
promotion
Evaluation/assessment
Program development
2
ND
LD
AD
ND
7
1
2
4
1
4
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 65
Culminating activity
3
4
4
Overall rating of intern
1
1
8
Successful completion of
practicum
11
7
1
6
7
Key:
Competence is limited. Additional instruction and/or
supervision is still required.
Competence is progressing satisfactorily. Some fineAcceptable Development (AD) –
tuning of knowledge base or skill development is
recommended.
Competence is approaching an independent
Approaching Target Development (AT) –
level.
Competence is at an independent level. Little
Target Development Achieved (TA) –
supervision is required.
No data or insufficient information is available to rate candidate at this
No Data (ND) –
time.
Limited Development (LD) –
Portfolio Assessment
During the course of their program, students complete numerous projects, case studies, papers
and other assignments; however, they are typically only evaluated by the instructor/s for the
course in which they are required. Providing an organized portfolio of work samples to the
School Psychology/PPS Committee at points in the second and third year of the program adds
another source of information by which the entire committee can judge student progress and
provide student feedback. The School Psychology Committee began the implementation of this
requirement beginning in spring, 2007. Students are provided a list of assignments to submit,
and they are to include a reflection paper on how these assignments have contributed to their
professional development. Below is a list of the various projects, assignments, etc. included in
the portfolio.
Portfolio - Due Spring of Year Two
1.
2.
3.
4.
5.
6.
7.
8.
9.
Research paper on behavioral intervention or PowerPoint lecture on theories related to
classroom learning (PSYC 605).
Research paper on school psychology service delivery model (PSYC 680).
Presentation outline/PowerPoint on area of childhood exceptionalities (PSYC 681).
Individual counseling case study (edited; PSYC 673A)
Educational test review paper (PSYC 660).
Self-evaluation/video critique on intelligence test administration (PSYC 661P).
Final section of culture identification workbook (edited; PSYC 672).
Two group counseling summary papers (edited; PSYC 634).
PowerPoint presentation on behavioral consultation case study (PSYC 636).
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 66
Portfolio - Due Spring of Year Three
10.
11.
12.
13.
14.
15.
16.
Research paper on area of developmental psychology (PSYC 603).
Research paper presentation/PowerPoint on review of socio-emotional assessment
measure (PSYC 662P).
Research paper on school district prevention program (PSYC 682).
Paper/PowerPoint presentation on teacher/staff in-service presentation (PSYC 688).
Final psychoeducational case study and psychological report (PSYC 663).
PowerPoint presentation from instructional consultation case study (PSYC 639).
Paper/PowerPoint from community collaboration project (PSYC 689B).
Exit Interviews
In order to assess student satisfaction and in an effort to measure their perceived level of
preparation at the completion of their program, all 2010 and 2011 graduates were asked to
complete a program exit survey. The results from this survey are presented below and suggest
that students, as a group, felt prepared upon completion of their program in all areas and well
prepared in most. There were a few areas such as exposure to diverse populations (largely a
reflection of the demographics of the practicum and internship sites which are located largely in
rural northern California), and program development that may require further attention and we
will continue to monitor satisfaction in these and all other areas with future surveys.
Mean Rating
Spring
2010
(n = 11)
Spring
2011
(n = 7)
1. Professional Knowledge Base
2.70
2.83
2. Consultation and Collaboration
2.50
2.50
3. Evaluation/Assessment
2.85
3.00
4. Intervention and Wellness Promotion
2.15
2.65
5. Ethics and Legal Issues
2.40
2.14
6. Working with Diverse Populations
2.25
2.14
7. Program Development
2.10
2.43
8. Knowledge of Exceptionalities
2.60
2.86
9. Practicum Experience
2.50
2.57
10. Internship Experience
2.85
2.86
11. Value of Culminating Activity
2.60
2.93
2.65
2.86
Domain
(Circle one: 2 thesis 4 exam)
13. Overall Rating of Program
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 67
Exit Survey Key
1 – Minimally prepared
2 – Prepared
3 – Well Prepared
III.
Use of Assessment Results to Improve Candidate and Program Performance
The data presented above are quite positive with respect to how both university instructors and
field-site supervisors view student competence along the various professional and dispositional
domains assessed at various points in the program. Students appear to be well prepared not
only in the content areas covered through the coursework but also in the application of that
knowledge in the field. Overall satisfaction of the field site supervisors with practicum and
internship students in both 2010 and 2011 cohorts appears to be high. Students were closely
monitored with respect to successful demonstration of a variety of competencies and most were
judged to meet levels of skill development at or, in most cases, exceeding acceptable levels. All
students in both cohorts performed well on their culminating projects whether it was the
comprehensive exams or thesis. The one student in the 2010 cohort who elected to write the
thesis successfully completed and defended it. The remaining ten students in this cohort passed
their comprehensive exams, as did the entire 2011 cohort.
Having discovered little in the data obtained prior to the last CTC visit in 2007 to direct future
program improvements, the School Psychology/PPS program decided that perhaps other
means of assessing student knowledge and skills could help in providing a more comprehensive
and balanced means to evaluate program effectiveness. The program committee therefore
agreed to use two other means of assessing student performance, one of which was the
successful completion of the national school psychology credentialing exam (the other was
completion of a portfolio in the spring of their second and third year). For students, their passing
this exam is now the final step in their being recommended for the California PPS credential in
school psychology. It also is their final step in being granted status as a Nationally Credentialed
School Psychologist (NCSP), with the prestige and career flexibility that entails. For the School
Psychology/PPS program, it offers a valuable tool in determining how students compare
nationwide to other graduating school psychology students as well as practicing school
psychologists who have national credentialing status. It speaks well of both the students and
program that all students in the 2010 and 2011 cohorts passed the National School Psychology
Exam on their first attempt.
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 68
Course Master Schedule
The following courses are required for those pursuing the School Psychology credential.
Fall, Year 1
PSYC 605 Advanced Human Learning
PSYC 573 Counseling Psychology
PSYC 680 School Psychology: Introduction to the Profession, the Education System, and
Prevention
PSYC 600 Research and Evaluation Methods
Spring, Year 1
PSYC 681 School Psychology: Study of Childhood Exceptionalities
PSYC 660 Instructionally Focused Assessment in the Schools
PSYC 670 Seminar in Group Counseling
PSYC 673A Practicum in Individual Counseling
Fall, Year 2
PSYC 661 Assessment of Intelligence and Cognition
PSYC 661P Practicum in Assessment of Intelligence and Cognition
PSYC 672 Cross Cultural Issues in Counseling and Research
PSYC 634 Practicum in School Counseling Interventions
PSYC 636 Practicum in Behavioral Consultation in Schools
Spring, Year 2
PSYC 603 Advanced Developmental Psychology
PSYC 662 Social and Emotional Assessment
PSYC 662P Practicum in Social and Emotional Assessment
PSYC 682 School Psychology: Legal and Ethical Principles and Preventive Service Delivery
PSYC 688 Practicum in School Psychology
Fall, Year 3
PSYC 663 Advanced Supervision in Psychological Assessment
PSYC 639 Practicum in Academic Intervention
PSYC 689A Internship in School Psychology I
* PSYC 699T Master’s Thesis
Spring, Year 3
PSYC 689B Internship in School Psychology II (4 days a week)
* PSYC 699T Master’s Thesis OR
* PSYC 696 School Psychology: Comprehensive Exam
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 69
Clinical Rehabilitative Services: Speech, Language and Hearing
SECTION A – CREDENTIAL PROGRAM SPECIFIC INFORMATION
I – Contextual Information
Program Contacts: Dr. Suzanne Miller
530-898-5949
sbmiller@csuchico.edu
Dr. Susan Steffani
530-898-6838
ssteffani@csuchico.edu
Contextual Information
The ability to communicate effectively using language systems distinguishes human beings from
other forms of life. Disabilities that interfere with communication skills prohibit a large number
of people from realizing their full potential in modern society. Study in the fields of speechlanguage pathology and audiology prepares one to appreciate the impact of such impairments
and to assist individuals in overcoming them.
Students in the Communication Sciences and Disorders program take courses that address
normal human growth, development of the communicative processes, detailed consideration of
disorders that arise in these processes, and their assessment and treatment. Coursework is
supplemented by practica that give students first-hand experiences in dealing with disorders of
language, voice and resonance, phonology/articulation, fluency, hearing, swallowing, cognitive
and social aspects of communication, and problems that necessitate the use of oral, manual,
augmentative, and alternative communication techniques and technologies. These experiences
are carried out in the University's Center for Communication Sciences and Disorders and in offcampus internships.
The program maintains an on-campus clinic and a speech-language-hearing science laboratory.
Graduate students receive supervised practicum experience in prevention, evaluation and
treatment for persons across the life span who have a wide range of communicative disorders.
The clinic is equipped with audio and video monitored therapy rooms and observations facilities.
Master's degree recipients are eligible to receive the Speech-Language Pathology Service
Credential from the CA Commission on Teacher Credentialing. This credential authorizes the
holder to serve in the public schools as a Language, Speech, and Hearing Specialist. Graduates
are also qualified to apply for the Certificate of Clinical Competence in speech-language
pathology (SLP) from the American Speech-Language-Hearing Association (ASHA), and the
license in SLP from the CA Board of Consumer Affairs.
Our PRAXIS passing rate for 2009-2010 was 100% and for 2010-11 it was 95%. Employment
rate for our Master's graduates for the past 2 years was 100%. The graduation rate among our
graduate students is approximately 95%.
This program conducts assessments to measure the following student learning outcomes related
to the California standards:
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 70
1. Demonstrate knowledge of basic human communication and swallowing
processes, including their biological, neurological, acoustic, psychological,
developmental, and linguistic and cultural bases.
2. Demonstrate knowledge of the nature of speech, language, hearing, and
communication disorders and differences and swallowing disorders, including
their etiologies, characteristics, anatomical/physiological, acoustic, psychological,
developmental, and linguistic and cultural correlates.
3. Possess knowledge of the principles and methods of prevention, assessment, and
intervention for people with communication and swallowing disorders, including
consideration of anatomical/physiological, acoustic, psychological,
developmental, and linguistic and cultural correlates.
4. Complete a program of student that includes supervised clinical experiences.
Academic Year
2009-2010
2010-2011
Program Specific Candidate Information
Number of Candidates
Number of
Completers/Graduates
15
14
21
21
SECTION A – CREDENTIAL PROGRAM SPECIFIC INFORMATION
II.
Candidate Assessment/Performance and
Program Effectiveness Information
Two formative and two summative assessments are conducted each year for our program as
follows:
Key Assessment #1: Comprehensive Examination – taken before spring of the 2nd year.
Comprehensives consist of 6 questions written over two days. Each faculty member writes and
scores 1-2 questions. Questions cover the 9 areas of learning required by our accrediting body.
Scoring is as follows:
 3.7 = Outstanding
 3.69 - 2.1 - Acceptable
 2.0 or below - Unacceptable
Key Assessment #2: PRAXIS – the national standardized examination for all CMSD students.
Students cannot receive certification unless they pass this test. The national passage rate for this
test hovers around 75%.
 700+ = Outstanding
 600-699 = Acceptable
 Below 600 = Unacceptable
Key Assessment #3: Clinic Assessment – an assessment form for clinical performance. The
assessment was developed by faculty and clinical staff. It consists of a 1-5 rating of 28 clinical
skills. The assessment is conducted at the end of each of three internships completed during the
2nd year and the end of on-campus clinical practicum for 1st year graduate students.
 Average of 4.5 - 5= Outstanding
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 71


Average of 3.0 – 4.5 = Acceptable
Average 2.9 or below= Unacceptable
Key Assessment #4: Performance Review – students compile a portfolio. Information is added
each semester. We review the portfolios periodically throughout the 2 year program. We
provide a rating to the students as follows:
 1 = Outstanding
 2 = Acceptable
 3 = Unacceptable
Student Learning
Outcome
Measure
Percent of Students Achieving
2009-10
n=14
14%=outstanding;
86%=acceptable
Assessment #3 – 1st years Clinical Practicum
(SLO 4)
Evaluations
n=40
5%=outstanding
95%=acceptable
2010-11
n=21
0%=outstanding;
95%=acceptable
5%=unacceptable
n=20
35%=outstanding
60%=acceptable
5%=unacceptable
n=58
86%=outstanding
12%=acceptable
1%=unacceptable
n=45
69%=outstanding
31%=acceptable
Assessment #4 – 2nd
years (SLOs 1, 2, 3, 4)
Performance
Reviews
n=14
0%=outstanding
100%=acceptable
n=21
29%=outstanding
71%=acceptable
Assessment #4 – 1st years Performance
(SLOs 1, 2, 3, 4)
Reviews
n=19
10%=outstanding
85%=acceptable
5%=unacceptable
n=21
9%=outstanding
91%=acceptable
Assessment #1 (SLOs 1,
2, 3, 4
Comprehensive
Exams
Assessment #2 (SLOs 1,
2, 3, 4
PRAXIS
n=14
29%=outstanding
71%=acceptable
Assessment #3 – 2nd
years (SLO 4)
Internship
Evaluations
n=30
62%=outstanding
38%=acceptable
SECTION A – CREDENTIAL PROGRAM SPECIFIC INFORMATION
III.
Analysis of Candidate Assessment Data
2009-10:
2nd years
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 72
1. Students performed satisfactorily on comprehensive examinations. No questions
were failed; hence, no students failed comprehensives.
2. Students performed extremely well on the PRAXIS. We made changes to our
program in the previous years in order to improve performance that had slipped to
the national average. We had 100% passage this year (national average
approximately 86%) and have maintained a 98% passage rate in the past 3 years.
We feel confident that this indicates that students are learning well. Curriculum is
appropriate and information in individual classes is consistent with programs
nationally.
3. Students also performed well in internship placements. In fact, 8 students
received perfect 5.0 evaluations by supervisors.
4. The performance review revealed acceptable ratings for all students. Faculty
unanimously agreed that there were not any students that were truly outstanding;
however, all students successfully completed all program requirements.
st
1 years
1. Students are in their first experiences of clinic; therefore, it is expected that
there would be few students in the outstanding area. All students that were
evaluated were in the acceptable range. We encouraged supervisors to be very
specific in evaluating student performance and to not be too lenient in grading.
This was clearly done particularly in the fall as student numbers were lower
than they have been in the past. Still, all students performed adequately.
2. We had 2 students in the outstanding range with all but one other in the
acceptable range. The one student in the unacceptable range has been discussed
by the faculty and feedback has been given to the student regarding areas that
need improvement
2010-11
2nd years
1. Students performed satisfactorily on comprehensive examinations. No student
was in the outstanding range. We had one student that failed 2 questions and
passed 4. This student did not provide sufficient information in her answers to get
a passing grade. The student has since re-taken these 2 questions (in summer) and
passed without a problem. The recently instituted scoring system continues to be
working well. More specific definitions for each score were developed this year
to increase consistency and ease of scoring.
2. Students performed well on the PRAXIS. We have exceeded the national average
passage rate of 86%. All but 2 students scores within one standard deviation of
the mean for the national performance (M=668; SD=67). One student scored
above one standard deviation. One student failed with a score of 570 (600 is
passing). This student will re-take the exam. Because the exam has 7 sections,
we decided to do a more in-depth analysis of the areas to see if there were areas
that were of concern and found the following results:
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 73
Area
Basic Human
Communication Process
Phonological and
Language Disorders
Speech Disorders
Neurogenic Disorders
Audiology/Hearing
Clinical Management
Professional Issues/
Psychometrics/Research
Average score
2009-10
54%
Average Score
2010-11
68%
89%
75%
74%
63%
83%
64%
75%
67%
62%
79%
63%
71%
The three areas that were the lowest were Basic Human Communication Process,
Neurogenic Disorder, and Clinical Management. We will be discussing these
areas as a faculty to determine what, if any, changes should be made to the
curriculum.
3. Overall, students performed well in internship placements. One student received
an unacceptable score of 2.68. This is the same student that failed 2
comprehensive questions. She had some significant emotional issues during her
time as a graduate student which was evident in her difficulties in school.
4. The performance review revealed acceptable ratings for most students with a few
students determined to be outstanding based on overall performance in
clinic/internships and classes. All students have completed and passed all aspects
of the program.
1st years
1. Overall, students showed graduate progress in scores from fall to spring
semesters in clinic. All students performed at least in the acceptable range. We
will begin grading clinic during the 2011-12 school year. Therefore, a few
changes to the Supervisor Evaluation of Student form were made. There were
also a few problems with getting supervisors to submit the evaluation forms in a
timely manner so that scores could be assessed. This has been discussed with
the faculty.
2. We had 2 students in the outstanding range with all others in the acceptable
range. Students are moving through the program well and are completing all
requirements successfully.
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 74
SECTION A – CREDENTIAL PROGRAM SPECIFIC INFORMATION
IV.
Use of Assessment Results to Improve Candidate and
Program Performance
2009-10:
1. We made changes during 2008-09 to our scoring of comprehensive exams;
therefore, the process was reviewed by all faculty in the program during the 200910 school year. It was unanimously decided that the new scoring process worked
well and should be continued. We did review our outstanding, acceptable, and
unacceptable ratings of Comprehensive Exams to determine score ranges. This
discussion resulted in the numbers provided above. We found that our
descriptions of each score (1-4) were not as detailed as they could be. Therefore,
we added language to increase specificity of descriptions. This was approved by
all faculty.
2. We continue to evaluate the best way to assess clinic and internship evaluations.
We feel comfortable with the current rubric used for assessment. However, this
included a section on “interpersonal skills” which routinely are graded as superior
for all students. This could possible skew results to higher numbers. We are in
discussion about whether to include these in final ratings.
2010-11:
1. We feel that we have made changes in the past that have developed a very strong
program. At this point, no curricular changes are planned. However, since we
looked at the specific scores on the sections of the PRAXIS, we do see that there
are a few areas that are consistently lower than others. We will review these and
determine what measures we should take to address these scores.
2. The 2011-12 academic year will be the first year of grading clinic. We wanted
an avenue of letting students know how well they are performing beyond the
credit/no credit grading. This allows us to adjust grading based on student ability
to complete all reports, lesson plans, and SOAP notes in a timely manner. Also,
to provide more specific feedback to students on how they are doing. This
grading system and rubric will be examined at the end of this year.
SECTION B
INSTITUTIONAL SUMMARY AND PLAN OF ACTION
Since the last submission of our 2007-2008 and 2008-2009 Biennial report, we have made
important changes to the organizational structure of the School of Education and some of its
programs. One significant accomplishment has been the reorganization of the two departments,
the Department of Education and Professional Studies in Education, into a single-unit School of
Education. Since the previous reporting period, three inactive programs, Reading/Language
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 75
Arts Specialist, Library Media Teacher Services, and Early Childhood Certificate in Special
Education, have initiated the process of requesting formal withdrawal status.
The reorganization into a single-unit of education has allowed us to address other previously
mentioned challenges such as duplication of coursework and the administration and program
coordination costs, particularly in view of the need for budget reductions. The School of
Education continues to make advances with personnel changes that began in 2008 in
preparation for our reorganization. The assessment coordinator has made progress expanding
our use of the locally developed Student Tracking, Evaluation, and Portfolio System (STEPS)
for data collection and management. The credential analyst, now located in the School of
Education, has helped to improve candidate monitoring and reporting processes through
technological support for candidate monitoring, file management and credential
recommendation processes. Additionally, a centralized field placement director has been hired.
She is to be the university point-of-contact for all our partner schools and agencies in matters
related to fieldwork. This change has addressed our K-12 school partners’ previous concerns
about the coordination of student teacher placements between the two departments and the
need for more streamlined communication processes. A centralized pre-program advisor has
also been hired to help prospective teacher candidates best meet their career goals by
providing accurate and specific information about all programs in one easy-to-find location.
As this report illustrates, the new structure has also allowed us to continue to improve the ways
we collect and use our data for program improvement. Unlike our last submission, this 20092010 and 2010-2011 report reflects our more centralized approach by presenting one unified
action plan that includes broad, data-driven areas for improvement agreed upon by all initial
credential pathways. The reorganization has also allowed us to set new additional goals that will
allow us to create additional efficiencies.
While the data above indicate that, overall, our programs are doing a good job of preparing
candidates to meet standards and expectations, it continues to be the case that the data
collection, management process, and the manner in which some data is presented still needs
further refinement. Whereas the current report reflects some differences among the instruments
used by initial credential pathways within programs, one new goal for the next reporting period
will be to implement a universally agreed upon 4-point rating scale and rubric to measure
progress in the areas of disposition development and field experiences. The draft of these
instruments is currently under development. Several programs have set the goal to refine data
collecting instruments for their key assessments. For example, the Single Subject Program
currently uses a unit plan for its key assessment. The data is recorded as an aggregated
percentage mean score that allows for minimal interpretation. Therefore, faculty have revised
the rubric to include thirteen planning, instruction, and assessment items on a 4-point scale.
Similarly, the Educational Leadership and Preliminary Administrative Services Credential
Program has revised its open-ended mid-program evaluation feedback form to a multi-item
instrument that measures candidate growth in each of the program’s five identified leadership
strands. Both programs will begin data collection with the new instruments in 2011-2012 and
conduct supervisor trainings in use of new rubrics to insure inter-rater reliability.
CSU, Chico Biennial Report of 2009-10 and 2010-11 Data (submitted 9/15/11) 76
Download