University of Colorado Denver HLC Accreditation Report

advertisement
University of Colorado Denver HLC Accreditation Report
School of Education and Human Development
Early Childhood Education Program 2009-2010
Early Childhood Education Program Educational Goals
The mission of the Early Childhood Education (ECE) program at the University of Colorado
Denver is to prepare early childhood professional leaders in Colorado with the knowledge and
skills to meet the needs of young children and their families within a rapidly changing and
diverse society. Our program provides substantive support to persons who are preparing to
become leaders in professional practice in one of two alternative career patterns: (1) early
childhood accomplished teacher and/or administrator—the Master’s degree in ECE, and (2)
specialist working with children with disabilities and their families—the license in Early
Childhood Special Education (ECSE Specialist).
The ECE Program utilizes 14 program assessments to measure the knowledge, skills, and
dispositions required to meet multiple professional standards:
 Council for Exceptional Children (CEC)
 National Association for the Education of Young Children (NAEYC)
 Performance-Based Standards for Colorado Teachers
 Colorado ECSE Specialist Licensure
Of the 14 program assessments, nine are true performance-based assessments that require the
teacher candidate to demonstrate proficiency on specific teaching tasks and the application of
knowledge in authentic settings. Proficiency on each performance-based assessment (PBA) is
determined by:
 observation and rating of teacher candidate practice by site supervisors during
authentic performance opportunities in practicum experiences, and
 review of portfolio documentation which serves as supporting evidence of the
attainment of national and state standards (unit and lesson plans; student work samples;
photographs of classroom environments and activities; formal and informal assessment
instruments; intervention and positive behavior support plans; logs of contact hours
with students, teaching teams, and families; and teacher candidate reflections on their
own performance).
Proficiency on each PBA is scored by the practicum site supervisor and university practicum
faculty based upon review of portfolio products and observed practice during practicum.
Performance-based assessments are rated on a 4-point scale:
Basic (1): Acquiring background knowledge through university coursework and
fieldwork.
Developing (2): Student demonstrates progress but does not yet meet expectations for a
beginning special education teacher; needs improvement or demonstrates inconsistent
mastery across many areas of the category.
Proficient (3): Student meets all of the expectations for a beginning special education
teacher; consistent mastery in all key areas of the category.
1
Advanced (4): Student exceeds expectations for a beginning special education teacher
and demonstrates insight and leadership. This score is reserved for truly outstanding work
and is rarely given to novice teachers.
Prior to the summer of 2009, the ECE program policy was that students must achieve at least a
Proficient rating on each element of each PBA during practica in order to receive a grade of B or
better and “pass” practicum. The intent of this requirement was for practicum site supervisors to
provide feedback and guidance to practicum students until they achieved a proficient level of
performance on all aspects of each practicum experience. If a student was not deemed to be
“proficient” on all elements by the end of the semester, the student would have to take an
incomplete grade and repeat parts of the practicum until proficient. However, upon review of
PBA ratings over several years, it became apparent that practicum supervisors were reluctant to
give ratings of less than proficient (which could require the student and the supervisor to work
together beyond the semester for which the student was registered for the practicum). Thus, an
unintended consequence of the requirement for proficient ratings on each element of each PBA
became the equivalent of “grade inflation,” the result of which was limited variation in scores on
PBAs (mostly Proficient ratings with a scattering of Advanced). The ECE faculty determined
that this limited the value of PBA ratings in terms of continuous program improvement—we
didn’t have enough information on knowledge or skill area gaps observed in our ECSE teacher
candidates that could be used to inform changes/improvements in ECE course delivery or
structure of practicum experiences. The faculty decided to revise the required ratings for PBAs—
beginning summer 2009—teacher candidates now need a rating of Proficient (or Advanced) on
80% of the elements in each PBA to “pass” practicum.
Five program assessments are exams or papers completed during coursework or as a culminating
event at the conclusion of a student’s program:
 course exam covering knowledge of historical and philosophical foundations of
services for young children, trends and issues in ECSE, and law and policies that affect
young children, families, and programs for young children;
 course exam covering knowledge of young children’s medical conditions and
medications, and their possible effects on children and families;
 philosophy of education paper;
 comprehensive exam after completion of all required coursework covering knowledge
related to all CEC Content Standards; and
 Colorado state educator licensure content-area test in ECSE (PLACE: Program for
Licensing Assessments for Colorado Educators).
This 2009-2010 report will focus on the assessment of outcomes for ECSE Specialist candidates
related to the Council for Exceptional Children Professional Standards. Although some
outcomes/standards are measured by multiple means throughout each student’s participation in
the ECE Program, only the most relevant assessment methods for each student learning outcome
are included in this report. In addition, this report focuses exclusively on any assessment data
that revealed areas for student growth (less than proficient ratings) and the associated program
improvement response.
2
Subsequent reports will synthesize data for ECSE Specialist candidates and candidates for MA in
ECE degree not seeking the ECSE license (less than 20% of ECE program graduate students).
The Performance-Based Assessments for the MA-only students are currently under revision; data
posted to LiveText on the previous MA-only PBAs are insufficient for analysis (n=2).
Student Learning Outcomes
Student Learning Outcome #2: Development and Characteristics of Learners
Special educators know and demonstrate respect for their students first as unique human beings.
Special educators understand the similarities and differences in human development and the
characteristics between and among individuals with and without exceptional learning needs
(ELN). Moreover, special educators understand how exceptional conditions can interact with the
domains of human development and they use this knowledge to respond to the varying abilities
and behaviors of individual’s with ELN. Special educators understand how the experiences of
individuals with ELN can impact families, as well as the individual’s ability to learn, interact
socially, and live as fulfilled contributing members of the community
and
Student Learning Outcome #3: Individual Learning Differences
Special educators understand the effects that an exceptional condition can have on an
individual’s learning in school and throughout life. Special educators understand that the beliefs,
traditions, and values across and within cultures can affect relationships among and between
students, their families, and the school community. Moreover, special educators are active and
resourceful in seeking to understand how primary language, culture, and familial backgrounds
interact with the individual’s exceptional condition to impact the individual’s academic and
social abilities, attitudes, values, interests, and career options.
Assessment Method: Curriculum PBA (elements #1 and #3)
1. Plan and implement developmentally and individually appropriate curriculum unit
based upon the context of children, family, culture, and classroom community
3. Make appropriate adaptations/modifications for individual children in the classroom,
including children with IEP or IFSP
1) Sampling: 28 students completing ECE 6912 Preschool Practicum summer 2009-spring
2010.
2) Data Collection Method: The Curriculum PBA is introduced in ECE 5010: Curriculum
and Program Development, and applied in the preschool practicum during which students
engage in essential experiences related to curriculum planning and implementation.
3) Scoring Method: Performance-Based Assessments are rated on a 4-point scale: 1 = Basic;
2 = Developing; 3 = Proficient; 4 = Advanced.
4) Results: n = 28 students completing Preschool practicum over summer 2009-spring 2010.
(Note: Throughout this report, any missing data is presumed to be a [technical] failure by
the university practicum supervisor in submitting data to Live Text. ECSE candidates
always complete each element of each PBA and are rated by their supervisors.)
3
#1: Plan and implement developmentally
appropriate curriculum unit based on
context of children, family, culture, and
classroom community
#3: Make appropriate adaptations and
modifications for individual children,
including children with IEP
Advanced
4
Proficient
23
Developing
0
Mean
3.15
5
19
4
3.04
5) Interpretation of Results: ECSE candidates demonstrate ability to plan and implement a
developmentally appropriate curriculum unit that addresses individual interests, learning
styles, and cultural/linguistic diversity and the majority of candidates are able to utilize
instructional strategies to address individual needs of children including those with
exceptional learning needs. Four candidates need support in their next practicum related to
differentiating and making adaptations to lessons based on the individual needs of
children.
6) Feedback: Candidates must describe how they chose their curriculum theme, and justify
how it is developmentally appropriate for the age group and individual children
(strengths, needs, interest, cultural and linguistic background) for which they are
planning. Practicum site supervisors approve curriculum themes prior to implementation.
With guidance from their practicum site supervisor, candidates select two target children
with an Individual Educational Plan. Each lesson plan must include a description of the
adaptations planned to meet the needs of these target children during the implementation
of the lesson. Practicum site supervisors and university practicum supervisors observe
students in practice and provide feedback throughout the course of their practicum.
7) Use of Assessment Data for Program Improvement: Two of the students rated as
“developing” on element 3 were international students with very little prior experience
working with children with special needs. Starting in fall 2009, ECSE licensure
candidates were required to work or volunteer on a regular basis in an early childhood
program that has a special education team serving children with special needs prior to
beginning practicum (volunteer placements are facilitated by the ECE Program Leader if
necessary). The major programmatic response to improve future candidate performance
on this PBA will be to ensure that this hands-on field experience begins as soon as
possible after admittance into the ECSE licensure program. (Due to transportation
difficulties and family responsibilities, these two international students were involved in
volunteer activities for only 1-2 semesters prior to preschool practicum.)
Student Learning Outcome #4: Instructional Strategies
Special educators possess a repertoire of evidence-based instructional strategies to individualize
instruction for individuals with ELN. Special educators select, adapt, and use these instructional
strategies to promote positive learning results in general and special curricula and to
appropriately modify learning environments for individuals with ELN. They enhance the
learning of critical thinking, problem solving, and performance skills of individuals with ELN,
and increase their self-awareness, self-management, self-control, self-reliance, and self-esteem.
4
Moreover, special educators emphasize the development, maintenance, and generalization of
knowledge and skills across environments, settings, and the lifespan.
Assessment Method: Intervention PBA
1. Access and summarize background information in relation to child’s development
which includes family’s identified priorities and concerns
2. Design intervention plan addressing child’s interests, strengths, and next
developmental steps
3. Implement intervention plan and collect data on child progress
4. Reflect on intervention process and collaboration with colleagues and family
1) Sampling: 38 students completing ECE 6910 Infant/Toddler Practicum and ECE 6912
Preschool Practicum summer 2009-spring 2010.
2) Data Collection Method: This Intervention PBA is introduced in ECE 6200: Early
Intervention Strategies, and applied in infant/toddler and preschool practica during which
students engage in essential experiences related to planning and implementing
intervention strategies.
3) Scoring Method: Performance-Based Assessments are rated on a 4-point scale: 1 = Basic;
2 = Developing; 3 = Proficient; 4 = Advanced.
4) Results: n = 38—10 students completing Infant/toddler practicum and 28 students
completing Preschool practicum over summer 2009-spring 2010:
#1: Access and summarize background
information in relation to child’s
development which includes family’s
priorities and concerns
#2: Design and implement intervention
plan address child’s interests, strengths,
and next developmental steps
#3: Collect, summarize, and interpret
data to inform and evaluate plan
#4: Reflect on intervention process and
collaboration with colleagues and family
Advanced
Proficient
Developing
Mean
Infant/toddler Infant/toddler Infant/toddler Infant/toddler
1
9
0
3.10
Preschool
2
Preschool
26
Preschool
0
Preschool
3.07
Infant/toddler Infant/toddler Infant/toddler Infant/toddler
2
8
0
3.20
Preschool
Preschool
Preschool
Preschool
2
26
0
3.07
Infant/toddler Infant/toddler Infant/toddler Infant/toddler
1
8
1
3.00
Preschool
Preschool
Preschool
Preschool
3
23
2
3.04
Infant/toddler Infant/toddler Infant/toddler Infant/toddler
1
8
1
3.00
Preschool
Preschool
Preschool
Preschool
1
25
1
3.00
5) Interpretation of Results: Most ECSE candidates demonstrate ability to use a variety of
evidence-based instructional strategies to individualize instruction for children with
5
exceptional learning needs, embedding those strategies across classroom activities and
routines and are able to describe why the particular strategies were chosen based on the
intellectual, emotional, social level, motor, adaptive and academic strengths and needs of
the child.
6) Feedback: Candidates submit a draft of their intervention plans to their practicum site
supervisor and university supervisor for feedback prior to implementation and data
collection.
7) Use of Assessment Data for Program Improvement and Effects on Student Learning:
ECSE candidates complete the Intervention PBA in two different practica—
Infant/toddler and Preschool. Three ECSE candidates needed support with regard to
creating an appropriate data tracking system to monitor the effectiveness of their
intervention plan in their first practicum (rated as “Developing” on element #3). Their
university practicum supervisors made extensive comments on their practicum portfolios
and/or met with them individually to discuss data collection and interpretation. During
one of the practicum seminars, a session was added on “Methods of Data Collection” as a
quick summary of content covered in several ECE courses. All three students were rated
as “Proficient” on this element in their subsequent practicum.
Two students were rated as “Developing” on element #4—the portion of the Intervention
PBA in which students are asked to complete a reflection/self-evaluation—during their
first practicum. Typically these students did not answer all of the questions listed in the
reflection/self-evaluation section, or they critiqued their practicum site but did not include
enough thoughtful reflection on their own performance. Both students received feedback
from their university practicum supervisors are were rated as Proficient on this element in
their second practicum.
Student Learning Outcome #5: Learning Environments and Social Interactions
Special educators actively create learning environments for individuals with ELN that foster
cultural understanding, safety and emotional well-being, positive social interactions, and active
engagement of individuals with ELN. In addition, special educators foster environments in which
diversity is valued and individuals are taught to live harmoniously and productively in a
culturally diverse world. Special educators shape environments to encourage the independence,
self-motivation, self-direction, personal empowerment, and self-advocacy of individuals with
ELN. Special educators help their general education colleagues integrate individuals with ELN
in regular environments and engage them in meaningful learning activities and interactions.
Assessment Method: Challenging Behavior PBA
1. Design and implement functional behavior assessment and positive behavior support
plan
2. Collect, summarize, and interpret data to inform and evaluate plan
3. Collaborate with team members, including family, to create plan
4. Plan and implement activity that promotes social and emotional development
(classroom or home setting)
6
1) Sampling: 39 students completing Challenging Behaviors PBA during Infant/toddler
practicum, Preschool practicum, and Primary practicum over summer 2009-spring 2010
terms.
2) Data Collection Method: The Challenging Behaviors PBA is introduced in ECE 5070:
Social and Cognitive Development and Disorders or ECE 5202: Stress, Violence, and
Behavior Challenges and applied during two out of three practica (infant/toddler,
preschool, or primary) during which students engage in essential experiences related to
working with young children with behavior challenges.
3) Scoring Method: Performance-Based Assessments are rated on a 4-point scale: 1 = Basic;
2 = Developing; 3 = Proficient; 4 = Advanced.
4) Results: n=39—1 student completing Challenging Behaviors PBA during Infant/toddler
practicum, 26 during Preschool practicum, and 12 during Primary practicum over
summer 2009-spring 2010 terms.
#1: Design and implement functional
behavior assessment and positive
behavior support plan
#2: Collect, summarize, and interpret
data to inform and evaluate plan
#3: Collaborate with team members,
including family, to create plan
#4: Plan and implement activity that
promotes social and emotional
development (classroom or home
setting)
Advanced
Infant/toddler
0
Preschool
1
Primary
5
Infant/toddler
0
Preschool
1
Primary
6
Infant/toddler
0
Preschool
1
Primary
6
Infant/toddler
0
Preschool
1
Primary
4
Proficient
Infant/toddler
1
Preschool
25
Primary
6
Infant/toddler
0
Preschool
25
Primary
6
Infant/toddler
1
Preschool
25
Primary
6
Infant/toddler
1
Preschool
25
Primary
7
Developing
Infant/toddler
0
Preschool
0
Primary
1
Infant/toddler
1
Preschool
0
Primary
0
Infant/toddler
0
Preschool
0
Primary
0
Infant/toddler
0
Preschool
0
Primary
0
Mean
Infant/toddler
3.00
Preschool
3.04
Primary
3.33
Infant/toddler
2.00
Preschool
3.04
Primary
3.5
Infant/toddler
3.00
Preschool
3.04
Primary
3.5
Infant/toddler
3.00
Preschool
3.04
Primary
3.36
5) Interpretation of Results: ECSE candidates demonstrate the ability to collect needed
background information through functional behavior assessment interview and
observation, design a positive behavior support plan using effective and varied behavior
management strategies developed in collaboration with team and family members, and
promote social/emotional development in natural settings.
7
6) Feedback: Candidates submit a draft of their positive behavior support plans to their
practicum site supervisor and university supervisor for feedback prior to implementation
and data collection.
7) Use of Assessment Data for Program Improvement and Effects on Student Learning: Two
students rated as “Developing” on an element in their first practicum received extensive
feedback from their university practicum supervisor and were rated as “Proficient” on
this skill area in their next practicum. Additional in-class exercises related to functional
behavior assessment and data collection/interpretation were added to the courses
presenting this content (ECED 5070 and ECED 5202).
Student Learning Outcome #8: Assessment
Special educators use the results of assessments to help identify exceptional learning needs and
to develop and implement individualized instructional programs, as well as to adjust instruction
in response to ongoing learning progress. Special educators collaborate with families and other
colleagues to assure non-biased, meaningful assessments and decision-making. Special educators
conduct formal and informal assessments of behavior, learning, achievement, and environments
to design learning experiences that support the growth and development of individuals with
ELN. Special educators use assessment information to identify supports and adaptations required
for individuals with ELN to access the general curriculum and to participate in school, system,
and statewide assessment programs. Special educators regularly monitor the progress of
individuals with ELN in general and special curricula.
Assessment Method: Assessment PBA
1. Observation and analysis of a Child Find team evaluation
2. Participation in IFSP and IEP process
3. Use of on-going assessment to determine child’s interests, strengths, and next
developmental steps
4. Communication of assessment results effectively with families and colleagues
1) Sampling: 36 students registered for ECE 6910 Infant/Toddler Practicum and ECE 6912
Preschool Practicum summer 2009-spring 2010.
2) Data Collection Method: The Assessment PBA is introduced in ECE 5200: Screening and
Assessment in ECE, and applied during the infant/toddler and preschool practica during
which students engage in essential experiences related to assessment of young children
3) Scoring Method: Performance-Based Assessments are rated on a 4-point scale: 1 = Basic;
2 = Developing; 3 = Proficient; 4 = Advanced.
5) Results: n = 36—11 students completing Infant/toddler practicum and 26 students
completing Preschool practicum over summer 2009-spring 2010.
8
#1: Observation and analysis of a Child
Find team evaluation
Advanced
Proficient
Developing
Mean
Infant/toddler Infant/toddler Infant/toddler Infant/toddler
1
10
0
3.09
Preschool
1
Preschool
24
Preschool
0
Preschool
3.04
#2: Participation in IFSP and IEP process Infant/toddler Infant/toddler Infant/toddler Infant/toddler
1
8
1
3.00
Preschool
Preschool
Preschool
Preschool
1
23
0
3.04
#3: Use of on-going assessment to
Infant/toddler Infant/toddler Infant/toddler Infant/toddler
determine child’s interests, strengths, and
2
9
0
3.18
next developmental steps
Preschool
Preschool
Preschool
Preschool
2
24
0
3.08
#4: Communication of assessment results Infant/toddler Infant/toddler Infant/toddler Infant/toddler
effectively with families and colleagues
2
9
0
3.18
Preschool
Preschool
Preschool
Preschool
1
22
0
3.04
5) Interpretation of Results: ECSE candidates demonstrate ability to: gather relevant
background information, administer formal and informal assessments, interpret and
report assessment results using effective communication skills, evaluate instruction and
monitor child progress, integrate assessment results in the development and
implementation of IFSPs and IEPs.
6) Feedback: Practicum site supervisor approve formal and informal assessment methods and
observe the ECSE candidate sharing assessment results during a parent conference and/or
IFSP/IEP staffing and provide feedback.
7) Use of Assessment Data for Program Improvement: Past programmatic response to
support candidate performance on this PBA has been to include more course assignments
and fieldwork prior to practicum that mirror the “essential” experiences associated with
the Assessment PBA. As a result of those changes, subsequent students had better
understanding of the requirements related to on-going assessment data collection and
summarizing assessment data to determine a child’s interests, strengths, and next
developmental steps. Based on the performance of ECSE candidates summer 2009-spring
2010, no revisions are planned. The one student rated as “Developing” with respect to
participation in the IFSP process failed to include all the required documentation, but her
analysis of the process based on DEC Recommended Practices and IDEA laws was
proficient.
9
Download