Department English and Foreign
Languages
School of Liberal Arts
B.A. in Romance Language
Education
CIP 13.1203 :
Program Code: 186
Program Quality Improvement Report 2010-2011
1
Student-Learning- or Service Outcomes
1. Students demonstrate a high level of proficiency in
the target language, understand the linguistic
system of the target language, and understand the
differences between the target language and other
languages.
2. Students understand the relationship between
language and culture, and can integrate cultural and
cross-disciplinary perspectives into teaching.
3. Students demonstrate an understanding of
language acquisition at various developmental
levels and can adjust instruction accordingly.
4. Students demonstrate an understanding of the
Standards for Foreign Language Learning and use
those to inform their teaching
Program Quality Improvement Report 2010-2011
2
5. Students demonstrate knowledge of assessment
practices, can interpret the results to students and
other stakeholders, and can use the results to adjust
instruction accordingly.
6. Students engage in professional development
opportunities and serve as advocates for foreign
language learning.
7. Students demonstrate effective computer literacy
Program Quality Improvement Report 2010-2011
3
Program goals and objectives
Alignment with Mission and Strategic Plan
1. Mission Statement.
•
•
•
•
Critical Thinking—Life-Long Learning
Cultural Awareness
Diversity
Marketable Speaking, Writing and Research Skills
2. Plan 2013
• Cultural and Economic Development
• Diversity
• Research
Program Quality Improvement Report 2010-2011
4
Program goals and objectives
Alignment with Mission, Strategic Plan,
School and Department
3. School Mission
• Quality degrees
• Student-centered
• Highest standards
• Driving cultural and economic force in the community
Program Quality Improvement Report 2010-2011
5
Program goals and objectives
Alignment with Mission, Strategic Plan, School and
Department
4. Department Mission
•
•
•
•
•
•
Student-centered
Commitment to teaching, scholarship and service
Prepare students to contribute to community and
abroad
Cultural awareness
Critical, analytical and creative abilities
Success
Program Quality Improvement Report 2010-2011
6
Assessment Measurements
1.
2.
3.
4.
5.
6.
7.
8.
OSAT French and Spanish
Content Portfolio
Lesson Plan/Unit Plan
Internship/Student Teaching Report
Teacher Work Sample
Official OPI (French or Spanish)
Professional Development Plan
Foreign Language Advocacy Paper
Program Quality Improvement Report 2010-2011
7
Objective One
Action Plan
•
•
•
•
More exercises on the imperfect and the
preterit were given
Weekly practice sessions were offered but
students were not willing/able to
participate
Practice OPIs were performed during
conversation classes
No data available yet
Program Quality Improvement Report 2010-2011
8
Objective Two
Action Plan
•
•
Additional data collected
Presented below
Program Quality Improvement Report 2010-2011
9
Objective 3:
Action Plan
• Assignments that deal with language
acquisition given in methods course
• Students tutoring different age groups and
write reflective statement
• No data available yet
10
Program Outcomes and measurement
PROGRAM GOAL:
MEASUREMENT OF PROGRAM OBJECTIVE
PROGRAM
OBJECTIVE 1
Students
demonstrate a
high level of
proficiency in the
target language,
understand the
linguistic system
of the language,
and understand
the differences
between the
target language
and other
languages
Methods used to
determine validity
of measurement
instruments
Methods used
to determine
reliability of
measurements
Schedule for
measurements
OSAT French or
Spanish (direct)
State Test
State Test
Fall/Spring
Content Portfolio
(direct)
Artifacts requested
aligned w/
objective
Inter-rater
reliability
Official OPI (direct)
National Test
National Test
Internship/Student
Teaching Report
(direct)
Aligned with
objectives
Inter-rater
Reliability
Language Learning
Advocacy Paper
(direct)
Aligned with
objectives
Inter-rater
Reliability
CURRICULUM
AREA OR TARGET
AUDIENCE
Measurements
Senior language
students
Program Quality Improvement Report 2010-2011
11
Objective 1 Data: OSAT
• Three students tested – Pass
• Three students to be tested (2011)
Program Quality Improvement Report 2010-2011
12
Objective 1 Data:
OSAT
Candidate one – Pass
a.
b.
c.
d.
e.
Listening Comprehension: exemplary (300)
Reading and Vocabulary: exemplary (300)
Language Structure: exemplary (285)
Written Expression: exemplary (300)
Oral Expression: exemplary (300)
Program Quality Improvement Report 2010-2011
13
Objective 1 Data:
OSAT
Candidate two – Pass
a.
b.
c.
d.
e.
Listening Comprehension: exemplary (285)
Reading and Vocabulary: exemplary (285)
Language Structure: exemplary (269)
Written Expression: exemplary (300)
Oral Expression: exemplary (300)
Program Quality Improvement Report 2010-2011
14
Objective 1 Data:
OSAT
Candidate three – Pass
a.
b.
c.
d.
e.
Listening Comprehension: exemplary (285)
Reading and Vocabulary: exemplary (300)
Language Structure: (met standard) 254
Written Expression: not acceptable (229)
Oral Expression: exemplary (224)
Program Quality Improvement Report 2010-2011
15
Objective 1: Content Portfolio
• Two to be collected and graded (Fall 2010)
• Three to be collected and graded (Spring/Fall
2011)
Program Quality Improvement Report 2010-2011
16
Objective 1: Official OPI
• Three students tested (2010) – Pass
• All three Advanced High
• One student scheduled to test – (Jan. 2011)
• Two to be scheduled
Program Quality Improvement Report 2010-2011
17
Objective 1: Internship/Student
Report
• Two collected and graded
• Four to be collected and graded (Spring/Fall
2010)
Program Quality Improvement Report 2010-2011
18
Objective 1: Internship/Student
Teaching Report
Standard
Number
of
Students
Approaches
Standard
(1)
Meets
Standard
(2)
Exceeds
Standard
(3)
Score
AVG.
1.b.8
2
3,3
6
3
1.c.1
2
3,3
6
3
Average
3
Program Quality Improvement Report 2010-2011
19
Objective 1:
Language Advocacy Paper
•
•
•
Two exceeded the standard with 2.7, 2.7
One met the standard with 2.3
Three artifacts to be collected and graded (Fall
2010)
20
Objective 1 Data: Advocacy
Paper
Standard
1.a.4
Student
Approaches
Standard
Meets
Standard
Exceeds
Standard
Score
#1
2.77
2.77
#2
2.3
2.30
#3
2.77
2.77
AVERAGE
2.61
Program Quality Improvement Report 2010-2011
21
Action Plan
• Continue with OPI practice exercises
• Require that all students use the respective
target language when requesting assistance in
the language lab
Program Quality Improvement Report 2010-2011
22
Program objective and measurement
PROGRAM GOAL:
MEASUREMENT OF PROGRAM OBJECTIVE
PROGRAM OBJECTIVE 2
Students understand the
relationship between
language and culture, and
can integrate cultural and
cross-disciplinary
perspectives into
teaching.
CURRICULUM
AREA OR
TARGET
AUDIENCE
Senior Language
Students
Methods used to
determine validity
of measurement
instruments
Methods used to
determine reliability
of measurements
Schedule for
measurements
OSAT
State Exam
State Exam
Fall/Spring
Unit Plan
Assignment Aligned
with Objectives
Inter-rater Reliability
Internship/Student
Report
Instrument Aligned
with Objectives
Inter-rater Reliability
Measurements
23
Objective 2 Data: OSAT
• Three students were tested: did not meet
standard
• Three students to be tested (2011)
Fall 2010
Program Quality Improvement Report 2010-2011
24
Objective 2 Data: OSAT
Candidate one – Did not meet standard (231)
Program Quality Improvement Report 2009-2010
25
Objective 2 Data: OSAT
Candidate two – Did not meet standard (231)
Program Quality Improvement Report 2009-2010
26
Objective 2 Data: OSAT
Candidate three – Did not meet standard (231)
Program Quality Improvement Report 2009-2010
27
Objective 2 Data: Unit Plan
• Three collected and scored (Fall 2009)
• Three to be collected and graded (Fall
2010)
Program Quality Improvement Report 2010-2011
28
Objective 2: Unit Plan
Standard
Approaches
Standard
(1)
Meets
Standard
(2)
Exceeds Standard
(3)
Score
Average
2.a.1
3
9
3
2.a.3
3
9
3
2.a.4
3
9
3
1
7
2.33
4
1.33
8
2.66
2.c.1
2.c.2
2
2
2.c.3
1
1
2
OVERALL AVERAGE
2.55
Program Quality Improvement Report 2010-2011
29
Objective 2: Internship/Student
Report
• Two collected and graded
• Four to be collected (2011)
Program Quality Improvement Report 2010-2011
30
Objective 2: Internship/Student
Teaching Report
Standard
Number
of
Students
Approaches
Standard
(1)
Meets
Standard
(2)
Exceeds
Standard
(3)
Score
AVG.
2.a.1
2
2
6
3
2.a.2
2
2
6
3
2.a.3
2
2
6
3
2.a.4
2
1 (2.8)
1
5.8
2.9
2.a.5
2
1 (2.8)
1
5.8
2.9
2.b.2
2
2
6.0
3
2.b.3
2
2
6.0
3
2.c.1
2
1 (2.7)
1
5.75
2.8
2.c.2
2
1 (2.75)
1
5.75
2.8
2.c.3
2
1 (2.75)
1
5.75
2.8
Program Quality Improvement Report 2010-2011
31
Action Plan
• Increase emphasis on popular culture
• Encourage students to travel abroad
• Have students watch, listen to, and read
products in the target language
Program Quality Improvement Report 2009-2010
32
Program objective and measurement
PROGRAM GOAL:
MEASUREMENT OF PROGRAM OBJECTIVE
Program Objective 3
Candidates
demonstrate an
understanding of
language acquisition
at various
developmental levels
and use this
knowledge to create a
supportive classroom
learning environment
that includes target
language input and
opportunities for
negotiation of
meaning and
meaningful
interaction
CURRICULUM AREA
OR TARGET
AUDIENCE
Senior Language
Students
Methods used to
determine validity of
measurement
instruments
Methods used to
determine
reliability of
measurements
Schedule
for
measurem
ents
Unit Plan
Assignment aligned w/
objectives
Inter-rater
reliability
Fall/Spring
Internship/ Student
Teaching Report
Instrument aligned w/
objectives
Inter-rater
reliability
Teacher Work Sample
Assignment aligned w/
objectives
Inter-rater
reliability
Measurements
33
Objective 3: Unit Plan
• Three collected and scored (Fall 2009)
• Three to be collected and graded
(Spring/Fall 2010)
Program Quality Improvement Report 2010-2011
34
Objective 3: Unit Plan
Standard
Approaches
Standard
(1)
Exceeds
Standard
(3)
Score
Average
3.a.1
3,3,3
9
3
3.a.4
3,3,3
9
3
3.a.5
3,3,3
9
3
3.b.1
3,3,3
9
3
3.b.2
3,3,3
9
3
6
2
9
3
6
2
3
5
1.7
3, 3, 3
9
3
3.b.3
Meets
Standard
(2)
2,2,2
3.b.4
3,3,3
3.b.6
3.b.7
2,2,2
1
3.b.8
1
OVERALL AVERAGE
2.7
Program Quality Improvement Report 2010-2011
35
Objective 3: Internship/Student
Report
• Two collected and graded
• Four to be collected (2011)
Program Quality Improvement Report 2010-2011
36
Objective 3: Internship/Student
Teaching Report
Standard
Number
of
Students
Approaches
Standard
(1)
Meets
Standard
(2)
Exceeds
Standard
(3)
Score
AVG.
3,3
6
3
3
5.75
2.9
3.a.1
2
3.a.2
2
3.a.3
2
3,3
6
3
3.a.4
2
3,3
6
3
3.a.5
2
3,3
6
3
2.75
Average
2.98
Program Quality Improvement Report 2010-2011
37
Objective 3 Data:
Teacher Work Sample
•
•
Three collected and graded
Three to be collected and graded
(Spring/Fall2011)
Program Quality Improvement Report 2010-2011
38
Objective 3: Teacher Work
Sample
Standard
Number of
Students
Approaches
Standard
(1)
Meets
Standard
(2)
Exceeds
Standard
(3)
Score
AVG
3,3,3
9
3
3.b.1
3
3.b.2
3
2
3,3
8
2.66
3.b.4
3
2
3,3,
8
2.66
Average
2.77
Program Quality Improvement Report 2010-2011
39
Action Plan
• Encourage students to become members of
professional organizations
• Encourage students to attend conferences,
workshops, etc.
Program Quality Improvement Report 2010-2011
40
Published information on graduates
Academic Year 09-10
Entered Graduate School
Working In Discipline
Fall 2010
1
Spring 2011
1
Total
2
Program Quality Improvement Report 2010-2011
Other
41