Ana G. Mendez University System

advertisement
Assessment of Adult Learning in a Discipline-Based Dual
Language Immersion Model®
Fidel R. Távara, M.Ed.
Assessment coordinator
Florida Campuses
The School of Professional Studies Assessment Plan
focuses on:
 Assessment of Student Learning
◦ Midpoint and Capstone Assessment
◦ Evaluation of Student Portfolios
◦ Language Placement Testing

Assessment of Program Effectiveness
◦ Student Representative Meetings
◦
◦
◦
◦
◦
End-of-Course Evaluations
External Peer Reviews
Continuous Assessment of Program Activities
Classroom Observations
Student Satisfaction Survey

Is formative

Occurs at a crucial decision point

Helps them to see that assessment is helping them

Aids in retention

Provides information to the stakeholders




Is summative
Provides opportunity to identify whether students
have achieved selected program outcomes
Determines the strengths and weaknesses of
students toward achievement of outcome
expectations
Helps assess skills other than professional content
mastery

Small group met off campus at corporate house.

Consultant from Regis led discussion.

Group brainstormed list of possible DLP objectives.

Group classified objectives in categories:
conceptual, language, communication, and
interpersonal.


The entire faculty met by academic areas on
campus.
Using the DLP objectives, faculty wrote area
manifestations aligning them with each objective.

Select diverse program areas.

Involve faculty and administration.

Identify programs which have heavy enrollment.

Qualitative analysis
◦ Faculty opinion on content and coverage of
program objectives and outcomes

Quantitative analysis
◦ Significant achievement increment
◦ Large enrollment

Alignment chart

Assessment instruments
◦ Diagnostic profile
◦ Portfolios
◦ Case studies
◦ Metacognitive papers
◦ Strategic Business Plan
◦ Organization’s Financial Analysis

Rubrics
Part of
Assessment
Program
Objectives
Program
Outcomes
Dual Language
Professional
Outcomes
Area
Manifestation
Diagnostic
Profile
#3: Analyze social,
psychological and
philosophical
foundations of
education.
#3: Develop
classroom
assessment.
# 1: DLP will be able
to develop ideas in
order to address
problems in an
effective way.
# 1: The DLP will
develop strategies or
action plans after
analyzing specific
situations in Spanish.
Remedial
Lesson
Plan
#5: Understand
and use different
educational
strategies and
techniques
effectively
#5: Develop
lesson plans.
# 1: DLP will be able
to develop ideas in
order to address
problems in an
effective way.
# 1: The DLP will
develop strategies or
action plans after
analyzing specific
situations in English.
Excellent
Very Good
Satisfactory
Needs
Improvement

Mid Point Assessment (Program Level)
◦ Designed by Faculty Experts
◦ Rubrics and Evaluation Criteria developed
specifically to measure program and language
objectives
◦ “Graded” by other Faculty Experts (not facilitator of
the course)
 Inter-rater reliability of over 80%

The performance of the students is measured as
follows:
◦ 3.50 - 4.00
Excellent
◦ 3.00 - 3.49
Very Good
◦ 2.00 - 2.99
Satisfactory
◦ Less than 1.999 Unsatisfactory
EDUC 355: B.A. Elementary Education Midpoint Assessment Results - Report 2009
English
Dual Language Profile
Program Objectives
Spanish
3.100
3.200
3.300
3.400
3.500
Spanish
English
Dual Language Profile
3.267
3.346
Program Objectives
3.490
3.547
3.600
MANA 316: BBA Management Midpoint Assessment Results - Report 2009
English
Dual Language Profile
Program Objectives
Spanish
1.800
1.900
2.000
2.100
2.200
Spanish
English
Dual Language Profile
2.236
1.967
Program Objectives
2.260
2.100
2.300
EDUC 584: M.Ed. Guidance & Counseling Midpoint Assessment Results - Report 2009
English
Dual Language Profile
Program Objectives
Spanish
0.000
0.500
1.000
1.500
2.000
2.500
3.000
Spanish
English
Dual Language Profile
3.050
2.725
Program Objectives
3.343
3.118
3.500
EDUC 447: M.A. Elementary Education Capstone Assessment Results - Report 2009
English
Dual Language Profile
Program Objectives
Spanish
3.200
3.250
3.300
3.350
3.400
Spanish
English
Dual Language Profile
3.417
3.278
Program Objectives
3.416
3.333
3.450
EDUC 587: M.Ed. Guidance & Counseling Capstone Assessment Results - Report 2009
English
Dual Language Profile
Program Objectives
Spanish
2.900
3.000
3.100
3.200
3.300
3.400
Spanish
English
Dual Language Profile
3.267
3.147
Program Objectives
3.467
3.404
3.500

Internal:
◦ Board of Directors
◦ Faculty and Staff

External:
◦ Professional and community forums
◦ Data base for reaccreditation visits
◦ Possible institutional and corporate alliances

Addition of language courses for graduate
programs: 050, 500 and 501
◦ Emphasis on early or concurrent enrollment in
these courses for graduate students

Revision of all course modules to explicitly include
language objectives: “3rd generation of modules”
◦ Inclusion of language development in class
assignments, activities and resources
◦ Evaluation activities to be 70% content, 30%
language
◦ Prioritization of graduate courses in the
development of 3rd generation of modules
 Replication of midpoint assessment model in
MBA program to verify possible differences
between bachelors and masters
Download