International
Outcomes Assessment
Dr. Barbara Wheeling
Montana State University Billings
Coordinator for Institutional Assessment
College of Business Director of Accreditation and Assessment
October 1, 2010
Outline
International Learning Objectives: Examples
Primary Concepts of Assessment
Developing Learning Objectives
The Process
Key Questions for Writing Learning Objectives
Assessment Tasks
Closing the Loop







2
Montana State University Billings
International Learning Objectives
Example from MSU Billings:
We want our students to be able to
1. Identify global issues and explain their implications.
2. Specify appropriate factors for consideration when
assessing international markets and operations.
3. Recognize significance of cultural differences on
business practice.




3
Montana State University Billings
International Learning Objectives
Example from Merrimack College:
Demonstrate the ability to function effectively in an
international environment.
Demonstrate the ability to apply international
perspectives to local business decisions.


4
Montana State University Billings
International Learning Objectives
Additional Examples
Identify differences in domestic and global business
practices.
Explain the effects of exchange rates on transactions,
weights and measures.
Identify a foreign market for a product or service.
Create a foreign market entry plan.
Demonstrate knowledge of global legal framework and
trade regulations.
Distinguish between appropriate and inappropriate
behavior in different cultural contexts.






5
Montana State University Billings
International Learning Objectives
Examples from Adelphi University
Our students should be able to identify global and
multicultural issues and explain their implications.
Our students should be able to make recommendations
based on global and multicultural issues.


6
Montana State University Billings
Primary Concepts of Assessment
The learning objectives should clearly state what the
learner should be able to do.
The assessment should measure if they can, in fact, do
that.


7
Montana State University Billings
Developing International
Learning Objectives
Look for indicators of a global perspective:





8
Knowledge about importing/exporting, trading partners and
policies.
Analysis of foreign country’s business environment and
proposing strategies that fit with local laws.
Identification of ethical issues.
Identification of problems in a cross-cultural business situation
and recommendation of solutions.
Montana State University Billings
The Process
Step 1: What should students be able to do?


These are the objectives.
Step 2: What indicates students have met the objective?


These are assessment tasks.
Step 3: What does good performance on the task look
like?


9
These are the criteria to assess.
Montana State University Billings

Step 4: How well did the students perform?



Step 5: How well should most students perform?


Use a rubric with the criteria or
Compile a score for each objective
The minimum level at which you would want students to
perform is a benchmark.
Step 6: What do students need to improve upon?

10
Information from the rubric will provide feedback and ideas for
improving instruction.
Montana State University Billings
Key Questions for
Writing Learning Objectives

1. Is it specific?

An objective is written too broadly if


11
It cannot be reasonably assessed with just one or two assessments
It covers several different elements of the subject matter from a
course or semester
Montana State University Billings

2. Is it observable and measurable?

Examples, not measurable:



Example, measurable:


12
“Students will understand how to divide two-digit numbers.”
“Students will develop an appreciation of cultural diversity in the
workplace.”
“Students will correctly divide two-digit numbers.”
“Students will summarize in writing their feelings about cultural
diversity in the workplace.”
Montana State University Billings

Avoid phrases such as,


Be careful of modifiers such as,


13
“have an understanding”, “have an appreciation for”, “be
knowledgeable about”
“will effectively”, “can accurately”, “should completely”
These can make measurement impossible
Montana State University Billings

3. Is it actually a teaching outcome?

Avoid phrases such as:


“will be taught”, “will learn how to”, “will be evaluated on”
4. Does the objective include action verbs?


14
Overt behavior that can be observed and measured
Examples: compile, create, plan, revise, analyze, design, select,
utilize, apply, prepare, use, compute, discuss, explain, predict,
assess, compare, rate, critique.
Montana State University Billings
Assessment Tasks



•
•
Case study
Video assignment
Research paper
International experience learning journal
Knowledge test
15
Montana State University Billings
Closing the Loop

International course


Globalization across the curriculum


Virtual syllabus
Experiential exercises


Course in each discipline
Example: role playing in a cultural context
Study abroad
16
Montana State University Billings
Q&A
17
Montana State University Billings