California State University, Fullerton
ASSESSMENT CONFERENCE XIX
Presentation on
Business Assessment Test
BAT
Jay Grosflam
Assessment & Accreditation
California State University, Long Beach
March 20, 2015
OFFICE - 562.985.5698
CELL – 310.498.2332
jay.grosflam@csulb.edu
Business Assessment Test
2015








BAT developed in 2004.
New 2015 BAT test in place for online or paper version.
Results used for AACSB accreditation and Assurance of Learning.
BAT tests for Business Functions / Quantitative & Technical Skills
17,698 tests given to date.
2013 – 1374 tests given.
2014 – 2956 tests given.
2015 – Number of California schools increasing – in talks with UC
schools and private Universities in / out of California.
BAT Subject Coverage








ACCOUNTANCY
ECONOMICS
FINANCE
MANAGEMENT
INFORMATION SYSTEMS
MARKETING
STATISTICS
MANAGEMENT
INTERNATIONAL
ETHICS
OPTIONAL:
BUSINESS LAW
SUPPLY CHAIN MANAGEMENT
~ Universities can request all, or a
subgroup of segments, with
more segments being developed
CSULB undergraduate Learning
Goals for AACSB







Critical Thinking
Ethics
Team & Interpersonal Skills
Communication Skills
Business Functions – tested by BAT
Quantitative & Technical Skills – tested by BAT
Domestic & Global Environment
BAT Purpose
 Create a benchmark for Business schools to compare and evaluate
student learning effectiveness.
 Develop a knowledge test for undergraduate students in California.
 BAT - Assesses Business Function / Quantitative Skills in the
Assurance of Learning for AACSB.
 Assessment results provide valuable program input to improve the
learning experience and Close the Loop.
 Cost effective assessment ($5 per test – revenue neutral) to support
AACSB Assurance of Learning.
 I offer my assistance to show how we incorporate BAT results AACSB
Assurance of Learning usage.
BAT Strengths







11 years of successful implementation. Since 2004.
Localized questions for the California State University system.
Customizable BAT test to your particular requirements.
Preview of all test question.
Quick turnaround of customizable results.
End data usable for AACSB Assurance of Learning requirement.
Results used in over 15 separate university AACSB
accreditation Assurance of Learning reports.
AOL Process
Mission
Learning Goal
Learning
Objective
Develop
Measurement
Evaluate
Improvements
Close the loop
Collect Data
Measure 1
Collect Pilot
Data
Measure 2
Analyze Data
Implement
Improvements
Identify Needed
Improvements
AACSB Assessment
 Direct versus Indirect Assessment
Direct = Student work - Exams, projects, papers, portfolios.
Indirect = Business Assessment Test
 Elective versus Core Course Assessment
Did you know…?
 Program level Assessment versus Course Level Assessment
Assessment of learning focuses on the results of a PROGRAM
Classes a student could have taken





Intro to IS
Intro to Marketing
Intro to Finance
Intro to Management
Intro to Statistics
Participating Universities











SFSU
CSUN
CSU Sonoma
CSU San Marcos
CSU Long Beach
CSU Bakersfield
CSU Stanislaus
Cal Poly SLO
CSU Dominguez Hills
CSU San Bernardino
SJSU
CSU Humboldt
CSU East Bay
Hong Kong Baptist University
BAT 2014
Q4 2014
1
2
3
4
CSULB
5
6
N
ACCT
ECON
FIN
BLAW MGMT
MIS
MKTG
STAT
SCM
INTL ETHICS
131
1068
194
38
167
910
259
2715
48.31
48.03
30.64
48.65
45.87
43.95
46.885
50.34
50.61
41.13
43.24
50.26
45.34
47.1
54.87
53.78
39.2
55.86
55.39
43.95
53.835
34.88
45.55
24.47
36.82
39.99
37.72
38.615
68.81
65.6
57.64
70.52
71.31
60.88
66.65
51.44
48.51
41.5
55.07
50.28
47.49
55.8
57
58.01
43.19
54.86
63.64
45.94
60.76
48.46
51.35
38.51
52.97
51.93
45.94
47.23
50.38
54.56
47.87
58.11
54.86
48.36
54.57
57.69
48.65
42.13
47.57
45.73
42.57
44.105
90
86.4
82.98
86.49
92.19
87.44
93.21
48.76
46.16
55.68
38.14
70.58
54.23
59.3
52.87
56.6
40.86
91.48
AVERAGE
CSU % PER
SEGMENT
AY 2013 14
ID
104850094
000148842
104874872
104262572
104397512
101690067
102992641
103454635
104341040
Overall Score - 80 Q's
40.00%
57.50%
57.50%
78.75%
57.50%
33.75%
75.00%
53.75%
60.00%
CSUX Average
CSU Average
ACCT
ECON
FIN
28.57% 87.50% 75.00%
28.57% 75.00% 75.00%
28.57% 75.00% 37.50%
57.14% 100.00% 87.50%
42.86% 87.50% 62.50%
28.57% 25.00% 50.00%
71.43% 50.00% 75.00%
57.14% 75.00% 25.00%
57.14% 75.00% 75.00%
44.44% 72.22% 62.50%
48.76% 46.16% 55.68%
BLAW
MGMT
MIS
25.00% 14.29% 14.29%
12.50% 57.14% 42.86%
25.00% 57.14% 71.43%
37.50% 100.00% 85.71%
37.50% 57.14% 71.43%
25.00% 42.86% 42.86%
37.50% 71.43% 100.00%
25.00% 85.71% 71.43%
37.50% 57.14% 71.43%
29.17% 60.32% 63.49%
38.14% 70.58% 54.23%
MKTG
14.29%
71.43%
85.71%
100.00%
71.43%
28.57%
71.43%
57.14%
71.43%
63.49%
59.30%
STAT
SCM
INTL
ETHICS
42.86% 42.86% 42.86% 42.86%
28.57% 85.71% 85.71% 71.43%
42.86% 57.14% 71.43% 85.71%
57.14% 57.14% 85.71% 100.00%
28.57% 28.57% 71.43% 71.43%
42.86% 14.29% 57.14% 14.29%
71.43% 100.00% 85.71% 100.00%
28.57% 28.57% 71.43% 71.43%
14.29% 42.86% 85.71% 71.43%
39.68% 50.79% 73.02% 69.84%
52.87% 56.60% 40.86% 91.48%
Closing the loop
How many students meet or exceed expectations?
Almost all
Reinforce
Celebrate!
Not enough
Improve:
Where are the deficiencies?
Curriculum changes?
Possible remedies?
Closing the loop
Possible remedies:





Modified courses or new books – Disagree = 68% Agree = 14%
A change in delivery technology – Disagree = 11% Agree = 75%
Changing an learning objective – Disagree = 46% Agree = 36%
Raising admission standards - Disagree = 57% Agree = 36%
Faculty development
 Info derived from:
 Ethics and Business Law Faculty Publications
 Closing the loop in assurance of learning programs: Current
practices and future challenges. University of St. Thomas,
Minnesota UST Research Online – 2013, page 282.
Effective assessment programs should…







Flow from mission or strategic plan
Have faculty ownership and responsibility
Rely on multiple measures
Provide useful feedback
Lead to improvement
Have institution-wide support (including budget)
Be cost effective
Sample Questions – 1 / 5
Accounting:
 The right to receive money in the future is called a(n)
a. account payable.
b. account receivable.
c. liability.
d. revenue.
 Which of the following is not considered an asset?
a. Equipment
b. Dividends
c. Accounts receivable
d. Inventory
Economics:
 Economists assume that individuals:
a. are rational and respond to incentives.
b. prefer to live in a society that values fairness above all else.
c. behave in unpredictable ways.
d. will never take actions to help others.
 Rent control is an example of
a. a price floor.
b. a price ceiling.
c. a subsidy for low-skilled workers.
d. a black market.
Sample Questions with answers
Accounting:
 The right to receive money in the future is called a(n)
a. account payable.
b. account receivable.
c. liability.
d. revenue.
 Which of the following is not considered an asset?
a. Equipment
b. Dividends
c. Accounts receivable
d. Inventory
Economics:
 Economists assume that individuals
a. are rational and respond to incentives.
b. prefer to live in a society that values fairness above all else.
c. behave in unpredictable ways.
d. will never take actions to help others.
 Rent control is an example of
a. a price floor.
b. a price ceiling.
c. a subsidy for low-skilled workers.
d. a black market.
Sample Questions – 2 / 5
Finance:
 Which of the following sources of capital is generally the most expensive for an average corporation?
a. Newly issued common stock.
b. Long-term bonds.
c. Preferred stock.
d. Short-term notes payable.
 In general, which of the following is likely to occur if you randomly add stocks to your portfolio
which presently consists of three stocks?
a. The company-specific risk of your portfolio will probably decline.
b. The expected return of your portfolio will decline.
c. The market risk of your portfolio will rise.
d. The expected return of your portfolio will rise.
Management:
 Organizations needs to adopt _______ when environmental uncertainty increases
a. work specialization
b. decentralization
c. centralization
d. tight vertical control
 When Google acquired Motorola Mobility, it was pursuing a _____.
a. corporate-level strategy
b. business-level strategy
c. functional-level strategy
d. multi-domestic strategy
Sample Questions with answers
Finance:
 Which of the following sources of capital is generally the most expensive for an average corporation?
a. Newly issued common stock.
b. Long-term bonds.
c. Preferred stock.
d. Short-term notes payable.
 In general, which of the following is likely to occur if you randomly add stocks to your portfolio
which presently consists of three stocks?
a. The company-specific risk of your portfolio will probably decline.
b. The expected return of your portfolio will decline.
c. The market risk of your portfolio will rise.
d. The expected return of your portfolio will rise.
Management:
 Organizations needs to adopt _______ when environmental uncertainty increases
a. work specialization
b. decentralization
c. centralization
d. tight vertical control
 When Google acquired Motorola Mobility, it was pursuing a _____.
a. corporate-level strategy
b. business-level strategy
c. functional-level strategy
d. multi-domestic strategy
Sample Questions – 3 / 5
Information Systems:
 Information systems that process purchasing orders, billing, payroll, etc. are called:
a. Decision support systems.
b. Transaction processing systems.
c. Expert systems.
d. Functional systems.
 _____ is by far the most popular language for creating and manipulating databases.
a. XML
b. HTML
c. PHP
d. SQL
Marketing:
 The stages of the product life cycle, in order, are:
a. introduction, maturity, decline
b. introduction, growth, maturity, decline
c. growth, maturity, plateau, decline
d. innovation, early adoption, late adoption, laggard
 Which marketing management philosophy focuses on the question, “What do customers want and
need?”
a. Sales Orientation
b. Production Orientation
c. Product Orientation
d. Market Orientation
Sample Questions with answers
Information Systems:
 Information systems that process purchasing orders, billing, payroll, etc. are called:
a. Decision support systems.
b. Transaction processing systems.
c. Expert systems.
d. Functional systems.
 _____ is by far the most popular language for creating and manipulating databases.
a. XML
b. HTML
c. PHP
d. SQL
Marketing:
 The stages of the product life cycle, in order, are:
a. introduction, maturity, decline
b. introduction, growth, maturity, decline
c. growth, maturity, plateau, decline
d. innovation, early adoption, late adoption, laggard
 Which marketing management philosophy focuses on the question, “What do customers want and
need?”
a. Sales Orientation
b. Production Orientation
c. Product Orientation
d. Market Orientation
Sample Questions – 4 / 5
Statistics:
 What type of sampling method should be used when accuracy and generalizability of findings is a
primary concern?
a. Random
b. Judgment
c. Convenience
d. Quota
 In a hypothesis test, the p-value was calculated as 0.025. If the level of significance is, α = 0.05, what
is the decision regarding the null hypothesis test?
a. Reject the null hypothesis.
b. Do not reject the null hypothesis.
c. No definitive conclusion can be made.
d. In a hypothesis test, p-value and level of significance has no relationship.
International:
 The price of a currency stated in units of another currency is the:
a. London interbank rate.
b. international money rate.
c. exchange rate.
d. money market rate.
 An equity-based joint venture exemplifies which type of entry strategy?
a. strategic alliance
b. licensing
c. exporting
d. wholly owned subsidiary
Sample Questions with answers
Statistics:
 What type of sampling method should be used when accuracy and generalizability of findings is a
primary concern?
a. Random
b. Judgment
c. Convenience
d. Quota
 In a hypothesis test, the p-value was calculated as 0.025. If the level of significance is, α = 0.05, what
is the decision regarding the null hypothesis test?
a. Reject the null hypothesis.
b. Do not reject the null hypothesis.
c. No definitive conclusion can be made.
d. In a hypothesis test, p-value and level of significance has no relationship.
International:
 The price of a currency stated in units of another currency is the:
a. London interbank rate.
b. international money rate.
c. exchange rate.
d. money market rate.
 An equity-based joint venture exemplifies which type of entry strategy?
a. strategic alliance
b. licensing
c. exporting
d. wholly owned subsidiary
Sample Questions – 5 / 5
Ethics:
 What do economists call the situation where a hired manager does not have the same interests
as the owners of the business?
a. conquest and control
b. a financial intermediary problem
c. a principal-agent problem
d. a financial problem
 Under stakeholder theory, a decision with ethical consequences would consider the impact to
which stakeholder?
a. Shareholders
b. Customers
c. The local community where the business is located
d. All of the above
Sample Questions with answers
Ethics:
 What do economists call the situation where a hired manager does not have the same interests
as the owners of the business?
a. conquest and control
b. a financial intermediary problem
c. a principal-agent problem
d. a financial problem
 Under stakeholder theory, a decision with ethical consequences would consider the impact to
which stakeholder?
a. Shareholders
b. Customers
c. The local community where the business is located
d. All of the above
Questions?
Thank you very much