College of Business (CB) Assessment Plan and Results

advertisement
College of Business (CB) Assessment Plan and Results
Academic Year of Report: 2008-2009
All CB activities are mission-driven which is “CWU’s College of Business faculty and staff create value and
opportunity for our students by focusing on quality in undergraduate education at the Ellensburg campus and
university centers in the Puget Sound and central regions of Washington state. We accomplish this through
emphasis on excellence in teaching, strengthened by faculty research and supported by professional service.”
GOAL 1: Create value by graduating students who possess foundation knowledge (CWU Goal I)
Method(s) of Assessment: Direct (ETS, CPA Exam).
Who/What Assessed (population, item): Graduating Seniors: ETS Exit Exam; Graduating MPA’s: CPA Exam.
When Assessed (term, dates): Capstone courses for undergraduates; Yearly for MPAs.
Criterion of Achievement (Expectation of how good things should be?): Vested in continuously improving pass
rates on each portion of the exam.
Analysis to Date:
For the time periods, ’02-’05 and ’06-08, %At/Below CWU Mean, CWU BSBA/BSAcc students consistently perform
better in the more quantitative areas of business—accounting (85%/81%), finance (73%/65%), economics
(74%/69%), quantitative business analysis (77%/61%), information systems (74%) than they do in the less
quantitative areas—legal and social (53%/62%), international (60%/62%), marketing (58%/59%), management
(57%/64%). These results led to a revamping of the undergraduate program including closing off upper-division
courses to students who are not majors and creating non-major versions of core courses (Introduction to
Marketing and Introduction to Management). It is still too early to assess whether these changes have had an
impact. One can note there is slippage in the ETS percentiles which may be a function of better schools beginning
to take the ETS exam. Specifically, examining the list of institutions that use the exam shows that the ’06-07 list
had 30% AACSB accredited schools taking the exam. The expanded ’06-08 list shows 29% of the list is AACSB
accredited. However visual inspection indicates that there seem to be many more Research I institutions using the
exam. Though there is slippage in percentile rating, it is observed that with few exceptions for CB students, the
number of questions answered correctly is increasing.
With regard to economics, the department introduced a capstone class, effective ’07-08 for assessment purposes
and moved away from an internally created exam to an ETS exam. Due to some mistakes by the ETS company,
some students have had to take paper and pencil tests which have yet to be merged with the on-line exams. So the
final results will not be available until October, 2009.
This is the first year of the CPA exam being used to assess the MPA program. Results are not available.
GOAL 2: Create value by graduating students who possess appropriate skills in the following areas: written
communication, oral communication, teamwork, critical thinking and ethics (CWU Goal I)
Methods of Assessment: Direct (Rubrics for written, oral, teamwork, critical thinking and ethics for the
BSBA/BSAcc. Rubrics for economics include written, oral, critical thinking. MPA uses written rubric.).
Who/What Assessed (population, item): Graduating Seniors: rubrics applied to exit case study and group project
for BSBA/BSAcc. BSEcon uses Econ 406 (Economics Assessments), Econ 426 (Economic Research), Econ 352
(Managerial) and Econ 332 (Public Finance) for written and oral assessment. The critical thinking rubrics is used
through all economics courses. Exiting MPAs: written rubric applied to comprehensive exam.
When Assessed (term, dates): Capstone courses for undergraduates offered quarterly. Comprehensive exam for
MPAs offered year end.
Criterion of Achievement (Expectation of how good things should be?): For the undergraduates, CB is vested in
continuously improving. For the graduates, 90% of the students should score 3 or higher in each area of the
written communication rubric.
Analysis to date:
At the undergraduate level, this year was benchmarking and working out issues with the rubrics. The
communication rubric did change substantially. In fall, 2009 the assessments for the previous spring courses will
take place resulting in the completion of the first year of rubric use for the BSBA/BSAcc. The BSEcon is just
1
beginning their assessment program. One major change in the curriculum approach is that core course faculty
have adopted one of the program goals that rubrics are used to assess. Starting this coming year, within the
programs of BSBA, BS Accounting, and BS-Econ-Business & Forecasting emphasis, the following courses and
associated faculty have undertaken responsibility for supporting the following goals:
Course/Faculty
MIS 386
FIN 370
OSC 323
MKT 362
MGT 382
Program Goal
Oral
Critical Thinking
Teamwork
Written
Ethics
With regard to the MPA, the goal had been for 90% of the students to score three or higher in each area. The
results indicate that 70% of the scores were three or higher. The faculty noted that most of the problems came
from international students who did not do well. The faculty are discussing whether the TOEFL minimum for
graduate students should be raised.
GOAL 3: Create value by graduating students who are satisfied with their educational experience (CWU Goal 1)
Methods of Assessment: Indirect (surveys).
Who/What Assessed (population, item): Alumni.
When Assessed (term, dates): CWU Testing Services surveys graduates every 5 years by department.
Criterion of Achievement (Expectation of how good things should be?): Vested in continuously improving
perceptions of knowledge, skills, and abilities.
Analysis to Date:
Graduate satisfaction surveys. As a recently introduced service, Testing Services has begun surveys of alumni.
Testing services surveyed Economics alumni who graduated between the years of 2003-2007 and alumni
graduating in 2002-2006 from the Department of Management (which later became the Departments of
Management and Finance and Operations Supply Chain). The survey response rate for economics was 26% and for
management was 6.88%. It is anticipated that focusing on these attributes listed in the tables throughout the
curriculum will improve in the evaluation results from alumni.
Department of Economics Alumni survey of those who graduated between 2003-2007
Knowledge, Skills,
Importance in Job? Avg. on a Scale of 1
How well did CB prepare you? Avg. on
and Abilities
(not at all important) to 5 (critical)
a Scale of 1 (very poor) to 5 (very well)
Thinking critically
4
4.5
Communication
5
4
Quantitative Reasoning 4
4
Economics Literacy
4
4.5
Department of Management Alumni survey of those who graduated between 2002-2006
Knowledge, Skills,
Importance in Job? Avg. on a Scale of 1 (not at
How well did CB prepare you? Avg.
and Abilities
all important) to 5 (critical)
on a Scale of 1 (very poor) to 5 (very
well)
Thinking Critically
4.25
3.82
Communication
4.59
3.90
Quantitative
4.02
3.63
Reasoning
Information Literacy
4.12
3.68
Ethics in Decision
3.93
3.60
Making
Leading/Team
4.11
3.92
Participation
2
GOAL 4: Create opportunity by providing accessibility to students in Washington state through programs and
courses delivered at the Ellensburg campus and at well-established University Centers co-located on dynamic
community college campuses (CWU Goal 1)
Methods of Assessment: Direct (Enrollment Data).
Who/What Assessed (population, item): Annual Average FTES by departments, by location.
When Assessed (term, dates): Annually.
Criterion of Achievement (Expectation of how good things should be?): Enrollment expectations are based on
capacity as measured by number of faculty deployed in conjunction with the CB standards for maximum
enrollments by level of course taught.
Analysis to Date:
The latest set of enrollment data available, 2007-2008, indicates that the College of Business Ellensburg campus
has 59.19% of CB students followed by Lynnwood at 22.23%, Des Moines at 15.17% and 3.4% at remaining centers.
This contrasts to CWU as a whole at 85.04% followed by Des Moines at 5.69%, Lynnwood at 5.14%, and remaining
centers at 4.12%. Thus 40.8% of CB’s enrollment is at centers in contrast to 14.95% of CWU as a whole.
GOAL 5: Create opportunity for a diverse student population (CWU Goal 6)
Methods of Assessment: Direct (Enrollment data-Diversity data by headcount).
Who/What Assessed (population, item): CB and CWU student population.
When Assessed (term, dates): Yearly.
Criterion of Achievement (Expectation of how good things should be?): Gender/ethnicity levels approximate
gender/ethnicity representation in the state.
Analysis to Date: As the table shows, student diversity both in terms of gender and race, typically meets but more
often exceeds the diversity for the state and CWU in general.
FEMALE
PERSONS
White/Middle
Eastern
American Indian
Asian
Black
Hispanic
Pacific Islander
Multi-racial
Minority
MINORITY
SUBTOTAL
Census 2007-WA
In Percent
50.2
CB 2008 in Percent
51.7
CWU 2008 in
Percent
52.7
84.6
70.6
79.4
1.6
6.7
3.6
9.4
.5
3.0
1.0
11.9
3.7
7.2
.6
5
.8
4.1
2.5
8
.3
4.9
24.8
29.4
20.6
GOAL 6: Create opportunity by providing an affordable business education
Methods of Assessment: Direct: CWU tuition costs.
Who/What Assessed (population, item): CWU tuition costs.
When Assessed (term, dates): CWU tuition costs.
Criterion of Achievement (Expectation of how good things should be?): CWU tuition benchmarks
Analysis to Date:
As can be seen in the table below, CWU has the second lowest tuition in the state.
2007-2008
CWU
In-state average for full-time
undergraduates
$4,611
3
EWU
WSU
UW-Seattle
WWU
$4,805
$5,812
$5,842
$4,568
GOAL 7: Provide quality in undergraduate education through teaching excellence (CWU Goal 1)
Methods of Assessment: Indirect (Surveys: Student Evaluation of Instruction)
Who/What Assessed (population, item): Students are assessed about faculty
When Assessed (term, dates): Every quarter, every class
Criterion of Achievement (Expectation of how good things should be?): Vested in stable, continuous improvement
of the SEOI’s averaged across the college.
Analysis to Date
Student Evaluation of Instruction (SEOI data) overall average for the College of Business for EVERY quarter since
2004-Fall, 2007 has an average for EVERY question of at least 4.0 with two exceptions which were 3.99.
GOAL 8: Provide quality in undergraduate education by delivering courses with an appropriate mix of
academically/professionally quality (AQ/PQ) faculty and participating/supporting faculty (CWU Goal 5)
Methods of Assessment: Direct (Faculty who meet AQ/PQ standards and who are classified as participating)
Who/What Assessed (population, item): Faculty
When Assessed (term, dates): Yearly
Criterion of Achievement (Expectation of how good things should be?): At least 50% of the faculty are AQ and 90%
are AQ+PQ with participating faculty delivering 75% of the school’s teaching and 60% of the teaching by discipline
and location.
Analysis to Date:
For the academic year, 2008-2009, for the undergraduate program, over 50% of the faculty are AQ. Regarding the
90% rule, all disciplines and campuses with the exception of Lynnwood (89.9%) are over 90%. With regard to the
90% AQ+PQ, Finance is problematic at 80% and HRM at 82.22%. With regard to participating, 71.48% of the
teaching is done by participating faculty with Des Moines being short at 51.82%. The MPA program meets or
exceeds all benchmarks.
GOAL 9: Provide quality in undergraduate education through our faculty who research primarily in the area of
contributions to practice, and learning and pedagogical research, and secondarily in discipline-based research
(CWU Goal 5)
Methods of Assessment: Direct (Category A and Category B output for professional development)
Who/What Assessed (population, item): Faculty research output.
When Assessed (term, dates): Yearly
Criterion of Achievement (Expectation of how good things should be?): At least 50% of the faculty are AQ; Mix of
research output with contribution to practice and pedagogical research dominating the mix.
Analysis to Date:
For the academic year, 2008-2009, the undergraduate program was over 50% of the faculty are AQ. For the 5-year
period, 2004-2009, 75.9% of intellectual contributions have been in the categories of pedagogical and practice
with less than 25% being discipline based.
GOAL 10: Provide quality in undergraduate education through excellent facilities, distance education facilities,
and library data-base resources (CWU Goal 3)
Methods of Assessment: Direct (monetary investments).
Who/What Assessed (population, item): Physical facilities.
When Assessed (term, dates): Yearly.
Criterion of Achievement (Expectation of how good things should be?): Adequate CWU budget devoted to
maintain or enhance physical facilities, DE, library resources.
Results to Date:
4
In any given year, approximately 12% of the CB courses are taught by distance education via live television. This
mode of delivery was subject to an ever expanding array of technical difficulties. Last summer, the provost added
$130,000 to the capital funds already allocated to this for improvements. To date, only $2000 has been utilized for
upgrades, and though only a small amount of money was spent, it apparently was spent wisely since a March 2009
survey of faculty indicated problems were significantly diminished.
Goal 11: Provide quality in undergraduate education through linkages with CB Advisory Board, alumni, and
employers, as well as through faculty professional service (e.g., serving on professional boards) (CWU Goal 4)
Methods of Assessment: Direct: Advisory Board and alumni participation, fundraising, professional service by
faculty.
Who/What Assessed (population, item): # of Board Members regularly participating in meetings; 3 of alumni
participating in events; amount raised from private resources; # faculty participating and # of organizations
served.
When Assessed (term, dates): Yearly.
Criterion of Achievement (Expectation of how good things should be?): Maintain or increase.
Results to Date:
The Advisory Board consists of 31 business professionals from the Seattle area and central region of the state. The
Board meets 3 times per year. As a benchmark using spring when it convenes in Ellensburg, in 2009 54%
participated in the meeting in contrast to 42% in 2008. In 2009, 34% of the board participated in the “Boardroom
meets the Classroom” with 66 students attending in contrast to 2008 when 29% of the Board participated with 65
students. To assess alumni participation, consider the most recent two Business-to-Business Lecture Series (widely
advertised Seattle events featuring notable speakers). The 11/13/07 attracted 76 registrants and 24, or 32%, were
alumni and the 2-19-09 B2B had 49 registrants with 22, or 45%, were alumni. Two benchmarks can be used for
fundraising, the Competitive Edge Fund (CEF) which supports faculty research output and Scholarship funding. The
Advisory Board raised $304,607 through the CEF since December 2002, with $266,985 used to support the
Research Grant Awards Program (RGAP). This support for the RGAP has resulted in 140 peer-reviewed journal
publications by 45 faculty. In 08-09, the total amount given to students as scholarships was $74,659 and in 2009,
the total amount given was $81,950. This was an increase in $7,291. For the academic year of ‘08-‘09, 18 faculty
participated in serving 42 organizations.
5
Download