Economics 2014_2015_program_assessment_REVISED

advertisement
2014-2015 Annual Program Assessment Report
Please submit report to your department chair or program coordinator, the Associate Dean of your College, and to
james.solomon@csun.edu, director of assessment and program review, by September 30, 2015. You may, but are
not required to, submit a separate report for each program, including graduate degree programs, which conducted
assessment activities, or you may combine programs in a single report. Please identify your department/program in
the file name for your report.
College: David Nazarian College of Business and Economics
Department: Economics
Program: Economics
Assessment liaison: Glen Whitman
1.
Please check off whichever is applicable:
A. ___X_____ Measured student work.
B. ___X_____ Analyzed results of measurement.
C. ___X_____ Applied results of analysis to program review/curriculum/review/revision.
2.
Overview of Annual Assessment Project(s). On a separate sheet, provide a brief overview of this year’s
assessment activities, including:
 an explanation for why your department chose the assessment activities (measurement, analysis, and/or
application) that it enacted
 if your department implemented assessment option A, identify which program SLOs were assessed (please
identify the SLOs in full), in which classes and/or contexts, what assessment instruments were used and the
methodology employed, the resulting scores, and the relation between this year’s measure of student work
and that of past years: (include as an appendix any and all relevant materials that you wish to include)
 if your department implemented assessment option B, identify what conclusions were drawn from the
analysis of measured results, what changes to the program were planned in response, and the relation
between this year’s analyses and past and future assessment activities
 if your department implemented option C, identify the program modifications that were adopted, and the
relation between program modifications and past and future assessment activities
 in what way(s) your assessment activities may reflect the university’s commitment to diversity in all its
dimensions but especially with respect to underrepresented groups
 any other assessment-related information you wish to include, including SLO revision (especially to ensure
continuing alignment between program course offerings and both program and university student learning
outcomes), and/or the creation and modification of new assessment instruments
Preview of planned assessment activities for next year. Include a brief description and explanation of how
next year’s assessment will contribute to a continuous program of ongoing assessment.
3.
EXPLANATION OF ASSESSMENT ACTIVITIES
The Economics Department conducts assessment on a two-year cycle, which was first implemented in 2013-14. In
the first year of the cycle, we assess student work (options A and B) in all six of our SLOs. In the second year of the
cycle, we conduct program review (option C) in all six SLOs.
However, due to a miscommunication in the first year of the current cycle, we only assessed four SLOs in 2013-14.
Therefore, we assessed work for the other two SLOs this year, while conducting program review on the four that had
been assessed. To summarize:
Assessment (Options A and B) was conducted on the following SLOs:
 Understand key macroeconomic variables and how fiscal and monetary policies affect them.
 Understand how institutions, government policy, and regulation affect economic growth and the
relative wealth of economies.
Program Review (Option C) was conducted on the following SLOs:
 Have strong communication skills.
 Have strong quantitative skills, including the ability to use and interpret economic statistics.
 Be able to express key economic concepts both intuitively and more formally.
 Understand how a decentralized market economy organizes economic activity, as well as the factors
that may impede that process.
The department adopted the six SLOs above in 2012-13, pared down from a set of twelve SLOs that had proven
cumbersome. The two-year cycle for assessment and program review was adopted at the same time. As a result, we
are just now completing our first complete cycle under the new system. The second cycle begins in Fall 2015.
ASSESSMENT OF STUDENT WORK
SLO Assessed: “Understand key macroeconomic variables and how fiscal and monetary policies affect
them.”
Process: This SLO was assessed in one section of ECON 401 in Fall 2014, using a set of 21 multiple
choice questions during an in-class exam. One question was excluded from the results because the answer
was miscoded on the answer key, leaving 20 questions. The sample size was n = 37, consisting of all
students who attended the exam.
Unfortunately, the instructor only collected question-level results, not student-level results. As a result, we
cannot say how many students answered enough questions correctly to qualify as “very good,” “good
enough,” and “not good enough.” Instead, we can only report the percentage of students who answered
each question correctly.
Results: The percentage of students who answered questions correctly ranged from a low of 11% to a high
of 86%, with an average of 57% and a median of 61%. Clearly, there was a range of difficulty to the
questions. Breaking the results down by subtopic, we found:



On fiscal policy (2 questions), 35%-54% answered correctly.
On inflation and price level (5 questions), 11%-81% answered correctly.
On interest rates (2 questions), 16%-30% answered correctly.
2


On macro measures of economic activity (6 questions), 27%-78% answered correctly.
On money and monetary policy (6 questions), 49%-86% answered correctly.
Analysis: It would be preferable to have student-level results instead of question-level results.
Nevertheless, the results suggest that our benchmark of 70% of our students’ performance being “very
good” or “good enough” is not being met for this SLO. It appears that students have the greatest difficulty
with interest rates, and the greatest success with money and monetary policy. Although this is the first year
that the department has assessed the new macroeconomics SLO, in previous years there had been a pattern
of poor performance on one or both of the two macro-related SLOs that were merged into this new one.
The latest results are consistent with that pattern.
SLO Assessed: “Understand how institutions, government policy, and regulation affect economic growth and
the relative wealth of economies.”
Process: This SLO was assessed in one section of ECON 412 in Fall 2014, using a final exam question on
the topic of how an increase in money supply affects three variables (investment, capital stock, and GDP),
depending on whether new money is channeled to savers or spenders. The sample size was n = 30,
consisting of all students who attended the exam.
Results: 17% of students’ work was deemed “very good,” 53% “good enough,” and 30% “not good
enough.”
Analysis: The department sets a benchmark of 70% of students’ work being “very good” or “good
enough.” That benchmark is satisfied here, although just barely (70%). Although we had intended to
measure this SLO in two courses, one of the intended courses was not offered in 2014-15. In the future,
two courses’ worth of data would be preferable.
PROGRAM REVIEW
The department conducted program review on four SLOs. The table below summarizes the results of
assessment in 2013-14:
SLO
Have strong communication skills
Have strong quantitative skills,
including the ability to use and interpret
economic statistics
Be able to express key economic
concepts both intuitively and more
formally
Understand how a decentralized market
economy organizes economic activity,
as well as the factors that may impede
that process
WHERE ASSESSED
ECON 412
ECON 433
ECON 409
ECON 410
RESULTS
80% “very good” or “good enough”
82% “very good” or “good enough”
91% “very good” or “good enough”
70% “very good” or “good enough”
ECON 410
ECON 412
91% “very good” or “good enough”
68% “very good” or “good enough”
ECON 411
ECON 433
85% “very good” or “good enough”
77% “very good” or “good enough”
As the results indicate, the department’s 70% benchmark for “very good” or “good enough” was clearly
met with respect to three SLOs, and ambiguously met for one SLO (“Be able to express key economic
concepts both intuitively and more formally”). For that reason, the department decided that no remedial
action was required.
3
The department did consider the possibility of calibration to deal with the disparate results in some
categories (91% vs. 70% on one SLO, and 91% vs. 68% on another SLO). However, the types of question
used to assess were too different to allow meaningful calibration. The questions used in different courses
tended to cover different aspects of the topic in question. For instance, in the case of “quantitative skills,”
assessment in ECON 409 focused on econometric (statistical) techniques, whereas assessment in ECON
410 focused on use of calculus for optimization in a theoretical model.
COMMITMENT TO DIVERSITY
None of the program’s SLOs is specifically related to the university’s commitment to diversity, except
insofar as our instructors always seek to make sure their assignments and activities respect that
commitment.
PREVIEW OF PLANNED ASSESSMENT ACTIVITY
In Fall 2015, the program begins a new assessment cycle. All six SLOs will be assessed in at least one, and
usually two, courses.
4
Download