General Education Committee Annual Report, 2013-2014 Membership Nadia White, Journalism, Chair Hayden Ausland, MCLL (fall) Ebo Uchimoto, Physics (spring) Susanne Caro, Mansfield Library Linda Frey, History (fall) Tobin Shearer, History / AAS (spring) James Randall, Music Kimberly Reiser, Applied Arts & Sciences Angela Dresselhaus, Mansfield Library Khaled Huthaily, Anthropology Lilian Calderon, BMED Mark Cracolice, Chemistry (spring) 2014 2016 2014 2016 2015 2015 2015 2015 2015 2016 Student Member Tucker Squires Regular Guest Attendee and Contributor Sue Bradford, Missoula College- Applied Arts and Science ADDITIONAL REPRESENTATIVES (Ex-Officio) Arlene Walker-Andrews, Associate Provost Joe Hickman, Interim Registrar Nancy Hinman, Interim Associate Provost Beth Howard, Interim Director, Office for Student Success General Education Course Review The General Education Committee reviewed 21 proposed courses for general education groups and 10 one-time only experimental general education courses. Most of these were for the Global Leadership Initiative. Three of the one-time-only courses were not approved and 7 of the proposed existing courses were not approved for general education. Four of these were 300 level courses taught in French. The instructor appealed the committee’s decision, but the Committee was not persuaded. One course was recommended for a different group, a revised form was submitted and it was approved. Two history courses (HSTR 364, Environmental History and HSTR 472, Problems of Peace and Security) to be offered one last time as Ethics courses. Both faculty members are retiring and did not submit paperwork for the last review cycle. The courses will be removed from History’s curriculum after this spring. The courses have been taught as Ethics courses for the past 20 years. The exception was granted for the courses. The four-year rolling review of Historical & Cultural, Natural Science and Mathematics began last spring and continued this fall. Six additional courses were renewed for the Historical and Cultural Group and 10 for Natural Science. One of the Historical Courses was recommended to transition to Literary and Artistic Studies. The rolling review consent agenda was presented to the Faculty Senate in December and changes were entered for the fall 2014 catalog. Two history courses (HSTR 364, Environmental History and HSTR 472, Problems of Peace and Security) were granted an exception to be offered one last time as Ethics courses. Both faculty members are retiring and the courses will be removed from History’s curriculum.. Again there seems to be some issues with the clarity of the criteria and learning goals for some of the groups. For example there has been some contention over the Ethics and Human Values Group. One proposed ethics course: LSH 389, Placebos, The Use of Words was not recommended for approval but was approved by the full committee. The Committee also considered an appeal for an ethics course that was denied: CHMY 302 Chemistry Literature & Scientific Writing. It went through several iterations in order to be approved. There is concern that Ethics courses not be too specialized, but there appears to be the need for professional ethics to count for general education for some of the professional programs and sciences considered extended majors due to credit requirements in excess of 120 for graduation. This spring the review of Literary & Artistic Studies, American & European, and Indigenous & Global was conducted. Courses approved in 2011 or later were exempt from the review and programs were given a one-year grace period. Many of the forms were not filled out properly and revisions were requested. In addition many of the justifications for inclusion of upperdivision courses were missing or insufficient. The Committee will consider creating an FAQ or provide guidelines for reasonable reasons for upper-division courses to be include in general education. Courses Existing Submitted Exempt Approved Followup pending Not approved Will contact to submit in the fall Literary & Artistic Studies 47 32 2 remove 3 34 6 2 American & European 25 15 3 15 Indigenous & Global 58 43 8 22 5 removed 9 2 12 Three experimental courses were approved for one-time-only general education designation during the spring. The courses missed the fall deadline due to the delay in available budget notifications. Language Requirement Motion After considerable debate and follow-up email correspondence from Senators, and additional efforts by ASCRC, the motion: “Effective fall, 2015, undergraduate students must fulfill the general education modern and classical language requirement (and cannot use a symbolicsystems exception to this requirement) unless they are enrolled in a program of study requiring over 48 credits for a first baccalaureate degree.” was approved by the Faculty Senate on February 13th In order for the motion to be implemented by fall 2015 the exemptions to the language requirement will be reviewed next fall. ASCRC drafted a form to be used for this process. Continued discussion of issues with the criteria and learning outcomes for Indigenous & Global and American & European Groups The Committee discussed the difficulty with the definitions of American and European and Indigenous and Global perspectives. Last year’s American and European workgroup proposed three options: 1) eliminate the category, 2) fix criteria and learning goals with minor changes to clarify criteria, 3) realign group with other groups to address overlap with other areas and clarify alignment of groups with the MUS core, and 4) review entire General Education Framework. Both the American and European and Indigenous and Global Perspectives are so broad that they are ambiguous. It is unclear whether the distinction is between geography, discipline, or identity. Because of this the Committee considered the possibility of a diversity requirement which would align better with the MUS Core. The Ethics category is inherently American & European, but the criteria and learning outcomes could be refined to allow for professional ethics and include respect for others. The History and Culture perspective could be narrowed by removing the culture component. The general education framework might be easier to manage with fewer clearly stated categories. Any revision must consider the pragmatics of assessment. The committee compared the MUS Core to UM’s and MSU’s General Education Requirements. The major differences from UM’s program include: o o o o Ethics and Human Values Upper-division Writing in the major Language requirement Two of the MUS Core categories (Social & History and Humanities & Fine Arts ) require 6 credits and give students the choice. o MUS Core has an American Indian Education for All Component The MUS Core categories have stronger criteria and learning goals. UM’s program is more discipline bound. Montana States general education program (Core 2.0) aligns better with the MUS core, but has some differences. It specifically requires a Social Science and Fine Arts course, and requires courses in Contemporary Issues in Science, University Seminar, Quantitative Reasoning, and is very clear about the College Writing. Assessment Associate Provost Walker-Andrews spoke to the Committee on February 19th about the accreditation requirement to assess the University’s General Education Program. The third year self-study addresses the core themes, resources, and various standards. Section 2C.9 and 2C.10 concern General Education. The seven-year report must show evidence of assessment: 2.C.10 The institution demonstrates that the General Education components of its baccalaureate degree programs (if offered) and transfer associate degree programs (if offered) have identifiable and assessable learning outcomes that are stated in relation to the institution’s mission and learning outcomes for those programs. The committee reviewed expectations, existing general education assessment programs from other universities, the history and intention of general education at the University of Montana, and various evaluation rubrics, including the Essential Learning Outcomes Rubrics. A Moodle shell was set up to house all the materials considered by the committee. Assessment of General Education has been, and continues to be an ongoing concern central to the work of the General Education Committee. (See Gen Ed Current Assessment Activities, attached.) Assessment of General Education can be conducted in a variety of ways and the General Education Committee reviewed options, examples and models, including: Assess each of the general education perspectives. Ask instructors how they are assessing learning outcomes. Randomly select courses and students’ answers to test questions or some other assignment. One concern with this approach is the perception of assessing the faculty member’s teaching. Review and revise the General Education mission statement/preamble to ensure its goals are assessable then develop a mechanism to assess students’ demonstration of those goals before they graduate. Then create a new mechanism for measuring the stated outcomes. One suggestion was to use work produced in capstone courses as points of assessment. The committee was concerned that the current goals are difficult to assess outside of a broad portfolio review. Currently, the goals of the preamble are: To develop competent and humane individuals who are informed, ethical, literate, and engaged citizens of local and global communities. Students should become acquainted with issues facing contemporary society, participate in the creative arts, develop an understanding of science and technology, cultivate an appreciation of the humanities, and examine the history of different American and global cultures. Upon completion of the general education requirements students should be able to articulate ideas orally and in writing, understand and critically evaluate tangible and abstract concepts, and employ mathematical and other related skills appropriate to a technologically focused society. The rolling review of the general education perspectives assesses the inputs and reviews syllabi and stated course goals for alignment with Gen Ed goals. In 2014, an assessment section was added to the general education form for faculty to state specifically how learning outcomes will be measured. This should start the process of collecting metrics and ensure that departmental assessment of outcomes addresses General Education goals as well as departmental goals. The committee discussed the challenges of a campus-wide assessment of goals as broad and foundational as those set forth in UM’s General Education. The assessment should be systematic and involve shared definitions. A four-point rubric is typically used. Associate Provost Walker Andrews indicated that a sample size of perhaps 50 students from each general education area would be acceptable. There are several levels where the assessment could take place. A new self-reporting Likert survey from the preamble was drafted (appended). It evaluates perception /opinion not the educational experience, but may fill in some of the gaps. The Committee will explore having GLI students complete the survey since they are randomly selected. The committee acknowledged that both student self reports and grades are insufficient to evaluate student learning outcomes. Assessment of student work would be the gold standard, but implementing such a portfolio review, to evaluate the full range of general education goals, is far more complex than a single perspective review, even one as complex as the new writing assessment review process at UM. It will be difficult to develop a mechanism that fits everything. Several examples of types of assessment were discussed. Such as asking students the same question at the beginning of the semester and at the end, or collecting portfolios of random students’ work embedded in courses from diverse disciplines. Moodle could be used for instructors to upload students work as evidence of their learning course outcomes. The Committee could start by asking instructors teaching general education course on Moodle to send student artifacts. Another option would be to look into the possibility of portfolio review for assessment. The Committee could investigate whether individual programs /schools accreditation reports include assessment data that could be linked to the essential leaning outcomes /general education. Student focus groups and survey results might be feasible. Although portfolio review is the gold standard for assessment, testing actual outcomes by evaluating student work is complicated. Collecting student outputs from current general education courses offered on Moodle could be an option, but would require extensive work on a rubric and logistics. The Oregon Model involved individual professors’ using value rubrics and holding discussions. It seemed very involved and time consuming. Another suggestion was to collect student work from discipline capstone courses to see whether they cover some of the learning outcomes implied in the preamble. One thing the committee can do now is improve the collecting of data on the current evaluation of the groups in terms of how many forms were incomplete, required follow-up, were approved, or denied. Although the Committee adopted the Essential Learning Outcomes as a tool for assessment at the recommendation of Associate Provost Walker-Andrews, actual adoption of this national standard to evaluate UM’s General Education Program would required too complete an overhaul of the program to be effective in a timely manner. In order to actually use the essential Learning rubrics it would be necessary to revise the general education criteria and learning outcomes to be parallel with the Essential Learning Outcomes language. For now, the Essential Learning Outcomes may be a resource, but not, ultimately, a guiding document. Additional Discussion Items Board of Regents General Education Council Chair White attended the BOR General Education Council meeting in Helena and discussed revisions to the MUS Core courses. Other concerns about General Education The current program does not prepare students to be engaged citizens through experience in discourse. Technology / computer literacy is a proficiency component missing from the General Education program. It seems that some majors offer many general education courses and do not encourage their students to take courses outside of the major. There has long been tension between the professional programs and the liberal arts. One possibility would be to differentiate that students pursuing a Bachelor of Arts degree are expected to take general education courses outside of their major, but students pursuing a professional degree may satisfy several general education courses within their major. This is another area where data would help to determine whether this is a pervasive issue. It should be possible to get data from the Registrar’s Office as long as the committee is very specific about what is needed. The Committee could also consider conducting a survey. Concerns about recommendations in the President’s Advisory Academic Planning Group’s impact on General Education Chair White asked that the Committee consider three questions/ issues: 1) The relationship of the Global Leadership Initiative and General Education 2) How should the General Education Committee work to ensure a broader campus understanding that interdisciplinary, international and global courses are already part of the General Education course offerings and programmatic goals? 3) What is the role of a traditional liberal arts education at a public research institution? Attachments/ Spring 2014 A memo on the state of General education assessment at the University of Montana Assessment of the University of Montana’s General Education program was initiated in 1984 and was most recently revised in 2009 after a broad restructuring of the General Education program was approved by the Faculty Senate in 2008. That revision signaled the beginning of a four-year cycle of review at two levels of the General Education Program: Each perspective is reviewed as are the courses that comprise each perspective up for review. The committee is completing the first turn of that review cycle in Spring 2015. The General Education program for the University of Montana Mountain Campus requires at most 49 credits of approved General Education credits. Students may opt to take more designated classes, but there are several ways that students might satisfy the General Education course load by taking fewer than 49 credits. For example, a student might test out of the language requirement, double dip in one or two perspectives, transfer into UM with a completed Associates degree, or pursue a major for which a symbolic systems class has been approved instead of a foreign language. Course review Courses for which General Education status is newly sought are reviewed for suitability each autumn. Review of existing General Education courses is completed each spring. The process for reviewing existing courses is cyclical and occurs concurrently at two levels. Courses are reviewed every three years by way of a rotation through the perspectives. Major changes of a course may trigger an early review. In turn: Each course is reviewed to see if it satisfies the goals of the perspective it represents. Each perspective is reviewed to see if the goals of the perspective are clear and appropriate to the General Education mission; Course review is completed by a subcommittee comprising a chair from the General Education Committee and members of the faculty at large and the General Education Committee who teach in fields relevant to the perspective. The subcommittee specifically reviews the course syllabi and narrative provided by the sponsoring faculty member to ensure the clear description of: the goals of each General Education class, how those goals satisfy the intent of the perspective, how the goals will be met in the class, and how achievement of those goals by the students is to be measured by the faculty member who teaches the class. Assessment of individual courses and student performance remains in the hands of the faculty who teach each General Education course and their respective department. Courses that fall short in subcommittee review are returned to the sponsor for revision before being considered by the full General Education Committee. Where no resolution is reached, a grace period of course review is extended and the sponsoring faculty member is asked to complete clarifications and resubmit for review during new course review in the Fall. If that fails, the General Education designation for the course is removed from the course catalog the following year. Currently, 90 courses are under review by subcommittees from the perspectives Literary & Artistic (38,) Global & Indigenous (37), and European & American (15). A substantial minority of the courses reviewed was returned for revision. A subset of those has entered the grace period and may seek further review in the Fall. Perspective review When preparing to address individual courses up for review, the subcommittee considers the perspective as a whole to be sure the perspective description and goals are clearly stated and useful to the committee and that the perspective articulates clearly with the General Education preamble. The subcommittee reports perspectives that require clarification or revision to the full General Education Committee and remedial actions a re considered. Those actions may include improving the perspective definition, overhauling the perspective description or goals, or recommending elimination or replacement of the perspective to the Academic Standards & Curriculum Review Committee. Currently, three of the eight perspectives overseen by the General Education Committee are under review as part of this process: Indigenous and Global Perspectives, American and European Perspectives and Ethics and Human Values. Additionally, any perspective may be brought up for review by a vote of the majority of the committee membership. Program outcome review During the completion of the first full cycle of review several concrete steps have been taken to initiate the process of developing program level assessment of the General Education Program, the next step towards a comprehensive assessment strategy. The committee has: Reemphasized the University of Montana’s commitment to a Liberal Arts education by clarifying the foreign language requirement. Seen the completion of a pilot project of authentic assessment of the Writing perspective of the General Education requirements and initiated planning of the next perspective-level assessment pilot project. Evaluated UM’s General Education mission statement for its potential to be assessed. As a result, the committee revised the course renewal request form to require faculty to identify specific assignments used to evaluate student’s grasp of key concepts related to the Gen Ed perspective assigned to that course. Identified perspectives that are more readily assessed, and those for which defining language posses assessment challenges. Created an assessment survey tool for evaluating student perceptions of the General Education material they have studied. Initiated review of assessment models that examine student outcomes and identify existing relevant data and resources for the assessment of program goals and learning objectives. These include tools such as The Essential Learning Outcomes and VALUE rubrics developed by the Association of American Colleges and University. As the school year draws to a close, the committee would like to draw attention to two areas of concern: Assessment workload and General Education disengagement. Assessment workload As a committee, we support the call for student-level assessment and concur that examining student outcomes is an important metric for evaluating our educational mission. At the same time, even as we develop a model for student-level program assessment, it is increasingly clear that the task of additional assessment falls on members of the faculty without a concomitant work reduction. This committee believes that Gen Ed instructors already complete student-level outcome assessment. As such, assessment is more appropriately overseen at the departmental level. It is likely that the same faculty completing assessment at the departmental level would be the most taxed by an additional, an in some ways redundant and less personal, assessment at the campus-wide level. We view our task as one of empowering departments to coordinate and collect the results of student assessment rather than adding another layer of bureaucracy and work for faculty. Disengagement The General Education Program at the University of Montana affects almost everyone involved in undergraduate education but few outside of this committee claim responsibility for it. And so it is of concern that several efforts to restructure the undergraduate curriculum appear to misunderstand the General Education Program and would benefit from the participation of a knowledgeable advocate for General Education. Specifically, areas of concern include: The release of the Task Group on Academic Programming report in 2013 illustrated a broad misunderstanding of the General Education Program. The group reported it was unable to avoid the General Education program in its work, yet never consulted with the General Education Committee and suggested a variety of contradictory changes to the Gen Ed Program. Initiation of the Academic Alignment and Innovation Program has begun, using the Academic Programming report as a springboard without specifically seeking involvement from the General Education Committee or broader Gen Ed community. In sum, the General Education Committee is charged with advocating for a strong liberal arts education through a well-structured set of undergraduate requirements. While assessment of the program is appropriate and ongoing, development of a student-level assessment of General Education’s broad goals is not an appropriate use of faculty resources at this point in time. The implementation of such an assessment will duplicate departmental level assessment, prove prohibitively expensive, and take years to implement. Such an effort will likewise preclude investment of faculty time and energy at higher level planning that appears likely to alter the General Education Program before an assessment program can be implemented. …………………………………………………………………………………………………… General Education Assessment Survey The General Education Program at The University of Montana –Missoula articulates the following objectives: Students completing the General Education Requirements of The University of Montana – Missoula will… Become acquainted with issues facing contemporary society Participate in the creative arts Develop an understanding of science and technology Appreciate the humanities Examine the history of different American and global cultures Able to articulate ideas orally and in writing Understand and critically evaluate tangible and abstract concepts Employ mathematical and other related skills appropriate to a technologically focused society The following survey instrument will assess student perceptions concerning whether or not this program succeeded in accomplishing its stated objectives: General Education Questionnaire Please complete the following information: Age: _______ Gender: ______ Culture/Ethnicity: ____________________________________ In what semester/year did you complete the General Education requirements: ___________________ Did you complete all of your General Education coursework at University of Montana? Yes ⬜ ⬜ No For each item below, please indicate one response that best reflects your learning experiences in completing the University of Montana General Education Program. 1. General Education courses provided me with an awareness of issues facing contemporary society. ⬜ Strongly Agree ⬜ Agree ⬜ Undecided ⬜ Disagree ⬜ Strongly Disagree 2. My General Education courses included opportunities to participate in one or more of the creative arts (drama, dance, music, fine arts, oratory, or writing). ⬜ Strongly Agree ⬜ Agree ⬜ Undecided ⬜ Disagree ⬜ Strongly Disagree 3. General Education courses helped me develop an understanding of science and technology. ⬜ Strongly Agree ⬜ Agree ⬜ Undecided ⬜ Disagree ⬜ Strongly Disagree 4. I have a greater appreciation of the humanities as a result of my General Education courses. ⬜ Strongly Agree ⬜ Agree ⬜ Undecided ⬜ Disagree ⬜ Strongly Disagree 5. General Education courses required me to examine the history of different American and global cultures. ⬜ Strongly Agree ⬜ Agree ⬜ Undecided ⬜ Disagree ⬜ Strongly Disagree 6. General Education courses improved my ability to articulate ideas orally and in writing. ⬜ Strongly Agree ⬜ Agree ⬜ Undecided ⬜ Disagree ⬜ Strongly Disagree 7. As a result of General Education courses, I can understand and critically evaluate tangible and abstract concepts. ⬜ Strongly Agree ⬜ Agree ⬜ Undecided ⬜ Disagree ⬜ Strongly Disagree 8. Completing the General Education requirements improved my ability to employ mathematical and other related skills appropriate to a technologically focused society. ⬜ Strongly Agree ⬜ Agree ⬜ Undecided ⬜ Disagree ⬜ Strongly Disagree