Academic Rigor – Departmental Reports Note: This document represents the independent submissions of the various departments and units listed prior to the Madison Institute on Academic Rigor held on June 16 and 17, 2011, and therefore do not reflect ideas that may have emerged during that process. This information should not be viewed as position statements, but rather as ideas and department ideologies which are open to revision following review of other faculty thoughts as well as discussions in the Madison Institute sessions. (References to departments/colleges have been removed) 1. For the xxxxx Department, academic rigor begins with strict adherence to our Undergraduate Educational Goals, Objectives, and Course Requirements. They are listed below. GOALS Knowledge: Students will acquire knowledge of the world's great literary, philosophical, religious, and artistic traditions. Students will comprehend the historical and social context of major political, intellectual, religious, economic, and cultural developments. Students will evaluate the evidence, ideas, and models needed to perceive how people relate to each other, to institutions, and to communities and to make judgments about the world. Students will comprehend the major achievements in the fine arts in world civilizations and the historical, social, and cultural context in which they were created. Students will discern the values, ethics, and legal issues in world civilizations, including their own, and how these issues relate to Western ideas of a free society. Skills: Students will read, write and speak critically, mastering how to make informed judgments based on existing evidence. Students will critically evaluate evidence: identify a thesis, identify sources used in the argument, identify the conclusions, and determine the perspective, bias, and reliability of the argument. Students will solve problems and communicate persuasively. Students will demonstrate proficiency in using a computer and a facility for communicating in a foreign language. Experience: Students will take on responsibility to become independent, creative and self-directed learners and complete projects of orderly study. Students will thoughtfully consider a number of positions before deciding which to support and to develop ways of perceiving, evaluating, and behaving within cultural systems different from their own. 1 Students will understand the importance of change and continuity over time, how people responded to change, and the importance of cause and effect in xxxxx. Students will discern the dynamics of an increasingly multi-cultural society. OBJECTIVES: Content: Students will demonstrate in all xxxxx classes and in assessment data collected by the Department knowledge of the major events, themes, individuals, and issues in world xxxxx. Chronology: Students will demonstrate in all xxxxx classes and in assessment data collected by the Department the importance of change and continuity over time, and how people throughout xxxxx have reacted to such change. This will include the importance of cause and effect in xxxxx, and the significance of historical context. Collection: Students will demonstrate the ability collect historical evidence in XXXX 395 and 400 level xxxxx classes and in assessment data collected by the Department. Students will demonstrate through the research process in these courses an awareness of how historians gather evidence using bibliographical materials available in printed, electronic and computerized formats. Analysis: Students will demonstrate in XXXX 395 and 400 level xxxxx courses and in assessment data collected by the Department an understanding of the different approaches employed by historians in approaching this evidence and how historical perspectives have changed over time. Central to the analysis of evidence is the critical selection and evaluation of evidence. For historians, thinking critically might be described as: 1) Identifying the thesis of an argument 2) Identifying how sources have been used in an argument 3) Identifying the conclusions of an argument 4) Determining the perspective, bias and reliability of an argument 5) Evaluating the strengths and weaknesses of their peers' arguments. Synthesis: As the culmination of the critical thinking process, students will demonstrate in XXXX 395 and 400 level classes and in assessment data collected by the Department an ability to produce a final written and oral synthesis of evidence. This will be achieved through the critical examination of arguments and synthesis of these arguments into a coherent product with a thesis and conclusion(s) based on responsible use of the evidence. Writing skills would be reinforced through an emphasis on writing, editing, proofreading, and word processing (computer) skills. Students will demonstrate the ability to articulate a thoroughly researched, carefully thought, and well organized positions in both written and oral formats. COURSE REQUIREMENTS The department has implemented course requirements for each level of course. These requirements appear on course syllabi. 100 level courses include XXXX 101 and 102. These courses offer broad interpretive overviews of world xxxxx (to 1650 and since 1650 respectively). Taught primarily as lecture with some discussion, the courses combine lecture and discussion to permit students to learn the content and chronology of world xxxxx, to learn how historians collect, analyze and synthesize evidence and engage in introductory exercises that require them to conduct analysis and synthesis. Readings in 100 level courses generally consist of a narrative text, primary source readings, and a number of monographs which specifically deal with major issues in world xxxxx. Faculty 2 generally assign short written assignments (precises, book reviews, out of class essays) that amount to roughly 10-15 pages of formal, out of class writing. 200 level courses are organized on the basis of world regions (i.e. U.S., Europe, Africa). Classes at the 200 level are taught primarily as lecture with some discussion. The 200 level courses introduce students to the major historical issues of a region and demonstrate how this particular region fits into the context of world xxxxx. Students gain a general knowledge of the content and chronology of the region studied, learn how historians collect historical evidence for later synthesis and analysis, and engage in introductory exercises which require them to conduct historical analysis and synthesis. Readings for a 200 level class generally consist of a central text, a book of either primary sources and/or historiographical readings, and two or more monographs which specifically deal with major issues in the region's xxxxx. Faculty generally assign several short written assignments (precises, book reviews, out of class essays) which amount to roughly 10-15 pages of formal, out of class writing. 300-level courses are taught as a combination of lecture and discussion. Students gain an in depth knowledge of the content and chronology of the theme or time period studied, learn to exhaustively collect historical evidence, and learn advanced methods of historical analysis and synthesis. Students are expected to deal with historiographical interpretations in this level class. Students demonstrate an ability to use the computer for word processing and learn how to locate source materials on the Internet. Students read between 800 and 1600 pages of material and write 11-20 pages of formal, out of class writing (book reviews, term papers, annotated bibliographies) for each 300 level class they take. 400-level courses are usually taught as seminars. Courses at this level are essentially capstones where students are expected to show an advanced ability to meet all department objectives. Students gain an in depth knowledge of the content and chronology of the topic or historical period studied, will continue to develop their ability to exhaustively collect evidence, which will be rigorously analyzed before the presentation of a sophisticated synthesis of that evidence. Toward this end, students are expected to deal with primary source materials as much as possible, to address historiographical nuances, to write a research paper, or precis, or series of papers. Ability to use a computer for word processing and to locate source materials is required. Students read between 1000 and 2000 pages of material and write 15-25 pages of formal, out of class writing (book reviews, term papers, annotated bibliographies) for each 400 level class they take. These goals, objectives, and course requirements reflect the department’s high academic standards. These standards are premised upon substantial reading and writing requirements for each course. Consequently, faculty members have also been encouraged to include an essay component in examinations to test not only students’ factual knowledge of assigned material but also their critical thinking abilities and writing skills. In addition to implementing the abovementioned goals and objectives, the maintenance of high academic standards also includes: an emphasis on holding all classes and office hours; periodically reviewing syllabi to ensure that all faculty adhere to the fundamental departmental requirements; gathering data on ways to improve courses via student evaluations and surveys; and reviewing the CFI website to keep abreast of innovative pedagogical strategies. Clearly, the Xxxxx Department would consider any program academically rigorous that closely adhered to its own specific goals, objectives, and course requirements. However, there are two policies that the Xxxxx Department has instituted that may prove useful to other programs that are interested in maintaining academic rigor. First, the Xxxxx Department requires the review of a syllabus before allowing transfer of credit from another college or university. In most instances, course descriptions alone do not provide sufficient information to determine whether or not a particular course from another institution meets all departmental requirements. 3 Second, for the transfer of upper division courses that are not taken in conjunction with an approved study abroad program, xxxxx majors are allowed to transfer a maximum of two courses toward completion of the major. Each course transfer request is approved by the department’s Majors Committee on a case-by-case basis. The Xxxxx Department maintains that if a student’s degree is coming from JMU and the department is certifying its rigor, the upper-division classes taken for the major should be courses offered at JMU. Finally, our departmental discussion also produced three general suggestions that would enhance the academic culture at JMU. These suggestions are that the university should: 1) encourage more open scholarly forums for faculty; 2) support more travel to conferences and for research; and 3) work toward smaller classes to consistently improve the quality of instruction. Though these suggestions are not new, they remain essential to a rigorous academic environment. 2. In its department meeting on April 13, 2011 the xxxxx Department had a wide-ranging, hour long discussion on academic rigor. The discussion addressed the questions posed by Dr. Benson but also went beyond them. Academic rigor in xxxxx is seen as involving providing students with challenging assignments that are graded using explicit standards which distinguish between different levels of performance along with providing students with meaningful feedback. In addition to our internally-focused discussion of both grade inflation and punitive grading, we also thought it was important to look at broader issues of curriculum instruction. While it was recognized that large classes could be taught it a rigorous fashion given the goals of the department and the academic skills we were trying to teach, it was also felt that large classes worked against this. Many faculty reported that they had to change or drop assignments (particularly those that are writing intensive) they found to be effective in promoting critical thinking skills because of the size of their classes. It was noted that exit interviews with graduating seniors repeatedly brought forward comments by our better students on the importance of rigor in their studies. They also noted that not all students felt this way and that this often had a negative impact on classes. To succeed, an added emphasis on academic rigor must be embraced by students as well as faculty. Increasing academic rigor is not a matter of adding more honors courses for our better students but changing the broader curriculum. Our discussion of academic rigor also stressed the point that no department could succeed in strengthening the rigor of its program without a university-wide effort. One point made by several faculty members was the need for the university to reexamine its mission statement and re-articulate an emphasis on academic rigor that is supported by its allocation of resources and the priority given to academics in the university. Additionally, it was noted that an emphasis on rigor would lead to lower grades for students and perhaps a higher failure rate. This is something the university must be willing to acknowledge and accept. Academic rigor in xxxxx was also felt to require students to take courses in a prescribed sequence. When this does not occur students enter into upper level courses without having been exposed to concepts and skills they need to succeed and it requires that instructors adjust the content of these courses to make time to go over this material. The department is adjusting the structure of the major to establish a clearer sequencing of courses for students. The ultimate success of this strategy is highly dependent on the number of students in the major and the size of the faculty. Historically our problem has been too many students entering the major as juniors and seniors trying to complete the major in a total of 3 semesters. This results in their taking all of their xxxxx courses together rather than in sequence. The department’s discussion of academic rigor also led to a suggestion that the general education program might be reexamined. Currently there is little connection between the academic skills taught in general 4 education and the needs of majors. Several examples were given. One faculty member noted the need for students to develop an ability to understand the nature of social science inquiry so that they might be able to frame paper topics more effectively in upper level classes. Social science critical thinking classes in general education do not do this. Many noted that the single greatest writing need for our major is for students to learn how to write review of the literature essays that emphasize skills in synthesizing, organizing and evaluating ideas from multiple sources. These are foundational writing and thinking skills that are necessary for our students to master prior to learning how to conduct a social science literature review in our major. This does not occur in General Education for many students who have successfully completed General Education requirements. Research methods courses depend upon Xxxx 220 to provide a foundation for instruction but no communication takes place between the Xxxx Department and research methods instructors as to what is taught in Xxxx 220. In the absence of a strong link between general education and majors it forces majors to cover topics and skills at the expense of material in their disciplines. 3. (1) What constitutes academic rigor in xxxxx? High development of ability to think abstractly and independently with the material, as opposed to a mere transfer of factual knowledge Demanding amount of reading assigned Excellence in writing: conceptual, grammatical, compositional Significant and demanding writing assignments No grade inflation o No “A’s” or “B’s” for light amounts of work o “C” should signify “average”. Currently at JMU, “B” seems to be the default “average” signifier, rather than indicating truly superior performance (2) Academic rigor elsewhere in the University At least a minority of JMU students somehow have internalized the notion that General Education courses are supposed to be “easy.” In student narrative evaluations of our professors teaching General Education sections, the “complaint” most frequently registered (with all due indignation) by students is: “This class was too hard for a GenEd course!” We regard grade inflation at JMU is a problem. Across the University 80%+ grades assigned are “A’s” or “B’s.” Professors who enforce higher standards run the risk of incurring student backlash because some students have not experienced a series of honest appraisals of their reasoning and writing capabilities. Based on faculty experience in other universities, control of grade inflation is only effective if it is a university-wide expectation and accountability is enforced from the top down. If it is not identified and publicized as a priority at the highest levels of university administration, efforts to control it become ad hoc and piecemeal. In xxxxx scrutiny of grade distributions is a stated factor in the annual evaluation of faculty, and, we believe, in some other xxxxxx departments. Large class sizes often complicate the implementation of demanding assignments, since such assignments often entail that students seek assistance. One professor reports hearing numerous movies being shown in the classroom next door to where he is teaching, and besides the noise interfering with his class, cannot help doubting the academic integrity of such a course. 4. The Department of xxxxx discussed several dimensions of academic rigor at its 4/15/11 department meeting. We focused on trying to identify principles that we think are applicable both to our department’s programs and to other academic programs at JMU. The following five core principles had considerable support in that discussion: 5 1] PREPARATION – Preparation here involves ensuring that curricular designs provide a suitable academic foundation in lower-level courses that permits instructors and students to explore material in greater depth in upper-level courses. 2] RESPONSIBILITY – Responsibility here refers to the need for students to take full personal responsibility for their learning and to the need for instructors to work to identify areas of strong performance, areas of satisfactory performance, and areas that need improvement when evaluating students’ work. 3] CRITICAL THINKING – Per Bloom’s taxonomy regarding the cognitive domain, students in all courses should be asked to perform both lower-order cognitive tasks (involving knowledge, comprehension, & application) and higher-order cognitive tasks (involving analysis, synthesis, and evaluation). Different disciplines (and different subfields within disciplines) will have distinctive specific tasks in both portions of the cognitive domain, but all college-level courses should involve some higher-order tasks involving critical thinking as envisioned by this taxonomy. 4] DIVERSITY of SKILLS – As they move through a rigorous academic program, students should be developing a diversity of skills via both their ungraded work (in and out of the classroom) and their graded assignments (in and out of the classroom). 5] EXPLORATION – Exploration here refers to exposure to distinctive learning styles and to new subject matter. A rigorous, college-level education should aspire to assist students to develop a passion for lifelong learning by modeling exploration across the curriculum. 5. Opening comments: This committee was charged with the task of identifying some determinants of academic rigor that exist in our department. From an email written by Dr. Benson, we were to consider the following: “…we also realize there are probably some general principles/parameters that are useful in defining academic rigor. We wish to go about identifying those general parameters…As a first step; we are asking that each academic unit provide (1) what they see as determinants of academic rigor within their program/unit and (2) elements that they would consider/see as crucial in identifying academic rigor in another perhaps dissimilar academic program/unit. The motivation to form this committee comes from a series of conversations with faculty sponsored by the Vice President for Academic Affairs, the Speaker of the Faculty Senate, and the Interim Provost, Dr. Jerry Benson. The following points are worth bearing in mind with respect to this issue: Dr. Benson’s motivation stems from faculty concern; it is supported by the administration Dr. Benson does not seek to standardize “academic rigor” across all departments Dr. Benson is content to let individual departments define/implement standards of rigor as/if needed The issue of academic rigor arose due to faculty concerns pertaining to one or more of the following issues: Over the past several decades grades have gone up but it’s not clear if students are actually learning more now than in the past; this trend possibly reflects grade inflation Technological advances have made it easier for students to cut-corners and/or outright cheat on assignments There is an on-going, often pessimistic national discussion on the value of a collegiate education 6 Evidence indicates that students expect more challenges in college than they are actually given Faculty are overcommitted research/service-wise and with increasing class sizes, it is often difficult to provide a level of involvement and rigor that might be desired Attempts at a definition: Prior to identifying “determinants of academic rigor” in our department and elsewhere, we need some working definition, or components thereof, of “academic rigor.” There was a consensus on the committee that a single definition of academic rigor was bound to be imperfect due to the diversity of classes, class sizes, assignments, teaching styles, grading systems, and other pedagogical factors. That said, key components of any definition might include: 1. Demand high-level performance. 2. Demand student-motivated responsibility for learning. 3. Demand expectations beyond the “comfort-zone.” 4. Demand critical thinking. 5. Demand mastery of the baseline knowledge of the discipline. Determinants of rigor in xxxxx: The committee noted that several standards of rigor already exist in the department. Faculty performance in attaining class goals and establishing a rigorous learning environment is the ultimate responsibility of the individual faculty member but is shared by the corporate body of faculty and administrators that oversee the academic program involved. To that end: 1. It is the responsibility of each program to evaluate and hire faculty who have the qualifications needed to meet and prepare specific curricular needs. 2. There are annual evaluations across all professorial levels; these evaluations include the assessment of teaching performance and classroom rigor. 3. In their third year each faculty member is fully critiqued in their performance, with developed teaching skills and rigor being major topic areas. 4. The acquisition of tenure assumes the assessment of an accumulated period of performance in which teaching quality is assessed in terms of the rigor for courses taught. Other ways to implement rigor in the classroom: Despite the list given above, the committee identified various additional methods/strategies that might be adopted in order to impose more rigor in the classroom. Departmental-level: Simply inducing a “culture” of rigor among faculty within and across departments via discussions, informal meetings, and perhaps the occasional workshop might go a long way to instilling a more rigorous classroom environment—many committee members felt that an ongoing dialogue concerning academic rigor is likely to be beneficial Individual faculty can work with personnel at the Center for Faculty Innovation regarding specific ways to implement rigor in the classroom Faculty might mentor/assess other faculty members regarding rigor on a request basis Departmental changes to number/type of assignments and grading scales might be considered for particular courses based on faculty feedback University-level: If students are to “hit the ground running” in terms of a rigorous academic environment, then perhaps higher standards of acceptance to JMU might be needed In some cases, smaller class sizes might allow faculty to better implement a rigorous classroom environment The administration along with faculty input might rethink the role of “General Education.” This might include creating a system that allows more student responsibility for choosing courses; presently, some students view 7 these courses as an obligatory “laundry list” rather than a meaningful curriculum that comprises a fundamental part of their education. Other issues regarding GenEd also came up, including modifying course content/requirements, and having better articulation and dialogue between GenEd and specific departments/programs. Conclusion on instilling academic rigor within the university Education is a dynamic and diverse process of enlightenment; as such it is difficult to come up with a single definition of rigor that applies across the entire university curriculum. Further, mandating a list of strategies/tasks that are designed to implement rigor in the classroom is more likely to erode faculty morale than actually improve classroom rigor. Instead, it might be wise to have the administration in conjunction with other university-wide organizations set a “tone of rigor” for the university. Students across JMU, independent of their major or course of study, should hear a credible, coherent, and consistent voice from “above,” a voice that emphasizes (and reemphasizes) academic rigor and the centrality of the academic and scholarly mission of the university. So long as the tone is credible, coherent, and consistent, it will also keep the issue of rigor on the collective mindset of the faculty. This solution avoids the usual problems associated with implementing a homogenous university or departmental-wide policy on a concept that is necessarily heterogeneous and diversely deployed across different classrooms. 6. Grade Inflation is a significant problem for 4 interrelated reasons: Many students expect an “A” just for trying. It has ceased to be perceived as a measure of the QUALILTY of that work. Today’s generation of college students have grown up in a culture where everyone is rewarded for trying. All kids get a trophy just for playing. Everyone gets a gold star just for trying. While there are merits to that in some regards, many have not known a culture in which awards/accolades/grades are earned. One way to begin to combat this is to require faculty to include in their syllabus/assignments a detailed rubric explaining exactly what constitutes an “A” (etc.) on that assignment and in that course. Faculty then must stick to that rubric, even in the face of pressure. In addition, syllabi could explain that the concept of "working hard," while valued, does not guarantee an excellent grade. One can "work hard" on something and still do average (C) work. It is the end product that is evaluated/graded. (These concept are important to stress to students during orientation as well.) Similarly universities need to move away from a student services orientation that inadvertently also perpetuates a belief that students (parents) are paying tuition, and therefore are entitled to high grades. It’s a customer service mentality that situates faculty as service providers not experts/educators. The customer is paying and demands a particular service. It is no longer a question of earning the grade. It’s a question of getting what you pay for. This situation has become more pronounced as tuition rates (at universities across the country) have risen. At JMU, this is particularly pronounced among out-of-state students (parents) who are paying a great deal for tuition, and who expect returns on that. The university should educate students on what tuition actually pays for. There are staggering statistics available that delineate how little tuition actually covers the cost of each student's education. Making students (and parents) aware of these statistics could help in altering the concept that student’s tuition pays for their instructor's salary. While the above two factors relate to the culture in which our students have grown up/live, the next contributing factor is related to the way that faculty are evaluated. While there are any numbers of ways to evaluate teaching, student evaluations tend to carry a heavy weight. They are convenient because they reduce everything to a single, easy-to-compare number and easy-to-quote anecdotes. One way to deal with this is to pair student evaluations with grade distributions during the annual review process. Are the faculty with the highest evaluations also the ones most likely to give the highest grades? Pair them also with syllabi and other measures of academic rigor such as assignments, reading lists, etc. There should be a standard question (or series of questions) required to be included in all 8 7. student evaluation forms in which students are asked to comment on the academic challenge/rigor of the course. Right now, many departments rely on outdated, useless questions like: “What did you like best/least about this course?” “What are the strengths/weaknesses of the instructor.” Such questions generate answers like: “I hated that it was at 8am.” “The instructor was hot.” “The instructor was knowledgeable.” (I should hope so!) Unit heads need to be able to read between the lines of student comments. For example, there’s a big difference between: “The instructor created a learning environment in which we all felt comfortable to speak and learn” versus “The instructor was more like a friend than a professor.” Faculty should be encouraged to make classes reading- and writing-intensive (or project-intensive if more appropriate for the class). However, the university must support faculty in that endeavor. Teaching loads are high. Morale is low. (No raises in how many years?) There is no incentive for faculty to make classes more grading-intensive and more rigorous. Increasing the academic rigor of a class (especially when it relates to the assignments), increases the workload of faculty. In many cases the opposite pressure exits from the above mentioned vicious cycle of faculty feeling that if they are too rigorous in their expectations/grading/assignments, they will receive bad evaluations, which will bring disfavor in Personnel Action Committees reviews and annual evaluations by their department heads. If the university is committed to academic rigor, then it needs to be prepared to support faculty in that endeavor—raises, academic leaves, smaller class sizes, etc. The university and academic units also, as mentioned in the previous bullet point, need to support rigorous faculty by altering how we evaluate faculty for tenure/promotion and merit raises. xxxxx engaged in discussions about academic rigor at two faculty meetings. From those discussions, the following themes emerged... - Challenging reading load. - Challenging writing assignments & projects. - Professional standards: competence. - Grading rubric that makes it clear that A work is exceptional and spells out expectations for each grade. - Avoiding grade inflation. - Do not rely too much on student evaluations; find other measures. 8. xxxxx defines academic rigor in two ways. The first refers to the requirements, demands, or challenges of a task or activity. The second way refers to “extreme strictness or stringency of standards, conduct, scrupulousness or rigidity in the application of rules, principles, or precepts” (Oxford English Dictionary). In this second way, rigor includes a strict sense or interpretation, precision, exactness; the quality or condition of being highly detailed, accurate, and thorough. We achieve academic rigor by these means: A sequenced curriculum that culminates in an internship required for fulfillment of the BA/BS and the MA/MS in xxxxxx Highly developed habits of mind: inquiry, critical thinking, critical procedures, and responsible behavior, all of which are required for accountability to professional standards and for vigorous citizenship. 9 Curricular connections (which courses are taken, the order in which they are taken, and crossdisciplinary connections among courses) Faculty knowledgeable and conversant with leading contemporary theory and practice. We expect students to follow our example. Coursework challenging students with contingency—wanting them to see themselves as authorities and challenging them to find their own answers to questions. Information management and information literacy—sifting through tons of material in all areas and selecting information of value. Academic rigor in xxxxxx is judged by standards of precision and by high expectations, by intensity of engagement, by excellent critical thinking and critical procedures, by mastery of professional standards of communication and forms of writing, and by professional codes of conduct. 9. The Department of xxxxx believes that the following five core principles form the foundation of academic rigor. Principle #1 – Rigor is a Commitment that should be Articulated in a Program’s Mission & Values Faculty in the Department of xxxxx collectively developed a Mission and Values statement that clearly articulates a commitment to an active, experiential learning environment that prepares students to apply their knowledge. The department emphasizes the high value placed on continuous improvement, collaboration, the promotion of individual strengths, and stakeholder relationships. Attached is a copy of the Mission and Values for the Department of xxxxx. Principle #2 – Rigor is Defined within a Program’s Learning Outcomes Program-level learning outcomes that traverse individual courses promote a culture of academic rigor. Integrated coursework where prerequisite courses enable higher level learning in subsequent courses promotes faculty collaboration and the development of consistent, systematic and measureable standards. Courses in the Department of xxxxx contribute to two different sets of Program Learning Outcomes: (1) College of xxxxxx Core, and (2) the B.B.A. in xxxxxx. Accreditation of the undergraduate xxxxx program by the Computing Accreditation Commission (CAC) of ABET gives external validation of these learning outcomes. Principle #3 – Rigor is Refined through Continuous Improvement and Assessment Faculty members utilize feedback from systematic assessment in order to continuously improve the curriculum content and meet the needs of our stakeholders. Employers, alumni and the xxxxx Executive Advisory Board are actively engaged in a formal process of feedback and improvement. This formal feedback mechanism is essential for ABET and AACSB accreditation. Principle #4 - Rigor is a Collective Faculty Value Ultimately individual faculty members are responsible for the rigor within their classroom. In the Department of xxxxxx, each course has a faculty leader. This faculty member is responsible for working with other faculty members to ensure that learning objectives are met and a reasonable level of consistency in academic rigor exists across sections. Principle # 5 - Rigor is Refined through Faculty Evaluation As part of the faculty evaluation process, the academic unit head (AUH) and members of the PAC give faculty 10 members feedback regarding how well they are meeting expectations of academic rigor and, if needed, offer suggestions on how to increase academic rigor in their classroom. Department of xxxxxxxx Mission Statement The Department of xxxxxx is committed to: (a) educating students by creating an active, experiential learning environment that prepares them to apply knowledge of information systems, operations, management science, and business for the betterment of organizations and society; and (b) serving the academic community and business communities through appropriate research and service. Our faculty maintain current and relevant curricula focused on information systems and analytical problem solving in a business context within the major and minor degree programs in xxxxxxx and the minor in xxxxxxx support other programs in the College of xxxxxx and the university by providing undergraduate and graduate courses in information systems, statistics, quantitative analysis, and operations and supply chain management. We value Continuous improvement Our faculty utilizes feedback from systematic assessment in order to continuously improve the curriculum content and meet the needs of our students and other stakeholders in a rapidly changing world. Diversity of academic fields and research among our faculty Our department includes faculty in computer information systems, management science, and operations and supply chain management who participate in their respective fields through scholarly research. The faculty strive to integrate this research into the educational process and curriculum. Collaboration, teamwork, and the promotion of individual strengths We maintain a collegial and supportive culture within the department, a respect for each individual’s talents and ideas, and an environment the supports success and the pursuit of excellence. Stakeholder relationships We build mutually beneficial relationships with students, business, government, and alumni communities in order to increase our value to all constituents and supplement our resource base. Service to diverse group of stakeholders We provide leadership and perform service to all levels of the university, for academic and professional organizations, and in the business community. We utilize our professional knowledge, skills, and talents to the betterment of the community at large. 10. 1. Determinants of academic rigor Currency and dynamic nature of the program, consistent with a continually changing economic and global environment. Expectations of professors. Projects that require research and analysis of actual companies, industries, or the economy. In-depth case work, both individual and group. 11 Testing that requires not only objective questions, but other forms of testing, such as essays and spreadsheet analyses, that emphasize critical thinking. Testing and evaluation that requires knowledge of what is going on in the markets, the economy, and the world. Experiential learning requiring engagement with the community. Breadth and depth of the materials covered in the course should be consistent with the course learning outcomes: o Breadth allows the students to develop a broad perspective of the subject, achieving higherorder learning that includes a basic understanding and synthesis. o Depth enables the students to develop a more thorough understanding of the subject, achieving higher-order learning that includes application, analysis, and evaluation. 2. Elements for academic rigor in another, dissimilar academic program/unit Same as above Other notes on rigor: 1. Academic rigor is not equivalent to low grades. An instructor could cover very few topics and details, yet still give difficult/tricky tests to create a false impression of academic rigor. 2. Student feedback should be an important element in identifying academic rigor. If the students feel a course is either too easy or too difficult, the course instructor should address the "rigor" issue. This does not mean that if the course is perceived as difficult that the instructor deviates from learning outcomes; it does mean that the instructor examines the course’s pedagogy and seeks ways of helping students achieve the learning outcomes. 11. Over the past month, the faculty in xxxxxx has met on a couple of occasions to discuss the two questions regarding academic rigor. Beyond the faculty meetings, I also requested further input from the faculty if they felt that is was warranted. Below, you will find our responses to the questions. What do you see as determinants of academic rigor within our program/unit? Academic rigor could be influenced, or determined, but to the degree to which learning objectives are clearly expressed, approached, and assessed. A rigorous academic program might have: cleanly defined learning objectives, a challenging and thought provoking approach to achieving these learning outcomes, and reliable, standard measures to assess the success of producing these outcomes. Further, our faculty was in agreement that rigor could be defined as, “an experience for students to receive the appropriate level of challenge and support in and out of the classroom that promotes and encourages learning.” It was unanimous among the faculty that academic rigor is not based solely on grade distribution. Rigor, however, is about creating an environment where students are willing to take risks, be vulnerable, and think introspectively. Within our programs, we believe to have created rigor by: 1) Establishing high, yet reasonable and relevant, goals and expectations 2) Explaining those goals and expectations to the students 3) Preparing to teach the most significant components (and if time, all components) required for the students to attain those goals and expectations 4) Expecting students to “study” the classroom and assigned material outside of class 12 5) Teaching the material in diverse ways, without being unnecessarily redundant, to attempt to reach as many different learning styles as possible 6) Requiring/forcing the students to apply and think critically about the material provided and the goals and expectations of the class through both in-class and out-of-class case studies 7) Giving pertinent, diverse and challenging assignments and assessments which reinforce and assist in the learning and critical thinking process 8) Providing timely and relevant feedback to those assignments and assessments in a manner calculated to assist in learning as opposed to simply providing the correct or better response and/or just “giving a grade” 9) Providing a classroom environment of mutual respect conducive to learning and open discussion 10) Providing practical learning experiences outside a traditional classroom where a student can apply theory (practicum and internship experiences, as well as our senior capstone “theme dinner experiences”. Elements that we consider/see as crucial in identifying academic rigor in another, perhaps dissimilar, academic program/unit. This was a difficult question for me and our faculty to answer, given that we don’t know other disciplines as well as our own. Our response to this question is based on our perception of other disciplines, and may not be completely accurate. However, we do believe that there are elements of academic rigor that do transfer from one discipline to another. For example, having strong learning objectives and challenging students to achieve those objectives is transferable. Having said that: Rigor in an academic setting is relative. What may be seen as rigorous in one program, may not be seen as rigorous in another program. It is hard to define other programs rigor because of how we stereotype one another. I heard the following from faculty: 1) Academic rigor in other departments, such as the sciences, translates into high workload and regurgitation. There is a great deal of memorization, identifications of facts or terminology, weekly quizzes, and multiple choice exams. 2) Academic rigor in music translates into actual performances. This, we believe, is similar to the hospitality program in that there is an applied component to the program. 3) Academic rigor in nursing is a standardized test, where it is an oral defense in philosophy. 4) Academic rigor in other areas (communication, etc.) is difficult progression guidelines (i.e., having a gpa requirement to enter the major) 12. Faculty in the xxxxx Program were asked to provide their input on determinants of academic rigor in the program. Please note that since the xxxxx Program has no dedicated faculty, some of comments may be included in other departmental statements. Below please find a general summary of our collective thoughts. (1) Challenge: Students should be challenged and encouraged to learn. They should also be held accountable for their performance. (2) Academic rigor applies to the breadth and depth of coverage of the subject matter. Breadth refers to the number and scope of topics covered in class, and allows the student to develop a broad perspective of the subject. Depth refers to the details and to the theories and models that are covered in class. An appropriate combination of breadth and depth should be chosen in order to challenge the student and encourage learning. 13 It was also suggested that there was an order to increasing academic challenge. From low to high, this order would include: (a) survey of subject: a general overview of the topic, (b) method of the subject: exposing the student to the dominant methodologies used in the discipline and allowing the student to know “where the practitioner is coming from”, (c) methodological practice: requiring the student to apply the material to demonstrate understanding, and (d) methodological application: requiring the student to apply the course material to situations that differ significantly from the discussions in class. (3) An academically rigorous course should not only expand a student’s knowledge, it should also expand a student’s critical thinking about the subject matter and awaken their academic curiosity. The above should apply to any class. For the xxxxx Program, rigor is also provided by specific demands of the program – the foreign language and the semester abroad requirement. 13. Note: In lieu of a meeting the statement below on academic rigor was drafted by the academic unit head for the Xxxxx Department’s consideration. It was circulated to all the faculty and feedback was solicited. Almost all feedback was positive and supportive. One faculty member wanted to stress “higher order” thinking as part of rigor. However, the AUH felt that would confound two very different, and important, dimensions. While he does not think all 22 faculty would wholly agree with this, all of them have had a chance to comment and most of them would mostly agree. (1) Academic rigor is simply challenging students and holding them accountable for their performance. As long as it is tied to course objectives the form or context of that challenge does not matter much, a classroom discussion can be as intellectually challenging as a project or exam. Practice in the xxxxx department has focused on grade distributions and student self reports of challenge on student evaluations as a starting point in discussing rigor with faculty in annual evaluations. (2) Objective indicators (elements) of rigor, especially across academic disciplines are problematic. While a useful starting point may be grade distributions (NOT just average grade levels) and student self reports, we doubt there is a “high level comparable” indicator that universally reaches the issue of challenge. Ultimately, the only guarantee of academic rigor is the professionalism and dedication of the faculty. 14. The Xxxxx Program’s perspective on Academic Rigor The Xxxxx discipline is the science of measuring and communicating information about performance. Although commonly thought of in terms of financial performance, nonfinancial measures are critical to evaluating the performance of many entities. Regardless of its form, performance information is valuable only if it has decision relevance which stems primarily from its predictive ability. The Xxxxx profession is the only private profession with a public trust. Although accountants are often paid by the organizations whose reports they are preparing, it is readily recognized that those reports are not for the benefit of the organization or its management. Rather, reports are being provided for the benefit of third parties who are trying to base a decision on the reported information. Such decisions may be whether to extend credit, invest capital, or provide donations to the entity being reported upon. The public trust which we hold compels xxxxx professionals to focus on the information needs of these third parties, rather than the self-interests of the organization or individuals. Unbiased and discriminating information benefits the capital markets by efficiently directing resources to the most worthy prospects. 14 The Xxxxx faculty view the practice of assigning grades to students as an extension of this public trust. Grades are merely a mechanism for measuring and communicating information about performance. Further, our view is that grades are not solely for the benefit of the student. Rather grades provide information to third parties who use the reported grade information to make decisions. Such decisions include whether to extend a particular student an offer of employment or admission to graduate school. We have succeeded in our measurement objectives if these third parties find they can use grades to distinguish between high and low performers. Academic rigor is merely a consequence of this general philosophy. We provide challenges to students. These challenges are designed to measure student performance. To be useful in a comparative sense, the challenges must distinguish between varying levels of student performance. The process culminates with the assigning of a grade. Since xxxxx employers persistently base employment decisions on students’ reported grades, we may infer that this information is useful in helping them predict performance in the workplace. If most or all students receive the same grades, the information we are providing would not have predictive ability and would be of no value. Therefore academic rigor benefits the most deserving student by allowing the marketplace to efficiently identify and reward their superior ability and performance. 15. Rigor in xxxxx curriculum at James Madison University can be described through the learning objectives given below: 1. Demonstrates knowledge of the scope, methods, and limitations of economic analysis; as well as of alternative economic methods, theories and their respective applications and implications. Rigor means the ability to fully formulate and apply economic models in diagrammatic and mathematical form, as opposed to only summarizing their conclusions in words. Economic models can be developed (1) mathematically, (2) graphically, and (3) descriptively. In xxxxx academic rigor implies using all three of these methods, beginning in principles courses. The goal is to achieve deeper learning so the instructional challenge is not just to use these different methods but to integrate them effectively. 2. Demonstrates knowledge of neoclassical microeconomic theory and its applications. Rigor means the ability to fully formulate and apply the models of microeconomic theory including models of individual choice and markets. 3. Demonstrates knowledge of macroeconomic theory and its applications. Rigor means the ability to apply aggregate models that allow a full understanding of economic problems on a national and international scale. 4. Demonstrates understanding of the roles of economic theory and institutions (including cultural values) in public policy formation. Rigor means the ability to fully articulate and apply the insights of the leading schools of thought on institutional xxxxx. 5. Demonstrates knowledge of the basic mathematical skills, quantitative methods and econometric tools used by economists in analyzing models, quantifying empirical relationships, and testing hypotheses. Rigor means the ability to formulate and test econometric models, and to accurately interpret econometric models in published research. Academic rigor can be found through applications of economic theories through 15 modern econometric techniques and software. While many students find econometric theories and applications difficult, the literature is not comprehensible without at least a basic understanding of econometrics. Students must also be made aware of the shortcomings inherent in econometric techniques and methods. 6. Demonstrates the ability to comprehend and critically evaluate economic arguments presented in the (print and on-line) media. Rigor means the ability to test popular economic arguments by reference to the findings of theoretical and empirical xxxxx. A key element is promoting content acquisition through critical thinking. The essential idea is to carefully review underlying assumptions in a model, noting how key model features depend on certain assumptions. It also means thinking about the policy conclusions implied by a theory and also comparing theories to master the nuances in content. Finally rigor involves emphasizing competing theories so that students are aware that the discipline of xxxxx does not always provide simple answers. 7. Demonstrates awareness of contemporary national and international economic conditions. Rigor means the ability to describe current economic indicators, to specify their value within a narrow range, and to identify the major explanations of current conditions. Policy debates often fall back on economic theories, and students must understand how abstract theories deepen their understanding of the world they inhabit. 16. The degree of rigor in a course (or program) is generally a function of two factors: the difficulty and the magnitude of the task a student is asked to accomplish. A task may be difficult but of limited scope. For example, most students find it difficult to create a predictive model using regression. But once they understand how to do it, the task has well defined parameters and can be successfully accomplished in just a few minutes. Conversely, a task may be easy but require a lot of time to complete. For example, a student might be asked to apply an extensive list of formatting specifications to a lengthy document. The task is not difficult but it requires a lot of time to complete. The most rigorous, challenging courses combine difficulty with magnitude. Like rigor, difficulty can be viewed as being a function two factors: the complexity and boundedness of a task. Our Xxxxx Analytics course teaches students to do CHAID (Chi Square Automatic Interaction Detection) and RFM (Recency, Frequency, Monetary Value) Analysis, procedures that have many moving parts . It is difficult for students to understand how all the different aspects of CHAID and RFM fit together. But the boundaries of what they must learn are well defined. On the other hand, in the several Xxxxx courses that involve client projects, the boundaries of the task are not well defined, e.g., in our Google Challenge course, students compete with tens of thousands of other students around the world to develop the most outstanding online xxxxx campaign. The scope for creativity and effort in this course is unbounded. Part of the challenge is to self-define the scope of the undertaking so as to complete a well-done project in the allotted time. An important indicator that a course is rigorous is an approximately normal distribution of grades. This distribution typifies courses that challenge all students who are enrolled. An approximately normal distribution indicates that course work was sufficiently challenging that even the more able students had to stretch to distinguish themselves. When there is a ceiling effect in the distribution of grades, i.e., when the tail of the distribution on the high side is truncated, it is a sure sign that the more able students were not fully challenged by the course. 16 We encountered an example of apparently insufficient rigor when developing new XXXXX academic progression standards this past year. Members of the XXXXX leadership council expressed some interest in using General Education Cluster 1 courses as part of our mix of required courses for admission to the XXXXX. The skills taught in Cluster 1 are highly relevant to success in business. But upon examination, we found that the diagnosticity of Cluster 1 grades was dubious because such a high proportion of students earned A or A- grades. We thus abandoned the idea of using Cluster 1 and instead used only courses in the XXXXX lower-division core where the rigor is such that grades are normally distributed. The first courses students take in a curriculum tend to establish expectations with respect to rigor and required effort. In the XXXXX, we are fortunate that our lower division courses establish the expectation that students must work hard to be successful in the various business majors. That expectation is reinforced by XXXXX 300, the first upper division business course which is distinguished by the scope and complexity of the business plan assignment it puts to students. Thanks primarily to the lower division XXXXX courses and XXXXX 300, Xxxxx majors come to us primed to work hard in their major courses. While classes taught in our department vary in their degree of perceived rigor, all students then take courses that are almost universally rated as being challenging, i.e., both analytical, quantitative courses and courses in which students work on unbounded client projects that have unlimited scope for the exercise of creativity and effort. 17. What determines Academic Rigor in this program? First – rigor where – is it in the Admittance process, the Journey, Graduation, or Career success? Student/Class Measures o Not Grade distribution - Academic rigor is not equivalent to low grades. An instructor could cover very few topics and details and still give tough tests to create a false impression of academic rigor. This would not help the students learn. o Students report they “worked a lot” - Student feedback should be the most important element in identifying academic rigor. If the students feel a course is either too easy or too difficult, the course instructor should address the "rigor" issue. o Measure the degree of challenge - An instructor should choose an appropriate combination of breadth and depth for a specific class to challenge and encourage the students to learn. This combination varies with the level of the course and course objectives. o Program Metrics – perhaps measuring the AOL each year and seeing if the metrics demonstrate growth o Students can view problems from multiple perspectives and choose the appropriate model o 1) start with meaningful objectives, 2) decide how I will know if students have achieved those learning objectives, 3) design instruction and authentic assignments that will demonstrate mastery of material, and 4) hold students accountable for demonstrating mastery through feedback and grading. Career Metrics o Career tracking – watching and comparing graduates of our programs compared to other schools o Survey the value of the programs with Young Alums o Ask host companies about the value of the graduates that have gone through it 17 Objective Measures o Compare content of these programs with programs at other institutions o “CPA” exam – are there certified tests that can be used to measure output? o “Certificates” – same idea – have students pass some comprehensive external assessments that are administered by standard bodies What elements are crucial in identifying academic rigor in another dissimilar academic program? “CPA” exam – are there certified tests that can be used to measure output? “Certificates” – same idea – have students pass some comprehensive external assessments that are administered by standard bodies 18. The need and assessment of academic rigor is an integral component of the Department of Xxxxx (XXXXX), not only to maintain its institutional credibility at James Madison University but it must also satisfy professional accreditation by the Council on Academic Accreditation in XXXX (XXX) of XXXX Association. For this national accreditation XXXXX must conduct continuous self-study, including an intensive on-campus site visit by XXX every eight years and the submission of annual progress reports each year during the eight year accreditation cycle. A component of the national review requires the department to demonstrate that students pass prescribed undergraduate course work in the following areas: biological sciences, physical sciences, social/behavioral sciences, and mathematics as well as an appropriate academic program of study in professional coursework for both undergraduate and graduate students (e.g., speech-language pathology requires 75 semester credit hours in a course of study addressing knowledge and skills including 36 hours at the graduate level). In addition to the review of didactic classes, an extensive variety of clinical opportunities and experiences across the entire breadth and depth of the professional scope of practice must be available to our students that include clinical exposure to patients in all disorder areas across the life span. As part of evaluating the clinical component, the students must not only pass the course but be able to demonstrate acquired clinical knowledge and skills. For speech-language pathology students they must acquire 400 clinical clock hours and if they wish to work in public schools 100 of the 400 clinical hours must be obtained in a public school setting. For audiology, students must acquire 1820 clinical clock hours. All students must participate in both formative and summative assessments throughout their academic training to demonstrate that they are acquiring and have acquired knowledge in specific areas and that they are developing and have developed clinical skills. Finally to assure that a speech language pathology and audiology program includes sufficient academic rigor all graduates of the program must pass a national examination prior to beginning their professional career. To assure all our students first have the opportunity to gain entrance into a graduate program and subsequently pass all graduate coursework and the national examination, XXXXX uses assessment markers along the student’s academic career path to evaluate progress. XXXXX uses the JMU assessment day to demonstrate the acquisition of knowledge in the professional areas between the sophomore year and the senior year using an examination format similar to the national examination. As stated above, at the graduate level the students must pass the national exam and our accreditation standards require all academic programs to make public on department websites the results of all graduates of the program on the national examination. In addition to the national aggregate score, there are subsection scores available that demonstrate the student’s acquisition of knowledge in distinct professional areas. For XXX the areas are: Basic Human Communication Processes, Phonology and Language Disorders, Speech Disorders, Neurogenic Disorder, Audiology/Hearing, Clinical management, and Professional Issues/Psychometrics/Research. For Audiology the subsections are: Basic Human Communication Processes, Prevention/ID, Behavioral Assessment/Interpretation, Electrophysiological Measurements/Interpretation, Rehabilitation Assessment, Rehabilitative Technology, Rehabilitative Management, and Professional Issues, Psychometrics, Research. 18 19. Learning to program is an essential component of Xxxxx education, but it is the ability to solve complex problems and communicate those solutions that is critical. A rigorous curriculum teaches students to incorporate theoretical and practical knowledge to solve problems in the small and in the large. Creating a rigorous Xxxxx curriculum involves the identification of problems where the application of theoretical concepts provides the development of a solution and key principles are necessary for an accurate and efficient implementation. Elements of assignments that can improve rigor are listed below. Students learn languages or systems new to them independently and apply them to solve substantial problems. Students write programs of several hundred lines (longer in more advanced courses) in a language students already know Students design substantial software systems that meet minimal standards of design quality (such as hiding information, reducing coupling, maintaining coherence, etc.). Students apply discrete mathematics to analyze computational problems and find solutions. Students read technical literature and are able to apply what they learn to solve substantial problems Students write technical documents that are grammatically and orthographically correct, and describe technical matters correctly, completely, and clearly. Students write substantial programs at different language levels, such as microcode, assembler, and high-level languages Students test their programs thoroughly enough to find bugs that would manifest themselves in regular use. Problems are assigned for which students cannot readily find the solution, e.g., cannot Goggle the answer. Students design, create, implement, test, or analyze an algorithm, program, system, or research document that: o addresses/solves a large problem (students need to discover/handle complex interactions) o addresses/solves a very specific, narrow problem (students need to master intricate details of a solution) o addresses/solves a problem they have never seen before (students apply what they have learned to new, unknown problems, or discover new ways of solving a problem) Assignments stress the importance of non-xxx factors (and consider those when grading) that go into creating an assignment solution: correct use of language, proper structure, and quality of presentation. Course offerings and classroom environment are also important components in a vigorous curriculum. Not only should each course provide the breadth and depth of material for the course subject matter but courses should build upon one another to teach the interrelationships and intricacies of fields in CS. Rigor in other academic units Though unique to the field of study, each department must have assignments and a curriculum that is both challenging and thought provoking. Students must be intrigued to find solutions and not simply asked to repeat material presented in the classroom. Student application of knowledge is essential for all units to provide curriculum rigor. 19 20. (Xxxxx) Response to Academic Rigor Questions 5/25/11 (This statement is not necessarily representative of the department as a whole, but rather represents individual(s)’ thoughts on this topic. Statements from Academic Culture Report Academic rigor or establishing a learning environment that appropriately challenges our students. Much of this discussion revolved around the academic rigor to which students are or are not exposed through their classes. Grade inflation came up frequently as a shorthand way of expressing concern about this issue. There were also variations in definition by discipline/academic program. In moving forward, we believe it would be worthwhile to share ideas about what makes a course of study rigorous. With increasing public focus on what it is that students are actually learning in college, this is a concern that extends to all of higher education. We acknowledge this topic is complex. As a starting point to addressing this issue, we propose a method for analysis and developing possible actions that respects differences among individual programs but recognizes the value of identifying general aspects of academic rigor that can be used by individual faculty and programs in assessing the learning environment they have or wish to establish. Our proposed methodology will begin with deliberations and reporting from the individual academic unit level. We hope to accomplish this prior to the end of May. Then we will invite nominations and select 50 individuals to participate in a two day Madison Institute this summer to identify those general aspects of academic rigor that can lead to constructive conversations among programs and productive analysis at the program level. Questions the Provost wanted answered: I. What do we see as determinants of academic rigor within our program/unit? II. What elements do we consider/see as crucial in identifying academic rigor in another perhaps dissimilar academic program/unit? Be sure and think about those structured learning events outside of the on-campus classroom – e.g., on-line, experiential, etc. Xxxxx Response to Question I: 1. There is a great deal of debate when trying to define academic rigor. (See article below**) 2. There are societal factors as well as internal policy factors that are in play. A. Students are coming to JMU with a sense of entitlement. This problem begins in elementary school with social promotion, honor rolls, bumper stickers, the rewarding of effort rather than results, and a continual bombardment of, often times, unearned positive feedback. “A” students are graduating from high school without having developed adequate writing skills. Yet these students have been told they are “A” students. B. Universities are being forced to graduate a certain percentage of students. C. There is a societal notion that “everyone is entitled to a college education”. D. The JMU Faculty Handbook requires the use of student course evaluations when determining teaching effectiveness. This process may be causing faculty members to decrease rigor in order to attain satisfactory ratings from students (entitled students!) E. By allowing certain programs to have gateway requirements, the university is forcing the more marginal students into the few remaining programs that are not gated. These ungated programs are, by default, facing an unusually high number of potentially low grades (and the possibility of low student course evaluations), possibly resulting in the dumbing down of the curriculum. 20 F. Within JMU there appears to be an uneven distribution of faculty positions across programs. The uneven distribution is most likely the result of a dramatic change in student interests over the past ten years. There exists an untenable situation within the programs in xxxxx that are not subjected to external accreditation/licensure. Within the B.S. in Xxxxx programs, we have a student major to faculty ratio of 100:1. Fall 2010 enrollments in HTH classes indicate an average class size of 68 students. Faculty members carry a 4/4 load. Assessing writing and critical thinking skills takes time and energy. The department ratios previously mentioned do little in the way of creating an academic environment conducive to the fostering of writing and critical thinking skills. As indicated by former Harvard President Bok, “The quality of education for college graduates also seems in peril, Bok said. Recently, 500 U.S. colleges administered the Collegiate Learning Assessment test to their undergraduates, Bok said. The test measures students’ writing and critical thinking skills. Results showed that 36 percent of students tested made no progress between there freshman and senior years in those skills. Another study shows that the amount of hours college students are spending on homework has dropped by 40 percent since 1960. Students now study about 14 hours a week, Bok said. About one-third of undergraduates have never taken a course with more than 40 pages of reading per week; and half haven’t taken any courses requiring them to write more than 20 pages over the course of the semester.” (Former Harvard President Calls for Major Shift in Teaching in Higher Education, Ioana Patringenaru | May 2, 2011). 3. It seems some are assuming that rigor is defined by grades (See highlighted section above). The greater the class rigor, the lower the grades…..Bad, bad assumption. Most of our programs have an external review process leading to accreditation/certification. Part of that process is to ensure that we are successfully producing course outcomes. Based on the first time pass rates for the students in many of our programs, we are leading the pack in producing students who achieve success. For example, one of our programs has had students achieving a 90% pass rate on the national certifying exam, while the national first time pass rate is around 50%. The JMU students achieving this 90% pass rate had a fall 2010 program specific GPA of 3.55. Grade inflation? We don’t think so. 4. If a large percentage of professors are complaining about grade inflation they need only look in the mirror to find the culprits. This is an easy fix…..If you think your grades are inflated, change the way you grade. If only a small percentage of professors are complaining about grade inflation, then those that think grades are a measure of rigor and that grades at JMU are inflated, need to convince the majority that grade inflation is a problem. 5. We do our students no good if our grading is out of line with the rest of the universities across the country (The data indicate JMU grades are within the national norm). In the graduate/professional school application process, our students are compared to other students. Often, grades are a major factor. If we decide that a “C” really means “average”, then our students will suffer once they leave JMU. Employers, graduate schools admissions committees, etc. will not look favorably on a bunch of C’s and B’s. 6. We are assuming, with a certain degree of arrogance, that faculty members have the ability to truly measure learning. And we are assuming grades reflect the rigor of a class. A vast majority of university faculty members came through “rigorous” doctoral programs that offered little in the way of best teaching practices, assessment and measurement, etc. We are assuming that our tests and assignments have acceptable reliabilities and validities. Yet, few if any professors analyze their measuring 21 instruments. Grades can reflect attendance and participation. Is attendance and participation reflective of academic rigor? Xxxxx Response to Question II: After considerable discussion we decided we could possibly react to a defense of rigor presented by a dissimilar unit. But we are not at all comfortable suggesting rigor standards for some other department. ** Academic Rigor: An Explanation or an Apology? James Lubker Academic rigor is a topic that elicits some rather strong feelings. I’ve heard students complain that the courses they are taking are too easy and that we don’t demand enough of them. Those students want more rigor in their courses. I’ve heard faculty complain that students are poorly prepared, have distressingly short attention-spans, and seem to be more interested in parties than in studying. Those faculty don’t think that students want or will tolerate increased academic rigor. I’ve heard parents demand that we refund their money for a course because their child didn’t really learn anything and that faculty are anything but rigorous in the classroom. I have also listened to all manner of views and opinions across the spectrum on this topic. So, a discussion, or a series of discussions, around this topic of academic rigor is certain to be interesting, perhaps contentious and, hopefully, helpful and illuminating. It would be especially helpful if any insights generated by the discussions could be used to actually improve what we do as teacher/scholars. With that in mind I was delighted to learn that the first issue of Universitas was to be devoted to the topic of academic rigor. I was also delighted to be invited to write a piece for that inaugural issue, since I do, in fact, feel rather strongly about the topic. My delight diminished somewhat as I began to think about writing the piece. Upon reflection, it seemed a strangely daunting task. Then I saw a very straightforward question raised by Scott Cawelti: “What IS academic rigor”? Cawelti’s question served as a catalyst for what follows. “Introduction to Linguistics” (Liberal Arts Core) was my most favorite course to teach at the University of Vermont. When I began teaching it I had fifteen students enrolled. Eleven years later, there were more than 110 students. In my opinion there were at least two reasons for that increase. For one thing, I was a good teacher. I was three times nominated for the best teacher of the year award and was once first runner-up for that high honor. My student evaluations were uniformly strong and I loved teaching that course. The second reason for the increase in enrollment was, I am sure, that it had a well-deserved reputation for being an easy course. It was perceived to lack academic rigor. I taught it that way on purpose, with malice aforethought. I “could” have made it extraordinarily difficult. I approached some of Naom Chomsky’s theories, and used as a non-required reference Chomksy and Halle’s book The Sound Pattern of English (Cambridge, 1968) along with the more recent (and more readable) book by Steven Pinker The Language Instinct: How the Mind Creates Language (New York, 1994). These are not transparent theories. I had a whole set of lectures on acoustic theory, which has some real complexity. I opened the doors to neural functions in language production. However, I did everything I could to keep it simple. You see, some of the students in this course were enrolled because it was a requirement of their major, that is in Communicative Disorders and Psychology. I held Professorial rank in both of those departments. Some pre-med and nursing students were enrolled because they knew I took a medical approach to much of the course, and that I held Professorial rank in the Department of Neurology in the College of Medicine. All of those students were looking at a good many courses down the road that would involve plenty of rigor. As the students in Communicative Disorders and Psychology would be taking more work in the future that involved Linguistics, I intended my course for those students to be a very basic introduction to the beauties of this field of study. The great bulk of the students in that course, however, were likely never to take a course in Linguistics again and I wanted to awaken in them 22 an interest in thinking about issues we discussed in class. My hope was that sometime, as an adult, they might open up an issue of the New Yorker and come across an article about Chomsky (there was a great series fifteen years ago) or a piece by Pinker and then they would say: “Hey, I had this crazy old prof back at Vermont who lectured about this stuff and it was pretty cool,” and they would be motivated to read the piece and, perhaps, ask some questions about it. If my cream-puff course awakened some interest and caused students to enjoy, at least a little bit, the act of thinking and asking questions and seeking answers to their own questions, then I absolutely did not care if they could go to the board and re-create Gunnar Fant’s “Acoustic Theory of Speech Production.” No academic rigor, right? On the other hand, I also taught a course while on the faculty of the Institute of Linguistics at the University of Stockholm, on Research Methods. Now, that one had some rigor to it. The nature of the beast, Research Methods, demands doing certain things by the book. Academic rigor, right? The operational definition of academic rigor in the classroom is going to depend a great deal upon the particular class being taught. The two courses I mention above may have both been quite rigorous, but in very different ways. In my introductory course I didn’t want them to memorize detail and I didn’t want to force-feed theory to them. I wanted them to ask questions. I began the course by explaining that I expected them to ask me these two questions, and to do so often: “What do you mean?” and “How do you know.” Some of them did – and that was all I needed to feel that I was on the right track. Getting first-year students to do that may just require a little rigor. I once had the great pleasure of sitting in a corner of a room high up in the Wenner-Gren building in Stockholm, talking with Morris Halle, co-author of the seminal book by Chomsky and Halle. He spoke at length of his belief that we spend too much time in the classroom teaching as if all the answers are in the back of the book; as if what is accepted as fact and truth today will remain so forever and we must teach it, rigorously, as some sort of dogma. In fact, he said, what wins a Nobel Prize today may elicit only a ho-hum in twenty years because what we do in research is strive to disprove theories. So, he said, his work with Chomsky, in Sound Patterns of English, was bound to be shown to be wrong in many of its facets, and his goal as a Professor was not to rigorously force his theories upon students but, rather, to rigorously encourage them to question his theories and find the errors in them. A rather different kind of rigor. As we consider academic rigor on our campus, and I very much hope we do take up that discussion, we must keep that basic question raised by Scott Cawelti very much in mind: What IS academic rigor? It may be in the eye of the beholder. It may, surely it must, vary with the course and sometimes vary within a given course. For me, rigor will always be doing whatever is needed to enable our students to ask good questions, to seek their own answers, to embrace change, to be comfortable with ambiguity, and to express themselves well and clearly in their writing and speaking. For others, classroom rigor may be something entirely different and much more explicitly defined. This is why it was so difficult for me to begin writing on this topic. I can only paraphrase the Supreme Court justice (was it Potter Stewart?) by saying that I can’t define academic rigor but I know it when I see it; however at least it puts the issue out on the table. Now, hopefully, we can begin to take a closer look and pose some questions of our own. James Lubker is Interim Provost and Vice President of Academic Affairs at the University of Northern Iowa http://www.uni.edu/universitas/fall05/pdf/jameslubker.pdf 23 21. …how academic rigor would be defined by that unit and what they would look for in deciding that some other unit representing a very different discipline or area of study was rigorous. What constitutes rigor and how to achieve it has been a topic of frequent conversation in xxxxx, especially in relation to setting standards and outcomes in clinical teaching where performance is more difficult to measure. Because we did not have time in the final faculty meetings of the year to revisit this topic, I set up a Blackboard discussion board forum during the month of May. This response incorporates both recent faculty input and my own perceptions about how we view rigor in xxxxx education. We view rigor in terms of both learning processes and learning outcomes, and are systematically “tuned in” to both of these areas. Our programs are guided by specific competencies at both undergrad and grad levels, and these professional competencies (called “Essentials”) were recently updated by the AACN. So we map our curricula for all programs to the BSN and MSN Essentials for Xxxxx Education. We also systematically gather program outcomes data related to program benchmarks for program accreditation. As our programs have developed and grown, it has been a priority to develop and use standard definitions and measures across courses. We have standard tools for student scholarly writing, presentations, peer evaluation, and portfolios. Of course the guidelines can be tailored to course needs; but our outcomes measures do reflect core standards we all use. With that as background, we have struggled with “rigor” in both process and outcomes areas: - We have had a lot of new faculty and novice teachers, so setting standards/expectations for student performance, holding students accountable, and engaging students actively in learning in ways the faculty are able to evaluate (especially clinically in a busy ever-changing environment) requires experience, confidence, and knowledge of pedagogy. New faculty also struggle to balance being helpful and supportive with setting clear boundaries and expectations with students. Nurses are nurturing, so that boundary setting can be a real challenge for many new faculty. The faculty has spent a lot of energy during the past year revising the BSN Practicum Evaluation Tool (PET) that is used across all practicum courses in order to help faculty focus and communicate clear standards for student clinical performance. So rigor in teaching is one component. - Faculty are adding a fair amount of web-enhancement and on-line components to classroom courses. This creates special challenges for assuring and assessing the depth and accountability of student learning. Even faculty with exemplary teaching abilities have struggled with this. - There is considerable concern and debate regarding grade inflation and faculty inability to maintain clear learning standards. The xxxxx faculty perceives that students expect A’s (especially in experiential courses with more qualitative and subjective evaluative components). Faculty stress about student course evaluations so are reluctant to give direct feedback regarding student learning challenges, especially in clinical courses. As a result, faculty complain that students are unprepared, etc. clinically, but some practicum course grades have little variability and do not reflect the range of student learning outcomes the faculty report. Faculty prefer a mastery, criterion based approach to practicum learning, but worry that “rigor” will decrease if we stop grading those courses. The conversation is ongoing, especially as the BSN faculty are working on some curriculum revision in the coming year. - A related theme is questions about student expectations for their own achievements, student entitlement, and student pressure on faculty. All related, of course, to faculty role development and identity. I got very little feedback on what xxxxx faculty would look for in assessing rigor in another discipline. However, based on our discussions, I would say criteria to evaluate rigor in any program must include learning and performance standards, well developed and high quality teaching/learning processes, congruent measures 24 and/or benchmarks to provide evaluation data. Also, this evaluation process must include standards and measures of faculty teaching. 22. Academic rigor in the XXXXX Department was identified as being the production of accomplished graduates. An accomplished, successful XXXXX graduate is one who demonstrates both a set of skills and body of knowledge, and a certain quality of mind. Key to this is the complementarity of these two dimensions to excellence: an XXXXX graduate should demonstrate both these sets of characteristics, not one without the other. A list of these characteristics is found below on the right side of the summary diagram. To reach this high standard of academic rigor in the form of quality graduates, the Department identified an exacting educational process that emphasizes the performance of both faculty and students. Again, key to this conceptualization (seen on the left of the diagram below), is the notion of education being an iterative process where both dimensions are important. Rigor, in short, is something that is achieved when our graduates demonstrate a certain depth of mind and depth of skills; this is the priority. The route to that end is one that emphasizes these qualities via the iterative development of learning. 23. The faculty of the Department of Xxxxx agree that a discussion of “academic rigor” is important and appropriate, but we feel the word “rigor” insinuates the wrong concern. Dictionary definitions of rigor do not match what we think is important. We do feel it is important that within courses, programs, and across all college experiences, students are engaged and challenged in ways that promote their development. Rather than focusing this conversation around “rigor,” we prefer the conversation focus on “engagement” and “challenge.” Experiences that promote student development do not have to be strict, harsh, or tough as suggested by the definition of the word rigor. We do, however, feel we need to cultivate student development by providing an environment that promotes growth. 25 The assessment of engagement and challenge is difficult for many reasons. Firstly, the college experience promotes development along many dimensions. Students advance during college intellectually, emotionally, socially, spiritually, and ethically. They develop a wider appreciation for things and ideas that extend beyond their more limited and self-focused earlier-life experiences. They develop skills that are useful in their professions and personal lives. Adding complexity to the problem of assessing engagement and challenge, students vary in their initial state along all of these dimensions. They differ in their self efficacy and motivation for development. Further, teaching and learning strategies vary in effectiveness across learners and teachers and for different educational objectives. Grade distributions are sometimes an indicator of challenge, but they often fall short. For example, grades are generally high for experiences that take a mastery approach, requiring students to perform, receive feedback, and repeat until they achieve a high level of competence. However, if instructors have high performance expectations and require students to work hard to reach their standards, they are providing experiences that we would consider to be challenging. To evaluate engagement and challenge, it is necessary to conduct a comprehensive review of courses, program curricula and other college experiences that consider the objectives of the experience, the activities required, and whether most students advance to a new level as a result of the experience. The questions addressed in this analysis will vary depending on the goals of each college experience. For some experiences reference to Bloom’s taxonomy (http://www.learningandteaching.info/learning/bloomtax.htm) can be useful. Sometimes Bloom’s taxonomy may fail to fully capture the objectives of a college experience. For some experiences we might ask whether students have advanced in their ability to competently perform particular tasks. We might ask if activities help them develop a deeper level of appreciation for creative works or natural beauty. For other experiences we might ask if they become more tolerant or compassionate. In the end this discussion shouldn’t really be about “rigor.” Desirable college experiences encourage student development through “engagement” and “challenge.” Are we doing all we can do to promote growth? This statement was created by xxxxx based on a discussion during the April 4, 2011 meeting of the Department of Xxxxx and subsequent discussion by e-mail. 24. The following is an attempt to capture faculty discussion regarding academic rigor. First noted as an indication of academic rigor was a list of requirements in the Xxxxx Program including: Use of a departmental grading scale Professional behavioral standards cited on each syllabus and in the Xxxxx Student Handbook Admission to the SW Program and Contracts with individual students should he/she not meet the standards Program-driven assignments (assignments that are linked to specific courses regardless of instructor) including o Challenging writing assignments - professional documentation assignments across courses o Challenging reading load Program sequencing: o Designed to be developmental in nature (Bloom’s Taxonomy) o Program of study not just a group of courses Multi-method outcome measures to address educational competences (objectives) of the program As a professional program, the culminating field practicum (internship) should demonstrate the soon to be graduate has walking around knowledge of the discipline 26 Discussion captured the following ideas which are more significant than the list above. Academic rigor: Is attached to difficulty, magnitude, complexity of assignments Should result in defined competency by end of academic of career Includes engaging students cognitively and affectively and expecting professional behaviors Should reflect multi-methods in pedagogy and requirements and outcome assessment strategies Involves moving from learning to simulating to applying knowledge Includes development of observational skills, interpretative skills and communication skills Involves moving up in levels of learning Need to know how to help students learn to interpret data; how to strike intellectual curiosity so that student start to mine data for themselves Would be helpful to have rubrics that could be used across instructors so that all know the standards to which students are being held (ex. Writing rubrics) Noted that rigor at the undergraduate level should be different than that at the graduate level. 25. The xxxxx department came up with the following: The determinants of academic rigor within and beyond the Xxxxx program are twofold: 1. The ability of students to analyze, synthesize, and critically evaluate the content under study, and to apply the knowledge to new situations. 2. The development and utilization of the appropriate evaluation methods for the above. 26. An academically rigorous course is recognized as being one that is Comprehensive Its subject matter is addressed in a way that gives a complete picture of the topics covered. Challenging Students will be exposed to and are expected to master material that significantly exceeds the prior knowledge limits of the average enrolled student and that requires a focused student effort to be successful. Appropriate It builds on its pre-requisites and fulfills its role as a pre-requisite to higher-level courses. The grades earned by students in the class closely reflect their mastery of subject matter. Professional The instructor has an educational background in an overlapping field of study and is able to explore details of the topic well beyond the usual course boundaries so that the context and meaning of each concept or technique can be explored without limits. The rigorous curriculum is Integrated It relies on the expertise and rigor of other departments in the university to provide their students with service courses and cognates of breadth and depth. Productive It empowers our students to successfully take the next step in their lives and careers through employment, graduate, or professional school in the same or related fields, thus 27 fulfilling JMU’s goal of preparing “educated and enlightened citizens who lead productive and meaningful lives”. 27. Academic Rigor in the JMU Department of Xxxxx and Xxxxx Although there are a variety of definitions of academic rigor, the interpretation generally employed by the Department of Xxxxx and Xxxxx at JMU (hereafter termed “Xxxxx Department”) is that the instructional mission should seek to provide a competitive national edge for any students successfully completing coursework from this department. The Xxxxx Department offers a curriculum guided by the national organization of professional chemists known as the American Chemical Society (ACS). The ACS Committee on Professional Training never stops evaluating both the specific courses in xxxxx offered throughout the nation and each ACS-certified college and university xxxxx department to maintain quality. As a result, throughout the nation, xxxxx course sequence and content have been reviewed and scrutinized for decades. As a long-standing ACS-certified program, the JMU Xxxxx Department has been recognized as offering a challenging and rigorous curriculum. In the 1950s and 1960s when JMU was Madison College, Drs. Wilbur Chappell, Raymond Cool, and Liberty Casali established a climate of integrity and thoroughness for coursework that has guided the department to the present day. Rigor is maintained in the Xxxxx Department by employing the following approaches (in no particular order): 1. General climate of rigor. Although it is not possible to demonstrate a metric for this climate, it is always in evidence. Faculty members frequently discuss classes, student performance, content, and rigor both in formal and informal gatherings and as part of the constant development of coursework and curricula. 2. Retention and hiring of the best faculty. It has been said that the best and most capable faculty will produce the best and most capable students. The Xxxxx Department thus recruits the best faculty for each subdiscipline that can be found when faculty jobs are opened. Considerable time, resources and effort are spent in the recruitment process with the expectation that new faculty (who are the best trained Ph.D.s available) will strengthen the rigor and quality of the department. 3. Careful consideration of student evaluations. The Xxxxx Department does not take student evaluations lightly. However, it has long been a standard in the department that student coursework evaluations do not serve as a primary criterion for advancement and promotion. The xxxxx faculty have been concerned that excessive dependence on student evaluations may lead to evaluations becoming a popularity contest and result in grade inflation. Rather the department places much greater emphasis on the reports provided by post-graduation students who have been asked to evaluate faculty performance when they have gone into the job market, or on to graduate study. 4. Undergraduate research and other activities. The involvement of undergraduates in active research projects mentored by faculty members has been a long-standing tradition in the Xxxxx Department. Publication in top-tier science journals and maintaining external funding with undergraduate researchers is only possible by establishing an academically rigorous environment. 5. An eye to the competition. The Commonwealth of Virginia is fortunate to have a number of highly-rated universities and colleges that excel in undergraduate chemical education. The JMU Xxxxx Department is not blind to need to establish a strong and rigorous curriculum in order to recruit competitively for the best students. Having strong and capable students helps ensure that coursework is offered with at a high level of rigor. 6. The success of students in the job market and graduate school. The JMU Xxxxx Department pays attention to the success of students applying for post-graduate work, professional school or in entering the job market. In the current year, more than one-third of the graduates were successful in gaining admission to graduate programs, some of which are among the most competitive in the nation. Feedback on how the students performed in post-graduate vocations and other activities is continually 28 7. 8. 9. 10. 11. collected to ensure that the rigor of coursework was appropriate for JMU students being competitive and successful. Structured and cumulative curriculum. Success in the discipline requires that students master foundational material including content knowledge, problem solving, and laboratory skills. The curriculum is structured so that students must demonstrate competence in pre-requisite coursework before being able to continue to do more advanced work in the field. Courses in the Xxxxx Department beyond the introductory level have numerous pre-requisites, including in some cases courses in mathematics and physics. They are held accountable for prior learning in future courses and must constantly revisit it to achieve mastery. Maintaining a statistical profile of introductory-level courses. XXXXX 131 and XXXXX 132 (General xxxxx I and II, respectively) are the gateway courses to the xxxxx major as well as many other majors on campus in the STEM fields. We have maintained detailed grade statistics since 1997 for XXXXX 131 and 2004 for XXXXX 132 on the performance of students in these classes. This allows us to compare the content knowledge of cohorts over many years, uphold standards, and hold the line against grade inflation. To date, we have data on over 9000 students. Statistics include average GPA (2.15 for XXXXX 131, 2.27 for XXXXX 132), DFW % (32.0% and 22.4%, respectively), A/B% (35.1% and 35.4%, respectively), high and low GPA given for different sections of the class recorded each semester, etc. Having a detailed running statistical profile enables us to see that rigor is maintained in these critical courses, but is also helpful for junior faculty members to give them a perspective when they are assigning grades for the first time teaching these classes. ACS final examinations given in many xxxxx classes. The ACS has an active exams committee who prepare assessment examinations for all of the core lower and upper division undergraduate courses in a xxxxx major. Each different subject exam – which is comprehensive within its subdiscipline – has a committee composed of national experts in their field, and each of the exams have undergone rigorous testing to determine national norms at a cross-section of universities around the nation. Most Ph.D. programs in xxxxx in the United States use these exams as placement exams for graduate courses and, if necessary, for remedial undergraduate work for Ph.D. students. Many of core xxxxx courses (lower and upper division) at JMU use the standardized ACS exams as the final course assessment. This enables comparisons of JMU students against national norms, across different sections of a class, and from yearto-year ensuring academic rigor. External checks through professional examinations. Many of the students enrolled in xxxxx courses are preparing for highly competitive pre-professional programs such as medicine. The need to prepare students for rigorous placement exams such as the MCAT for pre-medical students and the xxxxx GRE exam for prospective Ph.D. students ensures rigor in our curriculum. Working to have students produce professional quality materials. The laboratory experience is a significant part of any xxxxx major. In these courses, we help students to achieve professional-level results. Students are able to demonstrate competence in laboratory work through measurement. Students use modern, research-grade instrumentation and are expected to be able to run the instrumentation and interpret the results. Students are expected to present their results – both context and analysis – in accordance with the norms of the field by writing professional memos or laboratory reports in the style of a peer-reviewed journal article. Students are able to interpret advanced scientific information by presenting their own research and/or research from the literature as a scientific talk. Elements that the Department of Xxxxx and Xxxxx would identify as crucial in identifying academic rigor in a dissimilar program. While it is difficult to assess rigor in dissimilar departments or units across campus, several factors should be considered (again in no particular order): 29 1. Distribution of grades given in large population courses—particularly in introductory courses. While the average GPA in a course cannot tell the entire story, if the average GPA in course with a large enrollment (particularly 100-level courses), is exceptionally high, then the rigor of the course is immediately suspect. This is particularly true if the standard deviation in the course GPA is small. A high GPA with a small standard deviation implies that there has been no distinction made between excellent, average and weak students. This is problematic for maintaining rigor in a program and is actually a serious demotivator for hard working students. 2. Amount of reading/homework assignments required of a student. The sciences generally have homework/problem sets/laboratory reports required for outside of the classroom work, while many other disciplines have external reading, term-papers, projects, portfolios or case-studies required. The rigor and quality of these external assignments are a good proxy for the rigor in a course. If success in a course or discipline requires significant reading, reflection, problem solving and synthesizing of ideas outside of the designated lecture time, it is generally a good indication of the rigor of a course. There are no disciplines that can be learned in 3 hours a week for 15 weeks. A true appreciation and understanding for any discipline will require a significant amount of external work. 3. Courses or programs that build on prior knowledge and the activities that assess this. Student development should be apparent in courses and programs. Students should be able to carry over knowledge and skills from other courses and apply them later in their career, and over the course of a semester, demonstrate gains in subject material. This could take the form of demonstrating mastery of skill, having to integrate prior knowledge in more advanced coursework, or using a wide variety of skills or methods to interpret data/materials from different courses in the curriculum to develop new ideas, or being able to independently produce professional-quality work. Students should be required to take comprehensive exams where they are held accountable for integrating all course knowledge rather than just reporting back on a small part of the semester. Students should be required to do more than memorize facts to be successful in college-level coursework. 4. Programs in which student evaluations largely determine tenure and promotion are problematic. If the advancement, rank and salary of a faculty member is largely determined by student evaluations, academic rigor will undoubtedly suffer. Student evaluations can be easily manipulated my making an unwritten and unspoken agreement with students—“you participate in my class, and you will receive a high grade”. There is no quicker way to lower academic rigor than tying professional academic staff success to student evaluations. 5. External recognition of a program. Student success after JMU is the best indicator of the rigor of specific programs at JMU. We are in a competitive marketplace of providing employment or graduate/professional school opportunities for our students. The degree to which JMU students are able to receive offers to and ultimately to be successful after graduation is a testimony to the rigor of an individual program. If the program is perceived to be weak, employers and post-graduate programs will quickly figure that out and will no longer recruit and hire JMU graduates. 28. Each academic unit was asked to provide (1) what they see as determinants of academic rigor within their program/unit and (2) elements that they would consider/see as crucial in identifying academic rigor in another perhaps dissimilar academic program/unit. I engaged the Department of Xxxxx faculty to help answer these questions. Below is a summary statement as well as the raw results of our discussion. 1. What academic heads see as determinants of academic rigor within their program/unit There are short and long views on academic rigor in the Department of Xxxxx. A shorter view of rigor measure examines rigor at the course level and looks at guidelines for content based on external agency standards, the stated goals and objectives of the course (as demonstrated through assessment 30 techniques), assessing student abilities of higher order thinking and critical thinking in the course, and the integration lab and field work that supplement/augment lecture material. A longer view of rigor is measured by student success once they leave us and go on to graduate school and employment. Essentially, if our program is rigorous, then our student should be successful and external stakeholders (employers, graduate schools, APR evaluators, other departments) should recognize our program as producing high quality graduates, which is part of our mission statement. Raw faculty opinion Whether the material covered corresponds to the professional guidelines of the accrediting agency Higher order of thinking: higher on Bloom’s Taxonomy (synthesis, applications….) Integration of field, lab, theory in teaching & learning Development of observational skill, interpretative skills, & communication skill towards a professional level. Required learning experiences outside of class hours (i.e. field trips, lab/research) Requirements to take courses in other departments (i. e. Math, Chem, Phys) Every student meets learning objectives of our Assessment Plan/Exam Success in students in the major-jobs, grad school Fulfillments of Mission Statement for dept Retention of problem solving skills; understanding of importance of lifelong learning; understanding of scientific method & its advantages & disadvantages; can student thin outside the box Determined by external review, such as the APR. It is empirically observed by student success in continuing to graduate school and/or finding gainful employment in similar or related fields That our students can demonstrate a consistently high level of mastery in applying, synthesizing, and evaluating the knowledge, skills, & habits of mind in the geosciences. Ability to integrate knowledge from subdiscipline to subdiscipline. Ability to recognize the common thought processes, data bases, thinking strategies that are common of all geosciences problems solving. Ability to encounter a problem in the discipline and know the kinds of data necessary to solve it, strategies for thinking about it, what solutions might look like. What tells me that our dept has a rigorous program is when I observe success among our recent (1-4 years out) graduates. That success may be in gaining admission to a respected graduate program, especially if it is a program that is widely known as source of skilled proficient individuals upon graduation. That success may be in additional research, publications, etc. 2. Elements that academic heads would consider/see as crucial in identifying academic rigor in another perhaps dissimilar academic program/unit. This is a much harder concept to get one’s head around. Rigor may be defined differently by different programs, and I likely do not know enough to recognize it fully in greatly different departments. That said, if a program has well defined goals and objectives, if those goals and objectives are agreed upon by the faculty and by the internal/external stakeholders in that program, and if those goals and objectives are being met, then I consider it to be a rigorous program. I think that many times we fall into the trap of defining rigor too narrowly. If I judge an allied science program’s rigor based upon how my department’s students do in a cognate course that is designed and focused for an audience that is theoretical and not applied, or vice versa, then I may erroneously judge the rigor of the course/program. It would depend upon whether I had the preconceived notion that students should come out with theoretical knowledge or practical ability. Raw faculty opinion 31 Rigorous GENED courses should include quantitative reasoning, when appropriate. Demonstrated in past by what students do after they leave JMU (measured by external standards-can they get quality jobs or get into good grad programs?) Not in a good position to comment on other depts. Same thing as number 1. Gen Ed rigor would be based on achievement of learning objectives Are they effective communicators; do they enjoy learning; are they intellectually curious; are they capable of independent research? I strongly believe that academic review like this is only possible by sources outside the university, but within similar disciplines Clearly framed learning outcomes, parsed by developmental framework, inclusive of the knowledge, skills, & dispositions expected through consensus within the discipline. Ability to integrate knowledge from subdiscipline to subdiscipline. Ability to recognize the common thought processes, data bases, thinking strategies that are common of all geosciences problem solving. Ability to encounter a problem in the discipline and know the kinds of data necessary to solve it, strategies for thinking about it, what solutions might look like. I would like to see more consistency between programs in terms of basic courses taught by different instructors, or consistency in terms of what a student, who has taken a course in one program, is unable to up intellectually with students who took the same course context (e.g. calculus) in another program and clearly was not instructed at the same level. I also think that we should not lose track of our JMU mission with regard to rigor in General Education, and the vital role that academic units play in this part of the university mission. We have a General Education program that is designed to broaden the experience and the perspectives our graduates. The General Education program is so important, that it is the Required Education (perhaps a better name for it) of all JMU students. It is designed so that one may experience the differences and similarities between programs, departments, and colleges. A JMU graduate leaves as an educated citizen, ready to be employed or move on to additional education, but foremost one with a well-rounded education that is enlightened from multiple perspectives. That is the way that I read the rigorous mission of the institution, and it is our roles as department heads to assure that the rigor of our programs integrate into this overarching goal of the university. 29. Description and discussion of academic rigor has been organized under the following four headings:1 1. Meaningful Content a) Coursework should be designed with very careful attention to the recommendations of the relevant professional societies, meeting or exceeding content standards. b) Content should address the needs of students in a way that contributes to their abilities to synthesize concepts and knowledge across the university. c) Questions of content of individual courses should not be addressed in isolation but should be considered as a part of the curriculum of the entire discipline and the curriculum of the university as a whole. 2. Higher Order Thinking 32 a) All courses as appropriate for the audience and level of the course should require that students analyze and synthesize new and previously unfamiliar ideas. b) Higher order thinking in xxxxx is best characterized by the notions of communication, explanation, deductive reasoning, and proof. c) Assessment of student success and achievement should reflect higher-order thinking in meaningful ways. 3. High Expectations a) As appropriate for the level and audience for individual courses, clearly-stated expectations for achievement involving both basic skills and higher order thinking should be set in such a way as to be achievable by adequately prepared students investing time and effort at the appropriate fraction of “full-time” work. b) Care should be taken so that course grades remain consistent over time with established standards of achievement, both internal and external. 4. Active Engagement a) There is no single universally-applicable “best” approach to instruction, but all courses should both require and encourage active engagement of students with the course content. b) Class participation, student presentations, discussions, and other measures of student engagement should be reflected in assessment of student achievement in a significant way. 1 On the recommendation of several department members, this statement is organized based on categories adapted from a report by the faculty at SUNY-College at Buffalo. 30. Xxxxx considers itself to be a program of complex factors related to academic rigor. Our classroom activities, reflected in a comprehensive production program, are based in a collaborative art form that includes literature, history, technology, management, music, art, physical acuity, critical thinking and public service engagement. This broad set of interdisciplinary academic involvements is reflected in our mission statement as copied below. MISSION Xxxxx is rooted in the belief that the relevant artist is the thinking artist who couples the mastery and embodiment of concrete skills with knowledge of and sensitivity to the cultural environments of ideas, artistic forms, and other persons. The School trains and educates artists, scholars, and teachers in the rich traditions and current practices of dance, theatre, and musical theatre. Dedicated to the value of the intensive BA, the School’s programs blend liberal arts education and critical thinking with intensive, pre-professional training and practice. Faculty foster an environment that values and cultivates creative, passionate, disciplined, curious, innovative, engaged, articulate, collaborative, and independent-thinking artists and scholars. Committed to a teaching approach that emphasizes mentorship and individual attention to students, faculty members of the School empower students in the development of their own personal strengths, provide them with tools and opportunities to realize their potential, and equip them for successful work in professional environments, graduate programs, and as lifelong learners. Rigor in xxxxx is defined as the expectation of excellence by the students in the academic, artistic, and practical work of the unit; and the expectation of simultaneous involvement in theatrical production and coursework. 33 Toward this end, all production activities are a laboratory extension of work in the formal classroom setting. Students and faculty spend considerable periods of time outside the traditional classroom in a complex preprofessional learning environment. XXXXX faculty assume leadership roles in theatre and dance professional organizations. They engage in many professional activities outside of the academic setting that benefit students directly and indirectly. All XXXXX faculty write papers analyzing and critiquing Mainstage and studio theatre and dance events. Nearly every course includes a writing component, and writing intensive courses comprise a large percentage of courses in both the core and specific concentration courses. Laboratory and studio activities are required outside of the classroom for many courses. Comprehensive analysis and critical thinking skills are present in all theatre and dance activities and courses. Theatre, musical theatre and dance concentrations are fully accredited by the National Association of xxxxx and the National Association of xxxxx. We would expect that any unit would engage in interdisciplinary studies, critical thinking, research requirements, writing intensive courses and extensive activities outside of the classroom to be considered rigorous. We suspect that all academic units already meet or exceed any reasonable expectation of academic rigor as broadly defined and appropriate both to their disciplines and external accrediting bodies. 31. 1. What are determinants of academic rigor within your program/unit? Beyond student engagement with the challenging course material in the Xxxxx curriculum, the School of Xxxxx faculty has identified additional determinants of academic rigor within our program: Willingness to engage with Xxxxx content outside the confines of individual classes. We strive to help students begin to become lifelong learners by abetting their engagement above and beyond class expectations. We’re also helping them to develop intellectual tenacity, which goes hand in hand with rigor. Focus on mastery learning. We want our students to go beyond individual assignments or exams and develop competence and mastery with the material to enable them to apply the material in a variety of areas, as needed. Capstone design sequence. Our capstone design sequence is a tangible expression of our commitment to rigor as these projects require the students to integrate and synthesize the broad and varied content from across their coursework into a single project. Self-reflection. Our definition of rigor also emphasizes students developing their meta-cognitive skills to reflect on their own learning and where their strengths and challenges lie. Another determinant of rigor in the School of Xxxxx is developing a consistency of expectation, grading and feedback amongst the faculty so that students are hearing the same message consistently across the program. The faculty feel that it’s important to express a consistent set of standards to our students. As a faculty, we feel our curriculum is challenging and tough, but we strive to be fair in our expectations and approach. This is our operational definition of rigor. 2. What elements are crucial in identifying academic rigor in another perhaps dissimilar academic program/unit? We feel that many of the elements we described above would apply to all academic programs, both similar and dissimilar to Xxxxx. This is particularly true for the integration of knowledge across classes in a capstone project, extending learning to a mastery basis and going beyond what’s done in class, as well as the reflective metacognition focus. 34 We would suggest that all programs consider capstone projects for all students to help students experience the integration of knowledge and the development/design of new ideas/concepts/devices. 32. “Academic rigor: To challenge, through a relevant and sophisticated curriculum, those students who accept responsibility and demonstrably meet high yet achievable faculty expectations.” 33. What do we see as determinants of academic rigor within our program/unit? Primarily, the xxxxx support academic rigor by providing customized instruction that “scaffolds” classroom learning. Learners can achieve more with the expert guidance of our faculty and peer educators, which then “fades” as students become more capable of autonomous performance. Scaffolding pedagogies reinforce content and skills by emphasizing practice and metacognition. (Research indicates that learners’ awareness of a process—for example, how to solve a math problem or how to compose a presentation—brings the most durable, transferable benefits.) Scaffolding enables increased rigor in the classroom; for example, instructors can assign more writing or more complex STEM content when supported by xxxxx instruction. To infuse academic rigor into our pedagogies, we employ active, experiential techniques so that students retain ownership and responsibility for the learning process. Whatever methods we employ—feedback, explanation, modeling, or guided practice—we expect students to engage actively and make progress toward goals they define. Instructional encounters within the xxxxx are rigorous when the learner works as hard or harder than the consultant/tutor. The xxxxxx also support academic rigor by researching and developing new pedagogies and sharing expertise about learning with faculty. Through consultations and workshops, we help faculty increase their effectiveness and efficiency (with, for example, assignment design and evaluation techniques) which enables them to deliver more rigorous instruction with better results. What elements would we consider as crucial in identifying academic rigor in another perhaps dissimilar academic program/unit? Academic rigor can be seen as more content or more work, or more demanding content or work. The common denominator seems to be more learning, which boils down to students making more progress toward desired learning objectives. Progress can certainly be identified through assessment or classroom evaluation methods, including more rigorous grading and high stakes testing, for example. However, we believe that the true measure of rigorous education rests not only with faculty or curriculum but with learners themselves. In identifying academic rigor elsewhere, then, we would look for how departments allow, encourage, and support students to establish their own rigorous outcomes in collaboration with faculty and advisors. For example, what specific expectations and means have departments established for independent study and research? To what extent can students help shape the curriculum of a course or major? We find that we can infuse rigor into our instruction by holding students accountable for setting goals, for monitoring their own progress, and for working independently within and beyond their learning experiences in our Centers. Authentic academic rigor cannot be imposed but must be facilitated, and eventually developed within, autonomous learners. 35 34. XXXXX Faculty Meeting, April 12, 2011 A panel of XXXXX Faculty gave a brief presentation entitled “Dimensions of Academic Rigor,” which was followed by small group discussions. Each small group was asked to write 2-3 sentences expressing their conception of academic rigor. Each small group was given a set of the same 3 discussion questions, plus a unique question for their group. Thus, groups are identified by their “unique question” below even though the “unique question” was just one of the four questions they discussed. This document contains: 1. Link to panel presentation slides: Academic Rigor Panel Presentation (ppt) 2. Small Group Expressions of Academic Rigor (2-3 sentences) 3. Appendix A: xxxx thoughts on academic rigor, contributed post-meeting. Small Group Expressions of Academic Rigor Group One: “How can we influence academic rigor with our physical spaces?” Academic rigor is depth; it’s more about quality than quantity. Time is needed to be rigorous. Academic rigor is continuing to ask questions. (Intellectual curiosity) Academic rigor is not easy – telling the truth. Group Two: “How can we apply principles of academic rigor to our XXXXX material collections?” Intellectual curiosity, critical and creative thinking. Students challenging themselves and us (“how do I know that is a good resource?”) Students able to transfer knowledge and methods from one course or foundational courses across their college learning experience and into the “real world.” An understanding of how to build, from scratch, a foundation for knowledge in a new area. Group Three: “How can we collaborate with teaching faculty to enhance rigorous learning outcomes? “ The library can serve as a central hub for celebrating academic rigor & providing positive reinforcement to and about both faculty & students; avoid classifying people and focus on behavior (faculty & students). XXXXX balances classwork, liberal arts values, and practical application of knowledge, all within the context of lifelong learning. This is accomplished through efforts such as information literacy, media literacy, and administrative support for the JMU academic enterprise. The library vets and curates a large collection of scholarly content. It should also provide a place – an institutional repository and/or e-portfolio system – where students and faculty can preserve, publish, share and showcase their scholarly output. The library should continue to promote information and media literacy to point students to curated collections and encourage them to contribute to a central repository. Group Four: “What student characteristics (either actual or perceived) influence academic rigor?” 36 Students will be motivated to learn the subject for its own sake. They will think critically about information. They will challenge themselves to improve their knowledge and skills. Group Five: “How can online / blended courses contribute to a foundation for academic rigor?” Academic rigor is balance between mastery of knowledge, methodology on the one end of a scale; and communicating, being challenged in order to create new ideas on the other end of the scale Appendix A: xxxxx thoughts on academic rigor, contributed post-meeting. Academic Rigor Knowledge - Valuing knowledge; commitment to learning; understanding that knowledge is cumulative, ability to apply existing knowledge to discovery of new knowledge; recognizing that academia is built upon pursuit of knowledge; developing habits of mind; pursuing a life of the mind Completeness – Following all of the steps in the process of gathering information and evidence and developing conclusions; finishing the job, doing things thoroughly while avoiding short cuts; reading books and articles before citing them; understanding books and articles before citing them; citing sources completely and properly; using the whole work rather than the summary; willingness to commit more than the minimum effort Openness - Ability to go where the evidence leads rather than where you think it should go; willingness to challenge conventional wisdom; ability to throw away everything you’ve done and start all over again if a hypothesis or idea is proven false or the data don’t lead in the direction you thought they would lead; ability to recognize what is true and correct and what is not Persistence - Not giving up easily; sticking to the task even when it takes more time or effort than you thought it would take; prioritizing activities, putting first things first; spending the time it takes to do things right; striving to achieve true understanding rather than superficial knowledge; avoiding the expedient path Honesty - Giving credit where credit is due; acknowledging the sources of ideas and building upon the work of others; not cheating or lying in one’s work; being more interested in doing things right than in getting a good grade; holding oneself to a higher standard; following one’s own moral compass 37