Memo To: Faculty, Department Chairs and Deans From: Assessment and Curriculum Committees Subject: Conversion to Newly Defined Core Learning Outcomes Date: May 1, 2012 Background Over the last three years, the Assessment Committee has worked on new definitions for three of our five Core Learning Outcomes (CLOs). The three CLOs, in both their old and new forms as well as the rationale for the change are documented in the table below. Old Version Computer Literacy -- To be computer literate, graduates of the College will know basic information technology concepts and will be able to use a computer to manage files, perform word processing, and use the Internet and e-mail. New Version Information Literacy is a student’s ability to locate, evaluate, and use electronic and print materials to meet a particular information need in an ethical and legal manner. The information literate student: Determines the nature and extent of the information needed. Defines and articulates the need for information. Accesses needed information effectively and efficiently. Constructs and implements effectively-designed search strategies. Refines the search strategy if necessary. Evaluates information and its sources critically and incorporates selected information into his or her knowledge base and value system. Summarizes the main ideas to be extracted from the information gathered. Articulates and applies initial criteria for evaluating both the information and its sources. Compares new knowledge with prior knowledge to determine the value added, contradictions, or other unique characteristics of the information. Uses information effectively to accomplish a specific purpose. Applies new and prior information to the planning and creation of a particular product or performance. Rationale With the explosion of both quantity and accessibility of information (and misinformation) of recent years, the college faculty recognized that students need to be not just computer literate, but information literate. The new version of the outcome addresses this need and is based on information provided by the Association of College and Research Libraries. NOTE: The Assessment Committee has provided an Information Literacy rubric as a resource for faculty, available at http://www.ncstatecollege.edu/committees/ass essment/default.htm Understands many of the economic, legal, and social issues surrounding the use of information and accesses and uses information ethically and legally. Understands many of the ethical, legal, and socioeconomic issues surrounding information and information technology. Follows laws, regulations, institutional policies, and etiquette related to the access and use of information resources. Acknowledges the use of information sources in communicating the product or performance. Computation Proficiency is the ability to perform mathematical computations found in life situations. Students will be able to recognize and analyze math situations and solve problems using basic mathematical and algebraic computations. Computation Proficiency is the ability to perform the college-level mathematical computations found within the student’s chosen academic discipline or degree. Upon graduation, North Central State College students will be able to recognize, analyze, and solve math problems. The original outcome was based on the college’s previous minimum math requirement of MTH 103 -- Introduction to Algebra, a developmental math course. The college raised the minimum requirement to a college-level math course to be incorporated in the new semester curricula. The new CLO definition recognizes that change while allowing the various disciplines/degrees to determine where and how the outcome will be attained and assessed. Culture & Community – The goal of the College, especially of general education, is to enable students to become articulate, literate, and culturally aware citizens. Students graduating will demonstrate an awareness of culture and community issues, values, resources and diversity. Intercultural Knowledge and Competence is "a set of cognitive, affective, and behavioral skills and characteristics that support effective and appropriate interaction in a variety of cultural contexts.” (Bennett, J. M. 2008. Transformative training: Designing programs for culture learning. In Contemporary leadership and intercultural competence: Understanding and utilizing cultural diversity to build successful organizations, ed. M. A. Moodian, 95-110. Thousand Oaks, CA: Sage.) Students graduating from the College with an associate degree will demonstrate: The Assessment Committee struggled for years to gain traction with the original version of this outcome. Problems included measurability and the emphasis on general education. As a result, the Committee “started over.” The new version relies heavily on the expertise provided through the Association of American Colleges and Universities VALUE project. Intercultural Knowledge -- through cultural selfawareness, knowledge of cultural worldview frameworks Intercultural Skills -- through empathy, verbal and nonverbal communication Attitudes -- through curiosity and openness NOTE: The Assessment Committee has provided an Intercultural Knowledge and Competence rubric as a resource for faculty, available at http://www.ncstatecollege.edu/committees/ass essment/default.htm Changeover Plan 1. All Master Syllabi will be updated with the new CLO definitions in Fall 2012 by the Curriculum Committee. 2. Course Coordinators will need to consider whether the new CLO definitions necessitate either a change in assessment methods or the removal of the CLO from their course. a. If the current assessment method is still appropriate under the new CLO definition, then the Course Coordinator will not need to pursue this further except to update Student Syllabi. b. If an assessment method is changed or a CLO is removed from a course as a result of a new CLO definition, then the Course Coordinator will need to submit the revised Master Syllabus to the Curriculum Committee for approval via an abbreviated review process. The expedited process will be posted on the Curriculum Committee’s web site and be included in the new Curriculum Handbook. Assessment Resources The college’s Core Learning Outcomes. including definitions and assessment results, as well as program/department level learning outcomes and Program Assessment Reports are provided on our Student Success Plan . On the Assessment Committee’s web site are the Core Learning Outcomes Assessment Schedule and Learning Outcomes Assessment Tools (CLO rubrics, templates for the Program Assessment Report and the Course Assessment Report). The following table, an excerpt from the Course Assessment Report template, suggests possible assessment methods: *Legend for Column II: Evaluation Methods -- A List of Possibilities Direct Measures Indirect Measures (Do not rely solely on indirect measures) Score gains between entry and exit on published or local tests or writing samples Research projects, presentations, oral defenses, exhibitions, performances – scored using a rubric Written documents/essays – scored using a rubric Juried reviews of presentations or performances Performance on licensure, certification, or professional exams Portfolio assessments Scores on quizzes and tests that link to learning outcomes Observations of student behaviors with systematic recording of notes Systematic analyses of electronic discussion threads, “think alouds,” or knowledge maps Skills-based assessments using checklists, etc. Ratings of student skills by field experience supervisors Performance on standardized exams Performance on practical exams Employer rating of graduate skills via survey, interviews or focus groups Scores from classroom response systems (clickers) Feedback from computer simulations Graduate follow-up rating of skills via survey, interviews or focus groups Student ratings of the knowledge or skills gained Systematic analysis of student reflections on the knowledge or skills gained Students’ reflections on their values, attitudes, beliefs Other Resources: For writing learning outcomes o University of Central Florida’s guidelines for writing student learning outcomes that are SMART and MATURE o Bloom’s Taxonomy Matrix with verbs, materials/situations, and potential activities/products o More on Bloom’s Taxonomy including why and how to use it o ThinkWell- LearnWell ™ diagram with learning goals, outcomes and thinking skills For assessing learning outcomes o o The State University of New York rubrics: SUNY Critical Thinking Rubric SUNY Writing Rubric SUNY Math Rubric The Association of American Colleges and Universities Valid Assessment of Learning in Undergraduate Education (VALUE) project Examples of Core Learning Outcomes Assessment Plans for Master (and Student) Syllabi This following table includes the newly defined CLOs as they will be updated in all Master Syllabi. Examples of assessment plans are provided strictly AS EXAMPLES. Core Learning Objectives Assessment - - How it is met & When it is met All Listed Assignments are graded. EXAMPLES Communication – Written Communication – Speech The student will explore strategies to evaluate computer products and define product standards for an organization via research and written report in conjunction with Ch. 7; assessed using Writing Across the Curriculum rubric. The student will write a research paper on successful web based companies; due end of term; assessed using Writing Across the Curriculum rubric. The student will write analytic essays in weeks 5 and 10; response essays in weeks 3 and 7; evaluated by rubric. The student will find and present a summary of a professional journal article that identifies physical, mental and cognitive impairments and addresses the etiology and impact; assessed using the Speech Intercultural Knowledge & Competence Critical Thinking Information Literacy Checklist; weeks 8 and 9. The student will function as an engineering team member in an academic environment to work on a project and present it; assessed via Speech Rubric; mid-term. The student will do an oral presentation on informational interviewing, due at the end of the semester, as well as mock interviews throughout the semester; assessed using the Speech rubric. The student will discuss and explore their own personal attitude toward disability and mental illness and how that impacts their interactions with clients; assessed in Personal Attitude Reflection assignment (rubric); week 14. The student will identify the influence of cultural practices on an individual's adaptation of stressors and level of wellness; assessed in critical thinking exam questions (exam key) and identified in care plans of clients related to health practices followed (care plan rubric); weeks 2-16. The student will produce a technical marketing brochure that addresses multicultural audience issues; evaluated by brochure rubric; week 9. The student will increase his/her intercultural knowledge/skills/attitudes through small group projects/presentations; evaluated by pre and post self-assessment using the intercultural knowledge/competence rubric; mid-term with self-assessment repeated at end-of-term after clinical experiences. The student will plan, assemble, order, and produce a Portfolio Project that will require the student to prioritize artwork, sequence and group the artwork, and trouble shoot problems that come up along the way; throughout the semester; assessed using Portfolio Project rubric. The student will evaluate a patient scenario (to include patient assessment), select an appropriate therapy, and explain the rationale for the selection; cases in exams 1, 2, and 3; assessed via exam key. Student will study and analyze historical engineering disasters and while working in teams, develop practical Engineering Preventative Management Solutions to these scenarios throughout the semester; evaluated using Solutions rubric. The student will evaluate the effect of ethical considerations and social responsibility given local and global business scenarios; exams/quizzes throughout the semester but primarily assessed on exam during 1st 4 weeks. The student will respond appropriately to a complex “What would you do?” scenario that requires analysis, evaluation, inference, and explanation; scenario provided week 1 and finals week for a pre and post assessment using the critical thinking rubric. The student will find and present a summary of a professional journal article that identifies physical, mental and cognitive impairments and addresses the etiology and impact; assessed using the Information Literacy rubric; weeks 8 and 9. Computation The student will explore strategies to evaluate computer products and define product standards for an organization via research and written report in conjunction with Ch. 7; assessed using Information Literacy rubric. The student will complete a research paper assessed via the research writing rubric; 8th week of the semester. The student will solve homework problems in solar conversions, fuel efficiencies, and power loss (EIEO) using Excel, and temperature conversions using BASIC throughout the semester; assessed with problem answer key. The student will convert numbers among the decimal, binary, and hexadecimal number systems in problems in the midterm and final exams; assessed via answer key. The student will perform clinical medication calculations; Weekly and Final Exams (answer key).