Executive Summary Assessment of Student Learning and Development University Assessment Council For AY2012-13 Assessment of Student Learning and Development: At a Glance Noted strengths in student achievement or academic assessment processes: Students show improvement as they move from lower to upper division courses. Faculty are for the most part highly engaged in improving the quality of learning and the engagement of our students. Many departments are using the assessment management system (eLumen) effectively to measure student achievement of outcomes and to plan action steps for improvement. Departments with established, standardized assignments and rubrics seem to have more success with assessing students Frequently noted challenges in student achievement or academic assessment processes: Writing skills: Writing at the college or graduate level is cited as a challenge for a sizable proportion of students in most programs, undergraduate and graduate. Oral presentation skills (cited by traditional business) Quantitative reasoning skills (cited by business, traditional, cohort and graduate) Research citation (based on results from writing assessments) Personal accountability/responsibility (e.g., attendance, turning in work on time) (across programs, traditional and cohort) Global awareness (cited by business; missing in general education assessment) Training of adjuncts in the use of effective assessment and documentation of results in eLumen as well as skills in instructional technology. Not all departments submitted an updated Curriculum Map, although instructed to do so. Recommendations 1. Based on faculty reports, an institution-wide effort to improve student writing, especially writing that is below expected “grade-level,” is very much needed. Faculty have reported this every year and this recommendation has been made in response each year. What is needed is a set of intentional, systematic plans for improvement that can be evaluated to determine their impact and measure any improvement in student performance in this area. 2. In order to see the full value of our assessment management system (eLumen): a. more faculty need to enter student performance data b. a system should be developed to provide for ongoing training in eLumen for deans, department chairs, faculty, and adjunct faculty. 3. In order to document data-driven decision-making as part of the assessment process, college Deans are encouraged to develop college and program goals in response to faculty conclusions about needed improvements for student learning. General Education and University Outcomes General Education at Concordia University is defined as the required curriculum that exposes students to a variety of content and disciplines. University Outcomes are those academic, professional, and personal skills and values that are commensurate with a university degree, based on the faculty-adopted Framework for Learning. Two concerns might be raised regarding assessment of learning in these areas: 1. The current assessment process focuses primarily on the learning of University Outcomes within Concordia’s general education courses, often missing the achievements of transfer students (including those in cohort programs) and of third or fourth year students who are further along in their skill development. 2. There is no process for assessing learning of shared content across the general education course offerings, e.g., “History and Political Science,” or “Fine Arts.” Using the current assessment process, in July 2013 the General Education Committee reviewed assessment reports from academic departments that provide courses to meet general education requirements. Each department has identified two University Outcomes that general education courses in their area will address and measure during the semester. The reports indicate how well students in those courses are meeting those outcomes and what kinds of improvements are planned to increase the quality of student performance on those outcomes. The following is the summary by the General Education Committee: 2013 University Outcomes Assessment in General Education Courses Summary Based on Faculty Reports of Learning in Traditional General Education Courses Concordia University continues to seek to improve student learning through ongoing assessment initiatives and faculty development. This commitment to student learning also requires the university to report assessment findings to external (e.g., state and federal government, accreditation organizations, and parents) and internal constituents (e.g., students, oversight committees, academic departments, and Board of Regents). This report on University Outcomes assessment in general education courses is a portion of a larger Executive Summary of Assessment. The General Education Committee compiled the following summaries based on the annual reports submitted by academic departments teaching general education courses in the traditional curriculum. University Outcomes (See Appendix I) Results: How well are students achieving the outcome? Plans for Improvement: What might we do differently? Assessment Challenges: How can we improve our assessment process? Results: How well are students achieving the outcome? Plans for Improvement: What might we do differently? Assessment Challenges: How can we improve our Aesthetic Values Music: The results from the Music department show that half of the students are at beginning and the other half are spread across developing to exceeding. Scores for students in MUS 121 are higher than MUS 120. Theater and Dance: Assessments place the preponderance of students who take THR 101 at the “Developing” level. Within the “skill” oriented courses, instructors found gen ed students have never seriously studied aspects of the theatre art form. Consequently, they are required to perform many aesthetic tasks with which they are unfamiliar: making scenic drawings, rehearsing a monologue, preparing a dance, etc. Art department assessments – no report submitted Music: Avoid faculty changes in the middle of the term to prevent disruption in learning within courses. The rubrics could be reviewed to better evaluate student achievement. Help the less-prepared students perhaps by helping instructors with the curriculum. Theater and Dance: Since these are beginning level courses, it is appropriate that students are scoring predominantly at the “Developing” level. No further action anticipated at this point. Music: The rubrics are challenging to use to assess learning. This explains the scoring disparities. Art: Need assessment reports Civic Values Pol 131 American Government is the only course assessing this outcome. Only one class/section reported for this assessment. Subjectively, one instructor reported that students met the civic value outcome. Continue to use a new broad-based assignment in Political Science as well as plans to bring in more speakers. Gen. Ed. committee noted that it would helpful to use eLumen for results and include data from all course sections. Developing new assignments that are especially relevant to students. The committee recommends that assignments that assess the civic value be standard in all sections. assessment process? Results: How well are students achieving the outcome? Plans for Improvement: What might we do differently? Assessment Challenges: How can we improve our assessment process? Results: How well are students achieving the outcome? Plans for Improvement: What might we do differently? Assessment Challenges: How can we improve our assessment process? Results: How well are students achieving the outcome? Critical Thinking Multiple departments contributed to assessing this University Outcome. Data is missing from COM 309, HIS 212, CHE 110, ENV 120, ESC 140, PHS 111, PHS 221. The Theology department noted that scores were essentially the same as last year, but that these scores are lower compared to the other departments assessing this University Outcome. Adjuncts did report in Theology. In English, students have trouble interpreting versus summarizing in Intro to Lit, but are learning. This department noted big differences in fall versus spring, but perhaps this is due to how adjuncts enter the results in eLumen. Psych and Sociology noted that students are consistently in line with their beginning level. Math had scores consistent with first-year students. Physical science reported a range of 2 to 4 on the rubric. Theater and Dance assessed the majority of their THR 101 students as being “Accomplished”. The courses newly added to Theater and Dance Gen Ed offerings (Stagecraft, Acting I) allowed the department to assess this outcome with “process” oriented activities. The department found the teaching and assessment of this outcome to be a success. The three rubrics in the intermediate Theology courses will be a point of emphasis next year. The English Department plans to improve the “take away” from reading and writing about literature so it is clearer for students. Physical Science reported the use and design of assignments that can assess the majority of critical thinking outcomes. Math recognized the need to train adjuncts. Literature reported techniques to improve the teaching of critical thinking in the classroom. Theater and Dance will continue to teach and assess to this outcome – considered a success this academic year. Theology reported the need for more high-quality adjuncts. Requiring adjuncts to enter rubric scores for agreed-upon measures into eLumen continues to be a challenge but a recognized need. Mentoring adjuncts is difficult but important. Math and Literature also reported the need to work with adjuncts to clarify expectations. Global Values No department with a course within the Global Studies category submitted a report on the assessment of the Global Values outcome. No data. Instructors need to choose consistent activities and assignments that assess the Global Values outcomes and enter the scores into eLumen. No data. Since no one department has responsibility for global studies, instructors should take the lead to revisit the University Outcome and rubrics for Global Values and intentionally insert these into the syllabi and course activities. The Gen. Ed. committee may need to reassess which courses should be able to retain their status of teaching Global Values. Information Literacy (Missing assessment from HIS 212, BIO 130, HIS 121) Biology: Due to a lack of data it is difficult to generalize results. Kinesiology – Students are meeting and exceeding university outcomes. The strongest area is in preparing for research. The challenge in this area is in generating a search strategy and accessing resources. Writing - The scores in this achievement area are relatively low – though not surprising because the students only write one research paper for the class. The assessment meets the department’s expectation for beginning college students. Communication: The majority of the students accomplished gathering reliable data and internet sources at the average or above average level. Plans for Improvement: What might we do differently? Assessment Challenges: How can we improve our assessment process? Results: How well are students achieving the outcome? Plans for Improvement: What might we do differently? Assessment Challenges: How can we improve our assessment process? Results: How well are students achieving the outcome? Plans for Improvement: What might we do differently? Assessment Challenges: How can we improve our assessment process? Results: How well are students achieving the outcome? Plans for Improvement: What might we do differently? Writing: Spend more time teaching students to find, evaluate, integrate, and document sources. They also plan to meet more often in the library for class. Biology plans to assess a citation in more course sections to validate their subjective observations. Kinesiology: To improve, the department plans on utilizing the library staff to help students better understand the research process. Biology: Increase assessments across all sections with the addition of new faculty. Interpersonal Values Communication: Missing assessment from COM 103. This course is of only two that assess this University Outcome. Theater and Dance: THR 160 Intro to Dance was a new edition to Gen Ed and this outcome. While the department reported progress in student learning within this outcome, they noted a lack of consistency in their eLumen reporting. Communication - No data. One activity should be chosen by the instructors to assess these outcomes. The scores should be entered into eLumen. The General Education Committee encourages other department to teach and assess to the interpersonal University Outcome. Theater and Dance: The department plans to implement the outcome and assessment more specifically in eLumen scoring next year. No data. Acquiring data will assist course instructors, the Gen. Ed. committee and departments in their efforts to improve the teaching and learning process. Oral Communication (formal presentation) (Missing assessment from COM 103) Com 212: Areas of deficiencies seem to be in the specific delivery techniques whereas areas of strength are in the use of technology as visual aids. Social Science: Results show 79% of students fall in the “4” category. Kinesiology: All levels of the rubric are demonstrating students are in the accomplished or exemplary categories. The organization level of the rubric is the strongest, with style being the weakest. COM 212: Plan to give more attention to speech anxiety with pre and post assessments. Social Science: Department plans to emphasize the citation of references in formal presentations and being intentional with formal presentation skills. Faculty teaching introductory courses need to emphasize and assess formal presentation skills. Kinesiology: The online KHS classes will implement a voice over to help faculty better assess oral communication. They also plan to standardize the assignment rubrics across the various sections. COM: There is a need to increase assessment across all introductory courses. Physical Values Kinesiology: No eLumen data were developed due to technical problems. The faculty reflection is that students are understanding how fitness behaviors positively and negatively impact their overall health. Kinesiology developed the Physical Values University Outcome rubric in 2012. After entering the rubric into e Lumen, the department had trouble getting the rubric linked to the course. Assessment Challenges: How can we improve our assessment process? Results: How well are students achieving the outcome? Plans for Improvement: What might we do differently? Assessment Challenges: How can we improve our assessment process? Results: How well are students achieving the outcome? Plans for Improvement: What might we do differently? Assessment Challenges: How can we improve our assessment process? Results: How well are students achieving the outcome? Plans for Improvement: What might we do differently? With the rubrics written, the department is working on the problem of linking it to the course. Quantitative Reasoning (Missing assessments: MAT 125) Math: 83% of the students scored in the 2 to 3 range of the UO assessment. Physcial Science: Mostly 1’s, 2’s, and 3’s with the highest in the 2’s for interpretation of quantitative data, reads and analyzes quantitative data and translates verbal or written assertions into quantitative data. Math 135: Changes will be made to address challenging areas for students . Physical Science: Plan to ask students to provide models/label s to assess information. Include one higher level thinking question as a part of lab experiments. Math 135: The department will train new faculty in assessment procedures. Spiritual Values Theology instructors were successful in using the first part of the larger Spiritual Values rubric to assess student learning within their courses. However, as noted in a previous report, Theology struggles with other aspects with the spiritual values rubric. The phrase “total intellectual enterprise,” especially its use of the adjective “total” seems beyond the scope of the courses involved and is perhaps more appropriate for non-academic settings. In 2012-2013, Theology hoped to assess the “pertinence” outcome and seek a more limited scope for “the total intellectual enterprise.” The department reported that perhaps now on the other side of restructuring, they will have more time to take up this topic. None noted. Writing English: Students perform better in the spring than in the fall. The students performed somewhat better in the Intro to Literature class than in the College Writing course. Students do not automatically transfer learnings from College Writing to other courses. The new writing rubric is so general that it is hard to assess what aspects of writing students are doing well with and what aspects need more work. Theology: Overall students are writing at a comparable level to other general education courses. Biology: Assessment data for this outcome is limited. Music: Most students were meeting or exceeding expectations. The department noted completing and correctly citing references was a significant problem. English: Students perform better in the spring than in the fall. The students performed somewhat better in the Intro to Literature class than in the College Writing course. Students do not automatically transfer learnings from College Writing to other courses. The new writing rubric is so general that it is hard to assess what aspects of writing students are doing well with and what aspects need more work. Theology: Overall students are writing at a comparable level to other general education courses. Biology: Assessment data for this outcome is limited. Music: Most students were meeting or exceeding expectations. The department noted completing and correctly citing references was a significant problem. Assessment Challenges: How can we improve our assessment process? English: Students perform better in the spring than in the fall. The students performed somewhat better in the Intro to Literature class than in the College Writing course. Students do not automatically transfer learnings from College Writing to other courses. The new writing rubric is so general that it is hard to assess what aspects of writing students are doing well with and what aspects need more work. Theology: Overall students are writing at a comparable level to other general education courses. Biology: Assessment data for this outcome is limited. Music: Most students were meeting or exceeding expectations. The department noted completing and correctly citing references was a significant problem. Summary Observations by Members of the General Education Committee The General Education Committee notes the lack of any reported assessment of the Global Value within this assessment initiative. Unlike other University Outcome areas, the Global Value area does not have, within the university’s existing academic structure, one department that provides oversight for the teaching and assessing of the outcome within general education courses. Nevertheless, the General Education Committee will work to help improve the teaching and assessing of Global Values within general education courses – especially within courses in the Global Studies area. The committee believes that the Global Values outcome is a critical and potentially distinctive component of a Concordia University education. Common challenges across departments in the teaching and assessing of University-wide Outcomes are: Training and support of adjuncts as they teach and assess learning, Some departments are not completing assessments, in some cases due to having a number of untrained adjuncts or undeveloped/nonspecific rubrics, or by not having a designated assignment to use for the assessment; Appropriately citing sources seems to be a common issue for students and needs more attention Departments with established, standardized assignments and rubrics seem to have more success with assessing students and tend to report higher scores. It seems an intentional approach would help in some areas of teaching and assessment. The departments that have been most successful in effectively integrating the teaching and assessing of University Outcomes into general education courses are those that: Collaboratively collect, analyze, and discuss data on student learning together as a department. These faculty members then develop teaching and assessing strategies together to improve student learning across their courses and sections. Meet regularly to discuss how to improve student learning. Learning Outcomes in the Academic Major Summary of “Use of Results” for Academic Majors and Graduate Programs by College College of Business and Organizational Leadership Undergraduate Traditional Accounting (BB.A.) Finance (BB.A.) Marketing (BB.A.) Business Management (B.A.BM) We need to research and consider measures for increasing personal responsibility in students beginning in early classes. Additional assignments and discussions in the area of global awareness need to be implemented across the curriculum. The newly developed curriculum map shows an increase in deliverables related to global concepts. Increased opportunities for internships and other applied learning experiences are needed. Ongoing emphasis on and reinforcement of writing skills needs should continue. The newly developed curriculum map has added reinforcement of several outcomes, including global awareness, oral presentation skills, and critical thinking. Graduate Management& Leadership Department M.A. in Leadership & Management (MALM) M.A. in Human Resource Management (HRM) Place more emphasis on students completing work on time early in the program. Moreover, work with the academic advisor to coach new students who are struggling with their work. Better communicate expectations to adjunct faculty Share assessment rubrics with adjunct faculty and collect that data throughout the program. Share best practices with adjunct faculty Monitor performance better and provide specific feedback to adjunct instructors Improve collaboration between the Research instructor and the Action Research instructor to help students enter the final action research class with more complete deliverable. Ensure that assignments drive towards high levels of learning on Bloom’s Taxonomy. A complete audit of assignments across the program is needed. Evaluate specific course assignments to ensure they are helping students apply their learning and think critically and ethically about their studies. Core rubrics for key assignments are needed. It would be beneficial to have a faculty meeting specific to each program and update, equip, and empower them. There are a few additional topics that we might introduce in the MALM, and we are beginning some textbook changes to upgrade content to keep it relevant. MBA Department Master of Business Administration (MBA) More intensive training with WebEx and the ISS to assist methodologies in this new vehicle delivery (full and adjunct instructors). Set graduate student expectations in accordance with Principles of Graduate Study. Advocate for improvement of program quality initiatives. More feedback on papers and ensure it is timely feedback. Greater use of rich media tools for current and relevant topics for graduate level synthesis. Establishing the mentor program within the MAP. Enhancing Student learning over the next year we are concerned about enhancing student development in two main areas that the data suggests we need to improve, research and critical thinking. We need to acknowledge, understand and support as many as a third of our students who have not had education or professional experience in areas of Global Economics, Finance, and data analysis and/or who need extra help with writing. Undergraduate Cohort Management & Leadership Department B.A. in Organizational Management & Leadership (OML) Ongoing Adjunct training should continue, along with emphasis of Leadership-Mgmt departmental expectations. Continuing to focus adjuncts on their specific areas of expertise will also be helpful. The re-alignment of courses during transition was helpful, but, needs to be refined and evaluated to ensure all has been completely integrated for consistency in OML students’ learning-environment. Need to continue merging topic-areas, and updating to be better integrated with current Business needs. Consider adding in more group-work on real-Business case studies, in some select places in the learning program. We will continue to emphasize the key program elements of practical application, ethical decision making, and effective problem solving, along with writing and effective communication skills. A more interactive ‘presentation process’ needs to be employed for on-line Synthesis projects during completion phases, OML 440 course. All learning outcomes have been re-assessed, and updated. This needs to happen as an ongoing component of staying current and relevant for the students. Several of the universal outcomes (ex: writing skills, critical and systems thinking, life-long learning, and others) could be more consistently applied across multiple courses. Already being done, but needs to continue. Marketing Department B.A. in Marketing Management (MKM) B.A. in Food Retail Marketing (FRM) Advocate for improvement of program quality initiatives. Share best practices between full time and adjunct faculty (within CBOL / cross department) Providing better communication of expectations and assessment tools to adjunct faculty Share specific feedback and discuss areas of greatest opportunity (favorable and unfavorable) Offer mentoring/coaching for full time and adjunct faculty Two MKM courses will be revised based on SmartEval and adjunct faculty comments – Applied Account & Finance and the continuous updating of Interactive and Mobile Marketing. Continue to build more technology into the online classroom. Introduce internships as a way to address limited business experience on the part of some students. Criminal Justice Department B.A. in Criminal Justice (CJ) M.A. in Criminal Justice Leadership (MACJ) The University Outcomes in Effective Writing and Information Literacy were integrated into the curriculum map for CJ programs. GPS Life Plan learning tool will be included to help motivate students to become more active participants in their learning. College of Arts and Sciences Art and Graphic Design Department B.A. – Art The Art department continues to develop their assessment processes. Assessment is primarily completed at the conclusion of a student’s studies during the capstone course. Rubrics continue to be developed and strategically assigned to courses toward the goal of achieving effective evaluation of student learning. The department was encouraged to consider spreading assessment out over courses during a student’s development (and then re-evaluate in the capstone course) in order to evaluate student learning developmentally. In addition, locating the most effective course for evaluating studio work continues to be a goal of the department. Communication Studies Department B.A. - Communication Studies Student learning outcomes (SLOs) have been reviewed and streamlined throughout the program curriculum. Strengths of the program continue to be the linking theory with practice (internships, service learning and integrating activities with campus life events). Evaluation of student learning indicates that students understand how communication develops in relationships and that they can actively apply concepts to their experiences in the “real world”. A new course on Blackboard, required for current student interns, (online Discussion Board) allows students to benefit from one another’s intern experiences and provides feedback to faculty supervisors. The department still plans to develop an eLumen professionalism rubric for internships. The introduction of, and assessment of activities in the, COM 444 Research Methods course continues to demonstrate that student understanding of research methods in relation to scholarship has increased. Students continue to receive strong evaluations from internship supervisors. The department noted that developing student’s academic writing is a skill/need that continues to be addressed. English and Modern Languages Department B.A. - English Although writing is a major component of an English major the department was encouraged to explore assessment of some of your learning outcomes using other assessment activities (quizzes, oral presentations). Presentations also being a more “public” form of sharing knowledge might address the compliance and quality issues which continues to be a concern. Students in Writing in the Workplace performed at either an exemplary or accomplished level, and creative writing continues to be a particular strength. Adjustments to the assessment process to aide students developmentally in courses before students arrive at their capstone course will be considered. History Department B.A. - History The history department is doing an outstanding job of raising expectations and finding ways to help students reach those goals. Ongoing improvements to the curriculum, pedagogy, and process (e.g., adjunct training) are reported, however, improvements in documentation and reporting process were recommended, including a simplified eLumen strategy that would make gathering actual results easier. An updated curriculum map is also needed. It’s clear that the department that analyzes material from students and that the department makes specific improvements and adjustments, noting how changes have improved student performance. The department clearly is focused on constant quality improvement. Providing more specific data was encouraged. The department stated that a “global and civic focus,” is one of their “core concept areas.” It was recommended that it should be included as an SLO. Also, a “strong commitment to the use of technology” that has “been able to be incorporated it into more and more classes” should be added it to the “research” SLO. The report indicated that “Class discussions” were an evaluated activity. The department should consider developing a tool (rubric) to measure demonstrated learning for each student expressed during class discussions . “Data” or “results” provided are fairly vague impressions of student achievement. For the purposes of documentation, the department is encouraged to include some actual measures that will more clearly document the effectiveness of significant program and course improvements. Music Department B.A. – Music B.A. – Music Education B.A. – Church Music The Curriculum Map was reviewed and adjustments made, cross checking for accuracy. Evaluation of assessment activities revealed a number of administrative/clerical inconsistencies with assessment set up (in Elumen) and procedure across the faculty (primarily with adjuncts). Writing SLO and rubrics need to be streamlined and correctly linked to appropriate courses. The department noted that achieving quality collegiate writing continues to be a challenge for students. Music History reflects that we’ve had four different instructors in three years resulting in inconsistent student learning/assessment results. SLOs for each course are listed in every syllabus. Rubrics are shared with students in some course syllabi, but not others. Ultimately, assessment of student learning should be shared with individual students so they can respond to the assessment status of their learning. Music composition (lesson instruction) has resulted in outstanding growth and is a new strength for the program. Theatre & Dance Department B.A. - Theatre The department has developed a very clear set of learning outcomes covering the variety of aspects needed for the program (historical knowledge, analysis, technical production and performance). Multiple assessment activities are used to assess learning outcomes across the program (exams, class projects, presentations, papers, script analyses, oral and written critiques, scene work, portfolios, capstone projects, senior exit interviews, end-of-the-term showcases, theatre production work), and activities are intentionally and systematically coordinated across the program. The department reports that students continue to have high assessment of theatre history and aesthetics, working well in collaborations (particularly in student led productions) and having a greater understanding of play scripts (an improvement since the previous year). The department is able to develop partnerships with area professional theater companies, enhancing student learning through professional interaction and will be expanding their internship offerings. Theology and Ministry Department B.A. Theology B.A. Christian Ministry The department is in the process of reducing (streamlining) the number of assessment objectives. Assessment of student learning for 2012-13 showed that, for the second year in a row, in the majority of learning outcomes a larger percentage of students met the targets set by the DTM than has been the case historically. Students continue to show progress in achievement levels as they move through the curriculum sequence. In nine of ten areas for which data was available, sum percentages in identified areas exceeded the 7-year average. College of Education and Science Undergraduate Kinesiology and Health Sciences Department B.A./B.S. Exercise Science B.A. Exercise Science w/ Athletic Training emphasis B.A. Sports Management B.A. Sports Psychology B.A. Community Health B.A./B.S. Kinesiology The department continues to enhance teaching strategies to support student engagement. One instructor tried flipping the classroom last year and this might be tried in another class within the major this year. Many Blackboard grading rubrics have been standardized to ensure quality and consistent feedback. Ongoing training for adjunct faculty in pedagogy, Blackboard, and WebEx will continue. Curriculum requirements for each major have been revised and are now more unique to the major and an updated curriculum map of outcomes has been created. These new course structures will go into place this academic year. Assessment activities will be reviewed over the next year to coincide with the new map. Additional program goals include the following: 1) Library resources are intentionally highlighted in classes and the faculty plan to work on getting students to these resources. 2) Department wide peer reviewed rubrics for group work/assignments will be developed to counter the challenge of social loafing. 3) Review the University Writing Outcome or develop a department wide writing rubric. Math Department B.A. – Math B.A. in Information Technology Management (ITM) Math: The department feels good about changes that have been made to offer greater support to students in developing communication and technology skill sets. In the coming year their focus will be on embedding problem solving into coursework. Assessment rubrics will be adjusted/created to coincide with these additions. With the addition of the engineering program other adjustments may need to be made. The department will work to get the new faculty member up to speed on the assessment plan and will also tap into his knowledge base for ideas and insights. The department feels good about their current assessment plan which focuses on individual student assessments. ITM: In addition to establishing common course content assessment techniques and clearer rubrics with ITM faculty, the department hopes to be more proactive in providing formative feedback to students. This will help content retention and transference. It would be ideal if student strengths and opportunities for growth were shared in a common database between instructors. They also want to raise the standard for Operationalizing project implementation in 2013. Perhaps this will be more clearly articulated with the creation of the first offering of an MBA with an emphasis in IT Management. The intentional use of the common ARP rubric should be put into eLumen so that there is universal awareness and assessment among all instructors, not just ARP course-related instructors. In 2013, the department hopes to implement a new Virtual Teamwork rubric and utilize the standard Applied Research Project rubric in eLumen instead of the relatively unknown IT to Business rubric currently in eLumen. The same is true of the 12 competencies of Geek leadership assessment. It has been individually gathered, but not been entered into eLumen. Social and Behavioral Sciences Department B.A. - Criminal Justice Faculty will continue to work on teaching strategies that enhance student engagement and learning. Connections to professional organizations, utilizing the faculty development grants, and the faculty retreats should support this development. Additional texts were added to courses to support the application piece and these proved to be helpful so will be part of class content in the coming year. New internship sites were added last year and the department feels these were good additions for options for students and that the overall internship experience is key for application. The department currently assesses four main outcomes and they feel good about these, the assessment activities linked to them, and the consistency of scoring among department members. No changes will be made in regard to assessment activities for the coming year. B.A. – Psychology The department has identified the following working goals: 1) Be intentional and explicit in demonstrating critical thinking/oral communication skills by practicing with examples and ensuring that all faculty teaching introductory courses are aware of the need to emphasize and assess critical thinking, 2) Generate uniform critical thinking/oral communication exercises for all sections of introductory courses and ensure that all faculty teaching introductory courses are aware of the requirement to emphasize and assess critical thinking and oral communication skills, 3) Be intentional and explicit in the learning outcomes that are being emphasized and assessed in the upper level courses and share the learning outcomes and rubrics with the students, 4) Ensure that all faculty teaching upper level psychology courses are aware of the need to emphasize and assess the psychology major learning outcomes, 5) The department will emphasize more of the University Outcomes such as oral communication, critical thinking, and information literacy outcomes in the major, and 6) By 2014 students will be required to complete coursework in each of the key subfields of the discipline and the planning form will reflect this new requirement. They have a number of critical goals moving forward. B.A. – Sociology The department has decided to require a sociology internship for all sociology majors beginning Fall of 2013 to support students with the application piece amidst a field experience. They are satisfied with the current curriculum map and assessment structures and will modify as data becomes available. The department also mentioned a need for a fulltime faculty person to support the students within this major. B.A. - Family Life Education The department is satisfied with the current content of the major as well as the outcomes and assessment activities that coincide with them. No upcoming changes were reported. Biology Department B.A./B.S. Biology No report was submitted. Teacher Education-Initial Licensure Department Licensure (ECE, K-6, K-12, ESL, Special Ed) Overall the department has several working goals which include: 1) more emphasis on writing and a shared system to assess this, 2) continue to enhance knowledge and application in regard to diverse learners including ELL strategies such as SIOP, 3) remapping the entire program in light of the new INTASC standards, 4) devise a way to enter student teaching data into eLumen as it includes a great deal of summative candidate assessment information, 5) continue to work on ways to intentionally assess student dispositions across the program, and 6) embed activities that allow candidates to practice instructional design and pedagogy. All of this will be critical to the upcoming CAEP accreditation process. Some work is in progress in regard to embedding UBD, technology, and activities within the TPA framework into courses, and the new HR requirements and forms will be used beginning fall of 2013. Candidates have been able to take part in MTLE basic skills test prep workshops in connection to the TC2 initiative and feedback has been positive. In addition, the department continues to work on providing clear expectations for candidates in regard to program entrance interviews, academic requirements, and pre-clinical interviews. Child and Family Education Department B.A. in FLE (Cohort) Encourage faculty to utilize the empirical research in connecting theory and practice, particularly on the discussion boards and include a greater amount of readings that reflect current scholarship in the research literature. They have launched a project named, the FLE Exemplary Course Development and plan to use its rubric as a faculty tool for course improvement. B.A. in ECE A goal for this year is to list significant course terms (academic language) and content for each course. This will be shared with instructors to ensure the intentional connection of content from one course to the next with all faculty members using the same content language. New Grading rubrics for the specific course assignments mapped to the program objectives need to be written. The goal is to include the specific objective in the assignment criteria and rubric to ensure a clearer connection to the objective for students. In addition, a new DB grading rubric is in progress to ensure clearer expectations and academic discussions. Finding a way to access course evaluations would be extremely helpful for overall program development. Graduate Teacher Education-Advanced Programs M.A. Programs—MA in DI, MA in CIR w/Reading, MA in ECE, MA in EDL, MA in Ed Tech, MA in FLE, MA in Special Ed MA in DI: Faculty development for the adjunct instructors continues to be strengthened in the program, as many are new to Blackboard and eFolio technology. Focus on education in technology, the APA writing style requirements, and the use of Safe Assign to check and offer feedback to the student guiding integrity on research assignments will continue. MA in CIR w/Reading: The CIR coordinator has facilitated more collaboration and sharing of professional resources among adjunct instructors, through the use of WebEx meetings, and this collaboration will continue to be focused on in the upcoming 2013-14 academic year. Starting with the new cohorts from March 2012, the core courses have been slightly rearranged to increase student learning in the area of research methods, including a strong introduction to the APA writing style. The ED 521: Research Methods course will be the first course for CIR students, when they begin the five core course sequence. For the cohorts starting in the fall of 2012, the CIR program ‘grand tour question, and program outcomes will be modified. Outcome number eight will be removed, and the Grand Tour question will be: “Grand Tour Question: “In light of what we know about how children learn and the best practices in literacy instruction, how shall we teach literacy in educational settings today?” MA in ECE: The department thinks the most significant strategy will be the switch to WebEX from chat and have been told that the weekly live “meeting” will become more focused and intentional. The main goal this year is to list significant course terms (academic language) and content for each course, and to share this information with graduate faculty to ensure the intentional connection of content from one course to the next with all faculty members using the same content language. New Grading rubrics for the specific course assignments mapped to the program objectives need to be written. The goal is to include the specific objective in the assignment criteria and rubric to ensure a clearer connection to the objective. Finally, they will be adding the exit survey used by all the other Graduate Teacher Education programs as part of our assessment data. MA in EDL: Training for faculty will continue to be conducted as courses are updated and syllabi are updated. Training for faculty will continue with Blackboard and WebEx so the protocols will be consistent in all online courses. Course assignments in the updated courses will be redesigned to support the program outcomes. Assignments and rubrics will include listening skills (as well as written and oral skills). Coursework will be reviewed for alignment with Minnesota administrator standards as well as standards in North Dakota. A map of the outcomes throughout the courses will be identified and mapped. A review of course outcomes would be appropriate to ensure a solid foundation for students in educational leadership when the MA has been completed. Each course will be reviewed for rubrics. Rubrics will be developed for each assignment. MA in Ed Tech: Curriculum sharing, Instructor collaboration, and increased classroom technology experience will all be added to improve student achievement. Clearer explanations, templates and rubrics for written work with the educational technology students will be added to help increase satisfactory achievement in the program. The course sequence change, to allow for earlier inclusion of technology courses, and curriculum sharing will be changed to improve learning. MA in FLE: Encourage faculty to utilize the empirical research in connecting theory and practice, particularly on the discussion boards. Continued use of the FLE Exemplary Course Development. The FLE Exemplary Course Development is built on a rubric designed for advancing student success through course and curriculum development. Include a greater amount of readings that reflect current scholarship in the research literature. Continue to work on intentional use of Blackboard’s Exemplary Course Rubric as a faculty tool for course improvement. MA in Special Ed: In addition to training goals for all instructors, the department will implement the changes to learning outcomes in special education made early this school year and ensure they are embedded throughout the development of the program and course syllabi. Rubrics have been thoughtfully designed and implemented for each assignment in each course. Clear and concise rubrics aid in consistency among teaching staff, understanding among students, and greater accountability for our program in general. Summary Comments Some reports included more of a summary of events for the year highlighting a great deal of program improvement which was great to see, however these actions were not necessarily based on assessment information. Other reports discuss assessment activities that are not always specifically aligned with the learning outcomes of the program. Still others do not have identified assessment activities correlating to learning outcomes. This demonstrates that continued work is needed to unpack the process of assessment so that there is clear alignment between identified learning outcomes and assessment activities for programs, and to ensure that program changes are reflective in some way of overall program assessment. Appendix I The University Outcomes: Concordia Graduates will be able to. . . Critical Thinking -- Identify the problem/issue; articulate solutions/ perspectives; identify and assess key assumptions; identify and assess data and evidence; identify and consider of the influence of context; evaluate of the ethical dimensions and apply ethical principles; and synthesize conclusions, implications, and consequences. Information Literacy -- Prepare for research; generate search strategy and access resources; evaluate and process information; transfer and apply learning; incorporate information technology; practice legal and ethical use of information. Oral Communication (formal presentation and/or small group) -- Organize the presentation, develop the topic, language style, delivery, incorporating references, and center the presentation on the audience. Regarding group discussion: tailor the content, language, delivery and references to effectively communicate in a group-centered manner. Quantitative Reasoning -- Translate verbal or written assertions into quantitative data; read, analyze, and interpret quantitative data, such as graphs, charts, or statistics; use models; and translate quantitative evidence and reasoning back to verbal or written assertions and support conclusions. Writing -- Relate content to an audience, to develop and organize material, to construct fluent sentences using standard grammar, mechanics and references. Aesthetic Values -- Understand the value of artistic expression in reflecting and shaping the life of human communities; relate artistic expression to philosophical, religious, and social thought; and recognize the importance of major forms of artistic communication. Civic Values -- Understand the necessity for participation in the civic infrastructure of the United States; recognize the similarities and differences between American civic policies, institutions, and beliefs and those of other communities, nations, cultures, and peoples throughout the world; and recognize the civic responsibility of the citizen and all levels of government to ensure a democratic and just vision for society. Global Values -- Understand the relationships between the members of the global community; philosophical, religious, and social thought from global cultural contexts; the importance of global cultural expression; and the difficulties caused by ethnocentrism. Interpersonal Values -- Display effective interpersonal skills during interactions with students, faculty or staff, understand the value of effective interpersonal skills, accept and deliver constructive criticism, and effectively resolve conflicts. Physical Values -- Demonstrate strategies that promote lifelong health; implement and evaluate a personal physical fitness plan; implement a health-conscious lifestyle, including intellectual and emotional wellness; balance health of physical self and service to God and humanity. Spiritual Values – Demonstrate an understanding of how the essentials of the Christian faith inform one's life individually and in community, and a sympathetic appreciation of the pertinence of the Christian faith to the total intellectual enterprise.