University of Hawai‘i at Mānoa Assessment Office Hawai‘i Hall 107 manoa.hawaii.edu/assessment 2015 Annual Assessment Report Questions (Undergraduate Degree Programs) Updated 8/20/2015 1. Institutional Learning Objectives (ILOs) and Program Student Learning Outcomes (SLOs) Edit SLOs [click the link to edit the program SLOs before completing this question] Directions: A. Please click on each Institutional Learning Objective (ILO) below. (Your program student learning outcomes (SLOs) will appear.) B. Check the box to indicate that the program SLO is directly related to the ILO. C. Leave the box unchecked if the program SLO is not directly related to the ILO. Need help? Sign up for an ILO-Program SLO mapping workshop or call us (Monica, 956-6669; Yao, 9564283). Workshop registration This question is part of implementing Mānoa’s Institutional Learning Objectives for Undergraduates that was approved by the Faculty Senate in 2012 [+] Expand all 1a. General education [your program SLOs will appear under the ILO here when you click the ILO] 1b. Specialized study in an academic field 1c. Understand Hawaiian culture and history 2a. Think critically and creatively 2b. Conduct research 2c. Communicate and report 3a. Continuous learning and personal growth 3b. Respect for people and cultures, in particular Hawaiian culture 3c. Stewardship of the natural environment 3d. Civic participation 2. Your program’s SLOs are published as follows. Please update as needed. 3. Please review, add, replace, or delete the existing curriculum map. 4. For your program, the percentage of courses that have course SLOs explicitly stated on the syllabus, a website, or other publicly available document is as follows. Please update as needed. (check one) __0% __1-50% __51-80% __81-99% __100% Page 1 of 4 Updated 8/20/2015 University of Hawai‘i at Mānoa Assessment Office Hawai‘i Hall 107 manoa.hawaii.edu/assessment 5. Did your program engage in any program assessment activities between June 1, 2014 and September 30, 2015? __Yes __No (skip to question 16) 6. What best describes the program-level learning assessment activities that took place for the period June 1, 2014 to September 30, 2015? (Check all that apply.) __Create/modify/discuss program learning assessment procedures (e.g., SLOs, curriculum map, mechanism to collect student work, rubric, survey) __Collect/evaluate student work/performance to determine SLO achievement __Collect/analyze student self-reports of SLO achievement via surveys, interviews, or focus groups __Use assessment results to make programmatic decisions (e.g., change course content or pedagogy, design new course, hiring) __Investigate curriculum coherence. This includes investigating how well courses address the SLOs, course sequencing and adequacy, the effect of pre-requisites on learning achievement.de the university __Investigate other pressing issue related to student learning achievement for the program (explain in question 7) __Other: ________________________ 7. Briefly explain the assessment activities that took place in the last 18 months. 8. What types of evidence did the program use as part of the assessment activities checked in question 6? (Check all that apply.) Direct evidence of student learning (student work products) __Artistic exhibition/performance __Assignment/exam/paper completed as part of regular coursework and used for program-level assessment __Capstone work product (e.g., written project or non-thesis paper) __Exam created by an external organization (e.g., professional association for licensure) __Exit exam created by the program __IRB approval of research __Oral performance (oral defense, oral presentation, conference presentation) __Portfolio of student work __Publication or grant proposal __Qualifying exam or comprehensive exam for program-level assessment in addition to individual student evaluation (graduate level only) __Supervisor or employer evaluation of student performance outside the classroom (internship, clinical, practicum) __Thesis or dissertation used for program-level assessment in addition to individual student evaluation __Other: ________________________ Page 2 of 4 Updated 8/20/2015 University of Hawai‘i at Mānoa Assessment Office Hawai‘i Hall 107 manoa.hawaii.edu/assessment Indirect evidence of student learning __Alumni survey that contains self-reports of SLO achievement __Employer meetings/discussions/survey/interview of student SLO achievement __Interviews or focus groups that contain self-reports of SLO achievement __Student reflective writing assignment (essay, journal entry, self-assessment) on their SLO achievement. __Student surveys that contain self-reports of SLO achievement __Other: ________________________ Program evidence related to learning and assessment (more applicable when the program focused on the use of results or assessment procedure/tools in this reporting period instead of data collection) __Assessment-related such as assessment plan, SLOs, curriculum map, etc. __Program or course materials (syllabi, assignments, requirements, etc.) __Other: ________________________ 9. State the number of students (or persons) who submitted evidence that was evaluated. If applicable, please include the sampling technique used. 10. Who interpreted or analyzed the evidence that was collected? (Check all that apply.) __Course instructor(s) __Faculty committee __Ad hoc faculty group __Department chairperson __Persons or organization outside the university __Faculty advisor __Advisors (in student support services) __Students (graduate or undergraduate) __Dean/Director __Other: ________________________ 11. How did they evaluate, analyze, or interpret the evidence? (Check all that apply.) __Used a rubric or scoring guide __Scored exams/tests/quizzes __Used professional judgment (no rubric or scoring guide used) __Compiled survey results __Used qualitative methods on interview, focus group, open-ended response data __External organization/person analyzed data (e.g., external organization administered and scored the nursing licensing exam) __Other: ___________________________ Page 3 of 4 Updated 8/20/2015 University of Hawai‘i at Mānoa Assessment Office Hawai‘i Hall 107 manoa.hawaii.edu/assessment 12. Summarize the results of the assessment activities checked in question 6. For example, report the percent of students who achieved each SLO. 13. What best describes how the program used the results? (Check all that apply.) __Assessment procedure changes (SLOs, curriculum map, rubrics, evidence collected, sampling, communications with faculty, etc.) __Course changes (course content, pedagogy, courses offered, new course, pre-requisites, requirements) __Personnel or resource allocation changes __Program policy changes (e.g., admissions requirements, student probation policies, common course evaluation form) __Students' out-of-course experience changes (advising, co-curricular experiences, program website, program handbook, brown-bag lunches, workshops) __Celebration of student success! __Results indicated no action needed because students met expectations __Use is pending (typical reasons: insufficient number of students in population, evidence not evaluated or interpreted yet, faculty discussions continue) __Other: 14. Please briefly describe how the program used the results. 15. Beyond the results, were there additional conclusions or discoveries? This can include insights about assessment procedures, teaching and learning, and great achievements regarding program assessment in this reporting period. 16. If the program did not engage in assessment activities, please explain. View completed reports on the Assessment Office website: https://manoa.hawaii.edu/assessment/update2/view.php Exemplary Practices in Annual Reports Civil Engineering MS 2014 Economics PhD 2014 Ethnic Studies BA 2014 Hawaiian BA 2014 Social Work MSW 2014 Page 4 of 4 Updated 8/20/2015