Program Planning and Assessment (PPA) for Academic Programs Comprehensive Review, Annual Review & Action Plan Spring 2014 The purpose of Program Planning and Assessment at Hartnell College is to obtain an honest and authentic view of a program and to assess its strengths, opportunities, needs, and connection to the mission and goals of the college. The process is based on the premise that each academic program reviews assessment data and uses these data to plan for improvement. The results of these annual cycles provide data for a periodic (every five years) comprehensive review that shows evidence of improvement and outlines long-range goals. The Program Planning and Assessment process will improve and increase the flow of information about student learning, student success and student behavior at Hartnell College. The result of the process will also improve institutional effectiveness. Program/ Discipline Political Science Date Completed (must be in final form by 3/31/14)* 3/31/14 Date Submitted to Dean 3/31/14 *Please note that you should work with your colleagues and dean to ensure that this report is completed, revised as needed, in its final form and submitted no later than the end of March. List of Contributors, including Title/Position Lawrence J Adams III, Political Science Instructor (tenured) This PPA report is organized in 3 sections and 11 subsections as follows: I. II. III. Comprehensive Review – a. Overall Program Effectiveness, b. Instructional Staffing, c. CTE Programs – Labor Market & Achievement, and d. Program Goals. Annual Review – a. Course Data & Trends, b. Teaching Modality, c. Curriculum, d. Outcomes, and e. Previously Scheduled Activities. Annual Action Plan – a. New Activities and b. Resource Requests. INSTRUCTIONS For programs/disciplines scheduled for comprehensive review in spring 2014, please complete Sections I, II, and III. For programs/disciplines scheduled for annual review, please complete Sections II and III. I. COMPREHENSIVE REVIEW Please complete this section for programs/disciplines scheduled for comprehensive review in spring 2014. Go to Section II for programs/disciplines scheduled for annual review in spring 2014. A. OVERALL PROGRAM EFFECTIVENESS 1. Describe your program in terms of its overall effectiveness over the past several years. Please consider the questions below in describing your program/discipline/area. • • • • • • • • • • How are students/employees served by the program? What are the unique aspects of the program? How does the program relate to the needs of the community? How does the program interface/collaborate with other programs on campus?) What is working well in the program/discipline? If there is a sequence of courses in your program, what process or framework is used to ensure alignment? How is consistency maintained between/among multiple sections of a single course? Has the program explored alternative scheduling approaches? Do prerequisites, co-requisites and strongly recommended skills continue to meet program needs? Are there special considerations regarding capabilities of incoming students? What professional activities have faculty recently (last three years) participated in? [Begin response here] 2|Page B. INSTRUCTIONAL STAFFING 1. In the table below enter the number of sections offered and the number of full time and adjunct faculty in your program/discipline by term over the past several years. Term No. of Active Sections Full-time Faculty Adjunct Faculty 2. What staffing factors/challenges have influenced the effectiveness of the program? [Begin response here] 3|Page C. CTE PROGRAMS – LABOR MARKET & ACHIEVEMENT Please complete this section if the program is Career Technical Education (CTE). Go to subsection D if the program is not CTE. 1. Describe the demonstrated effectiveness on the program over the past several years with levels and trends of achievement data, including degree/certificate completions (awards) and employment statistics. [Begin response here] 2. Describe the number of, activities of, and recommendations resulting from advisory committee meetings that have occurred over the past two years. What information and/or data were presented that required or currently require changes to be made to your program? (Please attach copies of meeting minutes over the past two years and a list of committee members and their respective industries/areas.) [Begin response here] 3. Does labor market data and/or the need for additional education indicate that changes should be made to your program? Does the program (continue to) meet a labor market demand and/or fulfill an important step toward higher/additional education? [Begin response here] 4|Page D. PROGRAM GOALS 1. List and describe program/disciplinary goals for the next comprehensive review cycle—Fall 2014 through Fall 2018. Be sure to highlight innovative, unique, or other especially noteworthy aspects. A new mission and vision is currently before the board for approval in February. In considering your program’s future goals, please review the proposed new mission and vision statements. VISION STATEMENT Hartnell College will be nationally recognized for the success of our students by developing leaders who will contribute to the social, cultural, and economic vitality of our region and the global community. MISSION STATEMENT Focusing on the needs of the Salinas Valley, Hartnell College provides educational opportunities for students to reach academic goals in an environment committed to student learning, achievement and success. [List and describe program goals here] 1) 2) 3) 4) 5) 5|Page II. ANNUAL REVIEW This section must be completed for ALL academic programs, including those scheduled for a comprehensive review in spring 2014. A. COURSE DATA & TRENDS 1. Please evaluate the 3-year trend of enrollment and success of courses in your program/discipline. Identify the courses you are choosing to examine this current year in the list below. You do NOT need to evaluate trends for each course every year. Course Number POL-1 POL-2 POL-3 Course Name American Political Institutions Contemporary Governments Abroad Introduction to International Relations Does the course have any DE (online or hybrid) sections? Yes No No Please use the data that have been provided. Analyze trends that you observe with respect to the data for the identified courses and answer the following questions. ENROLLMENT 2. Review the enrollment data. Describe and analyze any patterns or anomalies that you notice. What do you make of these patterns or anomalies? What actions should be taken to ensure continuous improvement? POL-1: The discernible pattern regarding enrollments in this course is the consistently larger number of students that enroll in the spring semester than the fall semester. No anomaly is present since the pattern of enrollment is persistent commencing in academic year 2010-2011 through academic year 2012-2013. No action is necessary to ensure continuous improvement. POL-2: The enrollment pattern in this course is a consistent range of 53-54 students, obviously no anomaly is present and there is no need for action to ensure continuous improvement. POL-3: The enrollment pattern in this course appears somewhat consistent with two semesters with an enrollment of 50 students and a third with 43. Additional enrollment data over a longer period of time is required to determine if an anomaly is present, furthermore there is no need for action to ensure continuous improvement. SUCCESS 3. Review the success data. Describe and analyze any patterns or anomalies that you notice. What do you make of these patterns or anomalies? What actions should be taken to ensure continuous improvement? 6|Page POL-1: The success rate in POL-1 is a two-tiered pattern based on the fall and spring semesters. The fall semester has greater variance than the spring semesters: fall 2010 = 67% spring 2011 = 59% fall 2011 = 57% spring 2012 = 65% fall 2012 = 72% spring 2013 = 63% My first two questions after analyzing the data is centered on individual instructors assigned to face to face classes and distance education classes; was there a change in instructors or assignment to a different teaching modality? Is there a higher rate of success in day classes, night classes, and classes held at the King City center? In order to determine the answers to these questions additional data is required. Without the data required to answer the two questions no current action is being considered to ensure continuous improvement. POL-2: Based on two semesters of data the success rate in POL-2 is a consistent range of 8085%, no anomaly exists, no action is being considered to ensure continuous improvement. POL-3: Based on three semesters of data the success rate in POL-3 is 84%, 81%, and 94%. No anomaly exists and no action is being considered to ensure continuous improvement. DEGREES AND CERTIFICATES 4. Describe the demonstrated effectiveness of the program over the past several years with levels and trends of achievement data, such as degree and certificate completions/awards. The data provided by the Chancellor’s Office leaves out the discipline of Political Science both in the area of the Liberal Arts degree with an emphasis in Political Science and the AA-T degree in Political Science. Over the past three academic years I have observed students graduating from Hartnell College earning these degrees; furthermore many have transferred to four-year institutions with an AA degree in Political Science. 7|Page B. TEACHING MODALITY 1. Enter the number of Distance Education Courses, both fully online and hybrid sections, along with the number of full-time and adjunct faculty. Term Fall 2010 Spring 2011 Fall 2011 Spring 2012 Fall 2012 Spring 2013 No. of DE/ Online Sections 1 2 2 2 2 2 No of Hybrid Sections 0 0 0 0 0 0 Fulltime Faculty 1 1 1 1 1 1 Adjunct Faculty 4 4 4 4 4 4 2. Compare student success in the DE teaching environment with success in the faceto-face teaching environment in the same course. Are there differences? To what do you ascribe the differences in your program? Discuss any other relevant factors regarding diverse teaching modalities and environments, such as specific locations. There is a visibly clear difference in the success rates of face to face classes when compared to distance education classes. After the fall 2010 semester rate of 68% the success rates in DE sections of POL-1 fell off dramatically: 56%, 35%, 49%, 49%, and 38%. I believe the difference is found in the assignment of a DE instructor that teaches Political Science at the college level as opposed to the previous instructor that designed the course to be too easy and more along the lines of high school civics. 3. Describe the process to change and improve student success in DE courses/sections in your program, and any other relevant factors regarding diverse teaching modalities and environments, such as specific locations. The process to change and improve student success might have to be found in the students themselves as many students register in DE courses with the idea that they will be easier to pass or earn a letter grade of “A”. Perhaps the college could do a better job at informing students that success in a DE course requires a high degree of self-discipline and dedication to study. Or perhaps I could assign an instructor that would dumb-down the material such as the previous DE instructor who landed the job in part to the intervention of his wife – a tenured instructor at the college. 8|Page C. CURRICULUM Complete the following tables pertaining to courses scheduled for review. Courses scheduled for review during AY 201314 as previously specified POL-3 POL-45 POL-99 POL-5 Courses scheduled for review during AY 201415 POL-2 9|Page Faculty member(s) responsible for coordinating Lawrence Adams Lawrence Adams Lawrence Adams Lawrence Adams Faculty member(s) responsible for coordinating Lawrence Adams (a) Was the course reviewed and (b) taken through the curriculum process? Yes Yes Yes No (pending) Date of approval (or anticipated approval) by Curriculum Committee 11/21/13 11/7/13 11/7/13 Target semester and year—Fa 2014 or Sp 2015 Fall 2014 D. OUTCOMES Use your Program Outcome Maps to assist you in this subsection. As you plan your course assessments, keep the higher level program outcome in mind. While course level assessment serves the purpose of examining the teaching and learning for that particular course, it also provides the data that will be viewed collectively for assessment of the associated program level outcomes. PROGRAM LEVEL OUTCOMES 1. Please complete the following tables. List Program level outcome(s) scheduled for assessment as previously specified Demonstrate an ability to evaluate the governmental structures established by the Constitution of the United States of America and the California State Constitution. What changes have occurred in the program/discipline as a result of dialogue? None, the assessment was within the target range of 70% or above. Was the Program Outcome Assessment Summary completed? Yes Apply critical thinking skills in reading, comprehending, and interpreting political science scholarship. Additional reading and assessment requirements are currently being implemented Yes Employ political science research methods to address political questions using primary and secondary sources. None, the assessment was within the target range of 70% Yes List Program level outcome(s) scheduled for assessment in AY 14-15 Have your course level SLOs needed for this program level outcome been assessed or scheduled for assessment? Yes Develop a uniform methodology to analyze SLOs in POL-1. 2. Describe how program level outcomes were specifically addressed by the program/discipline during the past year. For example, were data gathered at the course level? Was there review and analysis of the data? How did the discipline faculty engage in discussion? Were any interventions conducted? Are there any plans to make changes to certificate/degree programs or improvements in teaching and student learning? 10 | P a g e Data was gathered at the course level by utilizing SLO assessment reports and individual instructor data derived from examinations. The discipline faculty engaged in discussions by individual meetings held each semester between the tenured and adjunct instructors. No direct interventions were conducted, the discipline agreed to meet each semester in order to review data, trends, and explore solutions to anomalies if required. CORE COMPETENCIES 3. Describe how Core Competencies were specifically addressed by the program/discipline during the past year. For example, were data gathered at the course level? Was there review and analysis of the data? How did the discipline faculty engage in discussion? Were any interventions conducted? Are there any plans to make changes to courses or improvements in teaching and student learning? Core competences were addressed in faculty meetings, review of syllabi, data derived from examinations, and the review of SLO data. The discipline agreed that additional data is required to provide a better framework for analysis. COURSE LEVEL STUDENT LEARNING OUTCOMES 4. Please complete the following tables. List courses scheduled for SLO assessment as previously specified POL-1 POL-2 POL-3 POL-5 POL-6 In what term was the course assessed? Fall 2013 Fall 2012 Spring 2013 Spring 2014 Fall 2013 List courses scheduled for SLO assessment in AY 2014-15 POL-2 POL-1 Faculty member(s) responsible for coordinating Lawrence Adams Lawrence Adams Was the Course Assessment Summary Report completed? Yes Yes Yes No Yes Target semester and year—Fa 2014 or Sp 2015 Fall 2014 Spring 2015 5. Describe course level assessments results and how they will influence your plans moving forward. The course level assessment results meet the achievement standard in POL-1 in every semester measured to date. In the electives the standard has not been met in any semester measured, however this result is tempered by the fact that each elective course has the highest retention and success rates when compared to POL-1. The anomaly in this case is found due to the fact that the elective courses are demanding and to date the SLO has been embedded in the first 11 | P a g e midterm examination. The hypothesis is that the SLO will meet the achievement standard if measured on the second midterm examination or the final exam. 6. Describe assessment activities that need to be strengthened or improved. What are the challenges to achieving these improvements? The assessment result that needs to be improved, as the ACCJC views pedagogy, is the outcome in the elective courses (as explained in number 5). The hypothesis referenced previously is being measured in spring semester 2014 as the SLO is being measured on both midterm examinations and the final exam. The retention rates and success rates in these courses suggest that marked improvement will be achieved by students when measured later in the course. The discipline foresees no academic challenges to improvement in this regard. 12 | P a g e E. PREVIOUSLY SCHEDULED ACTIVITIES This subsection focuses on activities that were previously scheduled. An activity can address many different aspects of your program/discipline, and ultimately is undertaken to improve or enhance your program/discipline, and keep it current. Activity scheduled What success has been achieved to date on this activity? Will activity What challenges existed or continue continue into AY 14-15? to exist? Will activity continue into AY 15-16?* 1. Course revisions POL-3, POL-5 (in progress) The inactivation of ETH-5 as POL-5 is no longer going to be cross-listed with ETH-5 Maybe, I hope not No 2. Course deletions POL-45, POL-99 None No No 3. Assessment POL-1, POL-2, POL-3, POL-6, (pol5 in progress) None No No * For each activity that will continue into AY 2015-16 and that requires resources, submit a separate resource request in Section III. 1. Evaluate the success of each activity scheduled, including activities completed and those in progress. What measurable outcomes were achieved? Did the activities and subsequent dialogue lead to significant change in student learning or program success? Each activity was successful as evidenced by the approval of the course revision of POL-3 and deletions of POL_45 and POL-99; the revision of POL-5 is currently underway. The assessments of all courses are completed or in progress (POL-5). No significant changes have been made or are being considered at this time. 13 | P a g e III. ANNUAL ACTION PLAN This section must be completed for ALL academic programs, whether scheduled for annual or comprehensive review in spring 2014. A. NEW ACTIVITIES This subsection addresses new activities for, and continuing new activities into, AY 2015-16. An activity can address many different aspects of your program/discipline, and ultimately is undertaken to improve, enhance, and or keep your program/discipline area current. A new activity may or may not require additional resources. Activities can include but are not limited to: • • • • • • • • • • NEW CURRICULUM FURTHER DEVELOPMENT OF THE PROGRAM OR SERVICE GRANT DEVELOPMENT AND PROPOSALS FACULTY AND STAFF TRAINING MARKETING/OUTREACH ENROLLMENT MANAGEMENT STUDENT SERVICES ADMINISTRATIVE SERVICES SUPPORT OPERATIONS FACILITIES 1. List information concerning new projects or activities planned. Please keep in mind that resources needed, if funded, would not be approved until spring 2015 and provided until FY 2015-16. Ongoing activities involving resources that will no longer be available from grant funds starting FY 2015-16 must be planned for appropriately. Activity 1. Guest speaker series 14 | P a g e Strategic Plan Goal(s) No. & Letter (e.g., 5A)* Realworld needs of Hartnell students Related Courses, SLOs, PLOs, or goals Desired Outcome(s) Resources Needed Person Responsible Estimated Date of Completion (can be more than one year in length) POL-1 POL-2 POL-3 POL-5 POL-6 Students evaluation of the real world as it applies to the discipline domestically and internationally The main stage, speaker system, possibly a stipend Lawrence Adams Five years Comments 2. AA-T Recruitment 3. Improve student learning POL-1 POL-2 POL-3 POL-5 POL-6 Improve student learning Poster boards, marquee listing, website listing Lawrence Adams 4. 5. * See Appendix A for a list of the 11 goals in the college’s Strategic Plan. 15 | P a g e Two years *** Please complete this page for each new activity. *** 2. This item is used to describe how the new activity, or continuing new activity, will support the program/discipline. Consider: • Faculty • Other staffing • Facilities • Equipment (non-expendable, greater than $5,000), supplies (expendable, valued at less than $5,000), • Software • Hardware • Outside services • Training • Travel • Library materials • Science laboratory materials a) Describe the new activity or follow-on activity that this resource will support. Guest speaker series: real world needs of Hartnell students b) Describe how this activity supports any of the following: 1) Core Competency 2) Program level Outcome 3) Course level Outcome 4) Program/Discipline Goal 5) Strategic Priority Goal Program level outcome: apply critical thinking skills in reading, comprehending, and interpreting political science scholarship c) Does this activity span multiple academic years? YES If yes, describe the action plan for completion of this activity. 1. Organizing of the series 2. Securing the main stage 3. Obtaining funding of stipends for speakers 4. Finding speakers 5. Completing steps 1-4 and actually holding an event d) What measureable outcomes are expected from this activity? List indicators of success. I do not know if there are measureable results from holding a guest speaker series, and realistically speaking there is no deed for a measureable result when holding an event for individuals as each will gain their own personal insight from the event. e) What are the barriers to achieving success in this activity? 16 | P a g e The securing of the main stage and funding of stipends are the two primary barriers to success. 17 | P a g e *** Please complete this page for each new activity. *** 2. This item is used to describe how the new activity, or continuing new activity, will support the program/discipline. Consider: • Faculty • Other staffing • Facilities • Equipment (non-expendable, greater than $5,000), supplies (expendable, valued at less than $5,000), • Software • Hardware • Outside services • Training • Travel • Library materials • Science laboratory materials a) Describe the new activity or follow-on activity that this resource will support. AA-T Recruitment: improve student learning b) Describe how this activity supports any of the following: 6) Core Competency 7) Program level Outcome 8) Course level Outcome 9) Program/Discipline Goal 10) Strategic Priority Goal Program level outcome: employ political science methods to address political questions using primary and secondary sources in conjunction with an increase of Political Science AA-T majors c) Does this activity span multiple academic years? YES If yes, describe the action plan for completion of this activity. 1. Organizing of recruitment events 2. Reserving Steinbeck Hall or a classroom 3. Reserving speaker system 4. Developing flyers and handouts 5. Completing steps 1-4 and actually holding a recruitment event d) What measureable outcomes are expected from this activity? List indicators of success. Increase the number of students majoring in Political Science. e) What are the barriers to achieving success in this activity? None 18 | P a g e B. RESOURCE REQUESTS If new/additional resources are needed for your program/discipline, it is important that you identify them and project their cost, and that these resources and costs be considered through the College’s integrated planning (governance, budget development, funding decision making, and resource allocation) processes. A resource is likely to be something needed to support an activity that you have identified in IIIA. above, in which case you must link the resource with a specific activity number (first column below). ). All resource requests completed in the various columns of a specific row must be linked to the new or continuing activity numbered on the first column of that same row. A resource could also be something necessary for your program/discipline to function properly to improve student learning, such as updated equipment in a classroom; in such case be sure to note that the resource is NOT tied to a specific activity. Activity No. 1. Personnel Classified Staff/ Faculty (C/F/M)* Guest Speaker 2. Supplies/ Equipment (S/E)** Use of speaker system Technology Hardware/ Software (H/S)*** Contract Services Training Travel Library Materials Science Labs Stipend 3. 4. 5. * Personnel: Include a C, F, or M after the amount to indicate Classified Staff, Faculty, or Manager. ** S for Supplies, E for Equipment. If additional supplies, for example, are needed for ongoing activities, this should be requested through the budget rollover process. *** H for Hardware, S for Software. 19 | P a g e Projected Costs $300 APPENDIX A. Strategic Priorities & Goals (from Hartnell College Strategic Plan 2013-2018) Priority 1: Student Access Goal 1A: Hartnell College will provide higher education, workforce development, and lifelong learning opportunities—with seamless pathways—to all of the college’s present and prospective constituent individuals and groups. Priority 2: Student Success Goal 2A: Hartnell College will provide a supportive, innovative, and collaborative learning environment to help students pursue and achieve educational success. Goal 2B: Hartnell College will provide a supportive, innovative, and collaborative learning environment that addresses and meets the diverse learning needs of students. Priority 3: Employee Diversity and Development Goal 3A: Hartnell College is committed to 1) increasing diversity among its employees; 2) providing an environment that is safe for and inviting to diverse persons, groups, and communities; and 3) becoming a model institution of higher education whose respect for diversity is easily seen and is fully integrated throughout its policies, practices, facilities, signage, curricula, and other reflections of life at the college. Goal 3B: To attract and retain highly qualified employees, Hartnell College is committed to providing and supporting relevant, substantial professional development opportunities. Priority 4: Effective Utilization of Resources Goal 4A: To support its mission, Hartnell College is committed to the effective utilization of its human resources. Goal 4B: Hartnell College is committed to having its physical plant, furnishings, and grounds maintained and replaced in a planned and scheduled way to support learning, safety, security, and access. Goal 4C: Hartnell College will maintain a current, user-friendly technological infrastructure that serves the needs of students and employees. Goal 4D: Hartnell College is committed to maximizing the use and value of capital assets, managing financial resources, minimizing costs, and engaging in fiscally sound planning for future maintenance, space, and technology needs. Priority 5: 20 | P a g e Innovation and Relevance for Programs and Services Goal 5A: Hartnell College will provide programs and services that are relevant to the realworld needs of its diverse student population, while also developing and employing a culture of innovation that will lead to improved institutional effectiveness and student learning. Priority 6: Partnership with Industry, Business Agencies and Education Goal 6A: Hartnell College is committed to strengthening and furthering its current partnerships, in order to secure lasting, mutually beneficial relationships between the college and the community that the college serves. 21 | P a g e