Principles Assessment Survey Summary __________________________________________________________________________________ In March and April of 2015, the Principles Assessment Survey (PAS) was completed by 41 administrators, faculty, students, and staff at RTC. Respondents were asked to indicate, on a scale from 1 to 5, to what extent the college has implemented 41 practices listed under each of five principles. These five principles are: (1) Committed Leadership; (2) Use of Evidence to Improve Policies, Programs, and Services; (3) Broad Engagement; (4) Systemic Institutional Improvement; and (5) Equity. Each principle is further broken down into 2-3 sub-categories containing two or more questions that pertain to different aspects of the principle (see Table 1). Average scores were calculated for each of the five principles, as well as each individual sub-category, to identify RTC’s strengths and areas for improvement. Average scores vary from 1 (little/none) to 5 (a lot) for each principle and sub-category. In cases where a respondent was not sure of the answer, they were able to indicate they were “unsure.” Responses of “unsure” were not included in the average score calculations. Table 1. Principles Assessment Survey - Principles and Sub-Categories Principle Sub-Category Number of Questions Committed Leadership (Principle 1) 1.1 Vision and Values 1.2 Commitment 3 3 Use of Evidence to Improve Policies, Programs, and Services (Principle 2) 2.1 IT and IR Capacity 2.2 Process for Identifying Achievement Gaps 2.3 Process for Formulating and Evaluating Solutions 4 3 2 Broad Engagement (Principle 3) 3.1 Faculty and Staff 3.2 Students and External Stakeholders 5 2 Systemic Institutional Improvement (Principle 4) 4.1 Institutional Management 4.2 Organization 4.3 Professional Development 7 2 3 Equity (Principle 5) 5.1 Institutional Equity 5.2 Equity in the Classroom 4 3 Responses indicate that Committed Leadership is RTC’s highest scoring principle, while Broad Engagement is RTC’s lowest scoring principle (see Chart 1). Furthermore, the Vision & Values, Institutional Equity, Commitment, and Institutional Management sub-categories had the highest scores. Professional Development, Faculty and Staff Engagement, Process for Formulating and Evaluating Solutions, and Process for Identifying Achievement Gaps had the lowest scores (see Chart 2). 1|Page Chart 1. Average Scores for the PAS Principles 4 3.68 3.56 3.28 3.03 2.94 Principle 2 Principle 3 3 2 1 0 Principle 1 Principle 4 Principle 5 Chart 2. Average Scores for the PAS Sub-Categories 4.00 3.79 3.57 3.53 3.11 3.00 2.98 3.65 3.40 3.40 3.15 2.93 2.85 2.67 2.00 1.00 0.00 1.1 1.2 2.1 2.2 2.3 3.1 3.2 4.1 4.2 4.3 5.1 5.2 2|Page The number of responses in each response category (1 to 5) for each of the 41 questions are outlined below, in addition to the “unsure” responses. Principle 1: Committed Leadership 1.1 Vision and Values Question 1.1a CEO and leadership team actively support efforts to improve student learning and completion, not just increase enrollments. 20 16 16 11 12 9 8 4 3 2 0 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure Question 1.1b CEO and other senior leaders have made an explicit policy commitment, communicated to faculty, staff, students and community, to achieve equity in student outcomes across racial/ethnic and income groups. 20 16 16 12 12 8 8 4 2 2 1 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure 3|Page Question 1.1c College communications, including website and news releases, emphasize a student success agenda. 20 15 16 12 9 9 8 3 3 1 (Little/None) 2 4 2 0 3 (Increasing) 4 5 (A lot) Unsure 1.2 Commitment Question 1.2a The board expects, and the CEO provides, regular reports on student outcomes and the impact of efforts to improve success rates. 16 12 10 9 8 8 8 4 4 2 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure 4|Page Question 1.2b Senior leaders demonstrate willingness to support changes in policy, procedures and resource allocation to improve student success. 16 13 12 11 11 8 4 3 2 1 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure Question 1.2c Faculty leaders actively support a broad-based student success agenda. 16 12 12 12 8 6 5 4 4 2 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure 5|Page Principle 2: Use of Evidence to Improve Policies, Programs, and Services 2.1 Institutional Research (IR) and Information Technology (IT) Capacity Question 2.1a IT capacity is adequate to meet the demand for data and institutional research. 20 17 16 12 7 8 6 5 4 4 2 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure Question 2.1b Policies and procedures are in place to ensure integrity of data collected. 20 15 16 12 9 8 4 6 3 3 1 (Little/None) 2 5 0 3 (Increasing) 4 5 (A lot) Unsure 6|Page Question 2.1c IR staff capacity is adequate to meet demand for data and research. 16 12 12 12 8 6 5 4 4 2 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure Question 2.1d IR staff effectively educates and assists college personnel in using data and research to improve programs and services. 20 17 16 12 8 6 4 3 4 5 6 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure 7|Page 2.1 Process for Identifying Achievement Gaps Question 2.2a College routinely collects, analyzes and reports longitudinal data on cohorts of students to chart student progress and outcomes. 16 13 12 11 10 8 4 3 2 2 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure Question 2.2b College routinely disaggregates student cohort data by age, race, gender, income, and other factors to identify gaps in achievement among student groups. 16 14 13 12 10 8 4 2 1 1 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure 8|Page Question 2.2c College regularly conducts surveys and focus groups with students, faculty, and staff to identify weaknesses in programs and services and opportunities for improvement. 16 14 12 9 8 8 5 3 4 2 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure 2.2 Process for Formulating and Evaluating Solutions Question 2.3a College routinely engages personnel from across the campus community to review data on student achievement and help develop and refine strategies for addressing priority problems. 16 11 12 8 6 7 7 7 3 4 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure 9|Page Question 2.3b College routinely evaluates the effectiveness of efforts to improve student success and uses the results to improve policy and practice. 20 16 16 12 7 8 5 4 4 5 4 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure Principle 3: Broad Engagement 3.1 Faculty and Staff Engagement Question 3.1a Faculty meets regularly to examine course and program outcomes and develop strategies for addressing achievement gaps and improving student success. 16 12 12 8 10 7 5 4 3 4 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure 10 | P a g e Question 3.1b Faculty routinely assesses academic programs and teaching strategies from the perspective of current research on effective practice. 16 12 12 12 8 6 5 4 4 2 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure Question 3.1c Part-time or adjunct faculty are actively engaged in institutional efforts to improve student success. 16 12 10 9 9 8 6 4 4 3 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure 11 | P a g e Question 3.1d There is alignment and extensive collaboration on efforts to improve student success between academic/instructional affairs and student services. 16 14 12 7 8 6 4 6 4 4 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure Question 3.1e Student services staff routinely assesses student success strategies from the perspective of current research on effective practices. 16 12 12 9 8 8 4 4 1 (Little/None) 2 4 4 0 3 (Increasing) 4 5 (A lot) Unsure 12 | P a g e 3.2 Students and External Stakeholder Engagement Question 3.2a College secures active student participation in efforts to improve student outcomes. 16 12 10 8 4 7 7 7 7 4 5 (A lot) Unsure 3 0 1 (Little/None) 2 3 (Increasing) Question 3.2b College secures input from external stakeholders to identify causes of achievement gaps and inform the development of strategies for improving student success. 16 13 12 8 8 4 7 5 5 4 5 (A lot) 3 0 1 (Little/None) 2 3 (Increasing) Unsure 13 | P a g e Principle 4: Systemic Institutional Improvement 4.1 Institutional Management Question 4.1a College has established strategic planning process that relies on data to set goals for student success and to measure goal attainment. 16 12 11 9 8 8 7 5 4 1 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure Question 4.1b Plans for a given year are driven by a limited set of strategic priorities that have a focus on student success. 16 12 10 9 9 8 8 4 3 2 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure 14 | P a g e Question 4.1c College regularly evaluates its academic programs and student services to determine how well they promote student success and how they can be improved. 16 11 12 10 7 8 5 4 5 3 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure Question 4.1d Decisions about budget allocations are based on evidence of program effectiveness and linked to plans to increase rates of student success. 16 11 12 10 10 8 4 4 4 4 5 (A lot) 2 0 1 (Little/None) 2 3 (Increasing) Unsure 15 | P a g e Question 4.1e College uses external grant funds strategically to support systemic efforts to improve outcomes for students broadly, not just for isolated projects that benefit small numbers of students. 16 14 12 10 9 8 5 4 1 2 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure Question 4.1f College actively works to scale up and sustain pilot programs or practices that prove effective. 16 12 10 10 5 (A lot) Unsure 8 8 7 5 4 1 0 1 (Little/None) 2 3 (Increasing) 4 16 | P a g e Question 4.1g The student success agenda is integrated with on-going accreditation activity. 16 12 10 9 9 8 8 4 4 1 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure 4.2 Organization Question 4.2a The college has a standing committee or committees responsible for guiding and monitoring efforts to improve student outcomes. 16 12 12 8 8 7 5 5 4 4 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure 17 | P a g e Question 4.2b Major meetings, organizational units, and work groups regularly focus on student success. 16 12 11 10 8 8 5 4 4 3 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure 4.3 Professional Development Question 4.3a The college offers faculty and staff professional development that reinforces efforts to improve student success and close achievement gaps. 16 12 12 8 7 8 8 4 4 2 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure 18 | P a g e Question 4.3b Induction and orientation activities for new faculty and staff foster a commitment to student success. 16 12 10 9 9 8 8 4 3 2 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure Question 4.3c College provides training to faculty and staff on using data and research to improve programs and services. 16 12 11 9 8 8 7 5 4 1 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure 19 | P a g e Principle 5: Equity 5.1 Institutional Equity Question 5.1a The college has a climate of respect for inclusiveness. 20 17 16 11 12 7 8 4 4 1 1 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure Question 5.1b The college consistently demonstrates a commitment to equity for all students. 20 17 16 13 12 7 8 4 2 2 0 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure 20 | P a g e Question 5.1c The college's staffing reflects the demographic composition of its service area’s population (community or region). 16 13 12 8 8 6 5 5 4 4 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure Question 5.1d The college routinely creates opportunities for all students, especially those who have traditionally faced the most significant barriers to achievement, to voice opinions about their college experience. 16 12 12 7 8 8 9 5 4 0 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure 21 | P a g e 5.2 Equity in the Classroom Question 5.2a Faculty members proactively create a learning environment that promotes the success of all students. 16 12 12 10 9 8 6 4 2 2 1 (Little/None) 2 0 3 (Increasing) 4 5 (A lot) Unsure Question 5.2b Multicultural perspectives are integrated throughout the curriculum. 16 13 12 10 8 6 5 4 4 3 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure 22 | P a g e Question 5.2c Adjunct and full-time faculty, staff (including front-line and student support services), and administrators have experience or knowledge of how to work with students from diverse backgrounds and are sensitive to the unique needs of cultural 16 11 12 11 9 8 5 4 2 3 0 1 (Little/None) 2 3 (Increasing) 4 5 (A lot) Unsure 23 | P a g e