LEAGUE TABLES AND NEW KPIs VC’s OPEN MEETING Anita Wright Head of Planning November 2013 League Tables and Rankings Why are League Tables Important? • League Tables are here to stay • • Increasing evidence that they inform choice • • • New Tables e.g. Which?, Unistats Students and parents Staff (to a lesser extent) Reputational Impact • • • • More significant in a competitive market Student recruitment Research grants Partnership activity University of Liverpool Headlines • The Good News • University of Liverpool is in the top 1% of International Universities • The Bad News • Ranking deteriorated in 2013 compared to 2012 League Table Performance How are we doing? • Performance in many metrics remains generally stable • Continue to see a drop in rankings • • Failing to keep pace with other HEIs Context • • • RAE results are fixed until REF 2014 published Research assessment highly weighted (1.5 times) REF performance is critical • Need to gain in other measures (e.g. SSR, Spend) to improve our rank Performance - Strengths Where do we do well? Staff Student Ratio Top 10 in the sector but downward trend Academic Services Spend Top 10 in the sector Completion Rate Stable performance, predicted, fluctuation Entry Tariff Improved performance, only maintained rank Quality vs student numbers Performance - Weaknesses Where do we do less well? Facilities Spend Improving, poor rank Good Honours Relatively stable, losing position Graduate Prospects Local students, less graduate opportunities Reputational Surveys Difficult to influence? Student Satisfaction Overall improvement, primary indicator, maximum weighting University of Liverpool Performance – THE World University Rankings University of Liverpool What can you do? • Subject Performance • • • Performance in individual subject areas critical Measures in overall league tables are adjusted for subject mix Overall University score depends on performance in each subject table • Understand performance in your area and which measures need improving • Outstanding Areas • Areas for Improvement KEY PERFORMANCE INDICATORS Why do we need them? • The Right KPIs are critical • • • Linked to our Strategic Plan Define and evaluate success against progress with strategic aims Broader context than what's in the league tables only • Essential to understanding our current position, where we sit against our competitors and predict future performance to inform our Plans • Facilitate performance improvement and progress against agreed Strategic Vision and direction • Make adjustments or take corrective action where necessary through effective monitoring and reporting New KPIs – Framework Link to Strategy and Vision Vision • Purpose and Vision • Core Values • Brand • Strategy to Achieve our Vision Strategy • Key Priorities Priorities • KPIs • Cross-cutting New KPIs – Agreed Approach Including Other Supporting Measures KPIs SPIs MI • Strategic and in line with Priorities and Vision • Small Number (i.e. 6-10) • More detailed measures in support of KPIs • Specific SPIs for Strategic Committees and Planning Units • Detailed MI in support of activity and performance monitoring by Schools/Institutes Agreed KPIs and SPIs Research and KE KPIs • • • • Research Quality and Impact Citations/Publications PGR Students Innovation SPIs • • • • Applications, Awards, Success Rates ‘Prestigious’ Projects (e.g. Fellowships) Income Large Grants Agreed KPIs and SPIs Student Experience KPIs • • • • Degrees Awarded Employability/Destinations Satisfaction (L&T and services) Diversity SPIs • • • • Contact Time and Quality League Table metrics (e.g. SSR, Spend) Applications and Conversions Progression/Retention Agreed KPIs and SPIs Widening Participation • As Student Experience KPIs SPIs • HEFCE Benchmarks • Access Agreement • Value Added Agreed KPIs and SPIs Enablers • Financial Health and Sustainability • Staff Satisfaction KPIs SPIs • Staff (retention, progression, diversity) • Condition of the Estate and Space Utilisation • Alumni and Fundraising Activity KPIs and SPIs Reporting Framework – Dashboard Examples • MI Dashboards and Explorer for KPIs and SPIs to support analysis • • • • Performance against Target Comparator Performance Trend over Time Drill down capability KPIs and SPIs Reporting Framework – R&KE Example KPI SPI MI % 3* and 4* outputs Eligible Staff Applications Research Quality Research Grants Awarded Success Rates Source of Funds Fellowships Prestigious Projects Large Grants Next Steps Current Development Areas • Define and Specify KPIs and SPIs • • • • • • Agree Targets/Milestones • • • • Link between KPIs, SPIs and MI – Three Tier Approach Report through dashboards and explorer Defined reporting calendar/timeline Develop Operational MI Validate by modelling historical data Actual value vs. RG position Challenging but Realistic Identify appropriate National and International benchmarks Integrate in to PPC and Quarterly Performance Reports Where Next? Overall Vision and Strategy • Move from MI to BI…. • MI is used to: • • • Inform decisions Define strategy Change behaviour • Leading to improved performance……. • More to follow ……your help in assessing our ‘BI Maturity’ Questions