SSH Evaluation Unit Membership Database Surname: Kushner Name: Saville Title/Job: Professor of Public Evaluation School/Dept: School of Education Address: UWE, School of Education, Frenchay Campus, Coldharbour Lane, Bristol, BS16 1QY 0117 3284258 Tel: Web Profile: Email: http://www1.uwe.ac.uk/ssh/education /research/people/professorsavillekush ner.aspx Saville.kushner@uwe.ac.uk Funded Projects of Research, Evaluation and Consultancy 2007 Evaluation of the Graduate Development Programme (UWE) Independent evaluation of the Dorset Care in Custody Programme (Dorset PCT) Independent evaluation of the Pacesetters programme (DoH) Country programme development, (UNICEF – Eastern Caribbean States) 2006-07 Country Programme Evaluation, Ecuador 2004-05 A series of small-scale independent evaluations of assessment and practice-based learning for nursing education; the Property Services Division of Gloucester CC; selfwithdrawing pupils from Bristol schools 2003-04 Independent evaluation of representative training for the Police Federation of England and Wales (PFEW) ESRC Seminar Series, ‘Democracy, Education and Methodology’ Research into school non-attendance (Bristol CC) Independent Review of the Learning Requirement for Police Probationer Training in England and Wales (Home Office) Evaluation of the Dorset Childrens Fund (Dorset Childrens Fund) (2003-6) Evaluation of multi-agency working in relation to the Bristol Childrens Fund (Bristol Childrens Fund) (2003-4) 2008-09 Wiltshire CC Management of Change Programme (WCC) Researching Education in the Arts (Arts Council of England) Case Studies in Science Management (European Association of Research Managers & Administrators) 2002-03 2000 Evaluation of the TTA School-Based Research Consortium Initiative (TTA) Evaluation of the Bridgwater Education Action Zone (EAZ) Evaluation of OFSTED Inspection Process at Summerhill School (Nuffield Foundation) 1999 Practice Research Project for SoundSense (national community music association) 2000-01 SSH Evaluation Unit Membership Database 1998 1997 Evaluation of the Department for Education & Employment 'Learning Through Earning' Project Evaluation of the JISC Information Strategies Project (Higher Education Funding Council for England) Understanding Boy's Sexual Health Education and its Implications for Attitude Change Continuation (ESRC) Evaluation of Practice and Assessment in Nurse/Midwife Education (English National Board for Nursing and Midwifery) Pilot for the Evaluation Case Study of a Hospital Trust (National Hospitals Trust) 1996-97 Visiting scholar in Evaluation, University of Malaga, Spain (Aug - Feb) 1995-96 Understanding Boy's Sexual Health Education and its Implications for Attitude Change (ESRC) 1994 - 95 Validation of Police Probationer Training (Home Office) Evaluation of the UEA Common Course Structure (i.e. modular programme) (University of East Anglia) Qualitative Evaluation of the Technology Enhancement Programme in Schools (Engineering Council) Evaluation of the Business with Information Technology in Education Project (HEFCE) 1993-94 1991-93 1990 - 91 1988 – 91 Policy Evaluation of the ESRC InTER Initiative (ESRC) Quality in Service Programme (Norfolk Police, Norfolk TEC) Self Evaluation Training for the Arts (Arts Council of Great Britain) Personal award from the Arts Council Stage ll Review of Police Probationer Training (Home Office) Evaluation of Police Recruit Training Policy and Practice in New South Wales (Government of NSW) Evaluation of the City of Birmingham Symphony Orchestra Adopt-a-Player Scheme (Calouste Gulbenkian Foundation) Personal scholarship Evaluation of the National Association of Arts Centres Education Programme (NAAC) 1987 - 88 1979 - 87 Evaluation of the Royal Opera House Education Department Policy and Practice (Esmee Fairbairn Charitable Trust) Evaluation of the Norwich Young Mother's Education Project (Norwich District Health Authority ) Management of Change Programme (Norfolk Police, HMSO, Norfolk Social Services) Visiting Fellow, National University of Costa Rica presenting a 4-week seminar on research methods for educational development Visiting Lecturer in Evaluation, Simon Bolivar University, Venezuela Visiting Lecturer in Evaluation, Department of Education, Auckland University Visiting Fellow in Evaluation, Deakin University, Victoria, Australia Evaluation of the Music Performance & Communication Skills Project at the Guildhall School of Music and Drama (Leverhulme Trust) Evaluation of the DES Lower Attaining Pupils' Programme (Nottingham LEA) Careers Guidance Observed (CARGO) - Evaluation of the EC Programme Transition from School to Working Life (Dept. of Education & Science) Evaluation of Bilingual Education Policy in the USA (Ford Foundation) SSH Evaluation Unit Membership Database Consultancy/Personal Commissions 2008 2007 2005 2003-04 2000-04 2001 2002 2001 1999 1998 1996-97 1995 1994 1994 1994 1993-95 1990-91 1990-91 1983 UNICEF (Ecuador) Programme design and methodological support for project, State of the Nation UNICEF (Eastern Caribbean States) Developing a Country Programme management Plan HEFCE Member of Expert Panel on Evaluation developing an evaluation strategy for the HE sector British Home Office Member of a Ministerial working party on police probationer training and Adviser to Her Majesty’s Inspectorate of Constabulary on police training European Association of Research Managers and Administrators Professional development for research managers; Her Majesty’s Inspectorate of Constabulary Support for national probationer training review and reporting Disabilities Rights Commission Advice on evaluation strategies for the Commission and for the review of its strategic objectives Ministry of Security, Costa Rica Advice on police training Qualifications and Curriculum Authority Curriculum evaluation UNICEF (Latin America) Advice on democratic evaluation development University of Almería, Spain University evaluation British Home Office Course development for the training of police trainers British Council The development of policy research in Ecuadorian Higher Education Ministry of Agriculture, Costa Rica The evaluation of agricultural extension programmes for technology transfer and for the training of extension workers Ministry of Education, Venezuela Writing a pre-tender specification for the evaluation of a $500m programme of educational reform British Home Office Curriculum development in police probationer training Association of Metropolitan Authorities Police probationer training Arts Council of Great Britain Self-evaluation for arts groups and clients of the Council European Commission Evaluation training for evaluators of EC projects in the programme 'Transition from School to Working Life' Some Invited Addresses and Keynote Presentations 2008 Conference Chair, Annual Conference of the UK Evaluation Society, Bristol, UK 2005 Invited presentation to Inaugural Conference of the Central American Evaluation Society, Tegucigalpa 2005 Keynote to the CEPOL European Police and Science Research conference, Lisbon SSH Evaluation Unit Membership Database 2004 Keynote to the Inaugural Conference of the Latin American Evaluation Society, Lima on evaluation and democracy 2004 Keynote to the National Music Federation annual conference on school curriculum, Bristol 2003 Keynote to the National Association of Music Educators conference, Exeter 2003 Invited public lecture for the Paideia Foundation, La Coruña, Spain on the public launch of my book, Personalizar la Evaluación 2002, Keynote to the Annual Conference of the Australasian Evaluation Society, Wollongong, on democracy and program evaluation (including a lecture tour in Queensland and Western Australia) 2001 Keynote to the National Association of Music Educators conference, Harrogate, on curriculum policy 1998 to the Stake International Symposium on Evaluation, Illinois, on program evaluation 1997 Keynote address to the Manuel de Fallas International Music Festival, Granada, Spain Some Recent Short Courses Organised/Delivered March 2004 - training for European research management (2 days) – Budapest (EARMA) June 2003 - training for European research management (2 days) – Faro, Portugal (EARMA) March 2003 – training for European research management (2 days) – Brussels (EARMA) January 2003 - evaluation training course (5 days), University of La Coruña, Spain November 2002 – evaluation training programme (5 days) Australasian Evaluation Society (Brisbane, Perth) September 2002 – research methods training course (4 days) University of Granada, Spain June 2002 - training for European research management (2 days) – Budapest (EARMA) May 2001 – qualitative research methods training (5 days) – Manuel de Fallas International Festival, Granada, Spain January/Feb 1994 democratic evaluation training programme (1 month), National University of Costa Rica Scholarships/Awards SSRC Research Studentship (1976-79) Personal Research Award, Calouste Gulbenkian Foundation (1990) Distinguished Visitor Scholarship, University of Málaga (1996-7) Editorships etc Joint Editor of the Elsevier series Advances in Program Evaluation Associate Editor of the American Evaluation Association monograph series New Directions for Evaluation Member of the Editorial Advisory Board of the American Journal of Evaluation Member of the Editorial Committee of the Sage Encyclopedia of Evaluation (2003-4) Member of the Editorial Board of the international journal The Quality of Higher Education (Latvia) Convenor of EVALCHAT, E-discussion list of the UK Evaluation Society (2000-2004) Ex-member, UKES Executive Council Research Students Supervised I have supervised to completion PhD and M.Phil projects including in the following fields: SSH Evaluation Unit Membership Database National Identities National Health Service management Early childhood education Disaffected school pupils and curriculum (Malaysia) The impact of rapid industrialisation on schooling (Malaysia) School transition to Grant-Maintained status Evaluation of agricultural extension programmes (Costa Rica) Evaluation of the Wawa-Wasi childcare programme (Peru) Moral education in a primary school Religious education and school inspection School-based curriculum development Publications Books & Monographs 2007 2002 2000 1992 1992 1991 1991 1986 with N. Norris (Eds.) Dilemmas of Engagement: Evaluation and the New Public Management, Oxford: Elsevier Personalizar la Evaluación, Madrid: Ediciones Morata (translated from original) Personalising Evaluation, London: Sage ESRC Initiatives and Their Coordinators: Oganising for Innovation in the Social Sciences, Report from the independent evaluation of the ESRC InTER Initiative, CARE, UEA A Musical Education: Innovation in the Conservatoire, (Victoria, Australia) Deakin University Printery The Children's Music Book: Performing Musicians in School, Calouste Gulbenkian Foundation (London) ESRC Initiatives and Their Coordinators: Organising for Innovation in the Social Sciences, ESRC Monograph Working Dreams: Innovation in a Conservatoire CARE Monograph, UEA with T. Logan (1984) Made in England: an Evaluation of Curriculum in Transition, CARE Occasional Publications No.14, CARE, UEA with T. Logan, N. Norris et al (1983) Decision Making in the Curriculum Unit E204/10 Open University . with B. MacDonald (1982) Bread and Dreams: a Case Study of Bilingual Schooling in the USA, Ford Foundation (New York) and CARE, UEA (Norwich) Journal Articles and Book Chapters 2009 2008 2007 2007 2006 2006 ‘Program Evaluation and Case Study’ in Mills, A. J., Durepos, G, Wiebe, E (Eds.) Encyclopaedia of Case Study Research, Thousand Oaks: Sage (in press) ‘Own goals: evaluation and accountability in Millennium Development Planning’ K. Ryan & B. Cousins (Eds.) International Handbook of Evaluation, London: Sage (forthcoming) with Nigel Norris, ‘The New Public management and Evaluation’ in S. Kushner & N. Norris (Eds.) Dilemmas of Engagement: Program Evaluation under the New Politics and New Public Management, Oxford: Elsevier with John Elliott, ‘The need for a manifesto for educational programme evaluation’ in The Cambridge Journal of Education 37(3) pp. 321-336 ‘Democratic Evaluation’ in M. Segone (Ed.) New Trends in Development Evaluation, UNICEF Working Papers in Evaluation #5, CEE/CIS Regional Office, pp. 35-38 ‘Adolescents and cultures of reflection: more than meets the eye’ in P. Burnard & S. Hennessey (Eds) Reflective practices in arts education. Netherlands: Springer SSH Evaluation Unit Membership Database 2006 2005 2005 2005 2004 2004 2004 2004 2003 2002 2002 2001 2000 1999 1999 1999 1998 1998 1998 1998 1997 1997 1996 1996 with C. Adelman, ‘Program Evaluation: a Democratic Practice’ for the AERA Handbook, Complementary Methods for Research in Education, NY: Laurence Erlbaum ‘Democratic theorizing: from noun to participle’ in American Journal of Evaluation, 26(4), pp.579-581 ‘A Global paradox for education’ in Martínez, J.B. & Aróstegui, J.L. Eds. Globalización y Educación. Barcelona: Graó ‘Qualitative Control: Government Framework for Qualitative Evaluation’ in Evaluation 11:1, pp. 111-122 with Barry MacDonald ‘Democratic Evaluation’ in S. Mathison Ed. Encyclopedia of Evaluation, Thousand Oaks: Sage ‘Program Evaluation’ in S. Mathison Ed. Encyclopedia of Evaluation, Thousand Oaks: Sage ‘Independence’, ‘Impartiality’, ‘Ethics’– a series of short entries in S. Mathison Ed. Encyclopedia of Evaluation, Thousand Oaks: Sage ‘Falsifying Schooling: Surrealism and Music Education’ in Social Context and Music Education R.E. Stake & J.L. Aróstegui Eds University of Chicago Press with Simons, H., Jones, K. & James, D. ‘From evidence-based practice to practice-based evidence: the idea of situated generalisation’ in Research Papers in Education 18:4, pp. 347-364 ‘The object of passion: engagement and community in democratic evaluation’ Journal of the Australasian Evaluation Society, 2:2, pp. 16-22 ‘I’ll take mine neat: multiple methods but a single methodology’ in Evaluation, 8:2, pp.249-258 ‘Culture, Standards and Programme Qualities’ in A. Benson, D. Hinn & C. Lloyd Eds. Visions of Quality: How Evaluators Define, Understand and Represent Program Quality, Oxford: JAI Press, pp. 121-134 ‘Come Into My Parlour: Ethical Space and the Conduct of Evaluation’ in H.Simons & R. Usher Eds. Situated Ethics in Educational Research, London: Routledge, pp. 56-68 ‘Fringe Benefits: Music Out of the National Curriculum’ International Journal of Music Education, 1:2, pp. 209-218 ‘Meta-evaluation of the University of Almería Spain Evaluation Plan’ in J. Fernandez Sierra & S. Fernandez Larragueta Eds Evaluación Institucional de las Universidades: Eficacia o Calidad, University of Almería Press, Spain with B. Walker ‘The Building Site: an Educational Approach to Masculine Identity’ in Journal of Youth Studies, 2:1, pp. 45-58 ‘Love and death and Responsive Evaluation’, in Proceedings of the Stake Symposium on Educational Evaluation, Champaign: University of Illinois with B. Walker ‘Boys growing up: understanding boys' sexual health education and its implications for attitude change’ ERIC document refereed ED413547 ‘Evaluación de Programas de Conciertos Para Escolares: el Empleo de Estudio de Casos en la Evaluación de la Educación Musical' in Moral, J.P. & Herencia, G.R. Eds Los Conciertos Didácticos , XXVIII Cursos 'Manuel de Falla', Granada: pp. 235-248 'Tener o no tener: distancia crítica y proximidad emocional en la actividad evaluadora de la educación musical' in J-M Correa Gorosope & J. Arruza Gabilondo Eds. Contextos de Aprendizaje, Servicio Editorial, Universidad del País Vasco Spain 'Los Pecados de Nuestros Padres: Gran Bretana - Cambio o Continuidad?' commissioned paper for Cuadernos de Pedagogía, No. 262, pp. 76-83 Spain 'Consumers and Heroes: A Critical Review of Recent Writings of Michael Scriven' in Evaluation 5:5, pp. 363-374 'The Limits of Constructivism in Evaluation' in Evaluation 2:2 pp. 189-200 reprinted in E. Stern Ed. 2005, Handbook of Evaluation, London: Sage 'The Research Assessment Exercise Versus Development in Higher Education’ in Educational Studies 44:1 pp. 5-8 SSH Evaluation Unit Membership Database 1995 1994 1994 1994 1994 1993 1993 1992 1992 1991 1991 1991 1990 1988 1988 1988 1986 1985 1985 1981 1978 'Learning From Experience: the Construction of Naturalistic Methodology', in Bulletin of the Council for Research in Music Education, University of Illinois No. 123, pp. 97112. 'In Defence of Module Four' in Policing, 10:4, pp. 234-242 'The Content of Educational Evaluation' in M. Pettigrew & B. Somekh Eds Evaluating Innovation in Environmental Education, OECD: Paris 'El Pianista, El Cáncer y La Familia' in La Nación, San José, Costa Rica, April 13th 'Against Better Judgement; How centrally prescribed music curriculum works against teacher development', International Journal of Music Education, No.23, pp. 134-145 'One in a Million: the Individual at the Heart of Quality Control' in John Elliott Ed Reconstructing Teacher Education, Falmer Press, London 'Naturalistic Evaluation: Practical Knowledge for Policy Development' in Research Evaluation, 3:2, pp.83-94 'Keep on Changing', in Policing, Vol.8, pp.139-148, with N. Norris, R. Davies, M. Pettigrew Research Careers in the Social Sciences - a policy review paper for the ESRC. Commissioned by the ESRC's Research Resources Board. Mimeo, CARE, UEA with R. Walker 'Theorising a Curriculum' in Ivor Goodson & Rob Walker Eds Biography, Identity and Schooling: Episodes in Educational Research, The Falmer Press, London 'Allegro Ma Non Troppo:An Evaluation Case Study of Performing Artists in the Community' in John Drummond Ed. The Community Musician: Training a New Professional, Report of the Oslo Seminar of the ISME Commission on Community Music International Society for Music Education, Landslaget Musikk i Skolen, Toftesgt. 69, Oslo, Norway 'Taming the Trojan Horse: Music in the National Curiculum', Arts Education Journal National Foundation for Arts Education October with N. Norris 'Interpretación, Negociación y Validez en Investigación Naturalista' in Hacia un Enfoque Interpretativo de la Ensenanza, Juan Bautista Martínez Rodríguez Ed. Publicaciones de la Universidad de Granada Spain reprinted from 'Interpretation, Negotiation and Validity in Naturalistic Research' in Interchange Canada/OISE II:4 1980 'Evaluation in the Arts; The Music Case' in Tickle L Ed The Arts in Education: Some Research Studies, Croom Helm, London. with B. MacDonald 'The Limitations of Programme Evaluation' in R. Murphy & H. Torrance Eds Evaluating Education: Issues and Methods, Paul Chapman, London 'Musicians Go to School: a Case of Knowledge and Control and Cross-Professional Action', American Educational Research Journal Summer, 28:2 pp. 275-296 with T. Logan 'Student Profiles' in Classroom Research ETL 822 Deakin University, Victoria, Australia with T. Logan 'The Careers Service and the Curriculum: Trapped in the Corridor' Cambridge Journal of Education 15:1 pp. 22-31. 'Vocational Chic; The Historical and Curriculum Context to the Field of Transition in England' in R. Fiddy Ed Youth, Unemployment and Training: A Collection of National Perspectives Falmer Press, London 'A Short Course in Parachute Jumping' in Rudduck J Making the Most of the Short InService Course Schools Council Working Paper 71, Methuen, London with J. Sanger 'The Politics of Creativity' in the Cambridge Journal of Education 8:2/3 pp. 173-181 Conference Papers and Presentations 2007 ‘Global Accountabilities, the New Public Management and the Millenium Development Goals’, Annual Conference of the American Evaluation Association, Baltimore, November SSH Evaluation Unit Membership Database 2005 2005 2004 2003 2003 2002 2001 2001 2001 2001 1999 1998 1997 1997 1997 1996 1995 1994 1993 1993 1991 1990 1990 ‘Enfoques y tendencias actuales en la evaluación de programas’, Second Conference of the Central American Evaluation Association on Evaluation for Development,Tegucigalpa, Honduras November ‘Police training and professional reform’ to the European Police Science and Research Conference, Lisbon, June ‘A manifesto for Democratic Evaluation’ Invited keynote address to the inaugural meeting of ReLAC (Redes de Evaluacion) Lima, Peru, November ‘Personalising program evaluation’ – to the American Evaluation Association annual conference, Reno, USA, November ‘Personalizar la Evaluación’ – invited public lecture at the Fundación Paideia, La Coruña, Spain on the occasion of the Spanish launch of my recent book, January ‘Walking backwards into the future: bureaucratic thinking and democratic evaluation’ invited address to the Australasian Evaluation Society annual conference, Wollongong, Australia, October Professorial inuagural lecture: ‘Eyes Wide Shut: Summerhill, Schooling and the Failure of Inspection’, March Workshop on Personalising Evaluation to the annual conference of the UKES Evaluation Society, Belfast, November Keynote address to the annual conference of the National Association of Music Educators NAME, Rippon and St. John College, York ‘Missing Persons: democratic evaluators in policing’ invited presentation to the KAPA ‘Performance Measurement and Evaluation’ seminar, Stourport, November ‘Personalising Evaluation’ to the annual conference of the British Educational Research Association, Sussex University 'Love and Death and Responsive Evaluation' to the Robert Stake Symposium on Evaluation, University of Illinois, May available through ERIC Document Reproduction Service No. ED 413 547 with B. Walker 'Boys Growing Up: Understanding Boys Sexual Health Education and its Implications for Attitude Change' to Annual Meeting of the American Educational Research Association Chicago, April 'Rediscovering the Subject in Programme Evaluation' to the Annual Conference of the UK Evaluation Society, London, December 'The Use of Case Study in Music Education Evaluation', keynote address to the Curso Internacional 'Manuel de Fallas', Granada, Spain, July 'To Have and Have Not: critical distance and emotional proximity in music education evaluation with a critique of 'connoisseurship' ' to the Council for Research in Music Education conference 'Qualitative Studies in Music Education' at Urbana Illinois, May 'Democracy in Flight: an Essay on Case Study, Programme Evaluation and Political Education' to the First Annual Conference of the UK Evaluation Society, Church House, London, September 'Hacia un Modelo Democratico de Practica Profesional dentro de Programas Sociales' to the Ministry of Agriculture Conference on Technology Transfer, San Jose, Costa Rica, March 'Naturalistic Evaluation: Practical Knowledge for Policy Development' to the ESRC/SSHRC conference entitled Evaluation, Social Science and Public Policy, Ottawa, Canada, June 'Evaluation for the Interdisciplinary Arts' invited address to a seminar at Corsham Court entitled Intergration and Interdisciplinarity in the Arts, Bath College of Higher Education and South West Arts, 12th/13th March 'One in a Million: the Individual at the Heart of Quality Control' to the annual conference of the British Educational Research Association, Nottingham September 'The Study of Non-Teacher Professionals in School Curriculum', to the Annual Conference of the American Educational Research Association Boston April 'As You Like It: Case Study Evaluation for the Arts' to the International Society of Music Educators Seminar, Oslo August SSH Evaluation Unit Membership Database 1985 1982 1982 1980 1979 1977 1977 'The Politicisation of Fieldwork Relations' to the SSRC 'Qualitative Methodology and the Study of Education' Workshop Whitelands College, London September . with T. Logan 'Street Riots on School Doorsteps: the destabilised social context of English Schooling' to the annual conference of the American Educational Research Association New York April . with T. Logan 'Inside the Processing Problem: Managing Complexity and Ambiguity in the processing of Naturalistic Data' to the Comparative and International Education Society annual conference New York March . with N. Norris 'Innovation, Social Change and Sensuality' to the annual conference of the American Educational Research Association Boston April . 'The Study of School Transition Through Case Study' to the annual conference of the British Educational Research Association BERA, Shoreditch College, September . 'A Grounded Epistemology: the political realisation of social research' to the annual conference of the British Educational Research Association at Nottingham University, September 'The Assertive School' to the Admissions to Higher Education Conference organised by the Careers Research Advisory Centre, Bulmershe College, Reading, April Book Reviews 2000 1999 1990 1990 Review of Evaluating Creativity: making and learning by young people, J. Sefton-Green & R. Sinker (Eds), London: Routledge in Cambridge Journal of Education, 30: 3, pp.445447 Review of On Bullfighting, A.L. Kennedy, London: Yellow Jersey Press (1999) in British Educational Research Journal, 27: 5, pp.665-666 Review of The Drama of Schooling: the Schooling of Drama, R.J. Starrat (1990), Falmer Press (London) in Journal of Curriculum Studies, 1991 Vol. 23, No.2 pp.201-2 Review of Evaluation as Policymaking, M.Granheim, M. Kogan & U. Lundgren (Eds) (1990), Jessica Kingsley Pubs (London) in Educational Review Vol. 44 No.1 (1992) p.98 Publications