LE_PH_PUB_05.12.01 The Strengths and Limitations of Case Study Research Phil Hodkinson and Heather Hodkinson University of Leeds Paper presented to the Learning and Skills Development Agency conference Making an Impact on Policy and Practice Cambridge, 5-7 December 2001 Correspondence: Phil Hodkinson School of Continuing Education University of Leeds LEEDS, LS2 9JT UK Heather Hodkinson School of Continuing Education University of Leeds LEEDS, LS2 9JT UK Tel: (0) 113 233 3223 Email: p.m.hodkinson@leeds.ac.uk (0) 113 233 3598 h.d.hodkinson@leeds.ac.uk 1 LE_PH_PUB_05.12.01 Introduction In the current educational climate, there is considerable pressure from a variety of sources to develop and emphasize scientific approaches to researching educational practice. Thus, Reynolds (1998) called for a science of teaching, and the evidence-based practice movement appears to regard the ideal form of research as the experiment, or randomized controlled trial (Oakley, 2000). The search is on to discover significant truths about teaching and learning that are ‘safe’ to share with practitioners, and generalisable across all relevant settings. This dominant approach raises older doubts about the value of qualitative case study research. It is argued that such studies cannot be generalised from, and are unlikely to produce findings that have predictive value. Yet a significant proportion of the better recent research in the learning and skills sector has taken the form of small scale investigations. In addition to our own work, of which more below, there are, for example, studies of sample FE colleges (Ainley and Bailey, 1997; Gleeson and Shain, 1999; Shain and Gleeson, 1999) of workplace learning (Lave and Wenger, 1991; Engestrom, 2001) youth training (Lee et al., 1990) and transitions from school to further education, training, employment unemployment etc (Ball et al, 2000). Furthermore, for many researchers based within the learning and skills sector, small scale case study work is one of few types of research that is viable, with the limited resources available. So in this apparently paradoxical context, what is the place and value of case study research? In particular, why have we chosen to conduct two different case study investigations into learning and teaching, within the Economic and Social Research Council’s (ESRC) Teaching and Learning Research Programme (TLRP)? One of these studies, conducted by both of us, focuses on the significance of school and departmental cultures in school teachers’ learning. The other, where Phil Hodkinson is working with others focuses on Transforming Learning Cultures in Further Education. We will say a little more about each of these, later. This paper is not concerned either with how to conduct case studies effectively (see Stake, 1995, Yin 1994), or with presenting a details analysis of the literature that addresses this complex question (See Gomm, et al., 2000). Rather, we draw upon our own past and current research investigations to examine the strengths of case study research, and then the limitations. We then address directly the problematic question about the extent to which more generalized lessons can be learned from idiosyncratic case study research. We conclude by arguing that case studies are a valuable means of researching the learning and skills sector but that, as with all research, interpreting case study reports requires care and understanding. The Strengths of Case Studies In identifying some of the strengths of case study research, we have focussed our analysis around six themes. In what follows, we address each of them separately. 2 LE_PH_PUB_05.12.01 1) They can help us understand complex inter-relationships One of the inherent characteristics of case studies, is that they operate with a severely restricted focus. One of the prime reasons for so restricting the scope of the research, is that it facilitates the construction of detailed, in depth understanding of what is to be studied, be it an FE college, a particular learning site, or even the career of an individual learner or worker. Furthermore, because of the depth that is possible, case studies can engage with complexity. We illustrate this point by drawing upon a case study investigation we conducted into a fairly short-lived variation on youth training in the UK, originally called ‘Training Credits’ (Hodkinson et al., 1996). The essence of this scheme was the use of vouchers, intended to give trainees, working with their employers, control over their own training programmes, by purchasing the training that they needed. When this scheme was introduced, it was immediately apparent that it depended on the mutual cooperation of a fairly large number of people and organisations whom we termed ‘stakeholders’. These included the trainees, their employers, their training providers, their parents, and the careers officers and teachers who helped them enter the scheme. The national evaluation of the scheme (Sims and Stoney, 1993) examined the perspectives and experiences of some of these major groups, such as trainees, employers and training providers. But, because of the need for national coverage and for fairly large samples, there was no way, in their data, of examining the complex interrelationships between these different players. Instead of that broad brush type of approach, we focussed upon the experiences of 12, eventually dropping to 10, trainees, all working within one of the pilot schemes. Because of the small number, we were able to follow the trainees over an eighteen month period, and to interview the various stakeholders with whom they actually came into contact. This gave us the opportunity to examine the complexity of the interrelationships between these different stakeholders, not only with each other, but also with the varying contexts within which the scheme was situated. These contexts included the local (home, place of work, place of training) but also wider issues of gender and social class, and of the contemporary policy climate for youth training, with its emphasis on marketised approaches. As well as revealing that different types of stakeholder had different needs and interests, this allowed us to go on and see how those differences impacted upon the progress of the individual trainees they were engaged with. In order to emphasize this particular strength of the approach, one of the dominant methods we adopted in writing up the research was to present multi-faceted stories of aspects of the trainees’ progress (Hodkinson et al., 1996). 2) Case Studies are grounded in “lived reality” It is an truism that all social research simplifies the phenomena investigated. However, case studies can do this in ways that strongly relate to the experiences of individuals, 3 LE_PH_PUB_05.12.01 small groups, or organizations. They retain more of the “noise” of real life than many other types of research. Indeed, other forms of research, such as the experiment or a carefully structured questionnaire survey, base their success on the ability to exclude such noise, and focus precisely upon the particular phenomenon or possible causal relationship that is to be investigated. There are good reasons for doing much research in this way, but an unavoidable problem with it is that in some circumstances, the excluded noise may be a highly significant part of the story. This particular facet of case study research brings it closer to the experiences of teachers and trainers than is possible with some other forms of research. For teachers always work with ‘noise’. Their contexts and conditions are always complex. Just like case study researchers, they cannot exclude unwanted variables, some of which may only have real significance for one of their students. In our study of teacher training, this enabled us to explore the significance of micropolitics in the progress of some students. We had not anticipated this in drawing up the research. Furthermore, despite the fact that there is an established literature on the significance of micro-politics in teaching, there was nothing else that examined this particular topic in relation to initial teacher training. Yet, during the first of two school experiences for a student called Luke, it was difficult relationships firstly between the PE department where he was working and the deputy head in the school who was in charge of the students, and secondly between both of these and the university organising the school experience, which proved to be significant factors in his progress (Hodkinson and Hodkinson, 1997). To cut a long story short, his final report was partly contradictory, and the student and the PE staff felt it was very unfair to him. Because we had interviewed all the significant players in this story before the crisis materialized, we were able to revisit our data and construct a feasible interpretation of what went wrong, and why. In other words, we could represent some of the real lived experience of Luke’s teaching practice, in order to examine the significance of what, at the outset, might have been termed background noise. In passing, it is worth pointing out that having prior data was especially important. When conflicts like this arise, it is human nature to reconstruct the past, partly to justify the position a person has adopted. This often makes it very difficult to get close to any real sense of what happened, or why. Admittedly with hindsight, we were able to track back through our data, and identify pointers to the root causes of the problem. None of the other students in our study had that particular problem, and without the detail of our case study approach, Luke’s report might just have seemed like evidence of a poor teaching practice or, alternatively, a poorly constructed report. Based upon our data, we would argue that it represented much more than either of these things. His story then alerted us to look for micro-politics in the experiences of other students, where its manifestations were often more subtle. Eventually, we went on to see micro-politics as a small part of a much larger issue, about the significance of the school culture where entrants to the teaching profession were trained (Hodkinson and Hodkinson, 1999). This, in turn, led to the focus of our current project examining the cultural dimensions of school teachers’ learning, as part of the TLRP. 4 LE_PH_PUB_05.12.01 3) Case studies facilitate the exploration of the unexpected and unusual Because of (1) and (2), case study research can throw up significant issues that were unexpected when the research commenced. One example of this, Luke’s story, has already been alluded to, but our work contains other significant examples. For example, in the Training Credits study we had not been intending to focus on the career decision making process, but it surfaced as a significant issue. The particular scheme that we were investigating was constructed around some complex action planning procedures. Early in our data-gathering process, two things became apparent. Not only were these procedures hardly being used in the scheme at all, but the ways in which decisions were made about work placements and training programmes bore very little relationship to the scheme’s assumptions about what would happen. Consequently, we refocused our investigation to examine the ways in which these sorts of decision were actually made. This refocusing took two forms. Firstly, as with Luke’s story, we revisited data that we had already collected, in order to see what the inter-related perceptions and experiences of our different stakeholders could tell us about this issue. Secondly, as this was a longitudinal study, we were able to ask about aspects of the process more explicitly, in the later rounds of data collection. Case study investigations also permit the examination of the exceptional, as well as the typical. Such cases are often excluded from other forms of investigation, which concentrate upon common patterns and themes in the data. But unusual stories can be valuable, in at least two ways. Firstly, the practice of teaching has to engage, on a regular basis, with ‘non-standard’ students and trainees. It is of very little help to a practitioner if research says that ‘normally, this type of student will want/do x’, if they are faced with an individual, apparently of that type, who wants/does ‘y’. Secondly, examining the exceptional case can itself throw valuable light on the nature of more normal processes. A case study that Phil Hodkinson conducted with Martin Bloomer illustrates both these benefits. They followed about 50 16-year old school pupils into, through and out of FE (Bloomer and Hodkinson, 1997, 1999), interviewing each of them twice a year, for at least three years. We know, from other research, that one of the best predictors of academic success in FE is the prior educational achievement of a student, linked to the equally well documented benefits of a middle class background (e.g. Roberts, 1993; Banks et al., 1992). For many of our subjects, this pattern was clearly demonstrated. But Daniel was different. His middle class background gave him an abiding interest in learning for its own sake, and a sense of inner self-confidence that things would be alright. He treated his A levels studies as a journey of personal exploration. He had no interest in passing exams, and for most of his time in FE, did little assessed work. As a result, he dropped out midway through the second year of his A level programme. We were able to use his story, with those of others, in two ways. Firstly, in constructing our conceptual model of learning careers, we were able to check that our thinking could account for exceptional cases, like him, as well as the more standard and predictable stories of others in our sample, though we chose to write about this conceptualisation using a different story, that of Amanda (Bloomer and Hodkinson, 2000). Secondly, when we placed this unusual 5 LE_PH_PUB_05.12.01 story alongside those of other students who had dropped out, we discovered that there were more similarities between them than we expected, even though all of the other drop outs were of working class origin, and some faced real personal hardships that Daniel did not. This analysis of dropping out, based on the detailed stories of all the seven students in our study who had dropped out, revealed significant problems with current policy approaches to dropping out of FE. For in Daniel’s and the other cases, the decision to drop out derived as much from outside the college as within it, and many of the key factors involved lay outside the knowledge and control of the teachers, who were being judged partly by the retention rates of their courses (Hodkinson and Bloomer, 2001). 4) Multiple case studies can enable research to focus on the significance of the idiosyncratic Our use of Daniel’s unusual story partially illustrates this next example of using case study approaches. For comparing different cases, be they of individuals, groups or organisations, can illuminate the significance of the idiosyncratic as opposed to the common, or shared experience. This is one of the prime reasons for the approach adopted within our two TLRP projects. In the one focussed upon school teachers’ learning, which is relatively small, we are researching teachers in four different departments, in two different schools. This is enabling us to identify features that appear to be common to all four departments, and those which are significantly different. Fieldwork on this project is about halfway through, and already some tentative observations can be made. As we expected, based upon our own prior research and that of others (see Harris, 2001 for a summary) it is already clear that the department is a highly significant point of identity for most of the teachers we are working with. On the other hand, the four departments work in different ways. For example, two of them are charcterised by strong team working with a close and supportive professional grouping. The other two departments are more dispersed in character, for example with teachers spending more time in the staff-room than the departmental spaces, and with a higher proportion of departmental discussion being in formal meetings and memos. Harris (2001) cites teamwork as one of the key characteristics of effective school departments. However, our case study approach reveals that things are more complicated than that. For the more fragmented departments in our sample are also very successful, but the teachers adopt subtly different methods of advancing their own learning and their own practices. In the Transforming Cultures in FE project, fieldwork has only just begun, so we have no findings to share. However, this project has taken full advantage of the unprecedented levels of research funding available within the TLRP, to focus on 16 detailed longitudinal case studies of teaching and learning in four FE colleges. Each single case focuses on the student and teacher interactions in one teaching site, be it a classroom, workshop, open learning centre, or whatever. Each of these case studies will be rich and detailed enough to be a research project on its own. We have deliberately selected the 16 sites to 6 LE_PH_PUB_05.12.01 encompass a wide variety of settings, student groups, and subject matter. The project will focus not only upon how students learn and teachers teach in those sites, but also on ways in which the research process can aid the on-going transformation of the learning cultures in each site. By the end of the project, this should enable us to clearly identify issues and approaches, which are common across all or most sites, and those that differ significantly. In other words, the project will help identify the extent to which broadly generalised approaches to teaching and learning in FE are valid, or, put another way, the extent to which the idiosyncratic contexts of each site is what really matters. 5) Case studies can show the processes involved in causal relationships Most conventional studies of causal relationships are based upon statistical correlation. The depth and complexity of case study data can illuminate the ways in which such correlated factors influence each other. Our earlier work on the Training Credits project, linked with the Bloomer and Hodkinson study of FE students, illustrate this point very well. We have already alluded to a significant amount of research and policy literature that demonstrates the close links between qualification achievement, at 16 and 18, with future careers. Those with better qualifications are more likely to get jobs, and to get better jobs, often with better pay. The assumption in many of these studies is that this relationship is causal: that higher qualifications cause people to get better jobs. It is this relationship, amongst other things, that has resulted in such a policy focus on retention and achievement as measure of success in the learning and skills sector (see, for example, Social Exclusion Unit, 1999). This is linked with the parallel assumption that the way to increase the number of young people who achieve these desirable qualifications is through a combination of better guidance and better teaching. This policy approach makes three largely implicit assumptions that our detailed case study data challenges. The first is that young people make largely rational decisions about future careers, and about which course to choose. If this were true, then guidance could indeed help ensure a better fit between what students need and what they eventually choose, by giving them relevant information and by enhancing their decision making. Data from both our studies shows this not to be the case. Young people make pragmatically rational decisions, which are strongly influenced by the social, cultural and economic contexts in which they live their lives. The second assumption is that students’ progress through education and into a job is normally and ideally a matter of simple, linear progression. In other words, it assumes that they do not change significantly as people, or change their career intentions, as their post-16 education progresses. The data from the study with Bloomer shows that, on the contrary, most of our sample of young people changed significantly during their 16 to 19 education, so that what they wanted towards the end, was very different from what they wanted at the beginning. The third assumption we have already encountered, for both studies demonstrate that many of the most significant factors in the learning careers of the young people we studied lay outside the actual place of learning. This was clearer in the case of the FE 7 LE_PH_PUB_05.12.01 study, as had been seen in relation to dropping out. In the Training Credits study, things worked rather differently. For most of these trainees, the place of work was the prime location for their training, but two tensions were apparent. In the workplace, the needs of the job often took priority over learning needs. For example, one trainee, working in a stables, had planned learning activities frequently cancelled, as the need to work with customers took priority. Also, doing the job at work often took precedence over off the job training. Finally, for these trainees, progression to work depended primarily on the decisions made by others (employers), and these were very rarely influenced by qualification achievement. Consequently, our researches would suggest that the links between qualification achievement and future career are complex, and work in different ways for different people, and in different contexts. This does not mean that the other research is wrong, but it does point to different ways of understanding any causal relationships involved, and identifies possible flaws in current policy approaches to these issues. 6) Case studies can facilitate rich conceptual/theoretical development A combination of the other five factors means that case studies are fertile grounds for conceptual and theoretical development. Existing theories can be brought up against complex realities, and the very richness of the data can help generate new thinking and new ideas. Though thick description can be valuable in its own right, case study research really demonstrates its relevance when such new or modified thinking takes place. In the Training Credits study, we developed a new theory of career decision making. In the teacher training study, we developed a clearer understanding as to why school-based practice was often at odds with the expectations of university-based educators, even though they had been very experienced teachers. The study with Bloomer developed the concept of ‘learning career’. In the current study of teachers’ learning, our conceptual development is at an early stage, but elsewhere in this conference we have outlines some of our early thinking (Hodkinson and Hodkinson, 2001). Teacher learning, we have suggested, involves the complex interrelationship between individual careers and dispositions to learning, the cultures of school and department, and the broader social, economic, political and above all, policy contexts in which teachers are currently working and have worked in the past. Limitations of Case Studies In order to balance this account, it is necessary to examine, if more briefly, some of the limitations of case study research. 1) There is too much data for easy analysis. All case study researchers are conscious of being swamped in data. For example, our Training Credits study generated 198 taped interviews. However such data is analysed, which is itself a contentious issue (Colley and Diment, 2001), much has to be omitted. 8 LE_PH_PUB_05.12.01 Anyone who reads Triumphs and Tears (Hodkinson et al., 1996) will notice that some trainees’ stories are given more detail than others. Furthermore, even the most detailed of those stories is a significant simplification of what we were told. In other publications from that study (e.g. Hodkinson and Sparkes, 1994) we chose not to tell individual stories at all, but rather to analyse issues across the stories. This is probably a more conventional approach, but the problem still remains. We only drew on quotes from a small number of trainees and their stakeholders, and took those out of the context of the stories of which the data was part. Much of what we found in that and subsequent studies has never been published. It is quite possible, indeed likely, that a revisiting of the data would reveal other issues and aspects that Training Credits scheme that are at least as interesting and important as those we chose to analyse and write about. 2) Very expensive, if attempted on a large scale Case study data is time-consuming to collect, and even more time-consuming to analyse. Yet cutting corners on either of these facets is likely to seriously weaken the value and credibility of any findings produced. This means that large or multiple case studies can be very expensive. The TLC project, for example, has an overall budget in excess of £800,000. Furthermore, there is often a reluctance to fund such large scale work, for some of the reasons explored below. On the other hand, some forms of small case study investigation can be quite cheap. Even for those days, the £45,000 spent on the Training Credits study is not large, by research project standards. Also, for practitioners trying to conduct their own small scale action research investigations, a case study of, for example, one group that they teach, is manageable, and can give valuable data. 3) The complexity examined is difficult to represent simply When case studies are successful in revealing some of the complexities of social or educational situations, there is often a problem of representation. If is often difficult to present accessible and realistic pictures of that complexity in writing. For instance, writing is predominantly a linear form of communication, with a beginning, middle and end, but much of what case study research reveals is simply not like that. Often, by writing about one aspect of the issue as, for example, in one person’s story, other aspects of it are unintentionally concealed. There are often several different ways to present the same set of issues, each one of which is subtly different in its approach and emphasis. This situation can make the findings of such research very difficult to summarise. 4) They do not lend themselves to numerical representation Some aspects of case study work can be fairly easily presented in numerical form, but much cannot. Some examples will illustrate the point. In the FE study conducted with Martin Bloomer, the actual sample size varied slightly from year to year. We started with more students than we finished with, we lost sight of some, or decided not to follow others. In some sweeps, particular students could not be contacted, in one case, for 9 LE_PH_PUB_05.12.01 example, because of illness. Consequently, it is difficult to express even the sample size of that study in simple numerical form. Presenting much of the findings of such studies in numerical form is even more problematic. For example, in the Training Credits study we argued that our sample trainees made decisions using pragmatic rationality. But if we try to look beneath that umbrella term, and analyse the extent to which students met one or other of the characteristics by which we identified that concept, two problems surface. Firstly, those characteristics make little sense separated out from the whole concept, so that it is difficult to express, for example, how many of our sample were using information from friends and relatives to make their decisions. Furthermore, identifying clear boundaries around an issue such as ‘did or did not use information from friends and relatives’ is difficult. At one extreme, we have clear examples where some of them talk about the sorts of information they got. For example, one of them was told about a job vacancy by his step-father, who worked in the firm concerned. Indeed, that step-father actually negotiated with the firm, to get him the placement. Others talked more generally about discussing possible careers with someone they knew. For these sorts of reason, we often used phrases like ‘most of our sample …..’ or ‘many of our sample …’. This lack of precision is regarded as a serious weakness by many other researchers. Finally, for the most important issues we were examining, attempts to break down data into numerical categories undermined the essential richness of the interrelationships we were interested in. In this respect, as others, the very strengths of case study research, described above, are the cause of this inability to count effectively. 5) They are not generalisable in the conventional sense By definition, case studies can make no claims to be typical. We have no way of knowing, empirically, to what extent our four secondary school departments are similar or different from other such departments in schools all over England. Furthermore, because the sample is small and idiosyncratic, and because data is predominantly nonnumerical, there is no way to establish the probability that data is representative of some larger population. For many researchers and others, this renders any case study findings as of little value. 6) They are strongest when researcher expertise and intuition are maximised, but this raises doubts about their “objectivity” For a combination of reasons that have been addressed elsewhere in this paper, researcher expertise, knowledge and intuition is a vital part of the case study approach. We have to choose what questions to ask, and how to ask them, what to observe and what to record. We have to draw out issues of interest from the data, and construct stories about those issues and/or people. In our research, we have decided how to present individual stories: what data and issues to include and focus on, and what to exclude. In this way, case study researchers are constantly making judgments about the significance of the data. 10 LE_PH_PUB_05.12.01 For these reasons, a key determinant of the quality of a piece of case study research is the quality of the insights and thinking brought to bear by the particular researcher. When you read our publications, you are accessing our construction of the data around issues we judge to be important. No matter how rigorous we strive to be, this means that the research is not, and cannot be, completely objective, nor can we easily make transparent all the judgements we have made. Like all good researchers, we try to present adequate evidence, from the data, to support the stories we tell, but a certain amount has to be taken on trust. For some researchers, this makes work like ours highly dubious, especially when combined with others of the limitations already listed. 7) They are easy to dismiss, by those who do not like the messages that they contain Quite apart from the sorts of weakness that are often found in case study research, there is a further problem if they present issues or findings that are unpopular, for example with policy makers or managers. Those who do not like what case study researchers write, can easily find reasons to dismiss those findings: the sample was too small; it’s not like that elsewhere; the researchers were biased, etc. The sorts of research based on large representative samples, with apparently clear, unambiguous findings, are much less easy to resist. 8) They cannot answer a large number of relevant and appropriate research questions Despite the small amount of space given to it, this reservation is arguably the most important of them all. Case studies are neither ubiquitous nor a universal panacea. There are very many important research questions that cannot be answered in this way. How Can Case Study Findings be “Generalised”? Despite the fact that they cannot be representative, case studies can provide more than simply idiosyncratic understanding. We prefer not to think of this as ‘generalisation’, because of the connotations of that term for statistically significant large scale surveys. Rather, the issue is what case studies can tell us about situations beyond the actual case that was studied. Good case studies, we would claim, can do that in a number of ways. 1) Theory can be transposed beyond the original sites of study Where case studies generate new thinking, that thinking has a validity that does not entirely depend upon the cases from which it is drawn. Our theory of career decision making can be judged in other contexts, and other settings. It has already been used on two other studies (one by Bloomer and Hodkinson, already described, and one by Ball, et al., 2000). It can also be compared with and judged against other rival theories of career development and career decision making, elsewhere in the literature. It is much, much more than ‘the story of 10 trainees’. 11 LE_PH_PUB_05.12.01 2) Findings can ‘ring true’ in other settings Readers of case study research can judge whether or not the analysis presented sounds convincing, based upon what they know of similar situations and circumstances. In our experience, many professionals can empathise with our studies, because they recognise the sorts of situation that we describe. They seem less relevant/attractive to policy makers and some managers, perhaps because they reveal some of the over-simplifications upon which some policies and managerial practices are based. 3) Case Studies can provide provisional truths, in a Popperian sense We would argue that our career decision-making theory establishes a provisional truth, even though it was based on the experiences of 10 young people, all white and all on a youth training programme. It is arguably the best account of such decision making in the current literature, and should stand, until contradictory findings or better theorising has been developed. The latter is beginning to happen, for example in the Ball et. al. (2000) study. However, the theorising is not widely known or recognised in the career guidance and counselling field. The reasons for this are fascinating, but do not relate to the case study origins. Conclusion In rounding off this brief analysis of some of the strengths and weaknesses of case study research, we would wish to make two fairly obvious points, one of which has some complex implications. Firstly, we would argue strongly for the continuing place of case study research, alongside many other types of research and approaches to it. Secondly, and more controversially, we would argue that there is no simple check list of criteria, against which the validity and/or quality of a piece of case study research can be judged. If common tests of objectivity , sample size, clear numerical categories and generalisability are applied, many case studies will fail, almost by definition. Rather, judging the worth of case study research demands some understanding and careful thinking by the reader. Do the stories told ‘ring true’? Do they seem well supported by evidence and argument? Does the study tell us something new and/or different, that is of value in some sort of way? Is any theorising better or more valuable than alternative models? These and many other questions can and should be asked of any case study that is read. Ideally, they should be asked from a position of some prior understanding: of the topic being investigated, and/or of the strengths and limitations of the methods and approaches used. With regard to the learning and skills field, this paper attempts to aid that latter type of understanding. References AINLEY, P. & BAILEY, B. (1997) The Business of Learning: Staff and Student Experiences of Further Education in the 1990s. London: Cassell. 12 LE_PH_PUB_05.12.01 BALL, S, MAGUIRE, M. and MACRAE, S. (2000) Choice, Pathways and Transitions Post-16 (London: Routledge/Falmer). BANKS, M., BATES, I., BREAKWELL, G., BYNNER, J., ELMER, N., JAMIESON, L., and ROBERTS, K. (1992) Careers and Identities: Adolescent attitudes to employment, training and education, their home life, leisure and politics (Milton Keynes, Open University Press). BLOOMER, M. and HODKINSON, P. (1997) Moving into FE: the voice of the learner (London: FEDA). BLOOMER. M. and HODKINSON. P. (1999) College Life: the voice of the learner (London: FEDA). BLOOMER, M. & HODKINSON, P. (2000), Learning Careers: Continuity and Change in Young People’s Dispositions to Learning, British Journal of Educational Studies, 26 (5) 583 - 598. COLLEY, H. and DIMENT, K. (2001) Holistic Research for holistic practice: making sense of qualitative research data. Paper presented at the Learning and Skills Development Agency Conference, Research: Making an Impact on Policy and Practice. Cambridge, 5-7 December ENGESTROM, Y. (2001) Expansive Learning at Work: towards an activity-theoretical reconceptualisation, Journal of Education and Work, 14 (1) 133 – 156. GLEESON, D and SHAIN, F. (1999) Managing ambiguity: between markets and managerialism – a case study of ‘middle’ managers in further education’, Sociological Review, 47 (3) 461 – 490. GOMM, R, HAMMERSLEY, M. and FOSTER, P. (eds) (2000) Case Study Method (London, Sage). HARRIS, A. (2001) Departmental Improvement and School Improvement: a missing link? British Educational Research Journal, 27 (4) 477-486. HODKINSON, H. and HODKINSON, P. (1997) Micro-politics in Initial Teacher Education: Luke's Story Journal of Education for Teaching, 23 (2) 119-129. HODKINSON, H. and HODKINSON, P.(2001) Problems of measuring learning and attainment in the workplace: complexity,reflexivity and the localised nature of understanding. Paper presented to the international workshop Context, power and perspective:confronting the challenges to improving attainment in learning at work. Northampton, 8-10 November. HODKINSON, H. and HODKINSON, P. (1999) Teaching to Learn, Learning to Teach? School-based non teaching activity in an initial teacher education and training partnership scheme, Teaching and Teacher Education, 15, 273 - 285. HODKINSON, H. and HODKINSON, P. (2001) Individuals, cultures & types of learning: a study of teachers learning in their workplaces. Paper for the Learning and Skills Development Agency Conference, Research, Making an Impact on Policy and Practice. Cambridge, December. HODKINSON, P. and BLOOMER, M. (2001) Dropping Out of Further Education: complex causes and simplistic policy assumptions, Research Papers in Education, 16 (2) 117-140. HODKINSON, P. and SPARKES, A.C. (1994) 'The Myth of the Market: the negotiation of training in a youth credits pilot scheme British Journal of Education and Work. 7 (3) 2-20. 13 LE_PH_PUB_05.12.01 HODKINSON, P., SPARKES, A.C. and HODKINSON, H. (1996) Triumphs and Tears: Young People, Markets and the Transition from School to Work (London: David Fulton). LAVE, J. and WENGER, E. (1991) Situated Learning, Cambridge: Cambridge University Press. LEE, D., MARSDEN, D., RICKMAN, P. and DUNCOMBE, J. (1990) Scheming for Youth: A study of YTS in the Enterprise Culture (Milton Keynes: Open University Press). OAKLEY, Ann (2000) Experiments in Knowing: gender and method in the social sciences, London, Polity Press. REYNOLDS, D. (1998) Teacher Effectiveness: better teachers, better schools, Teacher Training Agency Annual Lecture, reprinted in Research Intelligence, 66, Oct., 26-29. ROBERTS K (1993) "Career Trajectories and the Mirage of Increased Social Mobility" in I Bates and G Riseborough (eds) Youth and Inequality (Buckingham, Open University Press). SHAIN, F. and GLEESON, D. (1999) Under new management: changing conceptions of teacher professionalism and policy in the further education sector, Journal of Education Policy, 14 (4) 445 – 462. SIMS, D. and STONEY, S. (1993) Evaluation of the Second Year of Training Credits (Slough: NFER) SOCIAL EXCLUSION UNIT (1999) Bridging the Gap: New Opportunities for 16-18 year Olds Not in Education, Employment or Training. London: Stationary Office. STAKE, R. (1995) The Art of Case Study Research (London: Sage). YIN, R.K. (1994) Case Study Research: design and methods. 2nd. Edition. (London, Sage). 14