SESSION 2007/2008 SCHOOL OF HUMANITIES DEPARTMENT OF SOCIOLOGY, CRIMINOLOGY AND CULTURAL STUDIES Combined Course Handbook for Research Issues and Methods And Dissertation LEVEL M CODE: RESE 1001 UNIT CO-ORDINATORS: Thomas Acton and Terry Cannon 1 Research Issues and Methods RESE 1001 Handbook 2007-8 Contents Inside front cover The Harvard Referencing Format Course Specification 3 Assessment details 4 Lecture List, and a note on reading 5 Reading Lists 6 Lecture Notes Measurement, Meaning and bias, Research and the Dissertation 10 Lecture Notes: What techniques and topics might be covered in a Methods course: Looking for significance: Sampling and Probability; 11 Lecture Notes: Creating a Research Topic Template 14 Assessment Exercises: General Guidance 15 Lecture Notes Descriptive statistics and Measures of Association; Correlation, Chi-Square, parametric and non-parametric tests 17 Lab session on SPSS 24 Lecture Notes: Interview Surveys 26 Lecture Notes Observation: Participant and non-participant 27 Lecture Notes The Literature Review 29 Lecture Notes: The Analysis of texts 31 Lecture Notes Evaluation, Ethics, Access and Dissemination 33 Assessment Requirement: Research Ethics Form 36 Dissertation Guidelines 37 2 COURSE SPECIFICATION COURSE SUBJ CODE: RESE 1001 SCHOOL: Humanities Course Title: Research Issues & Methods Effective Term: 1 Course Co-ordinators: Thomas Acton and Terry Cannon General Level: PG Specific Level: M Credit: 15 University Subject Group: Humanities Specific Entry Requirements: None Introduction and Rationale: To conduct research of a high standard it is necessary to plan and design the study and surveys carefully. The research methodology should be informed by relevant theoretical and empirical knowledge. It needs to set clear objectives that will achieve the overall aim of the research and choose the appropriate tools of quantitative and qualitative analysis. Analysis, interpretation and presentation of data should reflect the logic running through the research exercise. Empirical issues and theoretical knowledge relevant to this programme will provide the context within which discussions of methodologies and principles of research will be undertaken. Additionally, special emphasis will be given to issues of collaborative and action research so that students are equipped to undertake the research and analysis at their place of work in relation to a ‘real’ problem. Aims: The course aims to: engender the need for careful planning of a project, including the need for clear researchable objectives; critically compare the different methods for collecting different types of information required, including surveys and participatory methods; demonstrate that the context of the available data should be carefully studied before use and application of data; examine criteria that determine the choice of research methodologies; and demonstrate that analysis, interpretation and presentation are linked and together contribute to the quality of research. Learning Outcomes: On successful completion of the course, the student will be able to analyse a research need and set out researchable objectives; select appropriate research methods; design, plan and execute a research study or appraisals; appreciate the issues related to collaborative and action research; critically assess the bases of available data before use of, and interpretation of that data; collect and manage data; analyse and interpret results; and prepare presentation and reports of research work. Indicative Content: Summary statistics and graphical methods Design of surveys and sampling schemes. Rapid Participatory Appraisals in relation to rural, urban and environmental issues. Data collection, storage and retrieval. Methods of qualitative and quantitative analysis. Report writing and presentation. Main Learning and Teaching Activities: Lectures and practical classes will be given in the principles of research and survey design. Lectures and role play will be used to teach methodologies in participatory appraisal. Instructions will be provided in the use of computer software for storage and retrieval of data. Assessment is by a portfolio of activities that encourage students to engage in research activities that are essential to the preparation of a good proposal. Each task contributes to the formation of a research proposal, which is not given a grade, but receives comments from the tutor concerned and the provisional supervisor. 3 Assessment Details: Methods of Assessment Portfolio Contents Weighting Pass Mark Maximum Word Length 20% 40% 3000 RESEARCH Research topic template Literature and resources search 30% 40% PROPOSAL to include research question, statement of purpose, literature survey, statement of methodology Template covering statement of research question or hypothesis, stakeholder analysis, issues and conflicts involved, data sources Preliminary search and. commentary on material relevant to topic. Demonstrates use of Harvard referencing. Research Ethics form Complete an acceptable standard research ethics form. Compulsory and must achieve a pass level. Case study 1 25% 40% 1000 Case study 2 25% 40% 1000 CASE STUDIES Outline Details Reflective analysis of material from the British Household Panel Survey of 1991. Reflective analysis of journal article or chapter relevant to dissertation topic Deadlines: A. SUMMATIVE The Summative Deadline is for a Portfolio containing all of the above, to be handed to registry with the headersheet firmly attached to it before 4pm on Friday 25th January. BUT if you don’t show us anything before then you are not likely to do very well. B. FORMATIVE For guidance on how to do these assessments, see p.15. Give drafts of individual pieces of work directly to Thomas Acton for formative assessment by the following dates if at all possible. Note – these pieces are not in order – you don’t finish one before starting the next. We will be working on all of them at once from the beginning of the course. Do hand them in sooner if you wish, and the later you hand them in, the less effective feedback will be: Research Topic Template: 2nd November Case Study One: 30th November Case Study Two: 30th November Literature Search 7th December Research Ethics Forms 7th December Overall Research Proposal 14th December 4 LECTURE LIST 5th October T.Acton Measurement, Meaning and bias, Research and the Dissertation 12th October T.Acton What techniques and topics might be covered in a Methods course: Looking for significance: Sampling and Probability 19th October T.Acton + T.Cannon (from 11.15) Creating a Research Topic Template: Moving towards a Research Proposal 26th October; Descriptive statistics and Measures of Association; Correlation, Chi-Square, parametric and non-parametric tests 2nd November 10.00 T.Acton, Workshop, 11.00 T.Cannon Graphs, Mapping, Correlation and Spatial Analysis 9th November T.Acton Lab session on SPSS in Lab. D230 (in the library) 16th November T.Acton Interview Surveys 23rd November T.Acton Observation: Participant and non-participant 30th November T.Acton The Literature Review 7th December T.Acton Analysis of Texts 14th December T.Acton Evaluation, Ethics, Access and Dissemination A note on Reading Many of the books listed in the reading list on the following pages are text books which cover most of the topics we look at, and duplicate each other; others are specialist discussions of particular topics. For your own reference it is often worth buying one of the “cookbook” type of text-books, that abound both in the library and in bookshops (though we cannot promise they are all in the library - this is one of the biggest growth areas of sociology publishing). Only you can tell which one will suit you best, however, so have a good look at several before you pick one; and make sure you get the latest edition. One compendium of very recent methodological commentary which is targeted very precisely on the concerns of your programme, although it is not a “cookbook”, is: Desai V and Potter R, eds. 2006 Doing Development Research London: Sage 5 READING LIST BY TOPICS 1. Measurement, Meaning and bias , Research and the Dissertation Alford, R.A. 1998 The Craft of Inquiry Oxford: OUP Blaikie, N. 2000, Designing Social Research Cambridge: Polity Burns R.B. 2000 4th Ed. Introduction to Research Methods London: Sage Desai V and Potter R, eds. 2006 Doing Development Research London:Sage Introduction Gilbert N ed 1993 Researching Social Life Sage, London Glaser B. and Strauss A. 1967 The Discovery of Grounded Theory Aldine, Chicago Hage J and Meeker B.F. 1988 Social Causality London, Sage, Chapter 2 Hantrais L & Steen Morgan eds. 1996 Cross National Research Methods in the Social Sciences, Pinter, London Morrow RA & Brown DD 1994 Critical Theory and Methodology Sage, London Roberts H. ed. 1990 Doing Feminist Research Routledge, London Stanfield JH and Rutledge MD, 1993 Race and Ethnicity in Research Methods, Sage, London Shipman M. 1997 4th ed. The Limitations of Social Research Longman, London Chch 1-3 2. What techniques and topics might be covered in a Methods course: Looking for significance: Sampling and Probability; Barnett V. 1991 2nd Ed. Sample Survey Principles and Methods Edward Arnold, London Chapters 1,3 Dale A., Arber, S., Proctor M., 1988 Doing Secondary Analysis Sage, London chapters 1-3. (esp. ch. 3, for Data Protection Act) Denscombe M. 1998 The Good Research Guide Open University Press, Buckingham Chapters 1,6,7 Desai V and Potter R, eds. 2006 Doing Development Research London: Sage, Chapters by Barker, Willis and Lloyd-Evans and Simon Dometrius N C. 1992 Social Statistics using SPSS Harper-Collins, New York chapters 1-2 Flick U.1998 An Introduction to Qualitative Research Sage, London Chapters 4-11 Gilbert M 1992 2nd ed. On Social Facts, Princeton University Press, Princeton Hindess B. 1973 The Use of Official Statistics in Sociology Macmillan, London Hughes J.A. 1976 Sociological Analysis: Methods of Discovery, Nelson, London, Chapters 1-3 Maisel R, and Persell C.H. 1996 How Sampling Works, Pine Forge Press, Thousand Oaks, California Shipman M. 1997 4th ed. The Limitations of Social Research Longman, London Chapters 48 (Part Two) 6 3 Creating a Research Topic Template Frankfort-Nachmias C., & Nachmias D, 1996 Research Methods in Social Sciences, London E. Arnold Bryman A.1998 Quantity and Quality in Social Research, London:Routledge 4. Descriptive statistics and Measures of Association; Correlation, Chi-Square, parametric and non-parametric tests. Barnett V. 1991 2nd Ed. Sample Survey Principles and Methods Edward Arnold, London Ch.2 Corston R. 1992 Research Methods and Statistics in the Social Sciences, Casdec, Birtley Dometrius N C. 1992 Social Statistics using SPSS Harper-Collins, New York chapter 7 Foster, J.J 1993 Starting SPSS/PC+ and SPSS for Windows: A beginner’s guide to data analysis Sigma, Wilmslow Gilbert N ed 1993 Researching Social Life Sage, London chapters 11-13 Kish L. 1987 Statistical Design for Research, Wiley, Chichester Maleske R.T. 1995 Foundations for Gathering and Interpreting Behavioural Data: An Introduction to Statistics Brooks/Cole, Pacific Grove, California Marsh C. 1988 Exploring Data, Polity, Cambridge, Chapters 1-3 Reid S. 1987 Working with Statistics Polity, Cambridge Chapters 1-6 Rose D. & Oriel Johnson 1993 Introducing Data Analysis for Social Scientists chapters 1-6 Corston R. 1992 Research Methods and Statistics in the Social Sciences, Casdec, Birtley Foster, J.J 1993 Starting SPSS/PC+ and SPSS for Windows: A beginner’s guide to data analysis Sigma, Wilmslow Hudson H.C. 1982 Classifying Social Data Jossey-Bass, London Reid S. 1987 Working with Statistics Polity, Cambridge chapter 7 Rose D. & Oriel Johnson 1993 Introducing Data Analysis for Social Scientists chapters 710 5 Graphs, Mapping, Correlation and Statial Analysis Desai V and Potter R, eds. 2006 Doing Development Research London: Chapters by Binns, Mercer, Unwin, Jennings, Conway&Donnelly, Findlay, Mawdsley and Rigg 6 Use of SPSS Corston, Rod & Colman A. 2003 A crash course in SPSS for Windows 2nd Ed. Blackwell, Oxford Field, Andy 2005 Discovering statistics using SPSS : (and sex, drugs and rock'n'roll) 2nd Ed. Sage, London Foster, Jeremy J. 2001 Data analysis using SPSS for Windows versions 8 to 10 : a beginner's guide . – 2nd Ed. Sage, London Johnson, S. 2005 Brilliant Microsoft Excel Harlow: Prentice Hall Kerr, Alistair W., Hall, HK and Ko, S.A. 2002 Doing statistics with SPSS Sage, London Marsh C. 1988 Exploring Data, Polity, Cambridge, Chapters 6 – 11 Reid S. 1987 Working with Statistics Polity, Cambridge Chapters 7-8 7 Rose D. & Oriel Johnson 1993 Introducing Data Analysis for Social Scientists chapters 10-12 7. Interview Surveys Brenner M. Brown J., Canter D. 1985 The Research Interview, Uses and Approaches Academic Press, London Foddy W. 1993 Constructing Questions for Interviews and Questionnaires: Theory and Practice in Social Research Cambridge University Press, Cambridge Gilbert N ed 1993 Researching Social Life Sage, London Chapters 3, 5-8 Marsh C. 1983 The Survey Method: The Contribution of Surveys to Sociological Explanation, Allen and Unwin, London McCracken G.D 1988 The Long Interview Sage, London 8. Observation: Participant and non-participant Bailey C.A. 1996 A Guide to Field Research Pine Forge/Sage, London Bell D.A. et al. 1993 Gendered Fields - Men, Woman and Ethnography Routledge, London Denscombe M. 1998 The Good Research Guide Open University Press, Buckingham Chapters 4,5,8 Desai V and Potter R, eds. 2006 Doing Development Research London: Chapters by Apentik & Parpart, Momsen, van Donge and Beazley & Ennew Gilbert N ed 1993 Researching Social Life Sage, London Chapter 9 Robson S. and Foster A. 1989 Qualitative Research in Action Griffin, London 1989 Silverman D. ed. 1997 Qualitative Research: Theory Method and Practice, Sage, London Warren C.A.B 1988 Gender Issues in Field Research Sage, London 9. The Literature Review Denscombe M. 1998 The Good Research Guide Open University Press, Buckingham Chapter 11 Hart, C. 1998 Doing a Literature Review: Releasing the Social Science Research Imagination Sage, London 10. Analysis of Texts Michael Billig, 1991 Ideology and Opinions: Studies in Rhetorical Psychology, London: Sage, Desai V and Potter R, eds. 2006 Doing Development Research London: Sage, Chapters by Meth & Williams, McIlwaine and Unwin Flick U.1998 An Introduction to Qualitative Research Sage, London chapters 14 - 18 Stuart Hall (ed.), 1997 Representation, Cultural Representation and Signifying Practices, London: Sage Publications and the Open Univrsity, [especially the two papers by Hall] McCracken G.D 1988 The Long Interview Sage, London Miles M.B and Huberman A.M. 1994 2nd Ed. Qualitative Data Analysis Sage, London Silverman D. 1993 Interpreting Qualitative Data: Methods for analysing talk, text and interaction Sage, London 8 11. Evaluation, Ethics, Access and Dissemination Bell J. 1993 2nd Ed. Doing Your Research Project Open University Press, Buckingham Bulmer M. Ed. 1982 Social Research Ethics Macmillan, London Bulmer M et al. 1986 Social Science and Social Policy, Allen and Unwin, London Cherns A. 1979 Using the Social Sciences Routledge and Kegan Oaul, London Denscombe M. 1998 The Good Research Guide Open University Press, Buckingham Chch 9, 12 Desai V and Potter R, eds. 2006 Doing Development Research London: Sage, chapters by Brydon, Harrison, Boas et al, Morse, and Gainsbury & Brown. Edwards A. and Talbot R. 1994 The Hard-Pressed Researcher Longman, Harlow Finch J. 1986 Research and Policy Falmer Press, Brighton Flick U.1998 An Introduction to Qualitative Research Sage, London chapter 6 Gilbert N ed 1993 Researching Social Life Sage, London Chch 4, 16 Gouldner A. 1979 For Sociology Allen Lane, London, 1973 Hakim, C. 1992 2nd Ed. Research design : strategies and choices in the design of social research. Routledge, London. Howe R. 1993 A Student Guide to Research in Social Science, Cambridge, Cambridge University Press Majone G. 1989 Evidence, Argument and Persuasion in the Policy Process Yale University Press, New Haven Miles M.B and Huberman A.M. 1994 2nd Ed. Qualitative Data Analysis Sage, London Chch 11, 12 Müller-Hill B. 1988 Murderous Science, Oxford University Press, Oxford Rose G. 1986 2nd Ed. Deciphering Sociological Research Routledge and Kegan Paul, London Shipman M. 1997 4th ed. The Limitations of Social Research Longman, London Chapters 911 Stern P.C. 1979 Evaluating Social Science Research Oxford University Press, Oxford Weber M. 1949 The Methodology of the Social Sciences Free Press, New York, pp.1-49 Wenger G.C. et al. 1987 The Research Relationship Allen and Unwin, London, 9 LECTURE NOTES Lecture 1. Introduction: Assembling the tools for arguments: Measurement, Meaning and bias , Research and the Dissertation What is a Concept? From thinginess to variables: measurement and Indices The meaning of a variable? The meaning of significance ? – the chance that a result did not occur by chance. Hypotheses and Investigations Hypotheses link at least two concepts, which may have either real or nominal definitions. You don’t have to have a hypothesis to investigate something - but unless you end up with something which could be formalised as one, you aren’t dealing in knowledge. A Research Project is a series of actions aiming to add to knowledge. Operationalisation In order to test a hypothesis, you have to put it in testable form, by operationalising it. Operational definitions turn concepts into variables, and produce indicators. With indicators we can test hypotheses by gathering data (although this is NOT the only point of gathering data.) DEALING WITH BIAS Is there such a thing as objectivity? Even if it isn’t achievable we can’t just say whatever we want. Plausibility depends on: Honesty about our own interests and values Transparency about our sources and procedures Replicability of our data-gathering Rigour and consistency in our scholarly reporting Does this justify what Alvin Gouldner called “The new objectivity”? Small group work: l) Produce a list of all the topics or areas in which members of the group may wish to carry out their research project 2) What variables are likely to be looked in all (or most?) of these embryonic research projects; and what kind of values will these variables have ? 10 Lecture 2: A) What techniques and topics might be covered in a Methods course B) Looking for significance: Sampling and Probability A. What techniques and topics might be covered in a Methods course a) Last week we tried to cover the philosophical bases if research: Ontology (assumptions about what exists): Measurement, meaning and bias; Hypotheses and other research questions Epistemology (how we know: what counts as evidence): Operationalisation, Testings and other investigations; Reliability and Validity - and we took a first look at how to bring these together in project design b) In designing projects we then have a choice of a large number of methods of i) data collection ii) data analysis i) Data Collection Library research and internet mining Secondary use of official statistics Secondary use of other statistical data-sets e.g. from the ESRC data archive. Secondary use of qualitative data sets (e.g. Peter Worsley’s of Meyer Fortes’ West African data) Sample surveys Interviews and oral history. Fieldwork and observation ii) Data Analysis i) Qualitative or thematic analysis and its software (e.g. NVivo) ii) Quantitative or statistical analysis (e.g. SPSS); Descriptive statistics, association, correlation, , parametric and non-parametric tests (e.g. chi-square). iii) Other issues in Research Design and Management; Acess and Ethics; literature reviews, scholarly conventions, intellectual property rights; writing up; dissemination and utilisation 11 B. Looking for significance: Sampling and Probability 1) What is Significance? The statistical operationalistion of commonsense philosophy? “Significance” as meaning /importance in everyday life. Statistics uses the mathematics of probability to operationalise this concept by making it measurable, effectively defining it as “the chance that a result did not come about by chance”. It is easiest to measure when data-sets or surveys are complete. We may map an entire area, or read a complete archive, or give a questionnaire (like a census form) to everyone in a population. Then we can look at association of variables in that population (e.g. sex and political opinion, or free-range living conditions and avian flu, or air quality and bronchitis) and see how different is the actual association from what it would have been most likely to be if the association was random. 2) Sampling But often we just cannot afford to survey complete populations or masses, so we examine a sample, which we hope will accurately reflect the characteristics of the whole population/area/archive we wish to examine (but in practice will reflect the accessible sampling frame, omitting, say, homeless people, or marshes, or illegible documents that we just can’t get at.) How do we try to make samples accurate? A. Methods based on Random Selection Remember “Random” is a technical term in the Social Sciences. A sample is random if and only if every member of the sampling frame has an equal chance of being selected. Taking the first subjects that come along is NOT random sampling (it’s called opportunity, or interviewer-selected sampling). 1. A true random sample (with replacement). How large should it be? Estimate the distribution of values within the sample compared with that of the sampling frame/population? (for the NHS = “Ask a statistician.”) 2. Random sampling without replacement 3. Multi-stage or Area Sampling (including multi-phase or filter sampling) 4. Stratified Random Sampling 12 5. Cluster sampling B. Methods attempting to approximate to random sampling (where it is hoped to be near enough to make the use of probability theory for calculating significance sensibly.) 1. Stratified non-random sampling including quota or judgmental sampling. Survey firms often try to calibrate this (cheap) technique against (expensive) random samples. 2. Systematic sampling eg every nth name, or alphabetical. C. Other : Snowball sampling, opportunity sampling Small Group Work Try to link the variables you considered last week into an operationalisable research question which might be the starting point for your dissertation. Before next week Pick two or three possible reports of research studies that you might use for your first case study. (see p. 16 below). 13 Lecture 3: Creating a Research Topic Template – Moving Towards a Proposal Making your choice of topic o Ensure you have a hypothesis or research question – think about answering the questions WHY, WHAT, HOW? (AND IF RELEVANT – WHEN, WHERE?). This should guide you to an analytical approach – not simple description. If your research question can be presented as one or more research hypotheses to be tested, this (these) need to be operationalised. o You should be examining and analysing the way in which resources (wealth, income, assets, environmental/natural) are distributed and redistributed, the patterns of power, distribution of income and assets (capital wealth), and (where relevant) the background history of these. You are analysing processes – what and how things happen, why they are happening the way they are, and what is different now from before (or likely to change in the future from what it is now). This is how you can relate your dissertation to the content of the core course on Globalisation and Development. o It should have clear boundaries so that you can limit the scope and not be drawn into less relevant areas. Think carefully about why you have chosen this topic. Your answer to this may show that you are doing it for reasons that may not lead to a good dissertation. For instance, if you are doing it ‘to help your country’, you may not be very objective in your analysis for fear of upsetting nationalistic feelings. If you are doing it ‘because it will help with my getting a job’, you may not show everything that may be seen as critical by a prospective employer. Think clearly about what your purpose and goal is – write it down and include it. Do a survey of literature and other resources (including the internet, data and statistical sources). If these are inadequate, you may have to change your topic. You must have some (probably “Western”) academic sources (which will most likely be in English). Sources that are limited to government or commercial information are not so likely to be objective, and may lead you to have a biased or partial dissertation. Academic sources are likely to be more objective, and in many cases “Western” academic sources (i.e. published in countries where there is more freedom of expression, often in English – which may include researchers from all over the world, not just the West!) are more protected from bias. Use electronic journals from our library: you should be able to demonstrate the use of journal articles as a key source for postgraduate work. Make explicit your methods of analysis – what will you use, and why will you use it? Do not use data simply to impress – graphs, tables, etc. must be there for a reason – to assist your analysis. Adequate resources, methods and information CONFIRMS VIABILITY OF TOPIC 14 Assessment Exercises – How to Do Them 1) Research Template: Suggested headings * Choice of topic o Justification o Research question or hypothesis * Why have you chosen it? * What is your purpose and goal? * Primary data collection methods, if any * Methods of analysis – what do you expect to use that is appropriate to your topic? 2) Literature Search and Resources Planning: Suggested headings * Preliminary Literature search (see Lecture 10) * Assessing Resources required: o Money (not much for you, but even paper costs money) o Equipment o Time (VERY Important to do a time-budget) o Personnel (You - in this case - but who might help. Might you do a cooperative project with someone else resulting in two reports ? Can you do a spin-off from a bigger research project at work ? * Ethics Assessment – see lecture 11 * Bibliography – this follows the Harvard system EXCEPT that a Research Proposal is the only form of academic writing where you are allowed to list sources you haven’t read or cited yet! 3) Case Study Analysis 1 Evaluate how the influence of gender and other variables on voting can be researched through the British Household Panel Survey, and what this tells us about how to use statistics, paying particular attention to the concept ofc statistical significance – see Lecture 8 4) Case Study Analysis 2 Choose a study or book or journal article (or other suitable material – you can check this with staff) which reports a single piece of original research and is related to your dissertation topic (i. e NOT a textbook, NOT a survey of many research results, NOT secondary analysis). Then do the exact opposite a Research Proposal: extract and evaluate the research template from the report, and tell us and tell us how successful it has been.The types of criteria you can use include (you can use these as headings if you wish): What is the objective or goal or purpose of the author? What type of author is it (single academic? Research team? NGO? Institution or organisation?) What is the research question or hypothesis used? What type of information and/or data does the author use? 15 Is the information adequate for the purpose? If not, what are its shortcomings? Does this constitute adequate evidence to support the author’s arguments? What is your assessment of the extent that the author has fulfilled the purpose/goal? 5) Project Proposal Portfolio This will include all the above items, improved after formative feedback. The mark given will be for the items as they appear in the portfolio, not as how they were first submitted. Respond to our comments! Improve them! Some Practicalities It may help to produce a ‘spider diagram’ of your project to help you to plan it. This work will be the foundation of your research proposal. If you don’t have a viable research proposal, it is literally pointless to start on your dissertation. As you collect references, ensure that you keep good notes on your sources so that you can give proper references. Make a bibliography as you go along, and note where you have found each source so that you can find it again easily when you begin work. Conclude by pointing out any other difficulties that may have to be faced (and how.) 16 Lecture 4 Descriptive statistics and Measures of Association; Correlation, Chi-Square, parametric and non-parametric tests. 17 18 19 20 21 22 Lecture 6: SPSS COMPUTING LAB SESSION - to be held in Lab D230 (in the Library) 1) Log on - ask for help if you don’t know how. You will need your computing id and your password, both of which are on your registration document. PLEASE REMEMBER TO BRING A DISK! 2) Check that you are aware of the software that is available to you through the university. At the end of this exercise we want you to e-mail your results for section 7 below to T.A.Acton@greenwich.ac.uk and then submit them with your comments as your second case study. 3) Click on the SPSS icon, choose the option for data entry and wait for a data entry grill to come up. (Note the TUTORIAL OPTION - it’s good - but we don’t have time for it this morning.) 4) Create a simple data set about the group we are in tonight: a) Define your variables: Put one in each of the boxes along the top row (or case) for as many variables as you have (2 to start with). This makes SPSS give a “default definition” of your variables. Then define them by clicking on the “variable view” button at the bottom of the table on your screen. Change var00001 to “Sex”. Define your labels by changing the residual categories which come up in the row. Give the full variable label of “Sex” as “Gender of the Respondent” Give the value labels 1=Male and 2=Female Make 9 your “missing value”. Keep everything else the same b) Now use your creative social-scientifc imagination to define a second variable “Ethnicity” using the same procedures as above. Try to avoid residues of racism - but keep it simple! (It’s harder than you think.) c) Now enter everyone in the class as a case with their gender and ethnicity 5) Analyse your data set as follows. Click on Analyze at the top, then Descriptive Statistics, then Frequencies, and after choosing the statistics you want (and charts, if you like - how about a pie chart!) proceed - and look at the Frequency Table in your Output File. What is the Standard Deviation for Sex? What is this an indication of ? 6) Minimise the Output file and click on analysis again. Then click on Crosstabs, and set up a cross-tabulation of Sex and Ethnicity. Run it after choosing chi-square and correlations (Kendalls Tau-b) as the statistics you want, and choosing some graphics. Inspect the result. Why doesn’t chi-square tell us very much with a very small sample? 7) Now for one we prepared earlier! Click on ‘file’ then ‘open’ then ‘data’ then enter an address I will give you on the day for the file BHPS1, and it should come up as a data set in your main window. This data set is from Wave 1 of the British Household Panel Study, which was established by the Economic and Social Research Council as one of the first national-level generalpurpose longitudinal studies to be conducted in Great Britain. Individuals entering Wave 1 of the survey in 1991 were re-interviewed at intervals throughout the 1990s. Further technical details and a copies of the questionnaires are available from the ESRC Research Centre on 23 Micro-Social Change at the University of Essex.This sample was randomly selected (with appropriate weightings) on a one-per-household basis from the 5,532 representative households interviewed at Wave 1. It comes from D.Rose and O Sullivan (1996) Introducing Data Analysis for Social Scientists Open Uni. Press, Buckingham ASSESSMENT EXERCISE Case Study One: (Max 1000words) What can you learn from cross-tabulating ASEX with AVOTE, and with AOPFAMF? Email Thomas Acton with an appropriate table and your comments, and submit this as your second case study. (1000 words maximum). 24 Lecture 7 Interview Surveys How do we get primary data from a human sample? Sample Survey Method How do we tap into the experience of other people? A) A choice of strategies Generally we have a choice between depth and generality. The more we concentrate on elucidating one person’s subjective reality, the deeper into it we can go. The more we try to generalise about lots of people, the less we can take note of the experience of individuals. B) A continuum of methods: Postal Questionnaire Administered Questionnaire Scheduled interview Structured Interview Focused Interview Unstructured Interview Informant Interview Oral History More Structured ^ l l \/ Less structured C. Formulating Questions for Questionnaires or Interview Schedules The more structured the strategy , the more careful we must be to standardise the questions to make sure the stimuli which produces the subjects’ responses are the same, so that the results are commensurable. When writing a questionnaire we have to make sure a) We operationalise all independent as well as dependent variables (ie always ask sex, age, parents’ occupation, marital status, ethnicity.) b) Include leading and misleading questions only if we really mean to c) Decide on a balance between closed and open-ended questions d) Decide whether multiple choice or scaled questions are appropriate e) We list the questions in the most respondent-friendly manner (leave age till last!) f) Arrange the questions to make the coding as easy as possible for data analysis - through pre-coding if possible 25 g) That any translations, or dialect adaptations are as near-equivalent as possible. (And that we don’t exaggerate how successful we are in this task! h) If necessary repeat a question in a different form as a check on reliability i) For interview schedules include any necessary probes or prompts for open-ended questions. D. The interview as a social situation Remember that the environment of the interviewee always has an effect, and so will the character of the interviewer in every situation but that of the postal questionnaire. The less structured the interview the more complex the situation and the nature of the rapport to be built between interviewer and interviewee (cf Government “Handbook for Interviewers”) 26 Lecture 8: Observation – Participant and non-Participant See for Yourself! Observation is the foundation of all methods of data collection: Interviews: Recording others’ recollected observations. Documentary Analysis: Examining written-down observations. Experiments: Stirring things up and recording the result. But sometimes sociologists need to observe directly what happens naturally when as it is happening. You may have to wait a long time for anything interesting to happen – but at least you will now that what you see happen is not the result of inadequately controlled experimental stimuli, or a figment of someone else’s memory or selective record keeping. (At least you can make your own selection!) Two common methods of direct observation: Non-participant and Participant observation. A. Non-Participant Observation: Select and operationalise hypothesis Draw up schedule for observation Carry out times, replaceable observation Analyse data e.g. Hypothesis: Our lecturer is excited by student questions. Operationalisation: Our lecturer waves his/her hands more when responding to student questions. Schedule: Ordinary Lecturing Responding to Questions Waves Hands Raises Hands above shoulders Scratches Head uncontrollably Assaults Students Pause for questions while you start filling this in. Most schedules are much more complex – with columns for different individuals, time periods and behaviour items. Complex hypotheses may require several schedules and several observers. Preparing a good observation schedule is as difficult and open ended an art form as writing a good questionnaire. 27 B. Participant Observation: Gain Access. Learn language if necessary and seek cultural acclimatization. (What is missing at this point? We, actually, hypothesis forming isn’t much use in participant observation. Hypotheses tend to be an end product for testing by other methods rather than a starting point.) Immerse self in total environment of the behaviour to be observed, while writing up field log. At this point text books tend to warn the observer against “going native”. Acton would prefer to warn the observer against remaining imperialist. Retreat to ivory tower, analyse log, write book, give expert advice on “your” natives for rest of life. (It doesn’t have to like that; it too often has been.) Advantages of Non-participant Observation Can be rigorously structured to give quantifiable, replaceable data. Relatively easy to defend against accusations of bias. Disadvantages of Non-participant Observation Lacks interpretative depth. Results are partly determined by initial selection of hypothesis and construction of schedule. Advantages of Participant Observation Unparalleled interpretative depth. Open-ended and flexible approach to new experience. Greatest possible challenge to observer’s ethnocentrism. Disadvantages of Participant Observation Highly subjective, and subject to accusations of bias. No way of knowing if subjects are a representative sample. If not combined with historical and other scholarship, may lead observers (especially structural functionalists) into considerable interpretative historical error. Leads to conflict of loyalties for observer and other theoretical problems (e.g. covert vs overt observation). Such ethnocentrism as survives the challenges to it may, through the observer’s writings, be embedded more firmly in the observer’s culture. Conclusion: Studying whole cultures requires a combination of ALL sociological and historical methods. 28 Lecture 9 The Literature Review Grounding Research in Existing Knowledge - and not reinventing the wheel ! a) Preparing yourself to ask the right questions b) Showing readers you know the issues and questions - so they take you seriously c) Showing gaps in existing knowledge d) Locating your own work theoretically. To do it you need a) to build a substantial bibliography (this may be in several sections - but using the Harvard system you list it all in a single list by author) . Don’t rely on existing bibliographies, but use search engines on the internet, CD Roms of article titles in the library, and the most recent journals. b) to discuss it in categorical terms i.e. your literature review is NOT an annotated bibliography, NOR should it be a succession of individual book reviews. Rather you should list the subject-area categories of literature (most dissertations have 2 or 3)- and cite the most important books within them. In literature reviews it is OK to have some rather general sentences about the tendency of a literature and then to have a long list of citations all within the same pair of brackets. This is greatly preferable to having a whole page of sentences referring to the same topic and citing a lot of similar books one at a time. c) not to pre-empt the substantial chapters of the report When you do your first draft of the literature review, you may find yourself writing miniversions of your overall conclusions and argument. These will need to be hiked out and put in later chapters. Your literature review reports the scope of the relevant literatures - it doesn’t present books as as evidence (except occasionally where you may have to explain why your thesis is not dealing with some topic you nevertheless recognise as important. Books and documents will only be presented as evidence in your substantial chapters. The corollary of this is: even a wholly-library-based theoretical dissertation still needs a literature review which treats books as part of “a literature”, rather than the subject of your research. Scholarly Conventions and Intellectual Property Rights The ESRC makes “intellectual property rights” a key part of the new research training. Why? No just commercial considerations - but to assure the evidence trail, and enable the assessment of bias, through transparency about the kind of document which is used as evidencer. 29 So DO use the Harvard system (see inside front cover) at all times, and AVOID any suggestion of plagiarism. Remember: Library research is not the same thing as a literature review. How to do the Literature Search component of the Research Proposal Complete a brief initial review of the literatures (ie the categories of literature) which are essential or desirable to contextualise your research, mentioning one or two of the most important examples of each. This preliminary review of the literature is obviously not going to be comprehensive – at this stage you are mainly making sure that your topic has sufficient resources – especially academic ones in English – to enable you to do the project. We would expect you to identify at least 10 significant academic sources in English, and a range of reports, internet sites, government sources, business reports (where relevant) in addition. 30 Lecture 10 ANALYSIS OF TEXTS (from books to interview transcripts and field notes) Content Analysis vs Discourse Analysis The quantitative vs qualitative argument rears its head again! The linguist de Saussure made a seminal distinction between langue (the structure of words, grammar and symbols of semiotics) and parole (the message or meaning), which together make up the structure of language. Content Analysis is concerned with langue, with language as behaviour, with analysing words as signifiers; Discourse Analysis is concerned with parole, with language as communication, with analysing what is signified, the arrangement of meanings. Is there a middle way? A. Traditional methods of content analysis: i) ii) iii) iv) v) formulate a precise hypothesis relating linguistic to non-linguist variables e.g. “Less extreme left wing groups will use more adverbs in their propaganda” define the relevant data i.e. state exactly what you are counting (eg – which groups, and phrases do you count as “left-wing”) choose units of analysis (words, headlines, sentences, stories or whatever, and definition of categories to contain units, which should be unambiguous, mutually exclusive and exhaustive. (If at all possible!) enumeration, index construction and testing of hypotheses testing for reliability (by repeat coding of texts) and validity (by construction of ad hoc predictive and construct validity tests) B. Traditional Methods of Discourse Analysis i) ii) iii) iv) v) locate the text in terms of what is known about the author, the author’s view of the audience, and different audiences’ views of the author. identify the major controversies involved: with whom is the author grouped and against whom. (And what differences exist within an identified discourse e.g “New” vs “Old” Labour. ) within a given corpus of texts identify and exemplify the common arguments and themes, and their logical links. Rigorously compare what each of the texts you are looking at says about the themes you have identified as important. Empathetically, imaginatively and hermaneutically characterise the main themes of the discourse(s) you are analysing. 31 C. Yippee – Computers can now do both at once From the 1980s on more rigorous analysis of extended in-depth interview transcripts essentially utilised both techniques (cf McCracken 1988). In the 1990s qualitative analysis software has essentially computerised this methodology with packages like NUDist, and Winmax. 32 Lecture 11: Evaluation, Ethics, Access and Dissemination A) Evaluation: 1) How do we assess the Research Reports of others? How do we decipher their methodology from the end product? Or from the Introduction (assuming this is the last part written? Is evaluation a mirror image of the research process? 2) The checklist approach: Check the appropriateness of a) Theory in general b) Whether theoretical propositions to be investigated are specific enough and grounded in the literature? c) Whether the operationalisation was apopropriate. Was there a pilot? Are methods of checking validity and reliability built in? d) Fieldwork. Were the decisions inherent in operationalisation adequately resourced and carried out? Was the access OK. How were problems acknowledged? Was the research ethical? e) Is the data analysis sound. 3) Problems with the “Where did it all go wrong” approach. a) as a method of learning methodology it tends to promote pessimism – even impossibilism b) Qualitative research, especially that engaged in theory-building rather than theory-testing, may not be so cut and dried as the stages above suggest. c) The method of ideal types versus the method of difference: the Bethnal Green Studies, (by Willmott and Young) describing ideal types or central tendencies of “Family and Community in East London” are still widely taking as a model despite Jennifer Platt’s devastating critique “Social Research in Bethnal Green” B). Ethics and Access Right from wrong? 1) The possibility of “Value - free” research? “This dilemma...actually does not exist, for one of its horns is imaginary. For it to exist one would have to assume, as some apparently do, that it is indeed possible to do research that is uncontaminated by personal and political sympathies... [that]... is not possible and... the question is not whether we should take sides, since we inevitably will, but rather whose side are we on.” [my emphasis] Becker, H. (1967) “Whose side are we on?” in Sociological Work, p.124 “An attitude of moral indifference has no connection with scientific objectivity” Weber, M. (1949) “The meaning of ethical neutrality in the social sciences” in The Methodology of the Social Sciences, p.54 Weber in fact opposed Scientism - the notion that there are two separate and autonomous spheres of fact and “morality” or ethics, and that the collection of facts (scientific data collection), is always to be done without reference to the collector’s value - system (scientific 33 objectivity) and that t science has a particular authority, and knowledge drawn from has a privileged epistemological status, i.e. is more authoritative because it is “scientific” in some way. Arguments against these notions: what is “scientific research”? What makes it “scientific”? Can “science” [more especially social “science”] ever be “value-free”? Should our research ever be value-free? What did Weber mean by his phrase “wertfrei” [value-free or unbiased]? 2) Ethical issues. If then we have to “do” ethics what is the status of ethical statements and codes of ethics: a) are they absolute (always to be adhered to no matter what the circumstances)? b) Are they relative (to be put into operation at some places at some times)? When and where do these codes apply (are they socially constructed notions that only apply to particular societies at certain periods)? Ethical situationism: the notion that each particular situation or circumstance can be measured “on its merits”, against one’s personal sense of ethics What is the relationship between ethics and justice? Social justice? Ideas about “good” and “evil”? “Give every man his due” (Socrates) But how do we define “due” and who is “everyman”? 3) Those who demand their “due” of the social scientist a) other social scientists – the “professions” b) employers and research funders: universities, government departments, funding trusts. Also the taxpayer or the people as a whole? c) Students, apprentices, research assistants d) the “subjects” (“objects”?) of research. 4) How do social scientists contribute to policy-making more generally? C) Dissemination 1) Getting your work published: Needful for any knowledge you have to be used or useful for someone else; (utilisation - briefing) An accounting for the resources that have been put in (accountability - report) A contribution to your c.v. (presentation - publication) 2) Oral Presentation as a preliminary N.B. Oral presentation can be of a written paper. Papers often find their way upwards through a hierarchy of locations of presentation viz. local graduate seminar seminar at someone else’s university (If you are using stuff from your dissertation you will almost always have to make it much tighter and more hearer-friendly. ) 34 Then via submission of an abstract to the organising Committee, go to Professional or issue-oriented conference or Scholarly Association Conference 3) Submission to peer-reviewed journals Once the bugs have been taken out of your work through discussions, it may, if you are lucky, be selected for the book of the conference. If so make sure that you change it quite a lot before submitting it to a peer-reviewed journal. For this, choose carefully; look at journals in the library, and adjust the style of your writing to the rules and style of the journal. Remember the less prestigious the journal, the quicker and easier it is to get published. Your paper will be sent to two anonymous reviewers, and you may be asked to make changes. (Usually a good sign). A tip: Join a professional association: volunteer to review books and act as an anonymous referee for their journal yourself. Don’t forget to list articles in professional journals - which may be more useful even if they don’t carry so much academic prestige. 4) Books Many journal articles also appear as book chapters. This is legitimate because the journal audience is disciplinary, but the book audience is usually problem-oriented. Edited books are often the outcome of issue-oriented conferences. If you run the conference - you often get to edit the book. And with all this experience, you may find the time to write a whole one yourself - or at least to send off book proposals to publishers (which go down better if you can refer to a few articles already published.) A tip: Give your papers a slightly different title and adapt the first paragraph to the venue at each outing: this will make your list of publications a lot longer 35 RESEARCH ETHICS FORM MA/M.Sc World Trade and Development 1)Date ……………………… 2)Name…………………………………………………… 2) Staff/Student I.D. (as on your Resource Card) ………………………. 3) List any individuals who are acting as supervisors for this research. …………………………………………………………………………….. 4) Title of your Research ……………………………………………………………………….. 5) Brief summary of your research proposal (250 words maximum) 6) Is there anyone whose interests might be damaged by, or who might object to the procedures or outcomes of your research in any way. Outline why you think your research is ethically justified despite any objections or risks, and what steps you have taken to minimise the possibility of unjustfiable harm. (NB, sometimes causing harm to individuals, eg facilitating the conviction of dangerous criminals, is justified. So be frank!) 7) Who is or are the funder(s) or sponsor(s) of your research, if any ………………………………………………………………... NOTE: If your research does involve any invasive physical procedures, or experimental work with human or animal subjects, or there are any complex or difficult ethical issues, you should also fill in the University Research Ethics Committee form. An electronic copy of this form is available by e-mail. Include a completed copy of this form with your project proposal 36 Dissertation Guidelines Process The Research Methods course forms the background to your analytical capabilities Foundations in Postgraduate Study provides the tools for critical thinking and practical guidance on research work The research methods course ensures that early on you provide a preliminary idea of your topic in the Research Topic Template, which is discussed in tutorial or seminar format in class. A potential supervisor is then identified who can meet and discuss with you your ideas and assist you in forming your research proposal. Coursework in the Research Methods course is directly linked to your dissertation: o Case Study Analysis encourages you to apply your analytical capacity and critical thinking to a study done by someone else that relates to your topic, and to do your own secondary analysis on published datas; o The Research topic template, Literature Search and the Research Ethics form will be edited together to make a Research which proposal provides you with the initial ‘map’ of your topic, based on a research question or hypothesis, a clear purpose, and initial survey of the literature. The formal summative for these pieces of work is in January. You should use the development of this coursework to begin your work on your topic so that by early next year you are well on the way to having a viable structure, an awareness of sources (and a collection of these as photocopies, notes, etc.) You should be submitting draft chapters by February and March You should then be ready to begin serious work on your dissertation as soon as the exams are over in May/June. Criteria for marking the dissertation: o o o o o o o o o o o Clear research question or hypothesis Coherence of argument Good use of evidence to support argument Originality of argument Clarity of structure Range of literature used – types of sources, extent of sources Correct referencing (Harvard System or other agreed system) Proper bibliography Visual presentation Grammar and spelling Proper length (15,000 including all annexes) The maximum length for the Dissertation is 15,000 words (including annexes). It will be submitted for a deadline in late August 2007 (date to be confirmed). 37 Two bound paper copies must be submitted, and an electronic version sent by email to your supervisor. The binding should be simple and cheap – e.g. a ‘comb’ binding available in many printing shops. The Dissertation will be marked by your supervisor, and a second marker within the university. Some will also be sent to the external examiner for moderation. The normal warnings on plagiarism (the representing of other people’s work as your own) apply to the dissertation and will be implemented strictly. Summary timetable for Dissertation for MA WTD students Indicative Month October November December January February March April/May June - August August Action Who Research Methods course and Foundations for Postgraduate Study course begin Research Topic Template presented Initial allocation of and meetings with potential supervisor Meetings with provisional supervisor Students coursework assignments for Research Methods: Case Study analysis Research Proposal Research Methods: Coursework submitted and marked TA & TC Early drafts of dissertation chapters prepared Dissertation chapters prepared Initial feedback from supervisors Exams Dissertation drafts prepared Supervisors comment Dissertation revised Submission Two bound copies and electronic version to supervisor 38 Students TC Students Deadline! Students TA & TC Students Students Supervisors Students and supervisors Deadline!