Content Page 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. 13. 14. Observational Method Experimental Method Experimental Design Aims & Hypothesis Variables: IV, VD & EV/CV Operationalisation Sampling Techniques Factors Associated with Research Design Reliability Validity Ethical Issues Data Suggestions for future/Improvements Writing Procedure Core Studies Loftus & Palmer Maguire Baron-Cohen Piliavin Savage-Rumbaugh Reicher & Haslam Samuel & Bryant Rosenhan Bandura Thigpen & Cleckley Freud Griffiths Dement & Kleitman Milgram Sperry 1. Observational Method G541 & G544 Section B 1. Briefly outline the observational method used in Psychology (4 marks) 2. Describe 2 observational studies in Psychology (8 marks) 3. Discuss strengths and limitations of using the observational method to investigate behaviour. Use examples of psychological research to support your answer (12 marks) 4. Compare observations with self reports. Use examples of psychological research to support your answer Key features of the observational method • In an observation, data are collected by someone observing (watching) participants and recording what pts do or say. • Sometimes the observer is present and sometimes the observer is hidden behind a one-way mirror. • Other recording techniques can be used, including video recordings and CCTV footage. • Observations may be conducted on their own or they may be conducted as part of an experiment. NB: What identifies an investigation as an experiment is whether it has an IV and DV rather ran where it is conducted or the details of the procedure Observation in Core Studies Study Loftus & Palmer Baron-Cohen SavageRumbaugh Bandura Freud Dement & Kleitman Sperry Approach Observational Role of observation in Study Observation Nature & Use Everything is left as normal, all variables are free to vary. Exam behaviour without the interfering in any way Design: Overt or covert observations Advantages •People tend to behave naturally (High EV) •Information gathered is rich and full •Can be used where other methods are not possible, where variables cannot be manipulated. Disadvantages •Experimenter has no control over the situation •Participants can be aware of being watched and this can affect behaviour •Problems of reliability due to bias or imprecise categorisation of behaviour •Problems of validity due to observers’ or coders’ assumptions •Replication difficult Informed consent Difficulty debriefing Privacy Ethical Issues Different Types of Observation Types of Observation Controlled Observations Conducted in a laboratory or classroom as part of an experimental procedure. Control of Pts and asked to do set tasks e.g. Bandura Natural Observations Participants Observations •No control over pts and what they do e.g. Piliavin •Type of natural observation, but observer is playing an active role and fully participating member of the group. Overt & Covert •Griffiths •Bandura Structured & Unstructured •Unstructured >Milgram •Time Sampling > Bandura e.g. 5 sec intervals •Event Sampling > Bandura Activity 1 Strengths & Weaknesses of Observational Method Observation Strength Weaknesses Activity 1 Strengths & Weaknesses of Observational Method Observation Strength Weaknesses •High EcV > naturalistic •Can establish C&E •Rich, qualitative data •Quan & Quali •Covert observations unethical •Easy to run •Can’t control all variables. Little standardisations. Difficult to replicate. •Low in DC’s (covert) •High DC’s (overt) • Improving Observations Inter-observer reliability: • 2 observers • Should be agreement on data collected Activity 2 Strengths & Weaknesses of Observational Types Strength Controlled Natural Participant Unstructured Structured Time Sampling Event Sampling Overt Sampling Covert Sampling Weaknesses 2. Experimental Method Section B 1. Briefly outline the experimental method used in Psychology (4 marks) 2. Describe 2 laboratory experiments in Psychology (8 marks) 3. Discuss strengths and limitations of using the experimental method to investigate behaviour. Use examples of psychological research to support your answer (12 marks) 4. Compare laboratory experiments with field experiments. Use examples of psychological research to support your answer 5. Discuss the extent to which psychology can be a science (8 marks) Brainstorm • Write down everything you can remember about the experimental method Brainstorm • Write down everything you can remember about the experimental method: • • • • • • • Types Design Hypothesis Variables Control Ethical Issues Data Collection Research that uses the experimental method… Key features of the experimental method • Theory: The aim of an experimental is to test a hypothesis (prediction) with the aim of disproving or supporting it. • Test: In order to test the prediction, it has to be established that one variable (thing) has a measurable effect on another variable (thing). • Control: The study must be conducted under controlled conditions so that the researcher can identify that the effect that has been found is due only to an identified variable and not to other factors that were not tested. • Replication: In order for support for a theory to be retested it is vital that any experiment can be replicated (imitated with the same results) by others. This means that the method must be identified precisely and be standardised so that it can be imitated. Key steps in an experiment 1. The experimenter comes up with a hypothesis 2. The experimenter designs an experiment to test that hypothesis 3. The experimenter manipulates one factor (the IV) that s/he has identified in his hypothesis as being likely to cause a particular effect. 4. The experimenter measures the effect of this manipulation (DV). 5. Other variables are controlled. 6. The experimenter analyses the difference in the mean results obtained in each condition. 7. If a significant difference is found between means, this supports the alternative hypothesis. If no significant difference is found, the null hypothesis is retained. Strengths -Test hypothesis by manipulation of IV -Scientific: follows standardised procedures > enables replication -Control over extraneous variables -Produces quantitative data which can be statistical analyses to ensure meaningful comparison. Limitations -Low ecological validity – removed from real life -Small sample reduces generalisability -Causes stress/anxiety to participants (ethical issues) -Doesn't collect qualitative data therefore reductionist. Laboratory Experiment Nature & Use Advantages Disadvantages IV manipulated to observe the effect on DV, under controlled conditions. Establishes causal relationships Allows for replication Good control over confounding variables Artificiality: Mundane realism and experimental realism The effects of being observed: Demand characteristics, (participants) evaluation apprehension (researcher) Field Experiment Nature & Use Advantages Disadvantages Investigate causal relationships in more natural surrounding •Establishes cause and effect relationships •Allows for replication •Behaviour of participants more typical than in a laboratory experiment, high external (ecological) validity •Avoids some participant effects •Low in internal validity, poor control •More time consuming Quasi (Naturalistic) Experiment Nature & Use Advantages IV not directly manipulated Naturally occurring Participants behave naturally Investigates the effects of independent variables that it would be unethical to manipulate Disadvantages Participants not allocated at random to conditions Difficult to identify what aspects of the independent variable have caused the effects on behaviour Activity 3 Strengths & Weaknesses of Experimental Method EXPERIMENTS Strength Weaknesses Activity 3 Strengths & Weaknesses of Experimental Method EXPERIMENTS Strength Weaknesses Test hypo by manipulation of IV Low Ec V removed from real life Scientific follow standardised procedures enable replication Difficult to organise > sample sizes small reduced generalisability Enable researcher to control EV thereby improving reliability of the results. Increase anxiety and stress for pts > ethics Produces quantities data that is can be SA therefore robust and meaningful Reductionist > simplifying human behaviour 3. Experimental Design Experimental: Independent Groups Definition Two (or more) groups of participants, one for each condition. •Avoids order effects •Participants cannot guess the purpose and of the experiment therefore reduces demand characteristics. Disadvantages •Needs more participants •Lacks control of participants variables Advantages EG: LOFTUS & PALMER Experimental: Matched Participants Definition Participants matched on key participant variables Advantages •No order effects •Participants variables partly controlled •EV well controlled Disadvantages •Matching is difficult EG: Bandura Experimental: Repeated Measures Definition Same participants in each condition Advantages •Good control for participant variables •Fewer participants •Removes pts variables Disadvantages •Order effects (e.g. Boredom, practice) •Participants guess the purpose (DC) EG: SAMUEL & BRYANT Activity 4 Design 1. Imagine that you are going to conduct an observation of children in a playground with two other researchers. To what extent to you think that you will all record the same behaviours? How might you cope with any disagreements? 2. If an experimenter used different wording in the instructions to different participants, how might this affect the results of the study? Activity 5 Strengths & Weaknesses of Experimental Design Strength IM RM MP Weaknesses Activity 5 Strengths & Weaknesses of Experimental Design Strength Weaknesses IM •No order effects •Reduce DC •Even with random allocation of pts to groups it is not possible to control pts variables as sample small RM •Removes Pts variables •Order effects need to be controlled •Less control over task variables as different materials need to be presented to remove order effects •Increase DC’s as repeat procedure MP •EV are well controlled Impossible to control of EV’s normally matched on one/two criterial 4. Aims & Hypothesis Research Definition The process of gaining knowledge through the examination of data derived empirically or theoretically. Reasons for using To produce objective facts Aims Definition Reasons for using The stated intention of a study To be clear about the purpose of a study Experimental (alterative) Hypothesis Definition Reasons for using A statement of the relationship between the IV and DV An alternative to the null hypothesis (accept/reject) there will be an effect of x on y Null Hypothesis Definition An assumption that there is no relationship (difference, association, etc) in the population from which a sample is taken with respect to the variables being studied. there will be no effect of x on y Directional Hypothesis 1 TAILED Definition Predicts the effect/relationship Reasons for Previous research suggests the direction using Non-directional hypothesis 2 TAILED Definition Does not predict the direction of the effect/relationship Reasons for -Allows for a using difference/relationships occurring in either direction -Previous research has been inconclusive Activity 6 Generating Hypothesis Generate a hypothesis for each of the questions: • What are “football hooligans” really like? • Do children play differently at different ages? • What are the effects of caffeine on attention and concentration? 1. Identify the independent variable (IV) and the dependent variable (DV) from each hypothesis. 2. Identify whether your hypotheses are one tailed or two tailed (remember one-tailed hypothesis predicts the direction of the effect of the IV on the DV, whereas a twotailed hypothesis does not). 3. Write a null hypothesis for each of the experimental hypotheses. Activity 7 Null Hypothesis Devise a suitable null and experimental hypothesis for the following: 1. An investigator considers the effect of noise on students’ ability to concentrate and complete a word-grid. One group only is subjected to the noise in the form of a distractor, i.e. a television programme. 2. An investigator explores the view that there might be a link between the amount of television children watch and their behaviour at school. Activity 8 Hypothesis Read through these examples of alternative hypotheses, and identify whether each is one- or two- tailed: 1. There will be a difference in scores on an intelligence test between people who eat fish and those who do not eat fish. 2. There will be a relationship between extroversion and introversion and a preference for loud music 3. People will remember more words in a foreign language if the information is presented in picture form, rather than as words alone. 5. Variables Variables Independent •Manipulated by the experimenter Variable •Create different conditions Dependent Variable •Measures the consequence of IV manipulation Activity 9 IV & DV Identify IV, DV in the following them in the following examples. Remember: • The IV depends on the DV • The IV is manipulated by the experimenter or varies naturally • The DV is one we measure 1. 2. 3. 4. 5. Long-term separation effects emotional development more than shortterm separation. (The two variables are length of separation and emotional development.) Participants conform more when the model is someone they respect. (The two variables are extent of conformity and degree of respect for the model.) Participants remember more words before lunch than after lunch. (The two variables are number of words remembered and whether the test is before or after lunch). Boys are better than girls at throwing balls. (The two variables are gender and ability to throw a ball). Physical attractiveness makes a person more likeable. (The two variables are attractiveness of a person’s photograph and whether they are rated as more or less likeable.) ING NEOUS Extraneous Variables • Situational variables are characteristics of the environment in which the experiment is being conducted which may have an effect on the results. The nature of these variables is very much dependent on the nature of the experiment but temperature, time and humidity could all be situational variables. • Person or Subject variables are inherent characteristics of the Experimental Unit that might affect outcomes. Hence examples of subject variables might include age, gender and other demographic details (among subjects) and x, y and z (among objects) although this is very much dependent on the object in the experiment. • Experimental variables are characteristics of the experimenter or the experimental team which might influence how the experiment is conducted, or how the experimental subject responds/behaves in the experimental setting. There is a wide definition for these variables and they may include age, gender, qualifications, etc. Extraneous Variables • Situational variables : Women shown the most romantic proposals are in a warmer room. • Personal Variables: What if the women shown the most romantic video clips are also more romantic in nature than the other women? • Experiment/Researcher Variables: What if the experimenter was really nice to one group and he was very gruff with the other groups? NB extraneous variables are only important if they are present for one group and not the other. If all of your subjects are exposed to the same extraneous variable (like if Josh was nice to all the subjects), then it won't change your dependent variable and it's not considered an extraneous variable. EXTRANEOUS Variables Variables other than the independent variable that may bear any effect on the behaviour of the subject being studied. Three main types 1. Subject variables: age, gender, health status, mood, background, etc. 2. Experimental variables are characteristics of the persons conducting the experiment which might influence how a person behaves. Gender, the presence of racial discrimination, language, or other factors may qualify as such variables. 3. Situational variables: Air temperature, level of activity, lighting, and the time of day. Confounding Variables • A confounding variable or factor is also sometimes referred to as a confounder or a lurking variable. • It is a "hidden" that affects the variables in question but is not known or acknowledged, and thus (potentially) distorts the resulting data. • This hidden third variable causes the two measured variables to falsely appear to be in a causal relation. • An experiment that fails to take a confounding variable into account is said to have poor internal validity. Controlling EV It is necessary to control extraneous variables so that results are not undermined by their effect (become confounding): 1. Control: Ensuring that an extraneous variable remains the same for all experimental units in the experiment. This requires that you are aware of the extraneous variable during the design stage and that you can control it. 2. Constant: Balance the variable across experimental groups This enables comparisons to be made between experimental units on the basis of the effect of the variable. Activity 10 Extraneous Variables Identify the IV and DV • Operationalise variables • Identify EV 1. A psychologist wants to investigate whether students who complete their 4 hours of independent study per week do better in the psychology exam than those students who only complete 1 hour per week... 2. An experiment to see if recall on a memory test is affected by time of day 3. Does drinking coffee whilst revising improve exam results? 4. An experiment to investigate the effects of fatigue on reaction time Activity 11 Independent Variables in Core Studies Loftus & Palmer Samuel & Bryant Bandura Piliavin Activity 11 Independent Variables in Core Studies Loftus & Palmer •The verb in the critical question Samuel & Bryant •Asking 2 questions before or after •Materials (play-doh, water) Bandura •Aggressive model, non aggressive, no model •Sex of the model Piliavin •Victim ‘black’ or ‘white’ •Victim ‘ill’ or ‘drunk’ •Intervention of model helper Activity 12 Dependent Variables in Core Studies Loftus & Palmer Samuel & Bryant Bandura Piliavin Activity 12 Dependent Variables in Core Studies Loftus & Palmer •Estimated recalled speed Samuel & Bryant •Mean number of errors in the conservation task Bandura •Frequency of imitative aggressive acts •Frequency of non-imitative acts •Frequency of verbally aggressive behaviours Piliavin •Time between first collapse and first helper •No of passengers who left when victim collapsed 6. Operationalisation ‘Eating spinach affects performance’ Operationalisation •Variables in a form that can be tested (operations) •How hypothesis will be tested Both IV and DV need to be precisely operationalised, otherwise, the results may not be valid and cannot be replicated. Activity 13 Operationalisation Here are some research ideas. For each one, identify the IV & DV and suggest ways in which each could be operationalised: 1. Do people remember more about a topic they are interested in that about one in which they have little interest? 2. Are there gender differences in the amount of aggression shown by children in play? 3. Are neurotic people more likely to suffer from phobias? 7. Sampling Method Population Definition The group of people whom the sample is drawn Evaluation May be biased Sample Definition Selected to be representative of the population Evaluation May be biased ,therefore can’t generalise Random sampling Definition Every member of the population has an equal chance of being selected Advantage Potentially unbiased Disadvantage Most replicable Needs to be drawn from a large population to be unbiased Difficult to obtain Participants for Psychological Research Volunteer Sample Self Selected Definition Participants become part of a study by Advantage volunteering Access to a variety of participants Ethically sound Disadvantage Volunteer biased Small sample Are you available? Opportunity Sample Definition Selecting people who are more easily available Advantage Easy to obtain Disadvantage Very biased Not replicable Activity 14 Target Population Identify an appropriate target population for each project below. You would select your research sample from this population. 1. To discover whether there are enough youth facilities in your community. 2. To discover whether cats like dried or tinned cat food. 3. To discover whether children aged between 5 and 11 watch too much violent television. 4. To discover the causes of anxiety experienced by participants in research studies. Activity 15 Sampling Find a study to illustrate volunteer sampling and another one to illustrate opportunity sampling. (Clue: Most of the studies you have covered used a volunteer sample, whereas some of the studies have used opportunity samples). 1. Why do you think volunteers are more likely than nonvolunteers to be sensitive to the demand characteristics of a study? 2. When would you not expect to find evidence of participant reactivity? 3. Is honesty the best policy? Would demand characteristics be reduced if both participants and experimenters knew the true aims of the experiment? Activity 16 Sampling in Core Studies Stated Y/N Loftus & Palmer Milgram Maguire Griffiths If stated, which one? If not stated, which should? 8. Factors associated with research design a. b. c. d. Operationalisation Standardisation Control of variables Pilot studies ‘Eating spinach affects performance’ Effects validity and replicability Pilot study Research is expensive (time + money). To establish weather a design works, that pts understand the instructions, that nothing has been missed out, and that pts are able to do what is asked, a pilot study (trial run, small scale) should be undertaken. Control of Extraneous Variables Any variables that change between conditions, other than the IV... Experimental Control Using techniques to ensure that extraneous variables are eliminated Extraneous/ confounding variables Random Allocation Hold constant or eliminate Counterbalancing Order effects balanced to make sure each condition comes first or second in equal amounts (ABBA) A set of procedures that are the same for all participants. To enable replication. Standardised procedures Participants to experimental groups; allocate items on a test Control of Investigator Variables (effect) Anything that investigator does which has an effect on the participant’s performance other than what was intended Double blind The investigator does not know the purpose of the experiment, to prevent expectations influence the participant’s behaviour Standardised A set of instructions that are the same for all participants. To avoid investigator effects. instructions OR Control of Participant Variables (effect) Anything that has an effect on the participant’s performance other than what was intended Single blind Deception to prevent the participants knowing the experimental aim Placebo Control group thinks it is receiving the conditions experimental treatment Demand A demand characteristic is a subtle cue that Characteristics makes participants aware of what the experimenter expects to find or how participants are expected to behave. Standardised A set of instructions that are the same for instructions all participants. To avoid investigator effects. Investigator effect: Anything the investigator does which has an effect on a participant’s performance in a study other then what was intended. Interviewer bias The same in an interview situation, through, for example, leading questions and the ‘Green-spoon’ effect Experimenter bias The effect of an experimenter’s expectations, communicated unconsciously, on a participant’s behaviour Control Group In the design of experiments, treatments are applied to experimental units in the treatment group. In comparative experiments, members of the complementary group, the control group, receive either no treatment or a standard treatment. Standardisation Procedures Pts treated in exactly the same way. Instructions Pts told what to do in exactly the same way. Activity 17 Control of Variables in Core Studies Well Controlled Loftus & Palmer Samuel & Bryant Bandura Piliavin Confounding Activity 17 Control of Variables in Core Studies Well Controlled Confounding Loftus & Palmer Video Clips Gender (or age) Samuel & Bryant Same materials Intelligence (or gender) Bandura Same toys to play with Not matched on age Piliavin Same subway carriage Participant variables 9. Reliability of Measurement 10. Validity Generalisability The findings of any particular study should apply to the whole population Internal Experimental External Types of Validity Measure Concurrent Content Validity: The legitimacy of a study Internal Validity Reasons for low internal validity The extent to which the a measurement technique measures what it is supposed to Demand Characteristics: Features of an experiment the elicit a particular response form participants. Participant reactivity Extraneous variables not controlled (CV), act as an additional IV. Mundane realism: Do measures used generalise to real life > contribute to external validity External Validity Assessing external validity Validity outside of the research situation, extent to which findings can be generalised How representative is the sample of participants of the population to which the results are to be generalised? Population V Do the research setting and situation generalise to a real-life setting or situation? Ecological V Do the findings generalise to the past and to the future? Historical V Extraneous Internal Mundane Realism Experimental Ecological Validity Population Validity Extraneous Variables Situational Variables Participant Variables Investigator Effects Demand Characteristics Participant Effects External Historical Validity Participant Reactivity Participant reactivity: The fact that participants react to cues in an experimental situation Hawthorne Effect Demand Characteristics Social Desirability bias Increased attention becomes a confounding variable Features of an experiment that a participant unconsciously, responds to when searching for clues about how to behave. A confounding variable. The desire to appear favourably Validity of Psychological Measure Concurrent How well does the measure agree with Validity existing measures? - Test using old and new tests Content Validity Does the method used actually seem to measure what you intended? - Use a panel of experts Concurrent Measure Content Activity 18 Ecological Validity in Core Studies How/Low Loftus & Palmer Samuel & Bryant Dement & Kleitman Milgram Evidence 11. Ethical Issues 11. Ethical Issues Deception Informed consent Psychological harm Informed consent Difficulty debriefing Privacy Confidentiality 11. Dealing with Ethical Issues Presumptive… A Prior… B C Dealing with informed consent • Presumptive consent: Ask for others’ opinion and presume participants feel the same way. • Prior general consent: Get participants to agree to take part in a number of studies, one of which they will be deceived in. 11. Dealing with Ethical Issues Dealing with deception • Debriefing: Inform participants of true nature of the study after it is conducted and allow them to discuss their feelings. • Right to withhold information • Cost and benefits: Deception is acceptable if the benefits are sufficient. 11. Dealing with Ethical Issues Dealing with protection from psychological harm • Anticipating harm and stopping • Using role-play • Use of questionnaires: Ask people how they would behave. • Debriefing Activity 19 Ethical Issues in Core Studies Informed Deception Consent Loftus & Palmer Samuel & Bryant Dement & Kleitman Milgram RTW Debrief 12. Data a. Type of data b. Descriptive Statistics c. Inferential Statistics Types of Data Data Collection Quantitative Data Qualitative Data Easy to analysis Oversimplifies reality Produces neat conclusions Represents the complexity of human behaviour More difficult to detect patterns and reach conclusions Provides rich data Subjective, affected by personal expectations and beliefs Descriptive Statistics 1. Measures of central tendency 2. Measures of dispersion 3. Graphical representation 2,4,4,5,6,6,7,7 8,8,8,8,8 9,10,11,11,12 Measures of Central Tendency Mean: Add Makes use of all the Can be values, divide by data misrepresentative number of if there are values extreme values. Median: Middle Not affected by value in an extreme scores ordered list Not as ‘sensitive’ as the mean Mode: The most The mist common common value(s) value(s) Not useful when there are several modes Measures of Dispersion • Measures of dispersion • the range • standard deviation Measures of Dispersion Range Highest to Easy to calculate lowest Affected by extreme values Standard SD measures Precise, all values Deviation the amount of taken into account variation or dispersion from Harder to calculate the average. Graphs & Charts Histogram Graph showing continuous frequency data with a true zero e.g Exam results 0-30marks Bar Charts Graph showing frequency data; data need not be continuous e.g. Categories Scattergraph For correlations. Scatter of dots; each dot represent one case Inferential Statistics 1. 2. 3. 4. Level of data Levels of significance Tests Type 1 & Type 2 Error Inferential Statistics June 2012: • What does p ≤ 0.05 level of significance mean? (2) • This means that this is a 95% probability that the change in the DV is as a result of the IV and a less than 5% probability that this is due to random chance. The findings are therefore statistically significant. Thus we can reject the null hypothesis and accept the experimental/alternative hypothesis. • If you obtained this level of significance in your practical project, explain what this would mean in relation to your null hypothesis. (4) June 2011: You must use a repeated measures design experiment and plan to collect quantitative data. State an appropriate statistical test to analyse the data you would collect. Give reasons for your choice. (3) Inferential Statistics June 2010: You must use a correlation design and plan to collect at least ordinal data. State an appropriate statistical test (nonparametric) to analyse the data you would collect. Give reasons for your choice. (3) June 2013: How could you obtain nominal level data from your practical project? (3) June 2014: You must use an independent measure design and plan to collect data which measures observable behaviour. State and appropriate inferential statistical test to analyse the data that would be collected in your practical project. Give reasons for your choice. (3 Inferential Statistics Specimen Papers: • You must use a repeated measures design experiment and plan to collect at least ordinal level data. State an appropriate statistical test to analyse the data you would collect. Give reasons for your choice. (3) • If having carried out your investigation and an inferential statistical test, your experimental hypothesis was found to be significant for p≤0.05, what would p≤0.05 mean? (3) • Identify and describe the rational for choosing an appropriate inferential statistical test that could be used to calculate the significance of any correlation in your practical project. (3) • If your practical project comes up with the findings or what does p ≤ 0.05 level of significance mean? (2) Inferential Statistics Experiment • This means that this is a 95% probability that the change in the DV is as a result of the IV and a less than 5% probability that this is due to random chance. The findings are therefore statistically significant. Thus we can reject the null hypothesis and accept the experimental hypothesis. Non-Experimental • This means that this is a 95% probability that the change in the DV is as a result of the IV and a less than 5% probability that this is due to random chance. The findings are therefore statistically significant. Thus we can reject the null hypothesis and accept the alternative hypothesis. Correlation • This means that this is a 95% probability that the relationship between the two variables is significant and a less than 5% probability that this is due to random chance. The findings are therefore statistically significant. Thus we can reject the null hypothesis and accept the alternative hypothesis. Nominal Data Ordinal Data Interval/Ratio Data Levels of Significance Is there a difference between the groups that is REAL or is it due to CHANCE? Level Probability Significance When used 1% (p<0.01) Highly Where we would want to take few chances 5% (p<0.05) Significant Acceptable for psychological research 10% (p<0.10) Marginally May indicate need for better methodology Less than Inferential statistics Non-Parametric statistical tests: 1. Mann Whitney U: Test significance of the difference between two conditions when an independent design has been used and the level of data is at least ordinal. 2. Wilcoxon matched participant signed rank: Test significance of the difference between two conditions when an repeated measures design has been used and the level of data is at least ordinal. 3. Chi-Squared: test of significance of association used when nominal data has been collected. 4. Spearmans Rho Test: when data is at least ordinal and a correlational method is used. Level of measurement Categorical Nominal Difference/Association Repeated Independent Sign Test Chi Squared Correlation Measured Ordinal Wilcoxon T Mann Whitney (matched pairs) U Spearman (rho) Type 1 & 2 Errors There is a possibility that errors may have been made: Type 1 Error Deciding to reject the null when actually the results was due to chance or some other factor. Type 2 Error Deciding to retain the null when actually the result was caused by the IV. Too Low P = <0.10 Type 1 Error more likely Too High P = <0.001 Type 2 Error more likely 13. Improvements & Future Research Improvements Indentify a limitation and suggest how you make improvements to the investigation: Future Research 1. • • Sample Method Validity Reliability Ethics Think about changes that you could make to your stimulus Could you use a different method? 2. What implications does your research have on society? What group would benefit from knowing this information (application) 3. Does this study have real life validity? Example: • • • • • If you were to progress research in this area what would you do next? 14. Writing procedures… 14. Writing a procedure for Experiments 1. Decide aim, research question and alternative/null hypothesis 2. Plan procedure, including obtaining ethics approval, choosing experimental design, operationalising the hypothesis, preparation of materials and deciding sampling method. 3. Obtain sample and make arrangements for conduct of study 4. Obtain informed consent from participants 5. Allocate participants to experimental conditions and give instructions. 6. Participants follow experimental steps (data collected) 7. Thank and debrief participants 8. Analysis data, produce conclusions 9. Write report of practical investigation 14. Writing a procedure for Observations 1. Decide aim and research question 2. Plan procedure: obtain ethics approval, draw up schedule (if structured observation): choose and train observers: plan time and location for observation. 3. Possibly run pilot study in order to check on usefulness of selected categories and feasibility. 4. Covert observations – no informed consent/overt Obs – pats informed that observation will be conducted. 5. Place observers in position. 6. Conduct observation – pts are observed for designated period while observers record behaviours (data collected). 7. Thank and debriefed pts (overt) 8. Analyse data, produce findings and draw conclusions 9. Write report of practical investigation. Qualitative Methods Observations Self Report Correlation Correlational Analysis Nature & Use Advantages Co-variables examined for positive, negative or zero association. •Allows study of hypotheses that cannot be examined directly •More data on more variables can be collected more quickly that in an experiment set-up •Problems of interpretation are reduced when no association is found Disadvantages •Interpretation of results is difficult •Cause and effect cannot be established •Direction of causality is uncertain •Variables other than one of interest may be operating Ethical Issues Misunderstanding of findings because causal relationship cannot be established Questionnaire Nature & Use Set of questions Design: open (qual) or closed (quan) Advantages •A lot of data can be collected •Does not require specialist administrators •People are more willing to answer embarrassing or personal questions on an anonymous written questionnaire than in a face-to-face interview Disadvantages •Leading questions, social desirability bias •Biased samples Ethical Issues Confidentiality Privacy Interview Nature & Use Questions can be predetermined, or created in response to answers. Design: structured/ unstructured questions Advantages •Lots of ‘rich’ data •Telephone interviews Disadvantages •Social desirability bias, interview bias •Requires skilled personnel Ethical Issues Confidentiality Privacy