PSYC 2013 Research Design & Analysis 1 Dr. P. McLeod October 6, 1999 FIRST MIDTERM EXAM ANSWER KEY Name: Student number: Part A. Multiple Choice (1 point each, total =22 42%) Answer all questions on the scanner form provided. Use pencil and erase any changed answers thoroughly. Choose the best answer for each question. Read questions carefully and please check that you have transferred your answers accurately. 1. Scientific explanations are A) empirical. B) rational. C) testable. D) all of the above 2. Explanation A makes Explanation B makes is true? A) Explanation A B) Explanation B C) Explanation A D) Explanation B four assumptions about behavior, whereas three assumptions. Which of the following is is is is more more more more parsimonious than Explanation B. parsimonious than Explanation A. testable than Explanation B. empirical than Explanation A. 3. We can usually have more confidence in scientific explanations than commonsense explanations because A) testing a scientific explanation rules out alternative explanations for observed behavior. B) our intuition about the causes of behavior is usually correct and requires little, if any, empirical testing. C) commonsense explanations are always wrong. D) all of the above 4. The method of authority A) has no place in scientific inquiry. B) is useful in the early stages of scientific inquiry. C) is not a valid way of acquiring information. D) can be used as a substitute for the scientific method. 5. You are hired by a local company to do research on improving employee morale. The research you conduct would best be classified as A) basic research. B) applied research. C) problem-oriented research. D) none of the above Psyc 2013 October 1999 Midterm 2 6. A ________ source contains original research reports. A) primary B) secondary C) germinal D) premier 7. If the policy of a journal is to send articles out for review prior to publication, that journal is a(n) ________ journal. A) nonrefereed B) refereed C) reviewed D) APA 8. In the introduction of a paper, you can expect to find A) details of methodology. B) a brief overview of the methods used and results. C) a general introduction to the area under investigation and a literature review. D) all of the above 9. When evaluating a results section, you should determine whether the A) results are important. B) results fit with your feelings about the phenomenon under investigation. C) appropriate statistics were applied. D) results agree with the particular theory to which you subscribe. 10. According to the text, the two defining characteristics of experimental research are A) measuring two or more variables and determining whether they covary. B) manipulating an independent variable and controlling extraneous variables. C) randomly assigning subjects to conditions and manipulating an independent variable. D) none of the above 11. If a causal relationship exists between variables, then A) the value of your independent variable will depend, in part, on the value of your dependent variable. B) the value of your dependent variable will depend, in part, on the value of your independent variable. C) there will be no strong relationship between your independent and dependent variables. D) none of the above will be true. Psyc 2013 October 1999 Midterm 3 12. In a simple two-group experiment, the group of subjects not receiving the treatment is called the ________ group. A) demonstration B) treated C) control D) experimental 13. A(n) ________ variable is a variable that may affect the behavior you are investigating but is not of interest to you. A) independent B) control C) correlational D) extraneous 14. A weakness of the experimental strategy is that A) causal relationships cannot be discovered. B) extraneous variables cannot be controlled. C) experiments can be done only in the laboratory. D) tight control over extraneous variables may limit the generality of your results. 15. The third-variable problem means that A) a correlational study with fewer than three variables is invalid. B) if two predictor variables are shown to be important predictors of the value of the criterion variable, then there is probably a third important predictor variable as well. C) in a correlational study there may be a third, unmeasured variable that actually causes changes in the other variables. D) none of the above 16. Although tight control over experimental conditions gives you high levels of ________, it may result in low levels of ________. A) internal validity; external validity B) external validity; internal validity C) reliability; validity D) validity; reliability 17. The degree to which your simulation mirrors real-world events is referred to as ________ realism. A) mundane B) experimental C) maudlin D) coincidental Psyc 2013 October 1999 Midterm 4 18. A measure can be A) reliable but inaccurate. B) invalid but reliable. C) unreliable and accurate. D) both a and b 19. Post and Crowther (1985) studied the variables that discriminate bulimic from nonbulimic girls. The categorization of girls as bulimic or nonbulimic constitutes a(n) ___ scale of measurement. A) interval B) ordinal C) ratio D) nominal 20. You conduct an experiment to contrast two study techniques. After participants either "cram" or spread studying out, you give them a test of comprehension. You find that your test was too easy--everyone in your experiment got 100 percent correct. You have A) an insensitive measure. B) encountered a floor effect. C) encountered a ceiling effect. D) an invalid measure. 21. "Cues provided by the research context and researcher about the purposes of a study" is a definition of A) experimenter bias. B) role attitude cues. C) volunteer bias. D) demand characteristics. 22. ________ are used in an experiment, along with your dependent variables, to test whether or not your independent variable had its intended effect. A) Pilot studies B) Manipulation checks C) Quasi-variables D) Matching variables Psyc 2013 October 1999 Midterm 5 Part B. Problem Solving Questions. (points as indicated, total=18 35%) Answer in the spaces provided, if extra space is needed (it shouldn't be unless you write big) use the back page. Point form is fine, as long as all the relevant points are included! 1. A social psychologist interested in the effects of alcohol abuse conducted the following study. He mailed questionnaires to the homes of workers who had been laid off from a local automobile plant. The surveys were mailed at various time intervals and the workers were asked to fill them out anonymously and return them. Information about the amount of alcohol consumption before and after the layoff was obtained. Fifty percent of the surveys were completed and returned during the course of the research. The researcher found a very high positive correlation between alcohol consumption and duration of unemployment. In his report the researcher stated that, "the conditions of unemployment produced a tendency for people to increase their intake of alcohol." What problems, if any, do you see with these data and the interpretation made of them? (2 pts) Because the researcher received replies from only half of the subject pool, the responses may not be reliable, and they may not be representative of the population. E.g., the people who do not drink might be uncooperative, which would make the sample biased. [Key here is recognition of possible sample problems.] The statement that unemployment produces an increase in alcoholic consumption is much too strong. We do not have the internal validity to make such a statement. It could be that excessive "leisure time" allowed the workers to have more time to indulge in alcohol. [Key here is shouldn't interpret causation from a correlational design] 1 point for each of the above What, if anything, might be done to increase the validity of this study? (2 pts) The researcher probably could have examined similar workers who had not been laid off as a comparison to the unemployed. Or, the researcher could wait until some workers had been rehired to examine consumption before, during, and after unemployment. Both of the last two procedures are quasiexperimental and would enhance the internal validity of the procedure. 2 points for anything that recognizes need for more data or another comparison.] Psyc 2013 2. October 1999 Midterm 6 Read the following edited and annotated abstract and answer the following questions. [based on: Kowatch et al. (1999) A SPECT HMPAO study of regional cerebral blood flow in depressed adolescents and normal controls. Progress in Neuro-Psychopharmacology and Biological Psychiatry. 23(4): 643-656] Seven adolescent patients (aged 13-18 years) with symptomatic major depressive disorder (MDD) and 7 age- and gender-matched normal controls underwent single photon emission computed tomography imaging [PET scanning] … while unmedicated and in a resting state. Ss [subjects] and parents were interviewed with child and parent versions of the revised Diagnostic Inventory for Children and Adolescents and diagnosed according to Mental Disorders-III-Revised (DSM-III-R) criteria. … The authors found relative regional cerebral blood flow (rCBF) increases in depressed Ss as compared with normals in [some areas of the brain]. They found rCBF decreases in the depressed Ss as compared to normals in [other areas of the brain]. Adolescents with MDD show rCBF abnormalities similar to those found in adult MDD rCBF studies. State the most likely null hypothesis for this study. (1 pt) H0 There will be no difference in regional cerebral blood flow (rCBF) between adolescents with major depressive disorder (MDD) and those without. What was the independent variable? (1 pt) Depression [Presense/absence of major depressive disorder (MDD)] Was it a true independent variable, or a quasi-independent variable? (1 pt) quasi-independent How many levels did it have? (1 pt) Two What was the dependent variable? (1 pt) regional cerebral blood flow (rCBF) What ethical considerations would this study would raise with an ethics board using current NCEHR guidelines? (2 pts) This study involves a vulnerable population (depressed adolescents) who may not be able to give fully informed consent Costs/benefits of the study -- participants are being exposed to an invasive procedure - PET scanning with injections of radioactive chemicals, potential benefits are basic knowledge 1 pt each for any reasonable ethical concern (to max of 2) Psyc 2013 October 1999 Midterm 7 3. You are interested in the suggestion that people get edgy and aggressive on very hot and humid days. Very briefly (1-2 sentences) explain how you might study this question using each of the following methods. (3 pts total, 1 pt each) a) archival research Examine statistics on aggressive crimes and relate to archival weather information - etc. b) survey research Have people keep diaries or notes on mood and weather -etc. c) naturalistic observations 4. Observe people waiting in line ups (or driving in congested areas) on both hot humid days and cooler dryers days and record number of complaints (horn honking / letting other cars in line). etc You are interested in the possible effects of having been abused as a child on adult relationships. You plan to have introductory psychology students fill out several self-report questionnaires indicating any abuse they had experienced as children, some personality measures, and questions about their current (or most recent) relationship including any abusive behaviour they or their partner have engaged in. Identify two distinct ethical issues that you would have to consider before doing this study. For each, indicate how the possible ethical problems might be minimized. (4 pts) It could be traumatic for the participants to recall the incidents of their childhood abuse. You would want to make certain they knew about their freedom to withdraw and you would want to watch for signs of people getting upset. It would be important to keep this very personal information confidential Best to use anonymous questionnaires to ensure confidentiality If information about abuse comes out, you may be obliged by law to reveal this the participants would have to be told of this possibility ahead of time. 1 pt for each of two that are identified, another point for any reasonable solution Psyc 2013 October 1999 Midterm 8 Part C. Short Answer Questions. (points as indicated, total=1223%) Answer in the spaces provided, if extra space is needed use the back page. Point form is fine… 1. Compare and contrast the validity, accuracy, and reliability of a measure. (3 pts) All are aspects of the quality of a measure, but differ in that: Accuracy refers to the extent to which a measure agrees with a known standard? Reliability refers to the consistency (replicability) of the measure (across time, situations, and/or observers) Validity is the extent to which it measures what it is supposed to 1 pt for each definition - compare and contrast part not essential 2. Compare and contrast the internal, external, and ecological validity, of an experiment. (3 pts) All are aspects of the applicability, usefulness or quality of the experiment but differ in that: Internal validity: the ability of your research design to adequately test your hypothesis External validity: the degree to which the results of your research can be extended beyond the research setting and sample used. Ecological validity is a specific type of external validity m- the extent to which experimental results generalize to the natural (real-life) context in which the phenomena occurs. 1 pt for each definition - compare and contrast part not essential Psyc 2013 October 1999 Midterm 9 3. How is "minimal risk" defined in the National Council on Ethics in Human Research (NCEHR) guidelines? (2 pts) Minimal Risk “… if potential subjects can reasonably be expected to regard the probability and magnitude of possible harms implied by participation in the research to be no greater than those encountered by the subject in those aspects of his or her everyday life that relate to the research then the research can be regarded as within the range of minimal risk.” Key part of definition: no greater risk than encountered by the subject in his or her everyday life -- an exact quote is not expected or required 4. What are the eight guiding ethical principals by which research ethics boards evaluate the ethicality of a research proposal using the National Council on Ethics in Human Research (NCEHR) guidelines? (4 pts) 1. 2. 3. 4. 5. 6. 7. 8. Respect for Human Dignity: Respect for Free and Informed Consent: Respect for Vulnerable Persons: Respect for Privacy and Confidentiality: Respect for Justice and Inclusiveness: Balancing Harms and Benefits: Minimizing Harm: Maximizing Benefit: .5 point each -- don't need the exact phrasing but should have the key concept (E.g., just the words "Human Dignity" would be OK)