i INF 397C Introduction to Research in Library and Information Science Fall, 2009 Day 4 R. G. Bias | School of Information | UTA 5.424 | Phone: 512 471 7046 | rbias@ischool.utexas.edu 1 4 things today i 1. I’ll work the answers to the practice questions. 2. We’ll talk about graphs and tables. 3. I will spend a few minutes introducing the scientific method and experimental design--to provide some context for . . . 4. Dr. Mary Lynn Rice Lively on qualitative methods. R. G. Bias | School of Information | UTA 5.424 | Phone: 512 471 7046 | rbias@ischool.utexas.edu 2 1 – Practice problems R. G. Bias | School of Information | UTA 5.424 | Phone: 512 471 7046 | rbias@ischool.utexas.edu i 3 2 - Graphs i • Graphs/tables/charts do a good job (done well) of depicting all the data. • But they cannot be manipulated mathematically. • Plus it can be ROUGH when you have LOTS of data. • Let’s look at your examples. R. G. Bias | School of Information | UTA 5.424 | Phone: 512 471 7046 | rbias@ischool.utexas.edu 4 Your Charts/Graphs/Tables R. G. Bias | School of Information | UTA 5.424 | Phone: 512 471 7046 | rbias@ischool.utexas.edu i 5 Some rules . . . i • . . . For building graphs/tables/charts: – Label axes. – Divide up the axes evenly. – Indicate when there’s a break in the rhythm! – Keep the “aspect ratio” reasonable. – Histogram, bar chart, line graph, pie chart, stacked bar chart, which when? – Keep the user in mind. R. G. Bias | School of Information | UTA 5.424 | Phone: 512 471 7046 | rbias@ischool.utexas.edu 6 3 - The Scientific Method R. G. Bias | School of Information | UTA 5.424 | Phone: 512 471 7046 | rbias@ischool.utexas.edu i 7 More than anything else . . . i • . . . scientists are skeptical. • P. 15 – “Scientific skepticism is a gullible public’s defense against charlatans and others who would sell them ineffective medicines and cures, impossible schemes to get rich, and supernatural explanations for natural phenomena.” R. G. Bias | School of Information | UTA 5.424 | Phone: 512 471 7046 | rbias@ischool.utexas.edu 8 Research Methods i S, Z, & Z, Chapters 1, 2, 3, 7, 8 Researchers are . . . - like detectives – gather evidence, develop a theory. - Like judges – decide if evidence meets scientific standards. - Like juries – decide if evidence is “beyond a reasonable doubt.” R. G. Bias | School of Information | UTA 5.424 | Phone: 512 471 7046 | rbias@ischool.utexas.edu 9 Science . . . i • . . . Is a cumulative affair. Current research builds on previous research. • The Scientific Method: – is Empirical (acquires new knowledge via direct observation and experimentation) – entails Systematic, controlled observations. – is unbiased, objective. – entails operational definitions. – is valid, reliable, testable, critical, skeptical. R. G. Bias | School of Information | UTA 5.424 | Phone: 512 471 7046 | rbias@ischool.utexas.edu 10 CONTROL i • . . . is the essential ingredient of science, distinguishing it from nonscientific procedures. • The scientist, the experimenter, manipulates the Independent Variable (IV – “treatment” – at least two levels – “experimental and control conditions”) and controls other variables. R. G. Bias | School of Information | UTA 5.424 | Phone: 512 471 7046 | rbias@ischool.utexas.edu 11 More control i • After manipulating the IV (because the experimenter is independent – he/she decides what to do) . . . • He/she measures the effect on the Dependent Variable (what is measured – it depends on the IV). R. G. Bias | School of Information | UTA 5.424 | Phone: 512 471 7046 | rbias@ischool.utexas.edu 12 Key Distinction i • IV vs. Individual Differences variable • The scientist MANIPULATES an IV, but SELECTS an Individual Differences variable (or “subject” variable). • Can’t manipulate a subject variable. – “Select a sample. Have half of ‘em get a divorce.” • Consider an Individual Difference, or Subject Variable, as a TYPE of IV. R. G. Bias | School of Information | UTA 5.424 | Phone: 512 471 7046 | rbias@ischool.utexas.edu 13 Operational Definitions i • Explains a concept solely in terms of the operations used to produce and measure it. – – – – – – Bad: “Smart people.” Good: “People with an IQ over 120.” Bad: “People with long index fingers.” Good: “People with index fingers at least 7.2 cm.” Bad: Ugly guys. Good: “Guys rated as ‘ugly’ by at least 50% of the respondents.” R. G. Bias | School of Information | UTA 5.424 | Phone: 512 471 7046 | rbias@ischool.utexas.edu 14 Validity and Reliability i • Validity: the “truthfulness” of a measure. Are you really measuring what you claim to measure? “The validity of a measure . . . the extent that people do as well on it as they do on independent measures that are presumed to measure the same concept.” • Reliability: a measure’s consistency. • A measure can be reliable without being valid, but not vice versa. R. G. Bias | School of Information | UTA 5.424 | Phone: 512 471 7046 | rbias@ischool.utexas.edu 15 Theory and Hypothesis i • Theory: a logically organized set of propositions (claims, statements, assertions) that serves to define events (concepts), describe relationships among these events, and explain their occurrence. – Theories organize our knowledge and guide our research • Hypothesis: A tentative explanation. – A scientific hypothesis is TESTABLE. R. G. Bias | School of Information | UTA 5.424 | Phone: 512 471 7046 | rbias@ischool.utexas.edu 16 Goals of Scientific Method i • Description – Nomothetic approach – establish broad generalizations and general laws that apply to a diverse population – Versus idiographic approach – interested in the individual, his/her uniqueness (e.g., case studies) • Prediction – Correlational study – when scores on one variable can be used to predict scores on a second variable. (Doesn’t necessarily tell you “why.”) • Explanation – con’t. on next page • Application – Applied research R. G. Bias | School of Information | UTA 5.424 | Phone: 512 471 7046 | rbias@ischool.utexas.edu 17 Explanation i • Three important conditions for making a causal inference: – Covariation of events. (IV changes, and the DV changes.) – A time-order relationship. (First the scientist changes the IV – then there’s a change in the DV.) – The elimination of plausible alternative causes. R. G. Bias | School of Information | UTA 5.424 | Phone: 512 471 7046 | rbias@ischool.utexas.edu 18 Confounding i • When two potentially effective IVs are allowed to covary simultaneously. – Poor control! • Remember week 1 – Men, overall, did a better job of remembering the 12 “random” letters. But the men had received a different “clue” (“Maybe they’re the months of the year.”) • So GENDER (what type of IV? A SUBJECT variable, or indiv. differences variable) was CONFOUNDED with “type of clue” (an IV). R. G. Bias | School of Information | UTA 5.424 | Phone: 512 471 7046 | rbias@ischool.utexas.edu 19 Populations and Samples i • Population: the set of all cases of interest • Sample: Subset of all the population that we choose to study. Population Sample Parameters Statistics R. G. Bias | School of Information | UTA 5.424 | Phone: 512 471 7046 | rbias@ischool.utexas.edu 20 Some (as yet untested) online practice problems i • http://webster.edu/~woolflm/zscores.html R. G. Bias | School of Information | UTA 5.424 | Phone: 512 471 7046 | rbias@ischool.utexas.edu 21 Homework i • None. • No new readings! • Catch up! R. G. Bias | School of Information | UTA 5.424 | Phone: 512 471 7046 | rbias@ischool.utexas.edu 22