3. RESEARCH CLASSIFICATIONS (Experimental) Research Classifications System #1: Basic research Applied research System #2: Quantitative research Qualitative research System #3: Experimental research Nonexperimental research Research Classifications Basic vs. Applied Research Basic Pure, fundamental research Discovery of new knowledge; theoretical in nature Takes many years for the results of basic research to find some practical utility Applied Central purpose to solve an immediate problem Improved products or processes Infers beyond the group or situation studied Interpretation of results relies upon Basic research Both types of research follow the same steps of systematic inquiry to arrive at solutions to problems. Research Classifications Quantitative vs. Qualitative Quantitative Numerical, measurable data (Sampling, Measurement & Data Collection) Traditional or positivist approach Clearly stated questions Rational hypotheses Developed research procedures Extraneous variable controls Large samples Traditional, statistical analyses Qualitative Generally non-numerical data (Survey Research, Action Research, Case Study Research ) Typically anthropological and sociological research methods Observations of a “natural” setting In-depth descriptions of situations Interpretive and descriptive Research Classifications Experimental vs. Nonexperimental Experimental IVs and DVs Cause-and-effect Extraneous variable controls 3 fundamental characteristics 1. 2. 3. At least 1 active IV Extraneous var controls Observation of the DV response to the IV Nonexperimental Causal-comparative 2. Descriptive 3. Correlational 4. Historical 1. Research Classifications Steps to Experimental Research 1. 2. 3. 4. 5. 6. 7. Identifying the research question or problem area Initial review of literature Distilling the question to a specific research problem Continued review of literature Formulation of hypotheses Determining the basic research approach Identifying the population and sample Research Classifications Steps to Experimental Research 8. 9. 10. 11. 12. Designing data collection plan Selecting or developing specific data collection instruments or procedures Choosing the method of data analysis Implementing the research plan Preparing the research report Categories of Engineering Research Research in Engineering can be grouped as follows: The study of what is possible Including both mathematical and less rigorous forms of theorising. The study of existing (naturally occurring) Including information processing systems E.g. animals, societies, brains, minds, .... Research involving creation of new useful information processing systems, and research directly related to engineering applications. The creation and evaluation of tools, Including formalisms and techniques to support all these activities. Experimental Research Experimental Quantitative Basic Applied Experimental Research Nonexperimental Correlational Basic Applied Descriptive Basic Applied Experimental Research Evaluation Experimental Research What is an Experiment? Research method in which conditions are controlled so that 1 or more independent variables can be manipulated to test a hypothesis about a dependent variable. Allows evaluation of causal relationships among variables while all other variables are eliminated or controlled. Conceptual Framework Empiricism Acquiring information and facts through the observation of our world Pragmatic observations Developing theory through experience and observation Non-scientific Quick and practical solution to a problem With little interest in explaining when, how, or why Example: Anabolic steroid use (abuse)… Variables Classifications Qualitative Ordinal Nominal Quantitative Discrete (scale) Continuous Independent variable (IV) Dependent variable (DV) Extraneous variable (EV) Definitions Dependent Variable Criterion by which the results of the experiment are judged. Variable that is expected to be dependent on the manipulation of the independent variable Independent Variable Any variable that can be manipulated, or altered, independently of any other variable Hypothesized to be the causal influence Variables Common IV and DV examples IVs Exercise Diet Medicine(s) Drugs Motivation Programs Procedures Methods Techniques DVs Performance Fitness Learning Health Knowledge Behavior Definitions Experimental Treatments Alternative manipulations of the independent variable being investigated Experimental Group Group of subjects exposed to the experimental treatment Control Group Group of subjects exposed to the control condition Not exposed to the experimental treatment More Definitions Test Unit Entity whose responses to experimental treatments are being observed or measured Randomization Assignment of subjects and treatments to groups is based on chance Provides “control by chance” Random assignment allows the assumption that the groups are identical with respect to all variables except the experimental treatment Constant Error (bias) Constant error is error that occurs in the same experimental condition every time the basic experiment is repeated – a systematic bias Example: Experimental groups always administered the treatment in the morning. Control groups always in the afternoon. Introduces an uncontrolled extraneous variable – time of day. Hence, systematic or constant error. Extraneous Variables Variables other than the manipulated variables that affect the results of the experiment. Error-producing variables (other than the IVs) that may impact the DV response. (A.k.a.# Intervening variables, Modifying variables, Confounding variables). Can potentially invalidate the results. Sources of Constant Error Demand Characteristics Experimental design procedures or situational aspects of the experiment that provide unintentional hints to subjects about the experimenter’s hypothesis If occurs, participants likely to act in a manner consistent with the experimental treatment. Most prominent demand characteristic is the person actually administering the experimental treatments. Experimenter Bias Effect on the subjects’ behavior caused by an experimenter’s presence, actions, or comments. Guinea Pig Effect Effect on experimental results caused by subjects changing normal behavior or attitudes to cooperate with experimenter.