SHS Inquiries, Investigation, and Immersion Quarter 1: Module 4- Lesson 3 Understanding Data and Ways to Collect Data (Data Collection Procedure) 1 SHS Applied Subject: Inquiries, Investigation and Immersion (3I’s) Quarter 1 Module 4 - Lesson 3: Understanding Data and Ways to Collect Data (Data Collection procedure) Republic Act 8293, Section 176 states that: No copyright shall subsist in any work of the Government of the Philippines. However, prior approval of the government agency or office wherein the work is created shall be necessary for exploitation of such work for profit. Such agency or office may, among other things, impose as a condition the payment of royalties. Borrowed materials (i.e., songs, stories, poems, pictures, photos, brand names, trademarks, etc.) included in this book are owned by their respective copyright holders. Every effort has been exerted to locate and seek permission to use these materials from their respective copyright owners. The publisher and authors do not represent nor claim ownership over them. Regional Director: Gilbert T. Sadsad Assistant Regional Director: Jessie L. Amin Development Team of the Module Writer: Juliet C. Saldo – Tapayas High School Editors: Fe F. Peralta – San Vicente High School Edna F. Aladano - GMEVHS Reviewers: 1. Preciosa R. Dela Vega, EPS - English, SDO Camarines Sur 2. Jeanette Romblon, EPS I - English, SDO Masbate City Illustrators and Layout Artists: 1. Edmark M. Pado – Cabugao Elementary School 2. Mary Jane S. San Agustin – Fundado Elementary School Printed in the Philippines by 2 Module 4 Understanding Data and Ways to Collect Data Lesson 3 – Data Collection Procedure In the previous weeks, you learned about the research designs and sampling population, that demand data collection. In this module, you are welcome to explore Lesson on Data Collection Procedure. Learning Target The lesson specifically aims to describe the data collection procedure of the study. Vocabulary List Data Collection Procedure - is the process of gathering and measuring information on variables of interest, in an established systematic fashion that enables one to answer stated research questions, test hypotheses, and evaluate outcomes. Interview - are used to collect data from a small group of subjects on a broad range of topics. You can use structured or unstructured interviews. Structured interviews are comparable to a questionnaire, with the same questions in the same order for each subject and with multiple choice answers Questionnaire/Survey - is the main instrument for collecting data in survey research. Basically, it is a set of standardized questions, often called items, which follow a fixed scheme in order to collect individual data about one or more specific topics. Sometimes questionnaires are confused with interviews. Observation - is a qualitative research technique where researchers observe participants' ongoing behavior in a natural situation. Depending on the type of observation research and the goal of the study, the market researcher will have varying levels of participation in the study. 1 Warming Up .If you want to know how many active friends can respond to your message in three minutes, try to contact your friends as many as you can in two minutes by sending them message of greetings. When you find someone who answers positively, count them. Each person can only be counted once. When you complete all the counting, classify and find out how many friends replied positively to your greetings, how many did not, or how many replied you with bitterness. In this way, you already collect data, which has something to do with lesson for today. 1. In your own words, what is data collection? 2. Mention at least 3 tools in data collection that you have in mind? Define each. Learning About It Collecting data is a necessary skill for any individual. Data is used in a variety of situations, such as writing up research reports in school, finding a specific item or getting necessary information for a job. Regardless of the reason for the data, there are similar tools used to find information and collect data. Computer and Internet The Internet can collect a wide range of data in a short period of time. A simple search through a search engine will result in several websites that are useful for data collection. Though the Internet has a large amount of information available, there are weaknesses as well. The main weakness when looking for data on the Internet is inaccurate information or inappropriate websites for the necessary information. When looking for data online, finding legitimate websites takes time. School websites and government websites are a good source of accurate information. Depending on the necessary data, organization websites are also legitimate. Surveys Surveys are an excellent data collection tool. These are useful in businesses, mental health studies, school projects or any other data collection that requires information from a large number of people. Surveys ask specific questions that are filled out by individuals. The answers provided in the survey provide data about a variety of subject, such as customer satisfaction about specific products or services. 2 Interviews Interviews are a data collection method that is used to gain information about a specific subject. Interviews are commonly given to experts in a specific field, such as interviewing a psychologist that specializes in children’s mental health when collecting data about a childhood mental health problem. Interviews are commonly used by news reporters to gain first-hand information about a specific story. Observation Data collection is not always about asking questions or researching online, but also about paying attention and observing as well. This is first-hand data rather than second-hand data from another source. Observation data collection includes specific items that are measured, seen or that others can reproduce. Books Books are a primary tool for data collection. While old books might have outdated information, even old books are used for historical studies or data collection. There are books available about any subject that ranges from mythology to history to science and math. The wide range of subj ects available in books allows for finding data about any specific subject. One of the main weaknesses with collecting data from a book is locating the necessary data and time constraints. Books are available for free reading and researching from libraries around the country. Source: Penn State: Observation: An Underused Method to Collect Data Education Resources Information Center: Strategies and Tools Used to Collect Data Florida State University: Criminology: Using the Internet to Collect Data The above information can be wrapped up to what qualitative data contains. Source: Department of Education 3 Group interviews can be classified into two types: 1. Focus groups – participants are selected by the researcher according to the specific sampling criteria. 2. Natural groups – participants belong to a group that exists independently of the study. 3. There are two kinds of observation: 1. Observation Checklist – quantitative in nature, and make use of ratings or numerical rankings. 2. Observation Guide – more qualitative, and allow more general descriptive documents. 4 Data collection is the process of gathering and measuring information on variables of interest, in an established systematic fashion that enables one to answer stated research questions, test hypotheses, and evaluate outcomes. The data collection component of research is common to all fields of study including physical and social sciences, humanities, business, etc. While methods vary by discipline, the emphasis on ensuring accurate and honest collection remains the same. The importance of ensuring accurate and appropriate data collection Regardless of the field of study or preference for defining data (quantitative, qualitative), accurate data collection is essential to maintaining the integrity of research. Both the selection of appropriate data collection instruments (existing, modified, or newly developed) and clearly delineated instructions for their correct use reduce the likelihood of errors occurring. Consequences from improperly collected data include: 1. inability to answer research questions accurately 2. inability to repeat and validate the study 3. distorted findings resulting in wasted resources 4. misleading other researchers to pursue fruitless avenues of investigation 5. compromising decisions for public policy 6. causing harm to human participants and animal subjects While the degree of impact from faulty data collection may vary by discipline and the nature of investigation, there is the potential to cause disproportionate harm when these research results are used to support public policy recommendations. Issues related to maintaining integrity of data collection: The primary rationale for preserving data integrity is to support the detection of errors in the data collection process, whether they are made intentionally (deliberate falsifications) or not (systematic or random errors). Most, Craddick, Crawford, Redican, Rhodes, Rukenbrod, and Laws (2003) describe ‘quality assurance’ and ‘quality control’ as two approaches that can preserve data integrity and ensure the scientific validity of study results. Each approach is implemented at different points in the research timeline (Whitney, Lind, Wahl, 1998): 1. Quality assurance - activities that take place before data collection begins 2. Quality control - activities that take place during and after data collection 5 Quality Assurance Since quality assurance precedes data collection, its main focus is 'prevention' (i.e., forestalling problems with data collection). Prevention is the most cost-effective activity to ensure the integrity of data collection. This proactive measure is best demonstrated by the standardization of protocol developed in a comprehensive and detailed procedures manual for data collection. Poorly written manuals increase the risk of failing to identify problems and errors early in the research endeavor. These failures may be demonstrated in a number of ways: 1. Uncertainty about the timing, methods, and identify of person(s) responsible for reviewing data 2. Partial listing of items to be collected 3. Vague description of data collection instruments to be used in lieu of rigorous step-by-step instructions on administering tests 4. Failure to identify specific content and strategies for training or retraining staff members responsible for data collection 5. Obscure instructions for using, making adjustments to, and calibrating data collection equipment (if appropriate) 6. No identified mechanism to document changes in procedures that may evolve over the course of the investigation. An important component of quality assurance is developing a rigorous and detailed recruitment and training plan. Implicit in training is the need to effectively communicate the value of accurate data collection to trainees (Knatterud, Rockhold, George, Barton, Davis, Fairweather, Honohan, Mowery, O'Neill, 1998). The training aspect is particularly important to address the potential problem of staff who may unintentionally deviate from the original protocol. This phenomenon, known as ‘drift’, should be corrected with additional training, a provision that should be specified in the procedures manual. Given the range of qualitative research strategies (nonparticipant/ participant observation, interview, archival, field study, ethnography, content analysis, oral history, biography, unobtrusive research) it is difficult to make generalized statements about how one should establish a research protocol in order to facilitate quality assurance. Certainly, researchers conducting non-participant/participant observation may have only the broadest research questions to guide the initial research efforts. Since the researcher is the main measurement device in a study, many times there are little or no other data collecting instruments. Indeed, instruments may need to be developed on the spot to accommodate unanticipated findings. 6 Quality Control While quality control activities (detection/monitoring and action) occur during and after data collection, the details should be carefully documented in the procedures manual. A clearly defined communication structure is a necessary precondition for establishing monitoring systems. There should not be any uncertainty about the flow of information between principal investigators and staff members following the detection of errors in data collection. A poorly developed communication structure encourages lax monitoring and limits opportunities for detecting errors. Detection or monitoring can take the form of direct staff observation during site visits, conference calls, or regular and frequent reviews of data reports to identify inconsistencies, extreme values or invalid codes. While site visits may not be appropriate for all disciplines, failure to regularly audit records, whether quantitative or quantitative, will make it difficult for investigators to verify that data collection is proceeding according to procedures established in the manual. In addition, if the structure of communication is not clearly delineated in the procedures manual, transmission of any change in procedures to staff members can be compromised Quality control also identifies the required responses, or ‘actions’ necessary to correct faulty data collection practices and also minimize future occurrences. These actions are less likely to occur if data collection procedures are vaguely written and the necessary steps to minimize recurrence are not implemented through feedback and education (Knatterud, et al, 1998) Examples of data collection problems that require prompt action include: errors in individual data items systematic errors violation of protocol problems with individual staff or site performance fraud or scientific misconduct In the social/behavioral sciences where primary data collection involves human subjects, researchers are taught to incorporate one or more secondary measures that can be used to verify the quality of information being collected from the human subject. For example, a researcher conducting a survey might be interested in gaining a better insight into the occurrence of risky behaviors among young adult as well as the social conditions that increase the likelihood and frequency of these risky behaviors. 7 To verify data quality, respondents might be queried about the same information but asked at different points of the survey and in a number of different ways. Measures of ‘Social Desirability’ might also be used to get a measure of the honesty of responses. There are two points that need to be raised here, 1) cross-checks within the data collection process and 2) data quality being as much an observation-level issue as it is a complete data set issue. Thus, data quality should be addressed for each individual measurement, for each individual observation, and for the entire data set. Each field of study has its preferred set of data collection instruments. The hallmark of laboratory sciences is the meticulous documentation of the lab notebook while social sciences such as sociology and cultural anthropology may prefer the use of detailed field notes. Regardless of the discipline, comprehensive documentation of the collection process before, during and after the activity is essential to preserving data integrity. Six Steps or procedures for successful data collection: Step 1: Identify issues and/or opportunities for collecting data. ... Step 2: Select issue(s) and/or opportunity(ies) and set goals. ... Step 3: Plan an approach and methods. ... Step 4: Collect data. ... Step 5: Analyze and interpret data. ... Step 6: Act on results. 8 Source: https://www.google.com/search?q=data+collection+methods&oq=data+collection&aqs=c hrome.3.69i59l2j69i57j0l2j69i60l3.13913j0j4&sourceid=chrome&ie=UTF-8 Keeping You in Practice Practice Task 1. Identify the data gathering tools appropriate to use in your study Practice Task 2. Describe the data collection procedure of your study. 9 Practice Task 3. As you write, consider the factors and various approaches in determining the data collection procedure of your study. Additional Tasks Task 1: Re-evaluate the data collection procedure. Choose the data gathering tool appropriate to your study and formulate interview and observation guide. Rubrics : Creativity Critical Thinking Appropriateness Content Organization Total Task 2: - 10% 20% 20% 30% 20% - 100% Present the manuscript of data collection procedure. 10 Cooling Down I. Identification Instruction: Answer the following questions and write your answers on your notebook or a separate answer sheet. ____________1. It is the process of gathering and measuring information on variables of interest, in an established systematic fashion that enables one to answer stated research questions, test hypotheses, and evaluate outcomes. ____________2. These are used to collect data from a small group of subjects on a broad range of topics. You can use structured or unstructured interviews. Structured interviews are comparable to a questionnaire, with the same questions in the same order for each subject and with multiple choice answers ____________3. It is the main instrument for collecting data in survey research. Basically, it is a set of standardized questions, often called items, which follow a fixed scheme in order to collect individual data about one or more specific topics. Sometimes questionnaires are confused with interviews. ____________4. It is a qualitative research technique where researchers observe participants' ongoing behavior in a natural situation. Depending on the type of observation research and the goal of the study, the market researcher will have varying levels of participation in the study. ____________5. It is a necessary skill for any individual. Data is used in a variety of situations, such as writing up research reports in school, finding a specific item or getting necessary information for a job. Regardless of the reason for the data, there are similar tools used to find information and collect data. ____________6. It can collect a wide range of data in a short period of time. A simple search through a search engine will result in several websites that are useful for data collection. ___________7. These are an excellent data collection tool. These are useful in businesses, mental health studies, school projects or any other data collection that requires information from a large number of people. ___________8. These are a data collection method that is used to gain information about a specific subject. Interviews are commonly given to experts in a specific field, such as interviewing a psychologist that specializes in children’s mental health when collecting data about a childhood mental health problem. Interviews are commonly used by news reporters to gain first-hand information about a specific story. 11 ___________9. This is first-hand data rather than second-hand data from another source. This includes specific items that are measured, seen or that others can reproduce. ___________10. These are a primary tool for data collection. While old books might have outdated information, even old books are used for historical studies or data collection. There are books available about any subject that ranges from mythology to history to science and math. ____________11. These group’s participants belong to a group that exists independently of the study. ____________12. It is quantitative in nature, and make use of ratings or numerical rankings. ____________13. This is more qualitative, and allow more general descriptive documents. ____________14. It precedes data collection, its main focus is 'prevention' (i.e., forestalling problems with data collection). Prevention is the most cost-effective activity to ensure the integrity of data collection. These includes activities that take place before data collection begins ____________15. It occurs during and after data collection, the details should be carefully documented in the procedures manual. A clearly defined communication structure is a necessary pre-condition for establishing monitoring systems. These include activities that take place during and after data collection II. Enumeration Instruction: Provide answers to the following items below. 16-17 Two types of Group interviews: 18-19 Two kinds of observation tools: 20-25 Six Steps or procedures for successful data collection: 26-31 Consequences from improperly collected data include inability to answer research questions accurately 32-37 Examples of data collection problems that require prompt action include: III. Essay Instruction: Answer the questions below briefly and concisely. 38-40. What are the identified data gathering tools to be used in a study? 41-45. In your own words, describe each data gathering tool considering its importance in the study. 46-50. As a researcher, how will you use interview and observation as data gathering tools in your study? 12 Learning Challenge Task 1. Interpretation of data Have an advance reading on data interpretation. After gathering the data, it will be computed, tabulated and interpreted. Task 2. Data analysis Study how to analyze data. Soon the data is already computed, tabulated and interpreted, the data needs to be analyzed to arrive into putting inference and implications. Points to Ponder Data collection procedure allows the researcher to adjust time or prepare time table in order to get timely, valid and reliable data that needs to be computed, tabulated, interpreted, inferred and given implications. Answer Key WARMING UP Pretest: Answers vary. Practice Tasks 1: Answer may vary. Practice Tasks 2: Answer may vary. Practice Tasks 3: Answer may vary. Additional Tasks Task 1: Answer may vary depending on their research problem. Task 2. Answer may vary. COOLING DOWN I. Identification 1. Data Collection Procedure 2. Interview 13 3. Questionnaire/Survey 4. Observation 5. Collecting data 6. Computer and Internet 7. Surveys 8. Interviews 9. Observation data collection 10. Books 11. Focus groups 12. Observation Checklist 13. Observation Guide 14. Quality assurance 15. Quality control II. Enumeration 16-17. Group interviews can be classified into two types: Focus Natural groups 18-19. There are two kinds of observation: Observation Checklist – quantitative in nature, and make use of ratings or numerical rankings. Observation Guide – more qualitative, and allow more general descriptive documents. 20-25. Six Steps or procedures for successful data collection: Step 1: Identify issues and/or opportunities for collecting data. ... Step 2: Select issue(s) and/or opportunity(ies) and set goals. ... Step 3: Plan an approach and methods. ... Step 4: Collect data. ... Step 5: Analyze and interpret data. ... Step 6: Act on results. 26-31. Consequences from improperly collected data include 26.inability to answer research questions accurately 27. inability to repeat and validate the study 28.distorted findings resulting in wasted resources 29.misleading other researchers to pursue fruitless avenues of investigation 30.compromising decisions for public policy 31.causing harm to human participants and animal subjects 32-36. Examples of data collection problems that require prompt action include: errors in individual data items 14 systematic errors violation of protocol problems with individual staff or site performance fraud or scientific misconduct III. Essay: Answers may vary. LEANING CHALLENGES Task 1: Answer may vary. Task 2: Answer may vary. References Knatterud.,G.L., Rockhold, F.W., George, S.L., Barton, F.B., Davis, C.E., Fairweather, W.R., Honohan, T., Mowery, R, O’Neill, R. (1998). Guidelines for quality assurance in multicenter trials: a position paper. Controlled Clinical Trials, 19:477-493. Most, .M.M., Craddick, S., Crawford, S., Redican, S., Rhodes, D., Rukenbrod, F., Laws, R. (2003). Dietary quality assurance processes of the DASH-Sodium controlled diet study. Journal of the American Dietetic Association, 103(10): 1339-1346. Whitney, C.W., Lind, B.K., Wahl, P.W. (1998). Quality assurance and quality control in longitudinal studies. Epidemiologic Reviews, 20(1): 71-80. https://www.google.com/search?q=data+collection+procedure&oq=data+collection& aqs=chrome.0.69i59j69i57j0l3j69i60l3.3465j0j9&sourceid=chrome&ie=UTF-8 https://ori.hhs.gov/education/products/n_illinois_u/datamanagement/dctopic.html#:~:t ext=Data%20collection%20is%20the%20process,test%20hypotheses%2C%20and% 20evaluate%20outcomes. 15