SUMMARY OF EVIDENCE IN THE LITERATURE
advertisement
Appendix B SUMMARY OF EVIDENCE IN THE LITERATURE Detailed information on Internet survey studies that we cite in this report is presented in Table B.1. 1 Some of the studies have multiple study arms, each of which is listed in a separate row in the table. Each study arm corresponds to a different experimental setting. For example, one arm of a study might use postal mail exclusively for contacting individuals, while another might use e-mail to invite individuals to participate in a survey that is done on the Web. We classified the survey samples into census, random (or probability), and convenience samples. Depending on who the target population is, a sample may be classified as either random or convenience. For example, a random sample of participants in an Internet newsgroup for dentists would count as a convenience sample if the population of inference is all dentists in the United States (including those who do not participate in the Internet newsgroup). Contact modes are classified as mail, phone, e-mail, newsgroup postings, traditional advertising (such as through newspapers or magazines), Web site advertising (such as hyperlinks in prominent Web sites), or Web. ______________ 1Some unpublished studies that we cited are omitted from the table because of limited information. 95 Utopia 2000 2001 2001 2001 2001 2001 Year 2001 Survey Topic Drug and alcohol use Couper Drug and alcohol use Berrens Attitudes on the environment Berrens Attitudes on the environment Asch Enlistment propensity in the military under different scenarios Everingham Balancing work and personal life Paolo Curriculum evaluation Primary Author Couper Fourth-year medical students RAND employees College students and college-bound students U.S. adults Target Population University of Michigan students University of Michigan students U.S. adults R 61 1,298 14,150 Census Census Random E-mail E-mail Mail Phone Random a 1,699 E-mail Contact Mode Mail E-mail Random Type of Sample Random a 13,034 Convenience 3,500 Sample Size 3,500 Evidence Table for Survey Studies Cited in This Report Table B.1 E-mail Web Mail + Web Phone Web Web — E-Mail Mail Phone — E-mail Response Follow-up Mode Mode Mail Mail ✺❁❐❆ 24 44 20.8 45.6 N/A 62 Response Rate (%) 41 96 Conducting Research Surveys via E-Mail and the Web Quigley Quigley Quigley Schleyer Taylor Taylor 2000 2000 2000 2000 2000 2000 Utopia Primary Author Paolo Year 2000 Political U.S. population approval 1998 U.S U.S. population election for 23 governors and 14 senators N/A N/A 438 7,279 21,805 7,209 Sample Size 83 R Survey Topic Target Population Curriculum Fourth-year medical evaluation students N/A Active-duty personnel, military spouses, civilians, reserve members N/A Active-duty personnel, military spouses, civilians, reserve members N/A Active-duty personnel, military spouses, civilians, reserve members Clinical Dentists practice Convenience Convenience Convenience Random Random Random Type of Sample Census Table B.1—Continued E-mail E-mail E-mail Mail Mail Mail Contact Mode Mail Web Web + e-mail + fax Web Mail Mail + Web Mail + Web — — E-mail Mail Mail Mail Response Follow-up Mode Mode Mail Mail ✺❁❐❆ N/A N/A 74.2 40 42 37 Response Rate (%) 41 Summary of Evidence in the Literature 97 Couper Couper Flemming Flemming Jones Jones Jones Kaye 1999 1999 1999 1999 1999 1999 1999 1999 Utopia Primary Author Witte Year 2000 Uses of Web for political information Health Health Health Election Survey Topic Social science: geographic mobility, community Organizational climate Organizational climate Election Employees of five U.S. federal agencies Employees of five U.S. federal agencies Anyone visiting the PEW Web site Anyone in prior PEW phone interview Staff at ten universities Staff at ten universities Staff at ten universities Anyone browsing the Web Target Population U.S. adults age 16 and over R N/A 200 100 200 N/A N/A 4,066 4,187 Convenience Random Random Random Convenience Convenience Census Census Sample Type of Size Sample 32,688 Convenience Table B.1—Continued Newsgroup postings E-mail Mail E-mail E-mail E-mail E-mail Mail Contact Mode Webb Web E-mail Mail Web Web Web E-mail Mail — — — — — — Mixed Mixed Response Follow-up Mode Mode Web — ✺❁❐❆ 34 72 19 N/A N/A 42.6 70.7 Response Rate (%) N/A 98 Conducting Research Surveys via E-Mail and the Web Sheehan Sheehan Shermis Shermis Vehovar Vehovar 1999 1999 1999 1999 1999 1999 Utopia Primary Author Sheehan Year 1999 Survey Topic Attitudes and behaviors associated with on-line privacy Health Web site purpose and funding Attitudes toward online privacy Telecommunications needs of educators Telecommunications needs of educators Electronic commerce Electronic commerce N/A N/A 585 585 580 834 Sample Size 5,000 R Members of the National Council on Measurement in Education Members of the National Council on Measurement in Education All Internet users in Slovenia All Internet users in Slovenia University faculty, staff, and students Creators of healthrelated Web sites Target Population Individuals with personal e-mail accounts Random Convenience Random Random Random Random Type of Sample Random Table B.1—Continued Phone E-mail E-mail Mail E-mail E-mail Contact Mode E-mail Phone Web E-mail Mail Mail + e-mail Mail + e-mail — — — — e-mail E-mail Response Follow-up Mode Mode Mail + E-mail e-mail ✺❁❐❆ N/A N/A 30 36 47 47 Response Rate (%) 24 Summary of Evidence in the Literature 99 Dillman Dillman Nichols Nichols 1998 1998 1998 1998 Utopia Primary Author Zhang Year 1999 Survey Topic Target Population Scholarly Researchers with inpaper press papers to be submissions published in eight library science journals Past Web sites Purchasers of visited, computer products lifestyles, behavior (“plain” Web page design) Past Web sites Purchasers of visited, computer products lifestyles, behavior (“fancy” Web page design) Economic Large commercial data of large U.S. companies commercial firms Economic Large commercial data of large U.S. companies commercial firms R 2,552 50 2,466 9,522 Sample Size 201 Census Convenience Random Random Type of Sample Census Table B.1—Continued Mail Mail Phone Phone Contact Mode E-mail Mail Mail + Web Web Web Mixed Mixed E-mail E-mail Response Follow-up Mode Mode Mail + Mixed Web + fax ✺❁❐❆ 84 94 36.3 41.1 Response Rate (%) 77.6 100 Conducting Research Surveys via E-Mail and the Web Utopia 1998 1998 1998 1998 1998 1998 Year 1998 a 51 Newsgroup postings Convenience Web site advertising Convenience 67 110 a Mail E-mail E-mail Contact Mode E-mail Convenience Traditional advertising Census Census Census Type of Sample Census a 226 N/A N/A Sample Size 226 R Survey Topic Target Population N/A Permanent faculty of Washington State University Schaefer N/A Permanent faculty of Washington State University Schaefer N/A Permanent faculty of Washington State University Schaefer N/A Permanent faculty of Washington State University Schillewaert Attitudes Flemish Web users toward the Web Schillewaert Attitudes Flemish Web users toward the Web Schillewaert Attitudes Flemish Web users toward the Web Primary Author Schaefer Table B.1—Continued Web Web Web Mail E-mail E-mail — — — Mail Mail E-mail Response Follow-up Mode Mode Mail + E-mail e-mail ✺❁❐❆ 0.68 1.68 0.18 57.5 54 48 Response Rate (%) 58 Summary of Evidence in the Literature 101 Utopia 1996 1996 1996 1997 1997 1997 Year 1998 Primary Author Survey Topic Schillewaert Attitudes toward the Web Coomber Drug dealer practices Kittleson Health educator certification Swoboda Future risks for the planet and mankind Bachman Total quality management in higher education Bachman Total quality management in higher education Comley Early adopters of technology 3,700 names and addresses purchased from Internet magazine in the UK Business school deans and chairpersons Business school deans and chairpersons Internet users Drug dealers worldwide Health educators Target Population Flemish Web users R 1,221 244 244 8,859 276 80 a Convenience Census Random Convenience Census Convenience Sample Type of Size Sample a Convenience 125 Table B.1—Continued E-mail E-mail Mail E-mail E-mail Mixed Contact Mode E-mail E-mail E-mail Mail Web Fax Web E-mail — — — E-mail — Response Follow-up Mode Mode Web — ✺❁❐❆ 9 52.5 65.6 25 N/A N/A Response Rate (%) 31 102 Conducting Research Surveys via E-Mail and the Web Kittleson Kittleson Mehta Mehta Mehta 1995 1995 1995 1995 1995 Utopia Primary Author Comley Year 1996 107 202 60 153 153 Random Random Random Census Census Sample Type of Size Sample 1,779 Convenience R Survey Topic Target Population Early adopters 3,700 names and of technology addresses purchased from Internet magazine in the UK Trivial Health educators in questions for a small professional health association educators Trivial Health educators questions for listed in an e-mail health directory educators Internet Active U.S. users of communiBBS newsgroups cation Internet Active U.S. users of communiBBS newsgroups cation Internet Active U.S. users of communiBBS newsgroups cation Table B.1—Continued Mail Mail E-mail E-mail Mail Contact Mode Mail Mail E-mail E-mail E-mail Mail Mail — — — — Response Follow-up Mode Mode Mail — ✺❁❐❆ 83 45 40 28.1 76.5 Response Rate (%) 18 Summary of Evidence in the Literature 103 Mehta Tse Tse Werner Schuldt 1995 1995 1995 1995 1994 Utopia Primary Author Mehta Year 1995 Survey Topic Target Population Internet International users communiof BBS newsgroups cation Internet Active U.S. users of communiBBS newsgroups cation Business Administrative and ethics teaching staff at Chinese University of Hong Kong with listed e-mail addresses Business Administrative and ethics teaching staff at Chinese University of Hong Kong with listed e-mail addresses Presidential General population approval in the U.S. rating Attitudes MIS and marketing toward faculty in shareware membership directories R 200 1,200 200 200 122 Sample Size 172 Census Random Census Census Random Type of Sample Random Table B.1—Continued Mail E-mail E-mail Mail E-mail Contact Mode E-mail Mail E-mail E-mail — — — Response Follow-up Mode Mode Mail + E-mail e-mail + fax Mail + E-mail e-mail + fax Mail Mail ✺❁❐❆ 19.3 N/A 6 27 63 Response Rate (%) 64 104 Conducting Research Surveys via E-Mail and the Web Parker Parker Walsh 1992 1992 1992 Utopia Primary Author Schuldt Year 1994 Survey Topic Target Population Attitudes MIS and marketing toward faculty in shareware membership directories Expatriation Former AT&T and employees repatriation Expatriation Former AT&T and employees repatriation Scientific Subscribers to the activities Ocean Division of with SCIENCEnet computer networks R 300 100 40 Sample Size 218 Random Census Census Type of Sample Census Table B.1—Continued E-mail E-mail E-mail Contact Mode E-mail Mail + e-mail E-mail Mail E-mail — — Response Follow-up Mode Mode E-mail — ✺❁❐❆ 76 68 38 Response Rate (%) 56.5 Summary of Evidence in the Literature 105 Kiesler Kiesler 1986 1986 Survey Topic Target Population Scientific Subscribers to the activities Ocean Division of with SCIENCEnet computer networks Health and Recently active personal computer mail characterusers at Carnegie istics Mellon University Health and Recently active personal computer mail characterusers at Carnegie istics Mellon University Utopia N/A = Not available. — = Not applicable. aNumber of responses. bTraditional and Web site advertising. Primary Author Walsh Year 1992 R 75 75 Random Random Sample Type of Size Sample 104 Convenience Table B.1—Continued Mail E-mail Contact Mode Mixed Mail E-mail Phone Phone Response Follow-up Mode Mode Mail + — e-mail ✺❁❐❆ 75 67 Response Rate (%) N/A 106 Conducting Research Surveys via E-Mail and the Web
