Methodological Review of Key Research by Key People within Information Systems Management Prepared By: Yi-da (Allen) Chen Yan (Mandy) Dang Zheren (Ben) Hu Sean Humpherys Chang Heon Lee Kevin Moffitt Jing Sun Sven Thoms Roopali Wakhare Yulei (Gavin) Zhang MIS696A: Readings in MIS Fall 2006 Oversight by Dr. Jay F. Nunamaker, Jr. Thanks to the assistance from Chris Diller Methodological Review of Key Research by Key People within Information Systems Management 2 Abstract In this research project, we analyzed 161 key research papers for the methodologies used. Finding were presented by methodology type and by MIS domain. We define each methodology and discuss their relationship to positivism and interpretivism, which are also compared and discussed. After grouping the research papers by methodology some interesting findings are available, summarized by the following table. MIS Domain Predominant Methodology Used Among Key Papers (determined by count) AI Lab experiments Collaboration Lab experiments & prototyping Data Management Design Science Economics of Information Mathematical modeling HCI Descriptive research Operations Management Mathematical modeling Social Informatics Descriptive research, argumentative research, and field study used most frequently System Analysis and Design Design Science Take as a whole, design science is used in 22% (35 of 161 papers) of all the key research papers, which frequency is double the nearest competitor. If you combine design science with system development and prototyping (because the two later methods also emphasize creating artifacts and could easily be constructed using design science principles) the frequency is 42% (67 of 161 papers) of all key research papers. The overall conclusion is that design science and other methods that develop artifacts, are the predominant research methodologies used by key MIS researchers among their key papers. Future classes should read the Limitations and Future Study section of this paper for important tips on how to conduct follow up research. Methodological Review of Key Research by Key People within Information Systems Management 3 Table of Content Abstract ................................................................................................................................................................................ 2 Introduction ........................................................................................................................................................................ 5 Contributions from Classes 1998 through 2005 .................................................................................................... 5 Contributions by Class of 2006 ................................................................................................................................. 5 Limitations and Future Research............................................................................................................................... 6 Definitions...................................................................................................................................................................... 7 Research Philosophy .................................................................................................................................................... 8 Ontology .................................................................................................................................................................... 8 Epistemology ............................................................................................................................................................ 9 Research Paradigms in IS ............................................................................................................................................ 9 Positivism ................................................................................................................................................................ 10 Interpretivism ......................................................................................................................................................... 10 Others....................................................................................................................................................................... 10 Defining Research Methodologies............................................................................................................................... 11 Action Research ..................................................................................................................................................... 11 Argumentative ........................................................................................................................................................ 11 Description Research ............................................................................................................................................ 11 Design Science........................................................................................................................................................ 11 Case Studies............................................................................................................................................................. 11 Ethnographic research .......................................................................................................................................... 11 Field Experiments.................................................................................................................................................. 12 Field Studies ............................................................................................................................................................ 12 Game-Role Playing................................................................................................................................................ 12 Historical methodology ........................................................................................................................................ 12 Laboratory Experiment ........................................................................................................................................ 12 Mathematical Models ............................................................................................................................................ 12 Pluralistic Methodology ........................................................................................................................................ 12 Prototyping.............................................................................................................................................................. 13 Simulation................................................................................................................................................................ 13 System Development ............................................................................................................................................ 13 Survey/Interviewing.............................................................................................................................................. 13 Methodologies Relationship to Positivism and Interpretivism......................................................................... 14 Methodological Review of Key Research by Key People within Information Systems Management 4 Presentation of Findings ................................................................................................................................................ 15 Key Research Using Argumentative Methodology ............................................................................................. 17 Key Research Using Action Research Methodology .......................................................................................... 18 Key Research Using Description Research Methodology................................................................................. 19 Key Research Using Design Science Methodology ............................................................................................ 23 Key Research Using Case Studies Methodology ................................................................................................. 28 Key Research Using Ethnographic Research Methodology ............................................................................. 30 Key Research Using Field Experiment Methodology ........................................................................................ 31 Key Research Using Field Study Methodology.................................................................................................... 32 Key Research Using Game-Role Playing Methodology .................................................................................... 33 Key Research Using Historical Methodology ...................................................................................................... 34 Key Research Using Laboratory Experiment Methodology............................................................................. 35 Key Research Using Mathematical Model Methodology .................................................................................. 37 Key Research Using Pluralistic Methodology....................................................................................................... 39 Key Research Using Prototyping Methodology .................................................................................................. 40 Key Research Using Simulation Methodology..................................................................................................... 42 Key Research Using System Development Methodology................................................................................. 43 Key Research Using Survey Methodology ............................................................................................................ 45 Methodologies by MIS Domain................................................................................................................................... 46 Conclusion......................................................................................................................................................................... 51 References ......................................................................................................................................................................... 52 Methodological Review of Key Research by Key People within Information Systems Management 5 Introduction The purpose of this research is to familiarize the reader with key researchers and key research in the Management of Information Systems (MIS) research discipline along with the related methodological preferences in said research. Contributions from Classes 1998 through 2005 Previous classes have compiled excellent research to familiarize readers with the MIS domain, including key researchers and their respective research. The Class of 1998 began the process by listing seven subdomains of MIS and for each subdomain listed over 45 influential researchers with a one paragraph biography. The Class of 1999 created a list of 47 key researchers in MIS grouped by ten research areas while describing in several paragraphs each key research. The Class of 2000 expanded the research areas to 15, listing 90 key researchers and highlighted research. The Class of 2001 presented a timeline of events in MIS and defined eight subdomains of MIS. The Class of 2002 re-categorized MIS into nine subdomains with a visual representation of the subdomain relationships; and they described seminal works for each subdomain. The Class of 2003 identified the top 101 MIS researchers, categorizing them by subdomain. The class of 2003 also presented a three-dimensional model of MIS research characteristics with axis representing behavior verses technical, application verses theory, and rigor verses relevance. Each seminal work was generalized onto the three-dimensional model for easy comprehension. Profiles of researchers with key contributions were also identified. The Class of 2003 provided future classes with an End Note reference library of the data. The Class of 2004 contributed to the body of knowledge by identifying U.S. departments of key research and key researchers. The Class of 2005 compiled the models of MIS from 2002, 2003, and 2004 into one comprehensive model. With this model, the class identified key research. In addition, the Class of 2005 included charts explaining the quantitative contribution of research from each subdomain. Contributions by Class of 2006 To add to the body of knowledge regarding key people and key research in MIS, the Class of 2006 will contribute in the following ways. 1. Identify and discuss common research methodologies and methodological paradigms 2. Discuss and compare positivism and interpretism paradigms Methodological Review of Key Research by Key People within Information Systems Management 6 3. Categories key research and key MIS researchers by methodology to provide precedence for methodologies from key research 4. Identify new key research and key individuals since the previous studies 5. Categorize methodologies used in MIS by domain 6. Compile PDF files of key research into a class repository for use by future classes 7. Update the End Note reference database as appropriate for use by future classes Limitations and Future Research Presentation of the findings to an audience of researchers had the unplanned consequence of misconceptions regarding author’s prime choice in methodology. For which we take full responsibility for and wish to explain our approach to prevent the same from occurring with the readers of this paper. Our research approach was to take the 161 key papers in MIS, group them by methodology type, and include author information; regardless of whether that researcher was know for prominence in a particular methodology. We let the paper classification speak for itself. Repeated comments of “That researcher isn’t a field study expert, she’s an ethnographic researcher,” gave indication that it was assumed that by placing an author in a methodology category we gave implication to it being the authors only or predominant methodology. Predominance cannot be construed by this limited sampling, as only the authors’ key research, not collective research, was analyzed. However, the findings are accurate according to the approach we used. This unforeseen consequence does the a significant positive consequence of identify a new opportunity for research. Research audiences desire to see which researchers are responsible for or have had major contribution to a particular methodology. The question on their mind is “When I hear design science (or any methodology) who should I think of as major contributors?” Future research projects can answer this question, which will require a distinct approach to the one used in our research. This section is typically found at the end of a paper, but we desired to present this material early to make the read aware of our approach and the various implications of it. Methodological Review of Key Research by Key People within Information Systems Management 7 Definitions While there is academic debate as to an all encompassing definition of MIS, this study uses the succinct and widely accepted definition of Brabb1: A management information system is the complement of people, machines, and procedures that develops the right information and communicates it to the right managers at the right time. Using this definition, each of the previous classes from 1998 through 2005 have created a conceptual model of MIS. Each class has subdivided MIS into various subdomains, ranging from 7 to 9 subdomains. While each class justifies their uniqueness, the distinguishing characteristics have become progressively consubstantial. For this reason and until a completely novel model of MIS is developed, we choose to follow the model presented by the Class of 2005 and refer the reader to their paper for defense and justification of the model (See Figure 1). While a difficult and potentially controversial task, defining “key research” and “key researchers” has precedence from previous MIS697 class research projects. In previous classes, the definition of “key” is those papers and individuals that have highly influenced and contributed to the IS body of knowledge. In an attempt to employee this definition, previous classes have used interviews with established researchers and citation figures to guide their selection. This paper accepts the definition and selection criteria of the past eight papers and will specifically use the list of key research and researchers provided by the Class of 2005’s research paper, with a few updates for recent research. The focus of this paper isn’t to dispute the past papers’ findings, but to augment their findings with a discovery and discussion of the methodologies used by key researchers. We wish we could include all the great quality research from IS in this paper, which thankfully would include thousands of papers. But realizing that this paper has a limited scope, we appreciate the reader’s patience with the selection process. 1 Brabb, George J. Computers and Information Systems in Business. Houghton Mifflin Co., Boston. 1976, pp. 26, 37. Methodological Review of Key Research by Key People within Information Systems Management 8 Figure 1: Model of MIS with eight subdomains presented by Class of 2005 and adopted for this study Using the MIS model from previous classes has the advantage of allowing our research efforts to focus on a unique contribution: to identify methodologies used by key researchers in their influential research. We hope that this data will provide precedence for future researchers in selecting and justifying a choose research methodology. Research Philosophy There are two research philosophies that guide scientific pursuit: ontology and epistemology. Ontology Ontology was originally developed in philosophy domain, in which it refers to being or existence. The definition of ontology in a dictionary has two meanings: “1. A science or study of being: specifically, a branch of metaphysics relating to the nature and relations of being; a particular system according to which problems of the nature of being are investigated; first philosophy; 2. a theory concerning the kinds of entities and specifically the kinds of abstract entities that are to be admitted to a language system.” (Inc Merriam-Webster, 2002). The first definition is commonly utilized in traditional philosophy, while the second one is popular in Artificial Intelligence and Knowledge Representation (Corazzon, 2006). In the present study, we will employ the general concept of ontology in philosophy and examine the assumptions extracted based on it for the methodology in MIS. Methodological Review of Key Research by Key People within Information Systems Management 9 From the philosophical perspective, ontology is the science which “provides criteria for distinguishing various types of objects (concrete and abstract, existent and non-existent, real and ideal, independent and dependent) and their ties (relations, dependences and prediction)” (Corazzon, 2006). It can be said to study conceptions of reality. Epistemology Epistemology is a philosophy branch which studies what is knowledge and how to obtain knowledge. In science, two fundamental problems encountered by every researcher are “what is knowledge?” and “how do we acquire knowledge?” which are primarily questions that epistemology addresses. Epistemology has three basic elements – truth, belief, and judgment, and it addresses the process and outcome that how human believe a justified truth. Examining the history of epistemology, we can find that the first theories about knowledge emphasized knowledge’s absolute, permanent character, whereas the later theories stressed its relativity or situation-dependence, its continuous development or evolution, and its active interference with the world and its subjects and objects (Heylighen, 1993). Logic and empirical methods are emphasized in epistemology. Empiricism and rationalism are two epistemological positions that dominated philosophy after Renaissance. According to the former one, knowledge is obtained through processes that subjects perceived the external objects through their sensory organs – ear, eye, etc., and transfer to their brain or mind; while the latter considers that “knowledge results from the organization of perceptual data on the basis of inborn cognitive structures” (Heylighen, 1993). Research Paradigms in IS Positivism dominated in IS in the last two decades, and methodologies in most articles are traditional due to the following of natural sciences (Alavi, Carlson, & Brooke, 1989). However, along with the development of Information System, other important research methodology paradigms, such as interpretivism and pragmatism, are reconsidered and integrated with positivism by researchers (Galliers & Land, 1987; Lee, 1991; Falconer & Mackay, 1999; Goles & Hirschheim, 1999; Mingers, 2001; Johnson & Onwuegbuzie, 2004; Weber, 2004; Marcon & Gopal, 2005). Methodological Review of Key Research by Key People within Information Systems Management 10 Positivism Positivism embraces the “objective” attribute of ontology. It postulates that the world is comprised by objects and structures which “exist as empirical entities, on their own, independent of the observer’s appreciation of them” (Goles & Hirschheim, 2000). The reality or realism of ontology is adopted by positivists. They consider objects and subjects who observe these objects are separate and independent things (Weber, 2004). Under the assumptions of epistemology, positivists should obtain knowledge based on the reality which exists beyond the human mind. They believe that subjects’ perception of the world reflects an objective reality which is independent to the subjects, and the reality provides the foundation for human knowledge (Weber, 2004). Interpretivism Interpretivists believe that objects and the subjects who observe these objects cannot be separated. They think the reality in a society is the product of a series of processes by which social subjects define and negotiate the meaning of the world. There are both subjective and objective characteristics of the world. The subjective characteristics reflects how human interpret that meaning, while the objective characteristics reflects an intersubjective reality – the negotiation about that meaning (Weber, 2004). From epistemology perspective, interpretivists believe that knowledge is derived from everyday concepts and meanings. Knowledge built up by human reflects subjects’ personal experience and background. Therefore, knowledge is constituted by human intentionally. Researchers enter the everyday social world in order to grasp the socially constructed meanings and then reconstruct these meanings in a social scientific language. Others Besides the argument of positivism and interpretivism among IS researchers, some other research methodology paradigms are also proposed for future research. Pragmatism, based on the philosophy of seeking truth value (Johnson & Onwuegbuzie, 2004), has emerged as “a fresh perspective on research” (Goles & Hirschheim, 2000). Methodological Review of Key Research by Key People within Information Systems Management 11 Defining Research Methodologies The following are several methodologies used in IS research. While the list attempts to be comprehensive, some may argue that a particular methodology is described by another. We recognize that there may be overlap, and we discuss the relationship between methodologies in the next section of this paper. Action Research In action research, the researcher wants to try out a theory with practitioners in real situations, gain feedback from this experience, modify the theory as a result of this feedback and try it again. Action research consists of many iteration. Each iteration of the action research process adds to the theory so it is more likely to be appropriate for a variety of situations. Argumentative Argumentative research uses logical arguments to arrive at a supposed truth. Postulates and axioms are constructed into a logical progression, that if all true, the conclusion must also be true. Description Research In….. Design Science Creates and evaluates IT artifacts intended to solve identified organizational problems. Design science is inherently a problem solving process. DS seeks to create innovations that define the idea, practices, technical capabilities, and products through which the analysis, design, implementation, management, and use of IS can be effectively and efficiently accomplished. DS can use a combination of other research methodologies to achieve the research aim. Case Studies A case study is a particular method of primarily qualitative research. Rather than using large samples and following a rigid protocol to examine a limited number of variables, case study methods involve an in-depth, longitudinal examination of a single instance or event: a case. Ethnographic research Ethnography refers to the genre of writing or research that presents qualitative description of human social phenomena, based on fieldwork. Ethnography presents the results of a holistic research method founded on the idea that a system's properties cannot necessarily be accurately understood Methodological Review of Key Research by Key People within Information Systems Management 12 independently of each other. The genre has both formal and historical connections to travel writing and colonial office reports. Several academic traditions, in particular the constructivist and relativist paradigms, claim ethnographic research as a valid research method. It can also include case suites, interviews, longterm studies of sites. Field Experiments Research done in a less controlled, natural environment, but must still be quantitative and include experiment research principles such as random selection. Field Studies Research done not in a laboratory but in the natural environment; it may be observational only, it may include experimental interaction with the subjects in the field. Game-Role Playing As-if experiments in which the subject is asked to behave as if he or she were a particular person in a particular situation. It requires a human subject playing a role or simulating a behavior. It may be conducted in a laboratory or interactively in the field. Historical methodology The historical method comprises the techniques and guidelines by which historians use primary sources and other evidence to research and then to write history. The question of the nature, and indeed the possibility, of sound historical method is raised in the philosophy of history, as a question of epistemology. The examination of societies of social unites over time and in comparison with one another. Ideographic. Laboratory Experiment This methodology is the most common and consists of empirical and quantitative research done in a controlled environment. Mathematical Models Abstract model using mathematics to describe system behavior; include independent variables, constants; may be derivable through proof; has a quantitative outcome that is verifiable via a proof or via experiments. Pluralistic Methodology This methodology differs from the reset in that if encourages using multiple research methodologies to achieve the scientific goal. Methodological Review of Key Research by Key People within Information Systems Management 13 Prototyping Research to discover solutions to problems. Developing a prototype, testing the prototype with measurable results. Simulation Enhances purely mathematical models when elementary functions alone cannot describe the solution. Generates samples of data from running multiple simulation, usually includes variables too numerous to put into one mathematical model or that cannot be derived via a mathematical proof and is generally not experimentally verifiable in the full-scale natural environment. System Development This research methodology can be thought of as “proof by demonstration.” It consists of five stages; concept design, constructing the architecture of the system; prototyping; product development; technology transfer. Survey/Interviewing This is a research methodology that relies on gathering research data via interviews and surveys instruments. The data is quantitative but usually reflects subjective opinions on a qualitative matters. Methodological Review of Key Research by Key People within Information Systems Management 14 Methodologies Relationship to Positivism and Interpretivism The following discussion presents the relationship between the various methodologies. The table below represents a relative classification of methodology in relation to positivism and interpretivism. The further to the left of the column, the more a methodology contains positivistic characteristics. We acknowledge that this representation is more subjective than our quantitative minds might desire, it is a generalization based on descriptions found in published papers on methodology characteristics and from interviews with experienced researchers. METHODOLOGY Survey Interview Observation Case Study Field Study Field Experiment Lab Experiment Simulation Prototyping Product Development Technology Transfer Conceptual Framework Mathematical Modeling Historical Methods Pluralistic Design Science Ethnographic Research Game / Role Playing Argumentative Descriptive Action Research POSITIVIST INTERPRETIVIST Methodological Review of Key Research by Key People within Information Systems Management 15 Presentation of Findings The following findings group the key researches and respective key research by the methodologies employed in the particular research paper. We group nearly 300 research papers in this manner. A particular research paper may appear in more than one category if more than one methodology was used. We encourage the reader to visit the previous class papers to discover additional biographical information about each author, such as dominate domain of focus, awards won, description of research contribution, etc. In addition to presenting our data, we have chosen to combine a graphical classification of each paper for our readers benefit. This graphical classification was developed by the Class of 2003 and augmented by the Class of 2005. It will assist the reader in quickly comprehending additional information about the particular research paper in questions based on three factors, listed below, which are transposed onto a three-axis graph. Theory / Application: Theory is described as a type of research that is used to describe an environment. Application is the use of an existing theory to propose an actual solution to a specific problem. Technical / Behavioral: Technical refers to positivist research, or research that relies on observable facts. Behavior refers to research that relies on interpreting observable behavior. Rigor / Relevance: Rigorous research typically involves exact, mathematical modeling. Relevant research is generalized for use by practitioners. Graphics to be used to classify papers Behavioral Theory Relevant Technical Theory Relevant Behavioral Application Relevant Technical Application Relevant Behavioral Theory Rigor Technical Theory Rigor Methodological Review of Key Research by Key People within Information Systems Management Behavioral Application Rigor Technical Application Rigor 16 Methodological Review of Key Research by Key People within Information Systems Management 17 Key Research Using Argumentative Methodology The following key research and researchers use argumentative methodology. Author(s) Murray Turoff Vladimir Zwass Murray Turoff Russell L Ackoff Barry W. Boehm Vannevar Bush Key Research MIS Domain Computer Mediated Communication Requirements for Group Support Collaboration E-Commerce: Structures and Issues (1996) Economics and Informatics Delphi and its Potential Impact on Information Systems Collaboration Management Misinformation Systems System Analysis and Design Software Risk Management System Analysis and Design As We May Think Behavioral Application Relevant Technical Theory Rigor Behavioral Application Rigor Social Informatics Newell, Allen Card, Stuart K The Prospects for Psychological Science in Human-Computer Interaction HCI Parnas, David Lorge Software Engineering Programs are not Computer Science Programs Systems Analysis and Design Computerization and Social Transformations (1991) Social informatics Rob Kling MIS Characteristic Model Behavioral Theory Relevant Technical Theory Relevant Behavioral Theory Relevant Behavioral Theory Relevant Technical Theory Rigor Behavioral Application Relevant Methodological Review of Key Research by Key People within Information Systems Management 18 Key Research Using Action Research Methodology The following key research and researchers use action research methodology. Author(s) Sara Kiesler Key Research Internet paradox: A social technology that reduces social involvement and psychological well-being?(1998) MIS Domain Social Informatics MIS Characteristic Model Behavioral Theory Relevant Methodological Review of Key Research by Key People within Information Systems Management 19 Key Research Using Description Research Methodology The following key research and researchers use description research methodology. Author(s) Erik Brynjolfsson Douglas C. Engelbart Clarence A. Ellis Marshall L. Fisher George P. Huber George W. Furnas Key Research MIS Domain The productivity paradox of information technology Social Informatics Augmenting Human Intellect: A Conceptual Framework(1962) HCI Office Information Systems and Computer Science(1980) System Analysis and Design Groupware - Some Issues and Experiences(1991) System Analysis and Design The Lagrangian Relaxation Method for Solving Integer Programming Problems(1981) Operations Management Issues in the design of group decision support systems(1984) Collaboration Effective View Navigation(1997) HCI MIS Characteristic Model Behavioral Theory Relevant Technical Application Rigor Technical Application Relevant Technical Application Relevant Technical Application Relevant Technical Theory Rigor Technical Application Rigor Shamkant B. Navathe Fundamentals of database systems(1989) Data Management Technical Theory Rigor Methodological Review of Key Research by Key People within Information Systems Management Stuart E. Madnick Ivar Jacobson Amit P. Sheth Richard Hull Roger King Gamma, Erich Helm, Richard Johnson, Ralph Software project dynamics: an integrated approach(1991) Data Managemtn Object Oriented Software Engineering: A Use Case Driven Approach(1992) System Analysis and Design The Unified Software Development Process(1999) System Analysis and Design An Overview of Workflow Management: From Process Modeling to Workflow Automation Infrastructure(1995) System Analysis and Design 20 Technical Application Relevant Technical Application Relevant Technical Application Relevant Technical Application Relevant Semantic database modeling: survey, applications, and research issues(1987) Design Patterns: Elements of Reusable Object-Oriented Software(1995) Vlissides, John Im, Kun Shin Kim, Kee Young Kim, Joon S. Tzilla Elrad Robert E. Filman A Response to "Assessing Research Productivity: Important But Neglected Considerations"(1998) and An Assessment of Individual and Institutional Research Productivity in MIS Aspect-Oriented Programming: Introduction(2001) Atef Bader Myers, Brad A. A Brief history of Human Computer Interaction Technology HCI Technical Application Relevant Methodological Review of Key Research by Key People within Information Systems Management Norman, Donald A. The design of everyday things 21 HCI Technical Application Relevant Nunamaker, J. F., Jr. Briggs, R.O. Mittleman, D.D. Vogel, D. R. Balthazard, P.A. Lessons from a Dozen Years of Group Support Systems Research: A Discussion of Lab and Field Findings Collaboration Ram, Sudha Guest Editor's Introduction: Heterogeneous Distributed Database Systems Data Management Pamela Samuelson Pamela Samuelson Sawyer, S Carl Shapiro Edsgar W. Dijkstra Edsgar W. Dijkstra Behavioral Application Rigor Copyright’s Fair use Doctrine and Social Digital Data. Communications of Informatics the ACM, (1994) 37(1) 21-27. Toward a new politics of intellectual property. Communications of the ACM. (2001). 44(3): 98-100. Social Informatics Social informatics in the information sciences: Current activities and emerging directions. Informing Science (2000). 3(2): 89-95. Social informatics Versioning: The smart way to sell information. Harvard Business Review (1998) 76(6): 106-114. Economics of Information Go To Statement Considered Harmful (1968) Systems Analysis and Design A Note on Two Problems in Connection with Graphs (1959) Systems Analysis and Design Technical Application Relevant Behavioral Application Relevant Behavioral Application Relevant Behavioral Application Relevant Technical Theory Rigor Technical Application Relevant Technical Application Relevant Methodological Review of Key Research by Key People within Information Systems Management Brad A. Myers Robert Johansen J.C.R. Licklider Creating user interfaces by demonstration (1988) and a brief history of human computer interaction technology (1998) Human Computer Interaction Groupware: Computer Support for Business Teams (1988) Collaboration Computer as a Communication Device (1968) and ManComputer Symbiosis (1960) Human Computer Interaction 22 Technical Application Rigor Behavioral Application Relevant Behavioral Application Rigor Methodological Review of Key Research by Key People within Information Systems Management 23 Key Research Using Design Science Methodology The following key research and researchers use design science methodology. Author(s) Sudha Ram. Sudha Ram D.T. Ross Royce, W. W. Amit P. Sheth Smith, J. M Stefano Spaccapietra Key Research MIS Domain Intelligent database design using the unifying semantic model (1995) Information and Management 29(4): 191 - 206. Data Management Multi-User View Integration System (MUVIS): An Expert System for View Integration(1990) Data Management Structured Analysis (SA): A Language for Communicating Ideas(1976). IEEE Transactions on Software Engineering SE-3(1): 16-34. Systems Analysis and Design Managing the Development of Large Software Systems: Concepts and Techniques (1970).Western Electronic Show and Convention, Los Angeles, Wescon Technical Papers. Systems Analysis and Design Managing Heterogeneous MultiSystem Tasks to Support Enterprise-wide Operations. (1995). Distributed and Parallel Databases 2(2): 155-86. Systems Analysis and Design Database abstractions: aggregation and generalization (1977). ACM Transactions on Database Systems (TODS) 2(2): 105-133. Data Management View Integration - a Step Forward Data in Solving Structural Conflicts. Management Ieee Transactions on Knowledge and Data Engineering 6(2): 258274. MIS Characteristic Model Technical Application Relevant Technical Application Relevant Technical Application Relevant Technical Application Relevant Technical Application Relevant Technical Application Relevant Technical Application Relevant Methodological Review of Key Research by Key People within Information Systems Management Stefano Spaccapietra. Ivar Jacobson Jeff Kramer Jeff Kramer Shamkant B. Navathe C. Mohan Salvatore T. March Peter Pin-Shan Chen Eric Clemons Model independent assertions for Data integration of heterogeneous Management schemas." The VLDB Journal — The International Journal on Very Large Data Bases 1(1): 81 - 126. The Object Advantage: Business Process Reengineering with Object Technology (1994) Systems Analysis and Design The Evolving Philosophers Problem: Dynamic Change Management (1990) and Managing Evolution in Distributed Systems (1989) Systems Analysis and Design Inconsistency Handling in Multiperspective Specifications(1994) Systems Analysis and Design A Theory of Attributed Equivalence in Databases with Application to Schema Integration (1989) Data Management Distributed data base management: Some thoughts and analyses (1980) Data Management The determination of efficient record segmentations and blocking factors for shared data files Data Management The entity-relationship model toward a unified view of data (1976) Data Management Evaluation of Strategic Investments in Information Technology (1991) Economics of Information 24 Technical Application Relevant Technical Application Relevant Technical Application Relevant Technical Application Relevant Technical Theory Rigor Technical Theory Rigor Technical Application Rigor Technical Theory Relevant Behavioral Theory Rigor Methodological Review of Key Research by Key People within Information Systems Management Edgar F. Codd Edgar F. Codd Extending the database relational model to capture more meaning (1979) Data Management A Relational Model of Data for Data Large Shared Data Banks (1970) Management Bill Curtis Process Modeling (1992) Richard L. Daft Organizational Information Requirements, Media Richness and Structural Design Frank DeRemer Programming-in-the-Large versus Programming-in-theSmall (1975) Geraldine Desanctis Toward Friendly User MIS Implementation (1983) Collaboration A Foundation for the Study of Group Decision Support Systems (1987) Collaboration On spatial database integration (1998) Data Management Simula--an ALGOL-Based Simulation Language (1966) Systems Analysis and Design Goal Based Workflow Systems (1994) Systems Analysis and Design Gerardine DeSanctis Stefano Spaccapietra Ole-Johan Dahl Clarence Ellis 25 Technical Theory Rigor Technical Theory Rigor Technical Application Relevant Technical Application Relevant Technical Application Relevant Behavioral Theory Rigor Technical Application Relevant Methodological Review of Key Research by Key People within Information Systems Management Clarence Ellis Toby J. Teorey Vijayan Sugumaran Veda C. Storey W. P. Stevens Gad Ariav C. Batini Barry W. Boehm Grady Booch Donald D. Chamberlin Groupware - Some Issues and Experiences (1991) Systems Analysis and Design A logical design methodology for relational databases using the extended entity-relationship model (1986) Data Management Ontologies for conceptual modeling: their creation, use, and management (2002) Data Management A Methodology for Learning Across Application Domains for Database Design Systems (2002) Data Management Structured Design System Analysis and Design DSS Design: A Systematic View of Decision Support System Analysis and Design A comparative analysis of methodologies for database schema integration Data Management A Spiral Model of Software Development and Enhancement System Analysis and Design Object-Oriented Development System Analysis and Design SEQUEL: A structured English query language Data Management 26 Technical Application Relevant Technical Theory Rigor Technical Theory Relevant Technical Application Relevant Technical Theory Rigor Technical Theory Relevant Technical Theory Relevant Technical Theory Relevant Technical Theory Relevant Technical Theory Relevant Methodological Review of Key Research by Key People within Information Systems Management Alen R. Hevner George W. Furnas The category concept: an extension to the entityrelationship model(1985) Data Management Generalized fisheye views(1986) HCI 27 Technical Theory Rigor Technical Application Rigor Edward Feigenbaum Myers, Brad A. Nielsen, J. Dendral and Meta-dendral: Roots of Knowledge Systems and Expert System Applications AI Languages for developing user interfaces HCI The Usability Engineering LifeCycle HCI Technical Application Rigor Technical Theory Rigor Technical Theory Relevant Methodological Review of Key Research by Key People within Information Systems Management 28 Key Research Using Case Studies Methodology The following key research and researchers use case studies methodology. Author(s) Robert K. Lindsay Shank, M. E Hau L. Lee Kling, Rob Vijay Gurbaxani Kenneth L Kraemer Kenneth L Kraemer {Add authors full name here. Sort each table row by full name using Tools-Sort} Key Research DENDRAL: A Case Study of the First Expert System for Scientific Hypothesis Formation. (1993) Artif. Intell 61(2): 209-261. MIS Domain Artificial Intelligence Critical Success Factor Analysis as Social a Methodology for MIS Planning. Informatics (1985).MIS Quarterly 9(2): 121129. MIS Characteristic Model Technical Application Relevant Behavioral Application Relevant E-Fulfillment: Winning the Last Mile of E-Commerce (2001) and Manufacturer Benefits from Information Integration with Retail Customers (2004) Operation Management What is social informatics and why does it matter? (1999) Social Informatics Institutional Factors in Information Technology Innovation (1994) Economics of Information Technical Theory Rigor Information technology and economic performance: A critical review of the empirical evidence (2003) Economics of Information Technical Theory Rigor Information technology and productivity: Evidence from country-level data (2000) Economics of Information Technical Theory Rigor {Add the title of the research paper here with the date reference. We’ll have End Note put a reference marker here.} {Specify the {Copy the respective image domain using from Class of 2005’s data} Class of 2005’s model} Technical Application Relevant Behavioral Theory Rigor Methodological Review of Key Research by Key People within Information Systems Management Murray Turoff Nielsen, Jakob Delphi and its Potential Impact on Information Systems Collaboratio n Designing Web Usability: The Practice of Simplicity HCI 29 Behavioral Application Rigor Behavioral Application Relevant Methodological Review of Key Research by Key People within Information Systems Management 30 Key Research Using Ethnographic Research Methodology The following key research and researchers use ethnographic research methodology. Author(s) Key Research MIS Domain MIS Characteristic Model In the 161 key MIS research papers analyzed, none were found to employ ethnographic research methodology. However, we know that researchers, such as Wanda Orlinkowski, use ethnographic research frequently, but only one her papers were included in the 161 key papers and it employed field survey methodology. Methodological Review of Key Research by Key People within Information Systems Management 31 Key Research Using Field Experiment Methodology The following key research and researchers use field experiment methodology. Author(s) Sirkka L. Jarvenpaa Robert Johansen J. Galegher R.E. Kraut Key Research MIS Domain Is anybody out there? Antecedents of trust in global virtual teams (1998) and computer support for meetings of groups working on unstructured problems: A field experiment (1998) Collaboration Social evaluations of teleconferencing (1977) Social Informatics Computer-Mediated Communication for Intellectual Teamwork - an Experiment in Group Writing(1994) HCI MIS Characteristic Model Behavioral Theory Rigor Behavioral Theory Relevant Behavioral Application Rigor Methodological Review of Key Research by Key People within Information Systems Management 32 Key Research Using Field Study Methodology The following key research and researchers use field study methodology. Author(s) Ronald Coase Yannis Bakos Erik Brynjolfsson Orlikowski, Wanda Orlikowski, Wanda J Baroudi, J J Key Research The Nature of the Firm (1937) MIS Domain Economics of Information Bundling information goods: Pricing, profits, and efficiency Economics of Information Frictionless Commerce? A Comparison of Internet and Conventional Retailers Social Informatics Using technology and constituting structures: A practice lens for studying technology in organizations Social Informatics Studying information technology in organizations: Research approaches and assumptions Social Informatics MIS Characteristic Model Technical Theory Rigor Behavioral Theory Rigor Behavioral Application Relevant Behavioral Theory Relevant Behavioral Theory Relevant Methodological Review of Key Research by Key People within Information Systems Management 33 Key Research Using Game-Role Playing Methodology The following key research and researchers use game-role playing methodology. Author(s) Key Research MIS Domain MIS Characteristic Model In the 161 key MIS research papers analyzed, none were found to employ game-role playing research methodology. However, we know that some researchers do employ this method. Dr. Nunamaker reports that he and colleagues conducted a study simulating refugee camps where roles were assigned to subjects. Methodological Review of Key Research by Key People within Information Systems Management 34 Key Research Using Historical Methodology The following key research and researchers use historical methodology. Author(s) Murray Turoff Key Research Computer Mediated Communication Requirements for Group Support MIS Domain Collaboratio n MIS Characteristic Model Behavioral Application Relevant Methodological Review of Key Research by Key People within Information Systems Management 35 Key Research Using Laboratory Experiment Methodology The following key research and researchers use laboratory experiment methodology. Author(s) Hsinchun Chen Key Research MIS Domain A Machine Learning Approach to Inductive Query by Examples: An Experiment Using Relevance Feedback, ID3, Genetic Algorithms, and Simulated Annealing (1998) Effects of Anonymity and Evaluative Tone on Idea Generation in ComputerMediated Groups (1990) AI Using a GDSS to Facilitate Group Consensus: Some Intended and Unintended Consequences Collaboration An Experimental Investigation of the Impact of Computer Based Decision Aids on Decision Making Strategies HCI R. Brent Gallupe Joesoph S. Valacich Jay F. Nunamaker, Jr. Electronic Brainstorming and Group-Size(1992) Collaboration Douglas C. Engelbart Display-Selection Techniques for Text Manipulation(1967) HCI Embedding web-based statistical translation models in cross-language information retrieval (2003) HCI Preliminary description of General Problem Solving -I (GPS-I) AI Joesoph S. Valacich Richard T. Watson Peter Todd Wessel Kraaij Newell, J. C. Shaw, and H. A. Simon MIS Characteristic Model Technical Application Relevant Collaboration Behavioral Application Relevant Behavioral Application Relevant Behavioral Application Relevant Behavioral Application Relevant Technical Application Rigor Technical Application Relevant Technical Application Relevant Methodological Review of Key Research by Key People within Information Systems Management Newell, A. Simon, H. A. Computer Science as Empirical Inquiry - Symbols and Search AI Nielsen, J. Finding usability problems through heuristic evaluation HCI Improving system usability through parallel design Systems Analysis and Design Nielsen, J. Faber, J. M. 36 Technical Theory Relevant Behavioral Application Relevant Technical Application Relevant Methodological Review of Key Research by Key People within Information Systems Management 37 Key Research Using Mathematical Model Methodology The following key research and researchers use mathematical model methodology. Author(s) Roni Khardon Selman, B Hau L. Lee Salvatore T. March JoAnne Yates Robert N. Kubik Edgar F. Codd George Dantzig Toby J. Teorey Key Research Learning to reason. Journal of the ACM (1997).44(5). MIS Domain Artificial Intelligence Knowledge compilation and theory approximation. (1996). Journal of the ACM 43(2). MIS Characteristic Model Technical Theory Rigor Technical Theory Rigor Information distortion in a Supply Operation Chain: The Bullwhip Effect Management (1997) Allocating data and operations to nodes in distributed database design (1995) Data Management Electronic Markets and Electronic Hierarchies Economics of Information On applications of differential equations in general problem solving (1966) Technical Theory Relevant Technical Application Rigor Behavioral Theory Rigor Technical Theory Rigor Relational Completeness of Data Base Sublanguages (1972) Data Management Decomposition Principle for Linear Programs (1960) Operations Management A comparative analysis of disk scheduling policies (1972) Data Management Technical Theory Rigor Technical Theory Rigor Technical Application Rigor Methodological Review of Key Research by Key People within Information Systems Management Wessel Kraaij Cynthia Barnhart Anitesh Barua Gerard P. Cachon Carl Shapiro Embedding web-based statistical translation models in cross-language information retrieval (2003) HCI Branch-and-Price: Column Generation for Solving Huge Integer Programs Data Management Information technologies and business value: An analytic and empirical investigation Economics of Information Supply Chain Inventory Management and the Value of Shared Information Operations Management Dynamic Competition with Switching Costs(1988) Economics of Information 38 Technical Application Relevant Technical Theory Rigor Behavioral Theory Rigor Behavioral Theory Rigor Technical Theory Rigor Methodological Review of Key Research by Key People within Information Systems Management 39 Key Research Using Pluralistic Methodology The following key research and researchers use pluralistic methodology. Author(s) Vijay Gurbaxani Key Research MIS Domain The Impact of Information Systems on Organizations and Markets Pluralistic Nunamaker, J. F. Dennis, A. R. Valacich, J. S. Vogel, D. R. Information Technology for Negotiating Groups Generating Options for Mutual Gain Pluralistic Nunamaker, J. F. Dennis, A. R. Valacich, J. S. Vogel, D. R. George, J. F. Electronic Meeting Systems to Support Group Work Pluralistic MIS Characteristic Model Technical Theory Rigor Behavioral Theory Rigor Behavioral Application Relevant Methodological Review of Key Research by Key People within Information Systems Management 40 Key Research Using Prototyping Methodology The following key research and researchers use prototyping methodology. Author(s) Gerardine DeSanctis Vijayan Sugumaran Veda C. Storey Wessel Kraaij Mark Stefik Terry Winograd Y. Richard Wang Michael Stonebraker Key Research MIS Domain Using Computing in Quality Team Meetings: Initial Observations from the IRS-Minnesota Project (1991) Collaboration Ontologies for conceptual modeling: their creation, use, and management (2002) Data Management A Methodology for Learning Across Application Domains for Database Design Systems (2002) Data Management Embedding web-based statistical translation models in cross-language information retrieval (2003) HCI Beyond the Chalkboard Computer Support for Collaboration and ProblemSolving in Meetings Collaboration A Language/Action Perspective on the Design of Cooperative Work Collaboration The Inter-Database Instance Identification Problem in Integrating Autonomous Systems (1989) Data Management The Design of the POSTGRES Storage System Data Management MIS Characteristic Model Technical Application Relevant Technical Theory Relevant Technical Application Relevant Technical Application Relevant Technical Application Relevant Technical Application Rigor Technical Application Relevant Technical Theory Relevant Methodological Review of Key Research by Key People within Information Systems Management Jay Banerjee Jay Banerjee Stuart E. Madnick Venky Harinarayan Anand Rajaraman Data Model Issues for ObjectOriented Applications System Analysis and Design Semantics and implementation of schema evolution in objectoriented databases System Analysis and Design Context interchange: overcoming the challenges of large-scale interoperable database systems in a dynamic environment(1994) Implementing data cubes efficiently(1996) Data Management 41 Technical Application Relevant Technical Application Relevant Technical Application Relevant Jeffrey D. Ullman Newell, A., Shaw, J.C. Report on a general problem& Simon, H.A solving program AI Nunamaker, J. F. Future research in group support systems: needs, some questions and possible directions Collaboration Unified theories of cognition AI Newell, A. Technical Theory Rigor Technical Application Relevant Technical Theory Rigor Pirolli, P. Card, S. Information foraging HCI Behavioral Theory Rigor Methodological Review of Key Research by Key People within Information Systems Management 42 Key Research Using Simulation Methodology The following key research and researchers use simulation methodology. Author(s) George W. Furnas Toby J. Teorey Patrick Suppes, Lin Liang, Michael Buettner Key Research MIS Domain The Vocabulary Problem in Human System Communication(1987) HCI A comparative analysis of disk scheduling policies (1972) Data Management Machine learning comprehension grammars for ten languages AI MIS Characteristic Model Technical Theory Rigor Technical Application Rigor Technical Theory Rigor Methodological Review of Key Research by Key People within Information Systems Management 43 Key Research Using System Development Methodology The following key research and researchers use system development methodology. Author(s) Key Research MIS Domain Shah, K. and Amit. P. Sheth InfoHarness: An Information Integration Platform for Managing Distributed, Heterogeneous Information. (1999). IEEE Internet Computing: 18-28. Systems Analysis and Design Amit. P Sheth Semantic Content Management for Enterprises and the Web. (2002). IEEE Internet Computing: 80-7. Systems Analysis and Design Querying object-oriented databases (1992) and on optimizing an SQL-like nested query (1982) Data Management Dynamic Configuration for Distributed Systems (1985) Data A Language/Action Perspective on the Design of Cooperative Work Collaboratio n The design and implementation of INGRES Data Management Program Development by Stepwise Refinement (1971) Systems Analysis and Design The Design of the POSTGRES Storage System Data Management Kim Won Jeff Kramer Terry Winograd Michael Stonebraker Niklaus Wirth Michael Stonebraker Management MIS Characteristic Model Technical Application Relevant Technical Application Relevant Technical Application Relevant Behavioral Theory Rigor Technical Application Rigor Technical Application Relevant Technical Theory Relevant Technical Theory Relevant Methodological Review of Key Research by Key People within Information Systems Management M. M. Astrahan System R: relational approach to Systems database management Analysis and Design Carlos A. ReyesGarcia AI and computational science: Implementing Fuzzy Expert System for intelligent buildings Artificial Intelligence Neighbors, James M. The Draco Approach to Constructing Software from Reusable Components Systems Analysis and Design Norman, Donald A. Draper, Stephen W. User centered system design : new perspectives on humancomputer interaction HCI Nunamaker, J. F. Future research in group support systems: needs, some questions and possible directions Collaboratio n Nunamaker, J. F., Jr. Chen, Minder Purdin, Titus D.M. Systems Development in Information Systems Research Systems Analysis and Design Parnas, David Lorge A Technique for Software Module Specification with Examples Systems Analysis and Design On the Criteria To Be Used in Decomposing Systems into Modules Systems Analysis and Design On the Design and Development of Program Families. Systems Analysis and Design Parnas, David Lorge Parnas, David Lorge 44 Technical Application Relevant Technical Application Relevant Technical Theory Rigor Technical Theory Relevant Technical Application Relevant Technical Theory Rigor Technical Theory Relevant Technical Application Relevant Technical Application Relevant Methodological Review of Key Research by Key People within Information Systems Management 45 Key Research Using Survey Methodology The following key research and researchers use survey methodology. Author(s) Key Research MIS Domain Sebastiani, F Machine learning in automated text categorization. (2002). ACM Computing Surveys 34(1). Dongmin Kim Trust-Related Arguments in Internet Stores: A Framework for Evaluation (2003) E-commerce An empirical assessment of the organization of transnational information systems (1999) Economics of Information An evaluation of research productivity in academic IT Social Informatics Kevin Bacon, Degrees-ofSeparation, and MIS Research Social Informatics William R King Athey, Susan Paul Beckman MIS Characteristic Model Behavioral Theory Relevant Behavioral Theory Relevant Behavioral Application Relevant Behavioral Application Relevant Methodological Review of Key Research by Key People within Information Systems Management 46 Methodologies by MIS Domain In grouping the 161 research papers by research methodology, interesting findings are presented. The following charts give enlightenment as to the frequency of each methodology employed within each MIS domain. By counting the key papers grouped by methodology, Design Science is by far the most frequent methodology used. Epistemology, Positivism, System Development, Prototyping, and Description, and Lab Experiments are equally used by secondary to Design Science. Number of Papers Simulation MANUSCRIPT Historical Computer Simulation Survey Pluralistic Criticism Conceptual Framework Ontological Field study Case Study Count Interpretivism Mathematical Models Argumentative Laboratory Experiment Descriptive Prototyping System Development Positivism Epistemology Design Science 0 5 10 15 20 25 30 35 40 Methodological Review of Key Research by Key People within Information Systems Management Methodologies for AI System Development Simulation Prototyping Mathematical Model Series1 Laboratory Experiment Case Study Design Science 0 0.5 1 1.5 2 2.5 3 3.5 Methodologies for Collaboration System Development Prototyping Laboratory Experiment Historical Field Experiment Series1 Case Study Design Science Descriptive Argumentative 0 0.5 1 1.5 2 2.5 3 3.5 47 Methodological Review of Key Research by Key People within Information Systems Management Methodologies for Data Management System Development Simulation Prototyping Series1 Mathematical Model Design Science Descriptive 0 5 10 15 20 Methodologies for Economics of Information Survey Mathematical Model Field Study Case Study Series1 Design Science Descriptive Argumentative 0 0.5 1 1.5 2 2.5 3 3.5 48 Methodological Review of Key Research by Key People within Information Systems Management Methodologies for HCI System Development Simulation Prototyping Mathematical Model Laboratory Experiment Series1 Field Experiment Case Study Design Science Descriptive Argumentative 0 1 2 3 4 5 6 7 8 Operations Management Mathematical Model Case Study Series1 Descriptive 0 0.5 1 1.5 2 2.5 3 3.5 49 Methodological Review of Key Research by Key People within Information Systems Management Methodologies for Social Informatics Survey Field Study Field Experiment Series1 Case Study Descriptive Argumentative 0 0.5 1 1.5 2 2.5 3 3.5 4 4.5 Methodologies for Systems Analysis and Design System Development Prototyping Laboratory Experiment Series1 Design Science Descriptive Argumentative 0 2 4 6 8 10 12 14 50 Methodological Review of Key Research by Key People within Information Systems Management Conclusion These findings provide precedence to using the various methodologies, particularly Design Science, which was used most often among the 161 key research papers. Design Science has gained popularity and utility among key researchers and in their key papers. 51 Methodological Review of Key Research by Key People within Information Systems Management 52 References Alavi, M., Carlson, P., & Brook, G. (1989). The ecology of MIS research: A twenty year review. In: DeGross JI, Henderson JC, Konsynski BR, editors. Proceedings of the Tenth International Conference on Information Systems, 363-75. Falconer, D. J., & Mackay, D. R. (1999). The Key to the mixed method dilemma. Proceedings of 10th Australasian Conference on Information Systems, 286-297. Corazzon, R. (2006). Ontology. A resource guide for philosophers. http://www.formalontology.it Galliers, R. D., & Land, F. F. (1987). Choosing appropriate information systems research methodologies. Communications of ACM, 30 (11), 900-902. Goles, T., & Hirschheim, R. (2000). The paradigm is dead…long live the paradigm: The legacy of Burrell and Morgan. Omega, 28, 249-268. Heylighen, F. (Sep, 1993). Epistomology, introduction. http://pespmc1.vub.ac.be/EPISTEMI.html Inc Merriam-Webster (2002). Webster's Third New International Dictionary: Since 1847 the Ultimate Word Authority for Schools, Libraries, Courts, Homes, and Offices. Merriam Webster. Johnson, R. B., & Onwuegbuzie, A. J. (2004). Mixed methods research: A research paradigm whose time has come. Educational Research, 33 (7), 14-26. Lee, A. S. (1991). Integrating positivist and interpretive approaches to organizational research. Organization Science, 2 (4), 342-365. Marcon, T., & Gopal, A. (2005). Uncertain knowledge, uncertain times. ASAC 2005, 248-261. Migners, J. (2001). Combining IS research methods: Towards a pluralist methodology. Information Systems Research, 12 (3), 240-259. Weber, R. (2004). The Rhetoric of positivism versus interpretivism: A personal view. MIS Quaterly, 28 (1), 248-261.