A Framework for the Configuration of Research Methods
Beyond Design Science and Behaviorist Methods
Prof. Dr. Ulrich Frank
Lehrstuhl für Wirtschaftsinformatik und
Unternehmensmodellierung
ICB Institut für Informatik und Wirtschaftsinformatik
Institut für Informatik und
Wirtschaftsinformatik (ICB)
Overview
10
Motivation
Overview of Prevalent Research Methods
A (Meta) Method for Method Configuration
Recommendations
Ulrich Frank © Research Methods
Contact
20
 Prof. Dr. Ulrich Frank
E-Mail:
ulrich.frank@uni-due.de
© Ulrich Frank | Research Methods
Copyright
10
Additional material that is provided with the lecture, especially
slides and audio files are protected by copyright: © 2005–2014,
Prof. Dr. Ulrich Frank <ulrich.frank@uni-due.de>, Universität
Duisburg-Essen, Campus Essen, Essen.
Duplication, modification, translation, dissemination or extraction
of parts are prohibited without written approval of the originator.
Only those students who attend the course are allowed to
download the protected material for their personal use.
Ulrich Frank © Research Methods
Objectives (1)
30
The participants should …
 be sensitized for essential questions related to scientific
research.
 realize that there are different ideas about science and
different conceptions of science.
 be able to elucidate the difference between scientific
research and commercial consulting.
 describe core terms characteristic for scientific research.
 describe and discuss prevalent research methods.
Ulrich Frank © Research Methods
Objectives (2)
40
 describe basic ontological and epistemological
assumptions
 describe and evaluate selected theories of truth.
 discuss the difference between the claim for explanation
and the claim for understanding.
 reflect upon the relevance of research methods for their
research.
 outline a method for the configuration of research
methods
 get inspiration for preparing and writing publications
Ulrich Frank © Research Methods
Scientific Proposition?
50
“The deployment of server/client systems induces an
average reduction of a firm‘s total IT costs of 20%.”
„The average profit per employee of all enterprises
shows a positive correlation with the relative number
of employees with an MBA.“
„Successful Management puts employees first.“
„The new method Business Requirements Now (BRN)
guarantees the rapid and complete detection of
requirements.“
„The positive energy of all employees mounts up to a
company‘s competitiveness.“
„Every human being has lived at least one former life
as a mammal.“
Research Project?
50
“Prototypical design of an integrated order
management system for a food retail company.”
„Design of a neural network to make forecasts of stock
prices.“
„Design of a method to introduce corporate
knowledge management.“
„Turning an old-fashion business into a hip online
platform – a case study.“
„Massive Open Online Courses: Business models,
opportunities and threats.“
„Power relations in insurance companies and their
effect on middle management.“
What are core characteristics of scientific research?
80
 Striving for knowledge?
 Striving for truth?
 Striving for explanation?
 Striving for a better life?
 Use of a precise language?
 Use of a research method?
 …
Further suggestions?
Research Method
100
„The method is essential for scientific studies and
hence, the key characteristic of science in general.„
(translated from Kuno Lorenz)
What is your understanding of a method?
… and of a research method?
Method, Research Method
110
 method: serves to guide solving a class of problems
 elements of a method



concepts to structure the problem domain with respect to certain
purposes
a process that illustrates how to proceed
evaluation criteria
 research method: guides the preparation and execution of
research projects as well as the documentation and
evaluation of research results
Prevalent Research Methods
120
 „Rational“, Behaviourist Approach
 Hermeneutic Approach
 „Design Science“
Case Studies
Action Research
Grounded Theory
Behaviourist Research
130
 originates in Logical Positivism: empirical studies as only
source of scientific knowledge (focus on induction)
 at first aimed at Psychology: scientific studies reduced to
observable behaviour
 in the meantime relevant paradigm of Social Sciences
 dominant paradigm of Information Systems – different
from „Wirtschaftsinformatik“; but also prevalent in
Management & Administrative Science
Characteristics
140
 restricted to subjects that allow for empirical studies
 research goals: description, explanation

through applying and testing of theories

aimed at confirmation or refutation
 restricted to hypotheses that can be tested empirically
Are there any research questions that are excluded
from empirical research?
Concepts to Structure Research Projects
150
Hypothesis
Inferred from
Theory
includes
Variable
includes
Feature
includes
Explanandum
Dependant
Variable
represents
operationalizes
Independant
Variable
represents
operationalizes
Disturbance
Variable
represents
operatonalizes
Set of
dependant data
explains
affects
Explanans
Noise
Set of independant data
Set of noise
data
collects
should control
should control
Field Study
collects
Experiment
collects
varies
Field
Experiment
Laboratory
Experiment
Concepts to Structure Research Projects
„The tighter integrated a
company‘s IT, the better its
Hypothesis
economic performance.“
Inferred from
Resource Based
View
Theory
includes
Variable
includes
Economic
Performance
operatonalizes
„explains“
includes
PI
Dependant
represents
• revenues
Variable per
Employee
• profitability
Feature
data of selected
Set of
companies
dependant data
data of selected
Independant
Set of indepenrepresents
Explanans
PI
Variable
dant datacompanies
Degree of IT
• redundancy of data
integration
• redundancy of
functions
Disturbance
operationalizes
Set of noise
represents
data of selected
Noise
Variable
data companies
collects
Qualification of
share of
IT employees
employees
should
control with
should control
CS degree
operationalizes
affects
160
collects
FieldNumber
Study of
companies:
Experiment
collects
varies
Field
Experiment
Laboratory
Experiment
Process Model
170
1
selection of research subject and questions
2
selection of appropriate theory
3
inferring hypotheses from theory
4
conceptualisation of dependent and independent variables; if need
be also of possible noise (operationalisation)
5
selection of representative set of subjects (e.g. business firms)
6
definition of scale levels
7
collecting data
8
testing hypotheses; significant statistic correlation as key criterion,
rather than falsification in rigorous sense
Requirements
180
 Objectivity: test independent of those, who conduct it
 Validity: data represent concepts of tested hypotheses
adequately; demands for isolating impact factors
 Reliability: measuring method allows for trustworthy and
reproducable recording of relevant data.
Evaluation
190
 Emphasis on terminological precision, reliability,
falsification etc. supports rational discourse and critique.
 contingency of the subject; lack of theories (->
http://www.istheory.yorku.ca/)
 focus on the past, instead of the future (no sufficient
account of possible worlds)
 bias through operationalisation


neglecting aspect that balk against operationalisation
pragmatic measurement approaches
 inherent tendency to trivial research results
„neurotic behavior ... such as its compulsive handwashing in
statistical procedures.”
McCloskey
„Top Tier“-Research (MISQ)
200
“Perceived ease of use will positively affect intended use of a businessto-consumer (B2C) Web site.”
“The perceived provider performance has a positive impact on the
satisfaction with Application Service Provider.”
“The technical service guarantees of an ASP have a positive impact on
perceived provider performance.”
“The functional capability of the ASP has a positive effect on the
satisfaction with ASP.”
“Child’s age will moderate the relationship between utility for children
and intention to adopt a PC for household use, such that utility for
children increases in importance as the child’s age increases.”
„neurotic behavior ... such as its compulsive handwashing in
statistical procedures.”
McCloskey
Hermeneutics
210
 method to guide the understanding and interpretation
of textual documents – but also of social/cultural
phenomena
 emphasizes a subjective approach to analyze a
research subject
 interpretation as a creative, sense-generating process


with subjective connotations
serves to inspire further invididual learning processes
 mediation through examples, images, metaphors,
analogies
Understanding is aimed at “empathy or re-creation in the
mind of the scholar of the mental atmosphere, the thoughts
and feelings and motivations, of the objects of his study.”
von Wright 1971
„Qualitative“ Research
220
 term „qualitative“ often used for differentiation purposes
(opposed to „quantitative“); however, not appropriate
 „qualitative“ approaches build on hermeneutic tradition
 prevalent justification: social systems do not allow for
objective explanation (as it is often supposed for Natural
Sciences), therefore thorough interpretations the only
option
 aimed at describing phenomena in a way that is suited to
make knowledgeable readers smarter
Example: Klein and Myers 1999
230
 proposed as an alternative to behaviourist research in
‚Information Systems‘
 basic assumptions:


Understanding the development and use of information systems
requires an interpretation of corresponding actions
to satisfy the claim for scientific knowledge, interpretations need to
follow adequate principles.
 seven principles as guidelines for „qualitative“ research
Principles suggested by Klein and Myers (Selection)
240
1. The Fundamental Principle of the Hermeneutic Circle
“This principle suggests that all human understanding is achieved by
iterating between considering the interdependent meaning of parts
and the whole that they form.”
2. The Principle of Contextualization
“Requires critical reflection of the social and historical background of
the research setting, so that the intended audience can see how the
current situation under investigation emerged.”
3. The Principle of Interaction Between the Researchers and the
Subjects
“Requires critical reflection on how the research materials (or “data”)
were socially constructed through the interaction between the
Ulrich Frank | Information Systems Research
researchers and participants.”
Evaluation
250
 accounts for relevant aspects of action systems that bulk
against operationalisation
 concept of „understanding“ remains vague
 subjectivity of interpretations necessary, but …


hinders critique -> threat of ideological knowledge
tendency towards narrative statements that are hard to test
 hence: threat to scientific competition and the idea of
progress
 originates in the Humanities, no elaborate terminology for
describing IT artefacts
Design Science
260
 proposed by Hevner et al. as a foundation for
construction-oriented (design-oriented) research
 guidelines for research and for publication


to support a scientific claim
mainly based on a behaviourist conception of science
 gained remarkable attention in Information Systems
Hevner, A. R.; March, S. T.; Park, J.; Ram, S.: Design
Science in Information Systems Research. In: MIS
Quarterly, Vol. 28, No. 1, 2004, pp. 75-105
Gregor, S.; Hevner, A.: Positioning and Presenting
Design Science Research for Maximum Impact. In: MIS
Quarterly, Vol. 37, No. 2, 2013, pp. 337-355
The Guidelines
270
#1
Design as an Artefact
Design-science research must produce a viable artefact in the form of a
construct, a model, a method, or an instantiation.
#2
Problem Relevance
The objective of design-science research is to develop technology-based
solutions to important and relevant business problems.
#3
Design Evaluation
The utility, quality, and efficacy of a design artefact must be rigorously
demonstrated via well-executed evaluation methods.
#4
Research
Contribution
Effective design-science research must provide clear verifiable
contributions in the areas of the design artefact, design foundations,
and/or design methodologies.
#5
Research Rigor
Design-science research relies upon the application of rigorous methods
in both the construction and evaluation of the design artefact.
#6
Design as a Search
Process
The search for an effective artefact requires utilizing available means to
reach desired ends while satisfying laws in the problem environment.
#7
Communication of
Research
Design-science research must be presented effectively both to
technology-oriented as well as management-oriented audiences.
Evaluation (1)
280
 helped with promoting construction-oriented research in
IS
 restricted to problems articulated in practice




neglects research that goes beyond present problems
hence, does not promise results that offer long-term orientation
no clear distinction from industrial R&D
lack of accounting for possible future worlds
 no specific methodological foundation



noncritical adoption of behaviourist testing procedures
no alternative testing procedures
demand for verification of research results; it remains an open
question how this can be accomplished.
Evaluation (2)
290
 mechanistic worldview


design characterized as a process of search within a given space of
possible solutions
neglects social contingency of requirements
 lack of specialized concepts for describing the IT artefact


based on concepts from systems theory and decision theory
no accounting for peculiarities of information systems
Intermediate Conclusions
300
 Research methods can be helpful.
 Prevalent methods come with specific shortcomings.
 Focussing on a particular method only will often restrict
the epistemological perspective and compromise the
quality of research results.
 … may be regarded as a burden
 Research methods can be destructive.
What could be done?
Towards the Configuration of Research Methods
310
 should contribute to the unity of IS research
 hence, provide a common foundation for all research on
information systems
 allow for comprehensible configuration of research
methods in a single case
 contribute to comparability of research results beyond
the use of particular methods
„What is the difference between scientific knowledge
and the dreams of a ghostviewer?“ (Kant)
Essential Characteristics of Scientific Knowledge
320
Knowledge
Documentation
Culture
Originality
Structure
Freedom
Abstraction
Transparency
Reflection
Justification
Critique
Rationality
Relevance
Frank, U.: Towards a Pluralistic Conception of Research Methods in
Information Systems Research. ICB Research Report, No. 7,
Universität Duisburg-Essen 2006
What is the key criterion to justify a proposition?
Focus on Justification
330
„Science, denotation of a general orientation that depends
on professionally applied justification procedures and,
hence, goes beyond common knowledge …“
translated from Kambartel
 deduction from accepted knowledge
 claim for objectivity
 claim for logical consistency
 truth as the ultimate test criterion
requires an adequate conception of truth
Justification through Truth
340
 The formal truth of a propostion can possibly be proven.


given: a proposition without proven truth value
proof: deduction of proposition from axiomatic or proven
propositions through formal operations
 not possible for propositions with an empirical claim
(why?)
 Empirical truth requires presuppositions about


the structure of the world (Ontology)
human recognition (Epistemology)
Basic Ontological und Epistemological Positions
350
Position
Ontological Assumption
Epistemological Assumption
Naïve Realism
The world has an objective
existence.
We see the world as it is.
Critical Realism
The world has an objective
existence.
We see the world as we
perceive it; perception is
fallible.
Moderate Idealism
(Kant)
The world has (probably)
an objective existence.
Our perception is based on
idealized constructions/ideas
(concepts).
Solipsism
(„radical“ Idealism)
There is no objective world
independent from
subjective cognition.
Only our own existence is for
sure. We cannot judge
knowledge about the world.
Social
Constructivism
The world as we perceive it
is a social construction.
Our perception is determined
by our language. Language is a
social construction.
Radical
Constructivism
The „world“ is a mental
construction.
Our „perception“ of the „world“
is produced by changing states
of our brain.
Conceptions („Theories“) of Truth
360
 Correspondence Theory
 Coherence Theory
 Consensus Theory
Correspondence Theory
370
“A” is true, if and only if A
A proposition is true, if it corresponds
exactly to the part of reality it describes.
Example: empirical investigation
basic position: Realism
What is the problem with the correspondence theory?
Coherence Theory
380
A proposition is true, if it does not contradict an existing
system of consistent and conceptually coherent (scientific)
propositions.
Example: literature based analysis;
application of conceptual frameworks
Basic position: (Realism), Idealism
What is the difference from the correspondence
theory?
Consensus Theory
390
A proposition is true, if everybody who is knowledgeable
and honest would agree on it.
Example: interpretation of social phenomena;
interpretation of case studies
Basic position: (Idealism), social Constructivism
What is the problem here?
Is Truth Enough?
400
 Information Systems is concerned with a huge (economic,
organisational, social) transformation that is
unprecedented in the history of humankind.
 Research needs to focus on future options, i.e. on possible
worlds.
 These cannot be true, because they do not exist yet.
 Hence, there is need for other conceptions to assess
scientific knowledge.
What criteria could that be?
Configuration of Research Methods: Idea
410
 describe class of possible configurations
 define minimum requirements for conducting research
projects
 common foundation of scientific research – bridging gaps
between different schools
 blueprint for specifying individual configuration
 framework for evaluating research projects
Frank, U.: Towards a Pluralistic Conception of Research
Methods in Information Systems. ICB Research Reports No.
7, Universität Duisburg-Essen 2006
Abstract Elements of Research Methods
420
 basic epistemological contribution


construction (of knowledge)
critique (of knowledge)
 research subject


IS artefact
surrounding action system
 justification


criterion
process
 intended representation of results
Abstract Elements of Research Methods
430
Meta Model
Action System
Representation
Epistemological
Objective
represented through
focussed at
Abstract Knowledge
Contribution
refers to
specialized from
Knowledge
Contribution
Research
Subject
Socio-Technical
System
IS Artefact
Internet Enabled
Business
Transactions
Corporate Information
System + Interfaces to
the Internet
refers to
supposed to justify
Justification
Criterion
validated through
0,*
Correspondence
Theory
Business Transactions
with Customers and
Suppliers
specialized from
Theory
Application
0,*
Field Study
Coherence
Theory
Literature
Review
Consensus
Theory
Virtual
Discourse
Resource Based View
Justification
Process
Natural
Language
Interpretation
refers to
adaptation and application of theory
motivation of hypotheses
discussion of results
Conceptual Framework
Formal
Language
Net-enabled Resources and
their Effects
instance of
Quantification of
Concepts
Hypothesis
Effect of NetEnabled Value on
Performance
Application
Domain
Particular Configuration A
Action System
Socio-Technical
System
Semi-Formal
Language
IS Artefact
Case
Study
Natural
Language
Language
Experiment
Formal
Language
Theory
Abstraction
of Factual
Correspondence
Theory
Field Study
Coherence
Theory
Literature
Review
Truth
Theory
Application
Consensus
Theory
Virtual
Discourse
Internet Enabled
Business
Transactions
Construction
Hypothesis
Abstraction of
Intentional
Action System
Cross-Organisational
Business Processes
Socio-Technical
System
Formal
Truth
IS Artefact
Cross-Organisational
WFMS
Prototype
Interpretation
Conceptual Framework
Formal
Proof
Workflow; Workflow Control
Structures
Conceptual
Framework
Purpose
Adequacy
Design
Artefact
Conformity
Test
Prototype
Natural
Language
Hypothesis
Implementation
of WFMS
Need for CrossOrganisational
Workflows
Critique
Critique of
Abstraction
of Factual
Critique of
Abstraction of
Intentional
Refutation
Purpose
Challenge
Increased Productivity
through CrossOrganisational Workflow
Management
Adequacy
Design
Artefact
Evaluation
Formal
Language
Petri Net
XML
Conceptual Model
Particular Configuration B
Core Concepts: Meta Model
440
specialized from
1,1
Epistemological
Contribution
represented through
0,1
0,*
1,*
0,*
Representation
0,* specialized from
focussed at
1,1
0,*
Abstract Knowledge
Contribution
refers to
0,1
specialized from
Knowledge
Contribution
0,*
0,*
0,*
0,*
supposed to justify
Research
Subject
0,*
refers to
0,*
refers to
1,*
0,*
Justification
Criterion
refers to
0,1
1,*
validated through
1,*
0,*
Justification
Process
0,1
Application
Domain
Ballpark View: Model-based
Configuration
Action System
Socio-Technical
System
Semi-Formal
Language
IS Artefact
450
Case
Study
Natural
Language
Language
Experiment
Formal
Language
Theory
Abstraction
of Factual
Correspondence
Theory
Field Study
Coherence
Theory
Literature
Review
Truth
Theory
Application
Consensus
Theory
Virtual
Discourse
Construction
Hypothesis
Configuration of Research Methods
Abstraction of
Intentional
Formal
Truth
Prototype
Interpretation
Formal
Proof
Conceptual
Framework
Purpose
Design
Artefact
Critique
Critique of
Abstraction
of Factual
Refutation
Adequacy
Conformity
Test
refers to
Epistemological Contribution
supposed to justify
validated through
Abstract Knowledge Contribution
part of
Knowledge Contribution
optional
Challenge
Critique of
Abstraction of
Intentional
is a
Justification Criterion
supports
represented through
Representation
requires
Evaluation
Justification Procedure
Ulrich Frank | Information
Systems Research
Research Subject
Example of Prototypical Construction-Oriented Research
460
Application
Domain
Action System
Socio-Technical
System
Natural
Language
IS Artefact
Case
Study
Semi-Formal
Language
Language
Formal
Language
Coherence
Theory
Truth
Theory
Application
Literature
Review
Consensus
Theory
Abstraction
of Factual
Virtual
Discourse
Hypothesis
Prototype
Interpretation
Formal
Truth
Formal
Proof
Conceptual
Framework
Abstraction of
Intentional
Design
Artefact
Purpose
Adequacy
Conformity
Test
Example 1: Study by Barua et al. (1)
470
 research question: How does the Internet improve
business performance?
 theory: "Resource Based View of the Firm"
 general hypothesis: The effect of the Internet on
performance depends on a firm's resources.
 set of more concrete hypotheses, e.g.: "Higher levels of
systems integration within a firm will be positively
associated with greater levels of customerside online
informational capabilities."
Example 1: Study by Barua et al. (2)
480
 justification criterion: correspondence theory of truth
 justification process: field study
 further approaches to justification: literature study
(coherence theory), virtual discourse (consensus theory)
Barua, A.; Konana, P.; Whinston, A.B.; Yin, F.: An
Empirical Investigation of Net-Enabled Business Value.
In: MIS Quarterly Vol. 28, No. 4, 2004, pp. 585-620
Reconstruction of Research Method
Action System
490
Business Transactions
with Customers and
Suppliers
Socio-Technical
System
IS Artefact
Internet Enabled
Business
Transactions
Corporate Information
System + Interfaces to
the Internet
Theory
Application
Correspondence
Theory
Coherence
Theory
Literature
Review
Consensus
Theory
Virtual
Discourse
Resource Based View
Interpretation
Natural
Language
adaptation and application of theory
motivation of hypotheses
discussion of results
Conceptual Framework
Net-enabled Resources and
their Effects
Formal
Language
Quantification of
Concepts
Hypothesis
Effect of NetEnabled Value on
Performance
Field Study
Example 2: Design of Artefact by van der Aalst et al.
500
 research objective: design of a language to model
business processes


should support the design of inter-organizational processe
should allow for a transformation into the schema of a WFMS
 research results

language specification (XML-DTD)
architecture of WFMS + prototype

rules for transforming workflow model to WFMS schema

Aalst, W., and Kumar, A.: XML-Based Schema Definition
for Support of Interorganizational Workflow. In:
Information Systems Research Vol. 14, No. 1, 2003, pp.
23-46
Reconstruction of Research Method
510
Action System
Cross-Organisational
Business Processes
Socio-Technical
System
Internet Enabled
Business
Transactions
IS Artefact
Cross-Organisational
WFMS
Conceptual Framework
Workflow; Workflow Control
Structures
Prototype
Natural
Language
Hypothesis
Implementation
of WFMS
Need for CrossOrganisational
Workflows
Purpose
Increased Productivity
through CrossOrganisational Workflow
Management
Adequacy
Design
Artefact
Formal
Language
Petri Net
XML
A Process Model to Guide Configuration of Methods
520
1
2
3
4
5
Selection of Core Knowledge Contribution
Test of Possible Elements
Selection of Most Appropriate Elements
Refinement of Configuration
Evaluation/Reconfiguration
1: Check General Suitability of Intended Research
Criterion
530
Check
Comment
Topic
Originality
Abstraction
research subject
action system + information system (artefacts)
within goal-oriented organisation (or group of
goal-oriented organisations)
Typically, the notion of information system
will focus on computer-based information
systems.
research goal
analysis, development, use and maintenance of
information systems with respect to a
managerial or economic perspective
This demands to check goals for their
potential economic implications.
responsibility
inappropriate invasion of other fields?
This criterion allows for an additional
check, which should usually be redundant.
superiority
superior with respect to identifiable aspects?
requires to identify respective aspects and
to show why they are superior to those of
previous contributions
surprise
potential for surprising peers
Judgement depends on experience &
introspection.
inspiration
potential for inspiring peers – unusual
approach or perspective?
Judgement depends on experience &
introspection.
concepts
clear focus on concepts that allow for being
applied to many cases, also to future cases;
should not be vague
requires checking whether core concepts
could be generalized into higher level
concepts
domain
intended application domain can be described
in a comprehensible way
the more precise the better
1: Check Possible Focus on Critique
540
Criterion
Check
Comment
Originality
Justification
construction
the more established the targeted construction
seems to be, the more original the critique
Judgement depends on
experience & introspection.
previous critique
Are there previous attempts to challenge the
construction? Is the intended critique clearly
superior/more effective?
This demands for a thorough
investigation of previous
critiques.
inconsistency
Does the targeted construction or critique
include logical inconsistencies or weaknesses?
Are these inconsistencies essential for the
knowledge contribution?
Identifying logical
inconsistencies is usually a
convincing justification of
critique.
2: Check Suitability of Intended Construction (1)
550
Criterion
Check
Comment
Originality
Abstraction
requirements
Is it possible to specify
comprehensible requirements? Does
the intended design artefact promise
to fulfil certain requirements superior
to existing solutions?
This demands for a thorough
investigation of existing solutions and
a differentiated registration of
requirements.
inspiration
unusual approach? inspiring
transfer of design principles from
other fields?
Judgement depends on experience &
introspection.
aesthetics
Is the intended solution more
elegant than comparable solutions?
Hard to judge, but still relevant.
dependence from
technology
Are the concepts used independent
from existing technology? If this is
not the case, it needs to be checked
whether existing technology is
supposed to be invariant in time.
Existing technology has a subtle
impact on researchers’ perception and
judgement. Total independence is
neither possible nor desirable.
However, it should be avoided to use
terms that are specific to certain types
of technology, which may well be
replaced by others.
2: Check Suitability of Intended Construction (2)
560
Criterion
Check
Comment
Justification
requirements
Is it possible to justify the
requirements the construction is
aimed at?
There may be an actual problem in
practice. However, that is not mandatory.
Requirements can also relate to possible
future worlds, i.e. reflect a need that may
become relevant in future times.
purpose
Is it possible to give reasons for
choosing a certain purpose? This could
be accomplished by providing
evidence that a corresponding
demand exists or will exist.
While justifying purpose makes sense for
an application-oriented discipline, it
requires a critical approach: Favouring at
a particular demand may imply
discriminating other interests.
specification
Are both requirements and design
artefact specified precisely enough for
a comprehensible test of adequacy?
Formal specifications would be best
suited at first sight. However, the price
(loss of semantics) paid for it, should not
be too high.
empirical test
Only an option, if requirements for
empirical test are fulfilled, which
include the reference to a theory or a
theory application.
A so called ‘proof of concept’ in a single
case is usually not a convincing
justification. This would be acceptable
only, if this single case can be regarded
as representative in all relevant aspects.
2: Check Chances for Including Behaviourist Elements
Criterion
570
Check
Comment
Feasibility
Originality
Is it possible to reduce the theory to
other existing theories?
It may occur that a definite reduction
is not possible, but a ‘close’ reduction.
In this case, it needs to be decided
whether the knowledge contribution
is a theory or rather a theory
application.
contingency
Are cases possible, which are not – or
will not – be covered by the theory?
Indicators: (structural) change and
incentives for change
This demands to reflect upon possible
future developments.
surprise
Is the application of the theory not obvious
(transfer as a challenge)? Is expected
outcome of test surprising? Is contingent
subject not comprehensively covered by
theory? Is there a chance to dissolve
contingency?
Judgement depends on experience &
introspection.
operationalisation
Is satisfactory operationalisation of key
concepts possible (no substantial loss of
relevant semantics)? Are sufficient validity
and reliability of corresponding data to be
expected?
This criterion is aimed at the question
whether a test makes sense even if
data are available.
availability
Are data available? Are resources required
to collect and analyse data, available?
This will often be a bottleneck that
deserves critical consideration.
Test
independence
2: Check Chances for Including Hermeneutic Elements
580
Criterion
Chance
Originality
Justification
Check
Comment
limit of
behaviourist
approach
Is the research question
addressed not suitable for a
behaviourist approach?
This is not mandatory. Also, it does no
imply that a behaviourist approach, if
it was possible, would be the better
option. However, if it is no option, this
would create a chance for a
hermeneutic approach.
surprise
new insights, surprising
perspective, focus on
hidden aspects
Judgement depends on experience &
introspection.
inspiration
inspiring insights, use of
metaphors and analogies
Judgement depends on experience &
introspection.
justification
criteria
Can theories of truth
(coherence, consensus,
correspondence) be applied
to convince others across
the borderlines between
different ISR communities?
The application of the coherence
theory may tempt to a selective
consideration of literature, while the
consensus theory may tempt to focus
on knowledge that is accepted within
a particular community only.
Therefore, a self-critical inspection of
the justification procedure is
recommended.
Comments on Publishing (1): Before you start
590
 certainly important, but should not dominate research
agenda
 main focus should be on research interest


What gets me excited?
What I am really good at?
 pivotal relevance of reading




as a virtual critical dispute with the author
aims at getting familiar with a field
helps to develop confidence about state of the art
and at developing a sense of quality
Take your time for finding a topic that gets you excited.
Comments on Publishing (2): Conducting Research
600
 Account for an appropriate configuration of research
method.
 Do not let the quest for a research method dominate your
research.
 Take your time for crafting your research questions and
goals of the project.


Goals should be ambitous,
but feasible
 Discuss your ideas with peers and ask them to be critical.
 Do not refuse to invalidate your previous assumptions.
dedication, attention and reflection are paramount.
Comments on Publishing (3): Prepare for Writing
610
 Think about possible co-authors.


Who could contribute from a different viewpoint to make
the paper better?
What can you offer?
 Check possible outlets (conferences, journals).


Read editorial statements (scope, intention, target group,
reviewing process)
Read papers that were published in the past.
Success Factors
620
 Time for (deep) thinking!
 self-confidence
 persistence
 (self-) criticism
 Challenge own ideas


check through reflection
discuss with peers
Finally: Nietzsche
630
„All these heaviest things the load-bearing spirit takes
upon itself: and like the camel, which, when laden, hastens
into the wilderness, so hastens the spirit into its
wilderness.”
„To create itself freedom, and give a holy Nay even unto
duty: for that, my brethren, there is need of the lion.”
„Innocence is the child, and forgetfulness, a new
beginning, a game, a self-rolling wheel, a first movement, a
holy Yea.”
Last but Not Least: Hyperion‘s Outcry
640
"Are we like tame poultry that must not leave the yard,
because it is fed there? No, we are like the young eagles
that the father has thrown out of the nest in order to catch
their prey in the high skies.”
References
650
Aho AV, Ullmann JD (1998) Foundations of computer science. Computer science press, New
York.
Berger PL, Luckmann T (1966) The social construction of reality: A treatise in the sociology of
knowledge. Doubleday, Garden City, N.Y.
Feyerabend PK (1993) Against method. Verso, London.
Frank U (2006) Towards a Pluralistic Conception of Research Methods in Information Systems
Research, Essen.
Frank U (2014) "Higher Value of Research by Promoting Value for Researchers",
Communications of the Association for Information Systems, Vol. 34, No. 43, 2014
Gregor, S.; Hevner, A.R.: Positioning and Presenting Design Science Research for Maximum
Impact. In: MIS Quarterly, vol. 37, no. 2, pp. 337-355
Hevner, A. R.; March, S. T.; Park, J.; Ram, S.: Design Science in Information Systems Research. In:
MIS Quarterly, Vol. 28, No. 1, 2004, pp. 75-105
Klein, H.K.; Myers, M.D.: A Set of Principles for Conducting and Evaluating Interpretive Field
Studies in Information Systems. In: MIS Quarterly, Vol. 23, No. 1, 1999, pp. 67–94
Morgan G (ed) (1983) Beyond method: Strategies for social research. Sage Publications, Beverly
Hills, Calif.