Uploaded by Said Saad

ExploringProjectSuccess finalpaperBJMII

advertisement
1
Exploring Project Success
Erling S. Andersen
Professor, Norwegian School of Management BI
NO-0442 Oslo, Norway
erling.s.andersen@bi.no
David Birchall
Professor, Henley Management College
Greenlands, Henley-on-Thames, Oxfordshire, RG9 3AU, England
david.birchall@henleymc.ac.uk
Svein Arne Jessen
Professor, Norwegian School of Management BI
NO-0442 Oslo, Norway
svein.a.jessen@bi.no
Arthur H. Money
Professor, Henley Management College
Greenlands, Henley-on-Thames, Oxfordshire, RG9 3AU, England
arthur.money@henleymc.ac.uk
2
Erling S. Andersen is professor of Information Systems and Project Management at
Norwegian School of Management BI, Oslo, Norway. His school is running an MBA
programme in Change management in China in co-operation with Fudan University,
Shanghai and several large multinational companies. Professor Andersen serves as Dean
of China programs. He has published several books and articles on information
technology, systems development, project management and management in general. The
third edition of his book Goal Directed Project Management – co-authored with
Kristoffer Grude and Tor Haug – was published by Kogan Page in 2005 and has also
been translated into several languages.
David Birchall is Director of the School of Management Knowledge and Learning and
Director of Henley Learning Advisory Services at Henley Management College, Henleyon-Thames, England. Professor Birchall is a regular speaker on innovation, knowledge
project management, IT and learning and new forms of organisation and has designed
management development programmes at all levels. He currently directs projects funded
by the European Union including multi-national partnerships, UK Government
Department and several commercial organisations; moreover, he regularly presents
research findings at conferences and seminars worldwide. His latest book Capabilities for
strategic advantage: Leading Through Technological Innovation – co-authored with
George Tovstiga – was published by Palgrave in May 2005.
Svein Arne Jessen is professor of Project Management at the Norwegian School of
Management BI, Oslo, Norway. His PhD in Project Management is from USC,
University of Southern California (USC) in LA, USA, in cooperation with Henley School
of Management, UK. He is an adjunct professor at University of Tromsø and on the guest
faculty at Henley School of Management,England, SUPAERO Technical University in
Toulouse, France, Hautes Ecoles Commerciale in Paris, France, and CERAM in Sophia
Antipolis, Nice, France. He has a broad background from international consulting and
execution of projects both in Asia, Europe and Latin America. For the time being he is
lecturing in countries like China, Singapore, Lithuania, besides France and the UK.
Arthur H. Money is Professor and School Director: Projects, Processes and Systems at
Henley Management College, Henley on Thames, England. Additionally, he is Director
of the Henley Research Development Fund. He has on two occasions served as a
Governor of the College. Professor Money received his PhD degree in Mathematical
Statistics from the University of Cape Town. He is the author of over 100 journal articles,
working papers, book chapters, co-author of nine books and co-editor of two books,
Professor Money focuses his research on statistics, management science and applications
in the areas of information systems, finance and marketing. He has extensive consulting
experience in the marketing research area.
3
Exploring Project Success
Abstract
Purpose – The paper studies the relationship between project success factors and actual
project success. It reports an investigation into those factors within the direct influence of
project managers that can make a real difference to the outcome of project endeavours.
Methodology/Approach – Using Principal Components Analysis on 60 questions about
actual project work performance collected from four culturally different regions (UK,
France, Norway and China), nine distinctively different critical success factors were
found. Similarly, using PCA on 10 project success items, three distinctively different
project success criteria were extracted.
Findings – The most important factors in improving managerial ability to deliver results
in time and at cost were strong project commitment, early stakeholder influence,
stakeholder endorsement of project plans and rich project communications. To secure
project impact, strong project commitment and rich project communications were the
main contributors. A well-structured and formal project approach and well understood
and accepted project purpose, implying high quality management, also scored high.
Captured experience was best supported by a well-structured and formal project
approach and rich project communications.
Practical implications – As the project approach increases as a means for implementing
strategic goals, project managers should devote increasing energies into rich
communication both within the project and towards the project environment.
Originality/value of paper – The study is cross-cultural. It shows that successful project
management, regardless of cultural differences, still depends on “hard features” such as
professional planning and cost control, but that “soft skills” such as rich communication
and learning from experience are prerequisites for project management to achieve
superior project success.
Keywords Project success, Critical Success Factors
Paper type Research paper
4
Introduction
More and more companies are using the project approach as the vehicle for creating
change in pursuit of organisational goals. Each project strives for excellence, yet is by
definition a unique task, normally subject to severe restrictions on budget and time; it is
widely recognised that projects involve a complex set of processes which helps explain
why so many fail to achieve the initial overall aims. The increasing turbulence in the
modern business environment also thwarts the rate of success for many projects.
However, in relation to the actual execution of projects, there is a long held assumption
that both line and project managers could improve their performance if they had a better
understanding of what constitutes project success and how the factors under their control
impact on outcomes. Despite this there is only limited prior empirical research aimed at
understanding the relationship between project success factors and actual project success.
Much prior research has also tended to focus on success as measured in operational terms
whereas emphasis is now often placed on a broader set of impact measures. This paper
sets out to redress this issue by reporting exploratory research into the impact of success
factors on a range of project success criteria.
Based on a questionnaire survey adopting an established instrument (the Project
Evaluation Scheme, see (Andersen and Jessen, 2000)for details), data were collected
from projects undertaken in four national settings. In this paper the authors identify
factors of upper-most importance in achieving project success. Here, Project success
criteria are the measures by which the success of the project is judged. Critical success
factors are then those elements within the project that can be influenced directly by
project management so as to increase the chance of achieving success. The paper will
explore the possible relationship between a set of project success criteria and a range of
project critical success factors.
Project success criteria
Project success can be viewed narrowly as achievement of intended outcomes in terms of
specification, time and budget. Whilst this was widely accepted as appropriate in early
writings on project management the project context has shifted and it is now recognised
that a broader set of outcome measures is now generally needed (Atkinson, 1999; Pinto
and Slevin, 1988; Wateridge, 1998).
Factors which have led to this view, in part, result from a broader strategic perspective
being required by the many project stakeholders. Such influences include the growing
concern to ensure maximisation of the lifetime value of the project endeavour (Bonnal et
al., 2002; Jaafari, 2000; Leach, 1999), the notion of the sustainable enterprise (Lidow,
1999; Saeed, 1998), the growth in interest in knowledge as the source of competitive
advantage (Drucker, 1993; Ruggles, 1997), the importance of motivation as a source for
better project execution (Graham, 1987; Steers et al., 1996), the idea of evaluation led
project or program endeavours (Gareis and Hueman, 2000; Pellegrinelli, 2002), and the
general turbulence of the business environment as mentioned earlier. So projects are
viewed less as isolated sequences of events aimed at a short-term goal and having limited
impact and rather more as long term strategic interventions which, to be accepted, have to
5
enhance the economic, social and environmental well being of the various project
stakeholders (Lim and Mohamed, 1999; Turner, 2002; Wateridge, 1998). Within
knowledge-based enterprises projects are also being considered as an arena for learning;
the uniqueness of projects makes each rich in opportunities for personal and
organisational learning (Ays, 1996; Keegan and Turner, 2001; Lundin and Midler, 1998).
(Munns and Bjeirmi, 1996) use the concept project management success. This is the
traditional view with a focus on the successful accomplishment of cost, time, and quality
objectives and the quality of the project processes or work. These matters are regarded as
the responsibilities of project management and a successful outcome on these would be
considered a project management success. (Baccarini, 1999) adopts a somewhat different
approach and uses the descriptor, product success, to illicit the impact of a project when
its execution is finished, such as; meeting the project owner’s strategic organisational
objectives, satisfaction of users’ need, and satisfaction of stakeholders’ need where they
relate to the product. We might also include criteria such as knowledge creation and
dissemination, which today many project owners include as factors that determine if the
project is successful or not (Fusco, 1997).
We regard overall project success as the broader concept, which deals with the wider and
longer term impact of the project, i.e. both project management success and the project
product success. Project management success can be determined at the end of the project.
Expanding the success criteria as the concept overall project success indicates will
necessarily postpone the final judgement on the project. The performance on some of
these success criteria will be finally decided months or years after the termination of the
project.
The two different success concepts should enlighten the debate on whether a project is a
success or not. A project might in one sense (project management success) be regarded as
a success, but in another (product success) be regarded as a failure, and even the vice
versa situation might occur.
Given this broader set of expected outcomes it seems reasonable to deduce that project
management needs to respond rather differently than as in the case of the more traditional
view. Questions of particular interest in this research relate to those factors within the
control or direct influence of project management which contribute to wider measures of
success and also how these factors interact to influence these outcomes (Globerson and
Zwikael, 2002). Our focus is on those elements under the control of project management
once the broad parameters of the project have been determined. The benefit to both
policy makers and project managers is in understanding the inter-relationship of factors
that need particular attention in order to achieve these outcomes and the eventual
establishment of performance indicators for the management of project managers.
In our research we include a range of success criteria, ten all together, including the
traditional success criteria (time, costs and quality), the business achievements, the
appreciation of the stakeholders, and the knowledge gained from project work.
6
Critical Success Factors
Critical success factors are those features of projects which have been identified as
necessary to be achieved in order to create excellent results: if the critical success factors
are not present or taken into consideration, one can largely expect that problems will be
experienced which act as barriers to overall successful outcomes (Rockart, 1979). Project
management, given the unique nature of each individual project, is an area seen as
benefiting from focusing management’s attention on such critical success factors.
Pinto and Slevin (Pinto and Slevin, 1987; Slevin and Pinto, 1987) have, with their Project
Implementation Profile (PIP) made a valuable contribution to the field of project
management insofar as they have demonstrated how to use critical success factors to
diagnose a project’s status. They used as critical success factors: Project mission (clarity
of goals and general direction), Top management support, Project schedule/plans, Client
consultation, Personnel (recruitment, selection, and training), Technical tasks (availability
of the required technology and expertise), Client acceptance, Monitoring and feedback,
Communication, and Trouble shooting (ability to handle unexpected crises and deviations
from plan).
Later writers have added to this list. More recently writers have overviewed critical
success factors (for examples see (Belassi and Tukel, 1996) and (Westerveld, 2002)). It is
difficult to identify a unifying framework. Belassi and Tukel group the factors into four
areas: factors related to the project (i.e. size, uniqueness, urgency), the project manager
and the team members (i.e. skills, background), the organisation (i.e. management
support, structure), and the external environment (i.e. political, technological).
Westerveld uses the European Foundation for Quality Management (EFQM) model as his
approach for categorising the different critical success factors. A Project Excellence
Model is presented with the following critical success factors: leadership and team,
policy and strategy, stakeholder management, resources, contracting, and project
management. Obviously there are different opinions as to which factors are critical for
project success.
Our framework (Andersen and Jessen, 2000) is based on a somewhat different approach
to earlier writers using critical success factors based on a step-wise structure, reflecting
progression through a project. In that way all aspects of project work identified from
earlier research into success factors has been systematically included, supplemented by
factors derived from practice. Hard (technically focussed) and soft (behavioural) issues
are taken into account. The following aspects of project work are covered:
1. Scope: Project mission and goals, Terms of reference;
2. Planning: Planning global level, Planning detail level;
3. Organisation: Formal organisation, Informal organisation;
4. Execution: Activities, Decisions;
5. Control: Financial and technical control, Internal and external
communications.
7
The research approach
This is a cross-national study involving a wide range of project types and respondents
with different stakeholder perspectives. The research adopts a quantitative approach with
the overall objective of examining the relationship between a series of predictors (project
success factors) and criterion variables (project success criteria) representing outcomes of
a project.
Questions of particular interest in this research are:
 Which success factors within the control or direct influence of project
management contribute to the wider measures of success?
 How do these success factors contribute to the success of the project?
The review of the literature demonstrated that the number of desirable outcomes expected
from a project is continually increasing. So, it seems reasonable to deduce that project
management will now need to have more ‘know how’ to be able to respond differently,
and appropriately, than was the case in the more restricted traditional environment in
which they operated previously.
A quantitative approach to answering the research questions is followed. To achieve the
overall objective two separate, but sequentially related, stages of analysis were carried
out:
Stage 1: Exploratory factor analyses, using principal component analysis (PCA) with
varimax rotation, were performed on the responses to the sections of the PEVSquestionnaire relating to:

The 60 statements covering the features of projects that are generally considered to
be critical to a project’s success, and

The 10 statements on criteria that are proposed for use in evaluating a project’s
success
This results in the identification of two sets of factors, or constructs as often referred to,
that summarise the original statements into a ‘manageable’ few categories of success
factors and success criteria. We refer to these, collectively, as project success factors (X)
and project success criteria (Y), respectively.
Each of the categories comprising X and Y were then named according to those items
that load ‘significantly’ on the category. Computing a composite factor score for each of
the categories followed this. These uncorrelated factor scores were then used in the
regression analysis in Stage 2.
Stage 2: A regression of the project success factors (X) on the project success criteria
(Y) was performed. This analysis allowed us to establish the nature and magnitude of the
impact of the different categories of success factors on the categories of success criteria.
8
Data
This research is based on data collected from subjects all of whom attended different
project management courses given by the authors in the respective countries during the
period 1999-2002. All students were in positions of some authority in relation to projects
- as project manager, in a support function, as project champion or as the client. It
includes a total of 529 respondents with 67% from Norway, 22% from China as well as
8% from France and 3% from the UK. The respondents would be recognised as
experienced practitioners within the direct field of the study. They responded individually
to the questionnaire. The questionnaire was handed out towards the end of the course,
which gave the lecturers the opportunity to discuss the different aspects covered by the
questions. That should ensure that the respondents had the same understanding of all
questions.
Data were collected about personal circumstances as well as project position. Also the
nature of the projects varied in terms of scale in relation to their employer’s experiences
and focus (52% construction/production related, 21% R&D and 20% decision support).
It was assumed that a universal approach has emerged for managing projects and that
certain elements are evident regardless of the context and that by aggregating data from a
wide range of project types and environments a generally acceptable set of success
predictors would be derived. However, it is recognised that the means for achieving this
performance will vary across project types. As an illustrative example we would
highlight the need in large infrastructure projects for clearly specified goals (Morris and
Hough, 1987) but recognise that processes by which goals are specified and agreed will
differ across industries.
The sample provided respondents with the following characteristics: 39% working on
large projects, 38% medium, 22% small; 69% male, 31% female; 10% 50 years and
older, 25% 40-49 years old, 45% 30-39 years old, 20% under 30 years old; 39% project
managers, 35% team members, 14% steering or advisory board members, 5% project
owners, 11% end-users.
The purpose of the study was to identify possible universal approaches to project
management, regardless of nationalities and cultures. We accept that such differences
exist, but the data material did not allow for studying the specific differences.
Analysis and results
The data were subject to analysis using SPSS Version 10. Prior to applying exploratory
factor and regression analysis the data were examined to ensure that they were amenable
to the use of these techniques. This involved examining the responses to each question
for invalid responses, missing values, for conformity to the normal distribution and for
outliers.
In checking the distributions of the responses, use was made of visual checks histograms, box-plots - and the numerical summaries of skewness and kurtosis. Both the
9
sample skewness and kurtosis coefficients had to be within three standard errors of zero
before the distribution of responses to a question could be deemed normally distributed.
Achieving ‘normality’ required the identification and removal of cases that were
‘outlying’. This resulted in a multivariate data set that could be subjected to factor and
regression analysis with confidence.
Factor Analysis to elicit underlying factors
For each set of items – 60 project success factor items and the 10 project success criteria
items – only cases with complete data were retained. The 60 project success factor items
had 265 cases with complete data and the 10 project success criteria items had 365 cases
with complete data. The sample sizes, being of the order of 300, are large enough for us,
to have confidence in the reliability of the factor solution (Field, 2000), p. 443).
Factors retained for further analysis were those that satisfied the ‘eigen-value greater than
one rule’. Additionally, before the application of factor analysis was considered to be
able to result in an appropriate factor structure it had to have a Kaiser-Meyer-Olkin
(KMO) measure of sampling adequacy of at least 0.7 (Field, 2000), p. 459). In order to
achieve a satisfactory KMO the factor structure was improved by identifying variables to
be removed from the analysis. After removal of such variables subsequent factor analyses
were run until an appropriate factor structure was obtained.
In interpreting and naming the factors, a loading of 0.40 for an item is considered
important in the make-up of the factor (Hair et al., 1998), p. 111). Where an unacceptable
KMO was achieved the factor loadings provide the basis for removing variables from the
analysis. Variables with a loading of less than 0.4 on all factors were omitted from the
subsequent PCA. Also, variables that loaded 0.40 or higher on two or more factors were
omitted.
Project success factors (X)
The final PCA after varimax rotation on the critical success factors items extracted 9
factors with eigen-values greater than one from the data, accounting for 62.3% of the
total variance. All 9 of the factors were interpretable. These factors and the items loading
on them are presented in Table 1. The table includes the label attached to each factor, the
statements as they appear in the questionnaire (Column 1), and the ‘significant’ factor
loadings (Columns 2-10). Only loadings of 0.45 or higher are listed in the table. A KMO
measure of 0.891 was achieved. Also we report the percentage variance extracted by
each factor.
---------Table 1 in about here
----------
10
Project success criteria (Y)
The final PCA after varimax rotation, on the project success criteria items, extracted three
factors with eigen-values greater than one from the data, accounting for 59% of the total
variance. All factors were interpretable. These factors and the items loading on them are
in Table 2. The table includes the label attached to each factor, the statements as they
appear in the questionnaire (Column 1), and the ‘significant’ factor loadings (Columns 24). Only loadings of 0.45 or higher are listed in the table. A KMO measure of 0.819 was
achieved. Also to be found in the table is the percentage variance extracted by each
factor.
---------Table 2 in about here
----------
Analysis and results – relationship between critical success factors and
success criteria
Then in order to identify particular success predictors, Pearson Product Moment
Correlations were computed between the predictor (X) and criterion variables (Y). After
selecting factors satisfactorily correlating with the criterion variables, linear regression
analyses were undertaken with each outcome variable. In Table 3 the Pearson Product
Moment Correlations between the predictor and criterion variables is presented.
---------Table 3 in about here
---------Each predictor correlates significantly with at least one of the criterion variables with
several correlating with more than one. So no clear pattern emerges to support the notion
that a different set of predictors will impact on each of the success measures and the data
suggest that a complex interaction is taking place. However, Rich project
communications is significantly correlated with all three success factors.
Y3 Managerial ability to deliver correlates strongly with X4 Strong project commitment,
X5 Early stakeholder influence, X2 Stakeholder endorsement of project plans, and to a
lesser degree, X7 Clear project constraints and X1 Rich project communications. Y1
Project impact correlates strongly with X1 Rich project communications, X4 Strong
project commitment, X9 Influence over on-going project processes, X6 Well understood
and accepted project purpose, and to a lesser extent with X8 Project execution flexibility,
X3 Well structured and formal project approach. Y2 Captured experience correlates with
fewer predictor variables – X3 Well structured and formal project approach, X1 Rich
project communications and to a lesser extent with X5 Early stakeholder influence and
X7 Clear project constraints.
The results of the regression analysis are presented in Table 4.
11
---------Table 4 in about here
---------Project impact is explained in major part by the factor, Rich project communications,
which is based on six variables:
1. Project participants have an open and efficient way of informing each
other as necessary
2. In project meetings there is a good and efficient flow of information
3. The project has well established information and communication routines
4. All key project information is gathered and distributed efficiently
5. The project has a clear and well-planned agenda of meetings for all
participants
6. Project stakeholders are well informed on project progress as necessary
Keeping stakeholders and participants well informed seems to be the key contributor to
the recognition of Project impact in project settings. The beta loadings indicate the
importance of three other factors, Strong project commitment, Well understood and
accepted project purpose and Influence over on-going project processes which account
for 6%, 5% and 5% of the residual variance respectively.
Well-structured and formal project approach and Rich project communications
contribute the most significant amount to the variance in Captured experience. The
combination of communications and a formal approach to managing the project seem to
relate to the degree to which the potential for explicit learning has been put in place.
We can see that Strong project commitment is the factor, which explains most of the
variance explained in relation to Managerial ability to deliver. This factor comprises five
items:
1. Project executors keep within quality parameters in all activities
2. All end user needs and desires are discussed with and agreed by the project's
key executors
3. The project is part of a well documented or understood strategy
4. Project activities are carried out exactly as planned
5. Project executors conform to the planned cost schedule for all activities
The other factor, which relates significantly to Managerial ability to deliver and explains
a reasonable amount of the additional variance, is Early stakeholder influence
comprising:
1. All key participants have been engaged in producing the master plan, or have
had the opportunity to influence it.
2. All participants have been given the opportunity to air their views on the
project's goal or mission.
3. All key people engaged in the project know who has decided its terms of
references.
12
The pattern of beta loadings indicates the relative impact of each component. But from
this analysis it is clear that aspects of involving major stakeholders throughout the project
life cycle has a strong relationship to Managerial ability to deliver.
We can see from this analysis that the pattern of component factors impacting on each of
the outcome variables differs in ways which would suggest that project effort should be
directed differently depending upon which set of outcome variables is considered most
important by the key stakeholders as a measure of success. However one key variable
impacting success on the three dimensions is one of the predominantly softer factors,
Rich project communications, although its impact is greater on both Project impact and
Captured experience.
Implications
Success Criteria
The success criteria identified in this research reflect the immediate short term,
predefined project goals (completion on time and to budget) as well as the longer-term
contribution to ‘organisational health’ in the form of strategic and personal success as
well as captured experience. The latter results from the project’s on-going contribution to
organisational success as well as through documentation to be the basis of a knowledge
management system and support later capability development. The strongest dimension,
however, Project impact, is a dimension representing the potential for the longer-term
impact of the project endeavour. This criterion relates more to the extent to which the
project contributes to achieving strategic aims and the project managers are then
motivated for future projects. The latter take their new tacit knowledge on to future
projects. Much of this high level success is based on rich project communications which
may be seen as making a significant contribution to building trust amongst the key
players and hence effective and sustainable working relationships.
The 3 success criteria appear to offer a good balance between the predetermined
intention, the immediate benefits of project success and the longer-term contribution to
the health of the organisation.
The 3 success criteria appear to offer a good balance between the predetermined
intention, the immediate benefits of project success and the longer-term contribution to
the health of the organisation.
Managerial ability to deliver
1. The application of project management methodologies which are factors widely
recognised as contributing to achievement of project goals (PMI, 2000; Wideman,
1988) strongly emerged as differentiators of the more and less successful projects
(Strong project commitment and Clear project constraints).
13
2. Involvement of stakeholders in the early planning of projects is widely recognised as
a means for gaining commitment to project endeavours and this factor emerged in our
research. This factor is widely recognised in the change management literature as a
strategy for gaining acceptance to certain types of change where one cannot plan the
change process in the same way as those with physical outputs (Cummings and
Woley, 2001; Yukl and Falbe, 1990).
3. Additionally, consistency of support from higher organisational levels in the form of
Stakeholder endorsement of project plans emerged as a differentiator in relation to the
achievement of overall project aims. Again this is evident in other research (Hollis,
1996; Sounder, 1983).
4. The factors that did not emerge as being significantly related to project management
success are of particular interest. Whereas much of the project management literature
prescribes tight project organisation and control, this was not found as a major
contributor to project management success. Neither was a broad understanding of the
project’s strategic purpose significant, nor having influence over on-going project
processes. These factors may well be contingent on the particular national and
business context in which the project is being executed as well as the nature of the
project endeavour.
5. The area least expected to be a differentiator of successful outcomes is that of Rich
project communications. This result contributes relatively little to the explanation of
overall variance even though significant. But it does hint at the possibility that more
communication with stakeholders and actors could benefit many projects in terms of
the achievement of immediate outcomes. This combined with the other factors
relating to stakeholder involvement implies a broadening of the basic project
management role to encompass more involvement with a range of stakeholders in the
tactical decision-making relating to overall project goals.
6. One area not generally identified in earlier studies is the degree of stakeholder
influence over project processes. We are not aware of it being highlighted in the
mainstream project management literature.
Project impact
As indicated at the beginning of the paper, the evaluation of projects is increasingly
including longer-term benefits. This success criterion reflects this concern to the extent to
which the project meets the plans and the needs of a range of stakeholders but it also
includes individual learning, which will aid future project endeavours.
1. Rich project communications is the major contributor to this outcome. Many of the
factors making up this success criterion are of a ‘soft’ nature and hence do not lend
themselves easily to measurement and benchmarking. The richness in communicating
within and outside projects seems to be, on the face of it, an essential aspect of
ensuring stakeholders take a positive view of the longer-term benefits (Kreiner,
1995). Whilst propensity to information sharing may well relate to personality (Might
and Fisher, 1985; Palmer, 1991), evidence is inconclusive and more research has been
called for (Sveiby, 1996; Szulanski, 1996). But processes and procedures can be put
in place to support the activity and training can also have a positive impact on
behaviour.
14
2. Strong project commitment features here as well as in relation to project management
success, but clear project constraints does not explain success in this case. So clear
predetermined targets for completion seem less important in terms of the overall
project and personal outcomes than efforts to conform to more flexible targets, which
reflect the realities of the environmental influences. However, well-understood and
accepted project purpose relates to a good understanding of the strategic intent.
3. Early stakeholder influence does not seem to impact on this success criterion. Again
the influence may be contingent on other factors which impact on some but not all
projects. It may be that in looking at longer-term impact the early involvement has
been overtaken by events.
4. Well-structured and formal project approach implies high quality management. One
would anticipate that stakeholders not directly participating in the project process
would find this particularly satisfactory and confidence building. For those
participating directly this structure would make clear the role expectations,
performance standards and then progress against targets (PMI, 2000).
Captured experience
This factor reflects the growing interest in knowledge management and the need to find
new ways of working for the ‘knowledge economy’ as business activities approach what
Ruggles describes as the ‘speed of light’ (Ruggles, 1997). Increasingly it is being
recognised that competitive advantage is to be gained through superior knowledge
management, capturing experience is a keystone of this.
1. Well-structured and formal project approach implies a level of 'personal safety',
which any manager needs in order to dare to use personal ability and creativity in the
best way. Combined with Rich project communications this would lead to the
adoption of best project management practice and may well result in increased
learning where projects are well executed. The learning aspect in this process is well
documented as a contributor to managerial motivation.
2. Rich project communications was not unexpected in this perspective. Learning and
understanding is in part the result of good communication and the greater the quality
of information sharing the more organisational learning is enabled. Systems being in
place to capture the learning and share it is an essential part of the knowledge
management process (Lundin and Söderholm, 1994).
3. Absent in explaining this outcome are the broader aspects of stakeholder involvement
and influence as well as understanding of the wider strategic purposes. Captured
experience is a factor more centred around project closedown.
Conclusions
This research set out to explore the relative importance in explaining project success of a
range of project critical success factors amenable to action on the part of project
management. Three project success scales were adapted to cover managerial ability to
deliver, project impact and captured experience.
Nine critical success factors were derived from an analysis adopting Principal
Components Analysis. The factors explaining differences in performance were found to
15
vary between the different success factors. Whilst strong project commitment and early
stakeholder involvement in large part explained managerial ability to deliver, rich project
communications supported both product and personal success as well as captured
experience. A well-structured and formal approach also supported captured experience.
So differences were found between the combinations of factors impacting on each
success factor.
From this research managerial ability to deliver appears strongly related to the application
of strong project management based on planning and cost control methodologies, “hard
skills”, whereas project impact as well as captured experience both benefit from rich
project communications, a factor which is less based on project management
methodologies and more dependent upon the application of ‘softer’ skills.
These findings would suggest that as the project approach increases in use as a means for
implementing strategic goals and hence success is measured more on long-term benefits
and impacts, project managers should devote increasing energies into rich
communication both within the project and towards the project environment. This implies
a stronger stakeholder orientation as a means for ensuring project success whether the
stakeholder is internal or external to the organisation.
This was an exploratory study and it would now seem appropriate to undertake
confirmatory studies using a wider sample including project participants from a greater
number of countries and cultures. Further analysis could also be undertaken to test for
differences, between national cultures, project types, size and duration. We encourage
similar studies to be carried out in the Baltic countries.
References
Andersen, E. S. and Jessen, S. A. (2000) "Project Evaluation Scheme", Project
Management, Vol 6 No 1, pp.61-69.
Atkinson, R. (1999) "Project management: cost, time and quality, two best guesses and a
phenomenon, it's time to accept other success criteria", International Journal of
Project Management, Vol 17 No 6, pp.337-42.
Ays, K. (1996) "Professional project management: a shift towards learning and a
knowledge creating structure", International Journal of Project Management, Vol 14
No 3, pp.131-36.
Baccarini, D. (1999) "The logical framework method for defining project success",
Project Management Journal, Vol 30 No 4, pp.25-32.
Belassi, W. and Tukel, O. I. (1996) "A new framework for determining critical
success/failure factors in projects", International Journal of Project Management,
Vol 14 No 3, pp.141-51.
Bonnal, P., Gourc, D., and Lacoste, G. (2002) "The life cycle of technical projects",
Project Management Journal, Vol 33 No 1, pp.12-19.
Cummings, T. G. and Woley, C. G. (2001), Organizational development and change,(7th
ed.), South-Western College Publ., Cincinnati, Ohio.
Drucker, P. F. (1993), Post-capitalist society, Butterworth-Heinemann, Oxford.
16
Field, A. (2000), Discovering statistics using SPSS for Windows, ISM, London.
Fusco, J. C. (1997) "Better policies provide the key to implementing project
management", Project Management Journal, Vol 28 No 3, pp.37-43.
Gareis, R. and Hueman, M. (2000), "Project management competences in the projectoriented organization," in Gower handbook of project management, J. R. Turner
and S. J. Sinister, Eds. Third ed. Gower, Aldershot.
Globerson, S. and Zwikael, O. (2002) "The impact of the project manager on project
management processes", Project Management Journal, Vol 33 No 3, pp.58-64.
Graham, R. J. (1987), Project Management as if People Mattered, Primavera Press, Bala
Cynwyd, Pa.
Hair, J. F. J., Tatham, R. L., Anderson, R., and Black, W. (1998), Multivariate data
analysis,(5th ed.), Prentice Hall, Upper Saddle River, N.J.
Hollis, J. G. (1996), Project Practice: An elaboration of the factors affecting the level of
motivation of project staff, Henley Management College.
Jaafari, A. (2000) "Life-cycle project management: A proposed theoretical model for
development and implementation of capital projects", Project Management Journal,
Vol 31 No 1, pp.44-52.
Keegan, A. and Turner, J. R. (2001) "Quantity versus quality in project-based learning
practices", Management Learning, Vol 32 No 1, pp.77-98.
Kreiner, K. (1995) "In search of relevance: project management in drifting
environments", Scandinavian Journal of Management, Vol 11 No 4, pp.335-46.
Leach, L. P. (1999) "Critical chain project management improves project performance",
Project Management Journal, Vol 30 No 2, pp.39-52.
Lidow, D. (1999) "Duck alignment theory: Going beyond classic project management to
maximize project success", Project Management Journal, Vol 30 No 4, pp.8-14.
Lim, C. S. and Mohamed, M. Z. (1999) "Criteria of project success: an exploratory reexamination", International Journal of Project Management, Vol 17 No 4, pp.24348.
Lundin, R. A. and Midler, C. Eds. (1998), Projects as arenas for renewal and learning
processes. Kluwer Academic, Boston.
Lundin, R. A. and Söderholm, A. (1994), "Conceptualization and learning - The black
environment of PM," in 25th Project Management Institute 1994 Annual Seminars
and Symposium. Vancouver, Canada.
Might, R. J. and Fisher, W. A. (1985) "The role of structural factors in determining
project management success", IEEE Transactions on Engineering Management, Vol
32 No 2, pp.71-77.
Morris, P. W. G. and Hough, G. H. (1987), The anatomy of major projects: a study of the
reality of project management, Wiley, Chicester.
Munns, A. K. and Bjeirmi, B. F. (1996) "The role of project management in achieving
success", International Journal of Project Management, Vol 14 No 2, pp.81-87.
Palmer, J. (1991) "Scientists and Information: II. Personal factors in information
behaviour", Journal of Documentation, Vol 3 No, pp.254-75.
Pellegrinelli, S. (2002) "Shaping context: the role and challenge for programmes",
International Journal of Project Management, Vol 20 No 3, pp.229-33.
17
Pinto, J. K. and Slevin, D. P. (1987) "Critical factors in successful project
implementation", IEEE Transactions on Engineering Management, Vol 34 No 1,
pp.22-27.
---- (1988) "Project success: Definitions and measurement techniques", Project
Management Journal, Vol 19 No 1, pp.67-71.
PMI (2000), A Guide to the Project Management Body of Knowledge,(2000 ed.), Project
Management Institute, Newton Square, Pa.
Rockart, J. F. (1979) "Chief executives define their own data needs", Harvard Business
Review, Vol 57 No 2, pp.81-93.
Ruggles, R. L. Ed. (1997), Knowledge management tools. Butterworth-Heinemann,
Boston.
Saeed, K. (1998), Towards sustainable development : essays on system analysis of
national policy,(2nd ed.), Ashgate, Aldershot.
Slevin, D. P. and Pinto, J. K. (1987) "Balancing strategy and tactics in project
implementation", Sloan Management Review, Vol 29 No 1, pp.33-41.
Sounder, W. E. (1983), "Project evaluation and selection," in Project management
handbook, David I. Cleland and William R. King, Eds. Van Nostrand Reinholt,
New York.
Steers, R. M., Porter, L. W., and Bigley, G. A. (1996), Motivation and leadership at work,
(6th ed.), McGraw-Hill, New York.
Sveiby, K. (1996) "Transfer of knowledge and the information processing professions",
European Management Journal, Vol 14 No 4, pp.379-88.
Szulanski, G. (1996) "Exploring internal stickiness: Impediments to the transfer of best
practice within the firm", Strategic Management Journal, Vol 17 No Winter Special
Issue, pp.27-43.
Turner, J. R. (2002) "Project success criteria", Project, No April, pp.32-33.
Wateridge, J. (1998) "How can IS/IT projects be measured for success?" International
Journal of Project Management, Vol 16 No 1, pp.59-63.
Westerveld, E. (2002), "The Project Excellence Model: A concept linking success criteria
and critical success factors," in IRNOP 5. Rotterdam.
Wideman, R. M. (1988), "The Basic for a Profession? The Project Management Body of
Knowledge," in 9th World Congress on Project Management. Glasgow.
Yukl, G. and Falbe, C. M. (1990) "Influence tactics and objectives in upward, downward
and lateral influence attempts", Journal of Applied Psychology, Vol 75 No 2,
pp.132-40.
18
Table 1: Principal components analysis of project success factors (X - independents)
using Varimax Rotation (only variables with factor loading greater than 0.45 have been
listed)
% Variance
Project participants have an open and efficient
way of informing each other as necessary
In project meetings there is a good and efficient
flow of information
The project has well established information and
communication routines
All key project information is gathered and
distributed efficiently
The project has a clear and well-planned agenda
of meetings for all participants
Project stakeholders are well informed on project
progress as necessary
All the organisations involved in the project effort
have agreed to provide the project with sufficient
resources
The detailed project plans are understood and
accepted by all project team members
All key participants have participated in the
detailed project planning within their area of
expertise
The detailed plan clearly indicates the
responsibilities of each project participant
The project has its own handbook or manual for
control which is used in an appropriate way
The project has a formal organisational chart
covering the entire project
Project control is executed by good managerial or
technical methods
Planning tools or similar aids are used in an
effective way in project planning
Project executors conform to the planned cost
schedule for all activities
Project executors keep within quality parameters
in all activities
All end user needs and desires are discussed with
and agreed by the project's key executors
The project is part of a well documented or
understood strategy
Project activities are carried out exactly as
planned
All key participants have been engaged in
producing the master plan, or have had the
opportunity to influence it.
All participants have been given the opportunity to
air their views on the project's goal or mission.
28.5
5.96
5.21
4.52
4.26
0.76
0.75
0.71
0.65
0.58
0.49
0.74
0.61
0.58
0.53
0.77
0.71
0.68
0.6
0.72
0.65
0.59
0.52
0.46
0.72
0.69
3.98
3.74
3.17
X9 Influence over
on-going project
processes
X8 Project
execution
flexibility
X7 Clear project
constraints
X6 Well
understood and
accepted project
purpose
X5 Early
stakeholder
influence
X4 Strong project
commitment
X3 Well
structured and
formal project
approach
X2 Stakeholder
endorsement of
project plans
X1 Rich project
communications
Project success factors
2.98
19
All key people engaged in the project know who
has decided its terms of references.
If the project fulfils its goals the results will be of
great value to the end users
The project mission or purpose is clearly stated
0.59
The goal and the purpose of the project is
accepted by all those involved in the project effort
The final date of project completion is clearly
defined for this project.
The financial and time limits for the project are
clearly stated
The project is well described and co-ordinated
with other projects and activities
The project goal and its terms can be changed if
conditions make it necessary
Project superiors ( Top Management, Steering
Committee etc) are available to the key executors
as necessary
All participants can influence both decisionmaking and responsibility allocation in the project
All key people in the project can, if they so desire,
participate in and influence all important decisions
Extraction Method: Principal Component Analysis. Rotation Method: Varimax with Kaiser Normalization.
0.75
0.71
0.62
0.69
0.68
0.49
0.76
0.65
0.69
0.6
20
% variance explained
The project participants have learned a lot from this project
Y3 Managerial
ability to
deliver
Y2 Captured
experience
Y1 Project
impact
Table 2: Principal components analysis of project success criteria (Y - dependents) using
Varimax Rotation (only variables with factor loading greater than 0.45 have been listed.
37.47 11.19 10.31
0.81
The project participants will be highly motivated for future projects
0.76
when this project is finished (or they were highly motivated on
completion)
The project is or will be regarded as a success by all participants
0.64
The project's end product is already or will be made use of as
0.6
planned
or assigned
The experience gained through this project will be or has been
0.84
discussed in a special meeting or in a final evaluation report
The project organisation will be or has been dissolved professionally
0.68
on project termination
All relevant documents from this project are or will be compiled in a
0.61
separate end-of-project report or file
The project will finish or has been finished within budget
0.78
The project will finish or has been finished on time
0.77
Extraction Method: Principal Component Analysis. Rotation Method: Varimax with Kaiser
Normalization.
21
Y1 Project
impact
Y2 Captured
experience
Y3 Managerial
ability to deliver
Table 3: Pearson Product Moment Correlations between the predictor and criterion
variables
X1 Rich project communications
0.33**
0.28**
0.16*
X2 Stakeholder endorsement of project plans
0.11
0.05
0.23**
X3 Well structured and formal project approach
0.14*
0.31**
-0.07
X4 Strong project commitment
0.24**
0.03
0.33**
X5 Early stakeholder influence
-0.01
0.14*
0.26**
X6 Well understood and accepted project purpose
0.22**
0.09
0.02
X7 Clear project constraints
0
0.14*
0.18**
X8 Project execution flexibility
0.17**
0.08
0.1
X9 Influence over on-going project processes
0.23**
0
-0.05
22
0.34
0
0.11
2 Stakeholder endorsement of project plans
0.12
0.03
0.01
3 Well structured and formal project approach
0.16
0
0.02
4 Strong project commitment
0.26
0
0.06
5 Early stakeholder influence
6 Well understood and accepted project purpose
0.23
0
0.29
0.08
Sig.
R2 change
Y3 Managerial
ability to deliver
0.29
Standardized Beta
Coefficients
Sig.
R2 change
Y2 Captured
experience
1 Rich project communications
Standardized Beta
Coefficients
R2 change
Sig.
Standardized Beta
Coefficients
Y1 Project impact
Table 4: Relationship between project factors and success based on stepwise linear
regression (only significant relationships are shown)
0.18
0
0.03
0.24
0
0.06
0.32
0
0.09
0.34
0
0.11
0.14
0.01
0.02
0.27
0
0.07
0.17
0
0.03
0.2
0
0.04
0.11
0.04
0.01
0.05
7 Clear project constraints
8 Project execution flexibility
0.17
0
0.03
9 Influence over on-going project processes
0.23
0
0.05
Download