Proposed Digest of Journal Articles for Public SES

advertisement
Capability Maturity Models
10
Nov
2015
APS Human Capital Matters: Capability Maturity Models
December, 2015, Issue 11
Editor’s Note to Readers
Welcome to the penultimate edition of Human Capital Matters (HCM) for 2015—the digest for
leaders and practitioners with an interest in human capital and organisational capability. Human
Capital Matters seeks to provide Australian Public Service leaders and practitioners with easy access
to the issues of contemporary importance in public and private sector human capital and
organisational capability. It has been designed to provide interested readers with a monthly guide to
the national and international ideas that are shaping human capital thinking and practice. The
inclusion of articles is aimed at stimulating creative and innovative thinking and does not in any way
imply that the Australian Public Service Commission endorses service providers or policies.
Thank you to those who took the time to provide feedback on earlier editions of Human Capital
Matters. Comments, suggestions or questions regarding this publication are always welcome and
should be addressed to: humancapitalmatters@apsc.gov.au. Readers can also subscribe to the
mailing list through this email address.
This edition reviews available material on Capability Maturity Models (CMM). The review started
from the premise posited by Schmidtchen and Cotton in their paper to the Australian and New
Zealand Academy of Management (ANZAM) in 2014:
Business process management is central to organisational capability and organisations
need to build, maintain, and continuously improve their organisational capability.
Central to this is the ability to accurately assess organisational capability. A common
mechanism for this is through the use of a maturity model
CMM were originally developed as tools for objective assessment of software implementation. It is
derived from work described by Watts Humphrey in 1989, based on his career with IBM.
Though developed for the field of software development, CMM can also be used to aid other
business processes. The term ‘maturity’ refers to the degree of formality and optimisation of
processes—from ad hoc through formally defined steps and metrics, to active optimisation of
processes.
A maturity model can be thought of as a set of structured levels that describe how likely the
behaviours, practices and processes of an organisation can reliably and sustainably produce required
outcomes. CMM can be used as a benchmark for comparison purposes.
List of articles:
The first article is the seminal paper by Paulk, Curtis, Chrissis and Weber from 1993 which draws on
the original work by Humphrey. The authors believe that the ‘simple’ maturity questionnaire
originally developed by Humphrey was intended to help organisations identify how their (software)
processes might be improved and that a structured review of processes, beyond just the
questionnaire, also offered an opportunity to explore process maturity
2
The second article is the paper presented by Schmidtchen and Cotton in 2014. The paper describes
the application of a business process maturity model in the Australian Public Service (APS) and
outlines its use for comparative purposes. It provides comment on the applications and limitations of
maturity models.
The third article by Rölinger, Pöppelbuß and Becker discusses the limitations of CMM. These
limitations are discussed by Schmidtchen and Cotton to explore a CMM for the APS.
The fourth article by McCormack and others investigates turning points in the maturation process.
The paper provides quantitative evidence of the critical maturity components associated with each
level of maturity.
The fifth article is the Administrative and Support Services Benchmarking Report for 2012/13 from
the New Zealand Treasury. This paper is included to demonstrate the internal benchmarking
properties afforded by comparisons over time according to a structured framework such as a
capability maturity model.
3
Paulk, M. C., Curtis B., Chrissis, M.B. & Weber, C.V. Capability Maturity Model for
Software, Version 1.1 Software Engineering Institute, Pennsylvania, USA, 1993
The book by Paulk et al is about software development processes and provides the original thinking
behind the development of capability maturity models for other business processes. In the five
chapters of the book the authors define and describe: the concepts necessary to understand the CMM
and the motivation and purpose of the CMM; the five levels of the model and the principles that
underlie them; how the model is structured into key process areas, organised by common features
and key practices; a high-level overview of how the model provides guidance for software process
assessments, capability evaluations and process improvements; and finally, the book concludes with
possible future directions for the CMM and related products.
This technical report was produced for the SEI Joint Program Office, ESC/AVS Hanscomb AFB, MA
and was funded by the U.S. Department of Defense
Return to list of articles
Schmidtchen, D. & Cotton, T. Comparative application of a business process maturity model
in the public sector. Paper presented to the 28th Australian and New Zealand Academy of
Management in 2014
According to Schmidtchen and Cotton, organisational capability in the APS has been defined as the
combination of people, processes, systems, structures and culture that contribute to continuously
improving performance in APS departments and agencies. The paper focuses on the use of a
maturity model as a comparative tool within the APS.
Two methods of assessing capability have been used in the APS since 2010. The interdependent
methods are firstly, the capability review model which focuses on leadership, strategic and delivery
capabilities. The second and complementary method is the CMM in which APS agencies use a
standard maturity model to assess a range of organisational capabilities such as stakeholder
engagement, strategic planning, risk management, change management, workforce planning and
performance management.
The first method requires a team of independent assessors on-site for an extended period. The second
requires an agency to make two self-assessments: the agency’s current maturity status against
specified capabilities and secondly, its required (or perhaps aspirational) status in regard to the same
target capabilities. The assessments are provided by way of a survey delivered as part of the State of
the Service annual census of APS agencies.
In the second method, the CMM method, the targeted APS agencies rate their current and required
capabilities in a maturity model structure of five levels from ad hoc (immature) to optimised
(mature). The levels are hierarchical. Progression from immature to mature is seen as an
evolutionary progression through: awareness (immature); general acceptance (defined by tools and
databases); managed (with a more centralised, strategic approach); to finally, regular integration of
lessons learned and feedback loops resulting in measurable benefits (mature).
The authors define APS agencies by five functional types: policy, large operational, small
operational, regulatory and specialist. Capabilities for functional groups can be compared within and
against other functional types though the critical measurements are the gaps between current and
4
required capabilities for individual agencies. In this way agencies are able to see increases in current
and required capabilities over time and, a reduction in the capability gap over time. As stated in the
discussion:
By comparing current capability over time, an assessment of whether agency capability
has actually ‘matured’; that is, has increased, can be made; this allows agencies to
evaluate the progress of earlier capability investments. By comparing their required level
of capability maturity over time, agencies are able to identify how their changing
business context has influenced their capability requirements; it assists agencies make a
critical assessment of their likely future business and what this means for investment
decisions in their business processes
More importantly, by examining the gap between current and future requirements,
agencies can determine where they might most profitably invest their resources to
improve capability across their business processes. This assumes a different view of
‘maturity’ in that business process maturity is not affected by simple constant
improvement, but rather by accurately assessing business needs and matching business
process maturity to actual business need. This then allows agencies to evaluate how
effective their efforts have been at improving their business processes where the need is
greatest. When looked at across an industry, in this case the APS, it assists in identifying
systemic areas of weakness to which resources can be allocated with greatest effect – in
the APS one area where this can be seen is in the workforce planning capability
While the authors note the limitations of CMM (which will be discussed in the next abstract) they
conclude that the CMM offers insights into organisational capability, especially when capability is
tracked over time.
At the time of this paper both authors were employed by the Australian Public Service Commission,
Commonwealth of Australia Canberra, Australia. Dr David Schmidtchen is the corresponding
author
Return to list of articles
Rölinger M, Pöppelbuß J, & Becker J (2012) Maturity models in business process
management, Business Process Management Journal, 18(2): 328–46.
Rölinger, Pöppelbuß and Becker reviewed the research community’s criticism of maturity models on
the basis that ‘scholars struggle with the conceptual enhancement of maturity models’. They note
that the ‘basic purpose of maturity models is to outline the stages of maturation paths’ which can be
applied for descriptive, prescriptive and comparative purposes. It is descriptive when describing an
‘as-is’ or current status/assessment. It is prescriptive ‘if it indicates how to identify desirable future
maturity levels and provides guidance on how to implement improvement measures’. It serves a
comparative purpose if it allows for internal and external benchmarking.
Criticisms (summarised by Schmidtchen and Cotton) include technical issues such as a lack of
validation in the development of the models (Wendler, 2012), limited guidance to improve
performance (Becker et al., 2009; Iversen et al., 1999), and step-by-step process ‘recipes’ that lack a
5
robust empirical foundation (Benbasat et al., 1984; King and Kraemer, 1984; de Bruin et al., 2005;
McCormack et al., 2009).
Maturity models are seen to offer a highly prescriptive improvement path that neglects alternative
approaches (Teo and King, 1997). They provide only a narrow definition of business process factors
that ignore internal or external forces that might influence process improvement (Mettler and
Rohner, 2009). Others have suggested that they focus on a predefined ‘end state’ instead of the
factors that actually influence evolution and change through to the application (King and Kraemer,
1984).
There has also been consistent concern over the non-reflective application of maturity models as a
substitute for engagement with the issues associated with business process improvement (Becker et
al., 2009, 2010; Iversen et al., 1999). Rölinger, Pöppelbuß and Becker analysed a sample of business
process management maturity models and found that while they adequately addressed the basic
development and descriptive design principles, the criteria for prescriptive use were rarely met.
Consequently, the models provided limited guidance for implementing improvement measures.
This article has additional value for those readers who wish to consider the differences between
business process management models (BPM) and process maturity models—a distinction that lacks
clarity, even in the academic literature. Rölinger, Pöppelbuß and Becker argue that more clarity is
needed concerning the concepts or entities that are the subject of the assessment models.
Dr Maximilian Rölinger (corresponding author) FIM Research Center Finance and Information
Management, University of Augsburg, Germany. Jens Pöppelbuß, European Research Center for
Information Systems, University of Münster, Germany. Professor Dr Jörg Becker, European Center
for Information Systems, University of Münster, Germany
Return to list of articles
McCormack K, Willems J, van den Bergh J, Deschoolmeester D, Willaert P, Indihar
Štemberger M,Škrinjar R, Trkman P, Ladeira M B, Valadares de Oliveira M P, Vuksic V B &
Vlahovic N,(2009) A global investigation of key turning points in business process maturity,
Business Process Management Journal, 15(5): 792–815.
This research focuses on improving the quality of maturity models for managers. Specifically, the
authors invite teams and leaders to use suggested guide-posts, milestones and measures to help
address their current level of capability maturity and how they might proceed to the next level. Key
turning points are conceptualised by the authors as components of business process management
(BPM) that become stable and lead to the next maturity level.
McCormack et al provide definitions for four stages of organisational maturity similar to those
already posited: ad hoc, defined, linked and integrated. Linked is seen as the ‘breakthrough’ level of
maturity in which managers employ process management with strategic intent and a view to results.
The basic components of the model are:

Process view in which steps, activities and tasks are documented in formats that allow people
across the organisation to communicate using the same vocabulary. There is broad
understanding of the processes across the organisation
6


Process jobs which require horizontal rather than vertical responsibility for which people
participate and take ownership
Process measurement and management systems which include measurement systems,
rewards for process improvement, outcome measurements, customer-driven and team-driven
measures and rewards
These are supported by process structure components which are designed to break down
functional compartments and which include horizontal teams and shared ownership. They are
also supported by customer-focused process values, and beliefs which ‘energise’ the
organisation.
The key turning points for transition to higher levels are, in order of transition from lower to
higher levels of maturity:








The customer needs and preferences are known
Teamwork and multi-skilling are endorsed
Process measurement and management are defined
Process metrics are used consistently
Job roles have been expanded to allow insight about links to outcomes
Process measures and management are accompanied by training and learning
Integration and the underlying ‘process-oriented culture’ are evident through everyday
use of common process language (e.g., input, output, process)
Finally, at the highest levels, process analytics and automated processes are important
Kevin McCormack, DRK Research, Raleigh, North Carolina, USA. Willems, van den Bergh,
Deschoolmeester and Willaert, Vlerick Leuven Ghent Management School, Ghent, Belgium.
Stemberger, Skrinjar and Trkman, Faculty of Economics, University of Ljubljana, Slovenia.
Ladeira and de Oliveira, Departmento de Ciencias Administrativas, CEPEAD, Universidade
Federal de Minas Gerais, Belo Horizonte, Brazil. Vuksic and Vlahovic, Faculty of Economics and
Business, University of Agreb, Zagreb, Croatia
Return to list of articles
The Treasury New Zealand, Administrative & Support Services Benchmarking Report for the
Financial Year 2012/13
This is the fourth annual Benchmarking of Administrative & Support Services (BASS)
Benchmarking Report provided by the New Zealand Treasury. A BASS report for 2015 exists
though the 2014 report goes into more detail about the use of a capability maturity models.
Capability maturity models are provided for each of: Human Resources; Finance; Procurement;
Communications; and, Legal. Each is described according to progressive maturity levels: lagging,
achieving, exceeding and leading.
In this report and similar reports for the three previous annual reports, capability maturity is only one
metric used. Metric descriptions for each function were originally based on the UK Audit Agencies
but have been refined so that they are now based on a range of international benchmarking best
practices. These include The Hackett Group, APQC and the Australian NSW ICT Benchmarking.
7
Each function is assessed against a range of metrics which include current and future aspiration
capability maturity. For example, for HR, eight metric definitions include two for HR CMM (current
and aspirational): capability maturity score for ten selected leading HR practices undertaken by the
function are averaged (1-4: lagging achieving, exceeding and leading) across the ten questions. The
same process of selecting 10 leading practices (and associated questions and average of four-point
score) within the function is applied to all functions, except ICT.
Using HR again as an example, the descriptions of the 10 leading practices assessed by way of CMM
(on the four-point scale) are:
Ref
Category
Capability element description
1
capability
developing people skills of managers
2
operations
strategic workforce planning (SWP) reporting and
analytics
3
4
5
operations
operations
operations
performance management
rewards strategy
staff engagement
6
resources
staff technology capability and process improvement skills
7
strategy
SWP data and capability
8
strategy
executive leadership in governance
9
strategy
linkage of HR policies and practices to broader
HR/Business goals
10
technology
automation and self-service delivery
To contrast and demonstrate the fit-for-purpose nature of the NZ capability maturity models used in
the public sector, the Procurement CMM is shown below:
Ref
Category
Capability element description
1
Influence
the profile of procurement in the organisation
2
supplier management
outcome focus
supplier relationship management
3
4
5
influence
people
procurement strategy alignment with agency key result
areas
procurement function engage with agency stakeholders
management of people and skills development
6
governance
governance and organisation of the procurement function
7
suppliers
sourcing and collaboration
8
technology
use of technology processes and tools
8
9
people
knowledge and performance management
10
governance
alignment with policy and processes
9
Download