Explore Algorithmic Business to Drive Differentiation.

G00300742
Explore Algorithmic Business to Drive
Differentiation
Published: 9 March 2016
Analyst(s): Stephen Prentice
Business and IT leaders need to step up to the growing business
opportunities enabled by algorithms. While algorithms are not new, they are
moving front and center in the race for competitive differentiation as leading
organizations uncover their true value.
Analysis
Gartner highlighted algorithmic business in the fall 2015 Symposium/ITxpo as a logical step in the
progression of digital business. Algorithms are not new, but where once they were simply
embedded in the computer systems to get work done, they are now feasting on the wealth of data
becoming available, leveraging the huge computing resources in the cloud and becoming a pivotal
source of competitive differentiation. In this special report, we explore the steady emergence of
algorithms into the limelight, the associated best practices in their usage, the new opportunities
they expose, and the challenges they pose for business and IT leaders.
As a recently introduced term, "algorithmic business" is not universally employed within the
considerable body of research presented here, but the technologies, principles and practices
described are exactly the same, and underline the fact that algorithms, data and analytics have a
long history of use within organizations in all industries. Our exploration of this significant disruptive
trend starts by defining algorithmic business in more detail, scoping its nature and extent and
continues with research across five coverage areas:
1.
Introduction to algorithmic business — looking at the various ways in which algorithms are
being deployed and creating opportunities, both now and in the future
2.
Algorithmic business today — taking a look at how algorithms are permeating business
activities in some key vertical markets
3.
New business opportunities — looking further into the future to suggest new business
opportunities and even new industries, which algorithmic business may enable
4.
The challenges arising from algorithmic business — a review of some of the issues and
challenges that face business and IT leaders as they move down the path toward algorithmic
business
5.
How to deploy algorithms for business — a selection of best practices and more detailed
guidance of the next steps to take in the algorithmic business journey
Defining Algorithmic Business
Algorithms are a mechanism to capture knowledge and insight in a packaged form that can be
simply reused in a consistent fashion. At the simplest level, algorithmic business is about the
delivery of business value from algorithms and data, but this is a very broad description (see Figure
1).
Figure 1. Algorithmic Business
Source: Gartner (March 2016)
Business and IT leaders must focus more precisely on those instances where algorithms are not
only providing the insight, but also have become pivotal to competitive differentiation, and are
recognized for their value contribution. Perhaps the pinnacle would be Google's PageRank, the
algorithm that defines the company, but Amazon, Netflix, global retailers, airlines and financial
services organizations around the world have all realized the value that their algorithms deliver, and
are steadily taking steps to expand their use.
In "Defining Algorithmic Business," we present a more detailed description of what algorithmic
business is, what it delivers and why it is so critically important as organizations move steadily into
an increasingly digital age. It includes Gartner's definition of algorithmic business.
Page 2 of 10
Gartner, Inc. | G00300742
Algorithmic business is the industrialized use of complex mathematical algorithms
pivotal to driving improved business decisions or process automation for competitive
differentiation.
Research Highlights
We have broken this special report into five major segments: introduction, current examples of
usage, new business opportunities, challenges and a "how to" section.
Introduction to Algorithmic Business
In this segment, we provide a variety of background research to help business and IT leaders
understand the development — and ultimate confluence — of several trends that drove the
significant elevation of algorithms from embedded logic into powerful competitive weapons.
Our journey starts with the fall 2015 Gartner Symposium/ITxpo keynote, where Peter Sondergaard
first described the huge opportunities that algorithms enable as organizations seek to take digital
business to the next level. The core elements of this keynote are captured in "Rising to the
Challenge of Digital Business: Key Insights From the 2015 Gartner Symposium/ITxpo Keynote."
For CIOs and CDOs, Alan Duncan's "The 10 Things You Need to Know About Algorithmic Business"
provides a brief summary of the key factors.
The significant developments in and growth of "smart" machines are key factors in the way
algorithms emerged from the shadows and have become more easily accessible to every
organization. This area is the subject of significant research coverage, but we include here a
selection of key pieces to help tell the background story of the rise of algorithms to prominence:
■
In "Smart Machines See Major Breakthroughs After Decades of Failure," Gartner Fellow Tom
Austin charts the slow progress of artificial intelligence (AI) from the early days in the 1950s to
the recent surge in capabilities. He suggests that this developmental path heralds a new 75year era of smart machines.
■
In "Smarter Machines Will Challenge the Human Desire for Control," we outline some of the
issues and introduce some of the underlying models for decision support that helped develop
the structure of algorithmic business.
■
Algorithmic business is seen as a natural evolution in the ongoing development of digital
business, and in "When Smart Things Rule the World — Introducing Autonomous Business," we
extend the existing digital business development roadmap out to 2025 and beyond, where we
anticipate algorithms becoming increasingly capable and operating in an increasingly
independent manner on behalf of people and businesses — and possibly even themselves. To
Gartner, Inc. | G00300742
Page 3 of 10
clarify (since this piece was published before the concept of algorithmic business was
introduced), we view autonomous business as an advanced form of algorithmic business (which
is in itself a highly evolved form of digital business).
Perhaps not surprisingly, the technologies, trends and developments, which enable algorithmic
business, have been highlighted in many of the forward-looking predictions from across Gartner
research in the last few months, especially in the areas of digital business and analytics:
■
At the high level, "Predicts 2016: Algorithms Take Digital Business the Next Level" makes it
clear what a key role algorithms are expected to play in the development of digital business.
■
The transformational impact of algorithms on the evolution of more human- and businesscentric approaches to technology is explored in "Predicts 2016: Algorithms Shift the Focus to
Business- and Human-Centric Emerging Technologies."
Our coverage of algorithmic business (and how we expect it to evolve in the years to come) is only
just starting, and will feature prominently in our most forward-looking agenda, as outlined in
"Planning for What Comes After Digital Business Primer for 2016," as well as much more detailed
coverage in the more targeted agendas covering the analytics space.
Algorithmic Business Today
Algorithmic business as a term may be new, but the practical usage of the underlying principles and
technologies and the disruptive business models it enables are already established in many
industries and organizations. Examples include:
■
Healthcare: See "The Emergence of Precision Algorithms in Healthcare," where Laura Craft
describes the emergence of the open availability of advanced clinical algorithms, and the
abilities that these bring to enable healthcare delivery organizations (HDOs) to monetize their
information assets, and to access algorithms that would otherwise be beyond their reach.
■
Human resources: In "Algorithms Will Transform Talent Acquisition," Helen Poitevin
summarizes the impact of algorithms to evaluate candidates' suitability for specific roles, and
the positive and negative impacts this will have on the activities of HR leaders.
■
Retail: The retail sector has long been at the leading edge of analytics and the use of algorithms
to drive greater engagement and efficiency:
■
In "Predicts 2016: Digital Business Uproots Traditional Retail Revenue Generation," a
number of retail analysts make the point that "algorithms will become the most valuable
assets of the retailer that must be managed, protected and — at times — shared freely to
encourage innovation."
■
Research Director Robert Hetu looks at the use of algorithms in merchandising in
"Algorithmic Retailing: Merchandising Leads the Way."
■
Chris Fletcher describes best practices in "Best Practices in Price Optimization and
Management: Three Ways to Enable Algorithmic Business and Dynamic Pricing."
Page 4 of 10
Gartner, Inc. | G00300742
■
Hetu then summarizes the use of algorithms within applications for price optimization in
"Market Guide for Unified Price, Promotion and Markdown Optimization Applications."
■
Education: In "Analytics, Assessment and Adaptive Learning Will Prepare You for the
Algorithmic Education Revolution," Jan-Martin Lowendahl looks at how higher education CIOs
have a key role in solving the global challenge of a scalable, affordable and quality education by
mastering the "three As" as precursors of true algorithmic education.
■
Asset-intensive: In industries such as oil and gas, energy production, mining, infrastructure,
and so on, automation has already squeezed most of the potential efficiencies out of the
processes, product innovation is limited and these companies increasingly struggle to
differentiate themselves and mitigate operational risks. In "Algorithms Will Drive Success in
Asset-Intensive Industries," we explore how the digital business, and especially the use of
algorithms, is becoming the new battleground for differentiation.
New Business Opportunities
Digital business is already transforming organizations, disrupting industries and creating new
opportunities for organizations prepared to make the transformation. We confidently expect
algorithmic business will create even greater levels of disruption, more new business opportunities
and even new industries in the longer term. In this body of research within the special report, we
look out a little further toward the next decade to explore what may happen as the current trends
become more established.
In "Algorithm Marketplaces Are Bringing the App Economy to Analytics," Alex Linden highlights the
emergence of marketplaces for algorithms, and explains how these currently nascent marketplaces
are expected to transform software development and allow developers to monetize their intellectual
property, and the flexibility and opportunities this will bring for user organizations in the future.
The following research covers the ability of algorithms to disrupt existing business models:
■
In the forward-looking research "Maverick* Research: Multiply Value Creation With
Programmable Business Models," Kristen Moyer and Gary Olliffe suggest organizations will
need to deploy multiple business models that are shared, dynamic, dispersed and opportunistic
(and created with the use of algorithms) to keep pace with the rapid pace of disruption in the
future (see Note 1).
■
We confidently expect that algorithms will impact not only business models but also entire
industries. In "New Industries 2030: Virtual Talent Industry" (part of a collection looking at
potential new industries in 2030), we suggest how advances in technology will create a virtual
talent industry that will enable businesses to recruit smart algorithms, machines, robots and so
on to provide the expertise historically fulfilled by people.
One of the earliest well-publicized (and occasionally problematic) implementations of algorithmic
business was in the financial services sector, where algorithmic trading of stocks, foreign exchange
and commodities became a source of great competitive advantage for some organizations for a
Gartner, Inc. | G00300742
Page 5 of 10
period of time. Not surprisingly, we believe algorithms will continue to play a major role in creating
further disruption in the financial services sector in the longer-term future.
In "The Future of Money Is the Programmable Economy, Not Just Bitcoin," Gartner Fellow David
Furlonger proposes how the "programmable economy" — a highly developed future evolution of
algorithmic business — might develop, and the role that bitcoin (and other metacurrencies) will play
in transforming the digitally enabled business protocols in the future. In "Hype Cycle for the
Programmable Economy, 2015," Furlonger and Ray Valdes chart the progress of a number of critical
contributory technologies, including the key blockchain (an algorithm which is likely to have a
significant impact in the years to come) in the development of the programmable economy.
The Challenges Arising From Algorithmic Business
Amid the enthusiasm and hyperbole of any new technology, trend or development, there is always a
downside, and algorithmic business will be no different. Alongside the many advances and benefits,
there will be the inevitable problems and issues, both anticipated and unexpected. In this collection
of research, we explore the possible problems and advise on how they may be addressed.
We start with Ray Valdes' rather dark and apocalyptic exploration of what could happen, but keep in
mind that this is a piece of Maverick research wherein we take deliberately strong positions that
may be against prevailing modes of thought and action (see Note 1). In "Maverick* Research: Algos
Gone Wild — The Coming Apocalypse When Machine Intelligence Is Both Too Little and Too Much,"
Valdes suggests that the beneficial effects of algorithms on society may be nullified by
algorithmically driven systems antithetical to human interests.
Along a similar (but perhaps less extreme) vein, in "Maverick* Research: Your Smart Machine Has
Been Conned! Now What?" Patrick Hevesi, Anton Chuvakin and Erik Heidt look at the risks of
malicious humans using and abusing algorithms to achieve their goals. The authors focus on
identifying the possible risks, and how forward-looking IT and business leaders can prepare to
mitigate the risks and protect their organizations in the future.
Algorithms act on data, but the notion that data and analytics are unbiased is a fallacy. In
"Algorithms Are Biased — Here's How to Overcome This Inherent Data Problem," a number of
analysts provide their insight and provide a set of best practices in deliberate design and
implementation choices, in order to mitigate the potential effects of this bias.
One of the issues that has emerged with the growth of digital business is the increasing importance
and potential impact of digital ethics. In the digital world, this is no longer a hypothetical or
philosophical discussion but one where very serious problems can arise from often unintended
consequences of algorithms influencing and making decisions:
■
In "Create Smart Machines With Ethics in Their 'Minds,'" Frank Buytendijk and Whit Andrews
provide essential advice on the steps that CIOs and others should be taking today to ensure
that smart machines (and the algorithms that control them) behave ethically and deserve our
trust in the future.
■
In a drill-down into the area of dynamic pricing algorithms, in "Are Your Algorithms Ethical?
Look to Examples of Dynamic Pricing for Guidance," Buytendijk and others draw on real-world
Page 6 of 10
Gartner, Inc. | G00300742
experiences to show how business and IT leaders cannot rely solely on the technical
capabilities of algorithms — but must use judgment and exercise restraint in the deployment of
these technologies.
How to Deploy Algorithms for Business
In this final body of research, we draw on the experience and insight of many analysts to provide a
series of best practices, methodologies and frameworks to help guide business and IT leaders in
implementing the various elements of algorithmic business.
The pivotal role played by analytics in the practical realization of algorithmic business is made clear
in "Predicts 2016: Advanced Analytics Are at the Beating Heart of Algorithmic Business." In this
piece, Alan Duncan and other analysts explain how analytics leaders must now exploit new
business models and ecosystems to drive the operations of algorithmic business.
For those still in early stages:
■
Lisa Kart explains how getting started is as much about changing the mindset and culture as it
is about the technology — see "How to Take a First Step to Advanced Analytics" and "How to
Get Started With Prescriptive Analytics."
■
Building on the previously mentioned challenges of digital ethics and algorithms, Alan Duncan
and Frank Buytendijk advise analytics leaders in "How to Develop Analytics That Foster Trusted
Business Relationships."
■
Algorithmic business will be built on broader use of algorithms to first advise, and eventually
execute, decisions of increasing significance to the organization and other stakeholders. "Find
the Best Approach to Decision Management" reminds us that decisions are different to reports,
data discovery and analytics.
Analytics and decisions are one aspect of algorithmic business, but the insights from the algorithm
need to be put into action and the business outcomes captured, so that algorithms become part of
the cycle of business process experimentation. In "Make Business Operation More Agile With
Intelligent Business Processes That Reshape Themselves as They Run," Michele Cantara explores
how algorithms make it possible to individualize business processes in response to business
moments. Additionally, "Eight Dimensions of Process IQ Determine How Smart Your Process Needs
to Be" introduces IT leaders to the Gartner Process IQ framework, and provides a vocabulary for
identifying the types and degree of intelligence they need form the algorithms powering their
business processes.
Although algorithms will play an increasingly pivotal role in the future algorithmic business, many
algorithms will be hidden, embedded in packaged business applications. "Invisible Advanced
Analytics: Coming to a Business Application Near You" provides useful insight into both the
opportunities and challenges this raises for analytics and application leaders.
Gartner, Inc. | G00300742
Page 7 of 10
One of the major challenges for CIOs and IT leaders will be feeding the inexhaustible appetite of
advanced analytics for computing resources. Information architects and analytics leaders will need
to modernize their infrastructure to cope:
■
"Apply Gartner's Information Capabilities Framework to Achieve Algorithmic Business Success"
provides a core model for how to approach this challenge.
■
As algorithmic business develops still further, the drive for faster performance, greater scalability
and more real-time insight will require innovative architectures. "Predicts 2016: In-Memory
Computing-Enabled Hybrid Transaction/Analytical Processing Supports Dramatic Digital
Business Innovation" describes some of the advanced and emerging technologies that will help.
Like all key areas, governance in analytics will be critical to success. Thomas W. Oestreich and Joao
Tapadinhas provide valuable advice in "Best Practices for Driving Successful Analytics
Governance."
Inevitably security issues will become increasingly critical:
■
In "How to Build Your Own Big Data Security Analytics Capability," Anton Chuvakin provides
useful guidance on how (and why) some leading organizations are utilizing advanced analytics
algorithms and big data to create their own security analytics capabilities.
■
In "Managing Risk and Security at the Speed of Digital Business," Tom Scholtz explains how
digital business challenges the basic principles of information risk and security management,
and how security leaders must understand the risks associated with innovations like algorithmic
business and balance the conflicting demands.
Moving away from the issues to the more positive aspects of analytics:
■
Jamie Popkin explains how analytics and algorithms are playing an increasing role in
understanding the voice of the customer in "Sentiment Analysis Cracks the Code on
Unstructured Voice of the Customer Analytics."
■
"Predicts 2016: Smarter Collaboration via Algorithms and People-Centric Design" explores how
algorithms and advanced analytics will reshape collaboration strategies.
Moving then toward the broad business trends, "CIOs Should Embrace the Aims of Industrie 4.0 as
a Cornerstone of Algorithmic Business" shows how support for broad industry initiatives like
Industrie 4.0 (a German Federal Government sponsored initiative to create smart manufacturing that
is gaining broader support as a framework for connected, smart products and systems) actually
aligns well with the evolution toward algorithmic business and provides a useful "big picture" of
what will be required and the business benefits that will accrue.
Algorithmic Business Will Demand New Talent
We end this body of research by looking at the critical issue of staffing and skills. With the requisite
skills and resources currently in short supply and the challenges in recruiting for the new roles
required for algorithmic business in the next few years, staffing and skills is becoming a growing
major challenge.
Page 8 of 10
Gartner, Inc. | G00300742
■
In "Match Talent Profiles to Algorithmic Business Ambitions," Gartner Fellows Diane Morello and
Hung LeHong provide valuable insight on the emerging skills expected to be essential for
success in algorithmic business and how and where to find them.
■
In "Staffing the Office of the CDO," analysts Mario Fabio and Debra Logan look at the broad
issues facing the chief data officer attempting to accomplish a broad remit with limited
resources.
■
Finally, Gartner Fellow Mark Raskino describes in "Techquisitions: An Uncommon Approach
Some CEOs Use for Digital Business Acceleration" one approach being explored by senior
executives in some industries to close the skills gap faster — acquiring technology companies.
Gartner Recommended Reading
Some documents may not be available as part of your current Gartner subscription.
"Entering the Smart-Machine Age"
"Creating Net-New Industries for the World in 2030"
"The Six Forces That Will Shape Business and Technology in 2030"
"Maverick* Research: The Programmable Economy Is the Ultimate Destination for Digital Business"
Note 1 Gartner Maverick Research
"Maverick" research is designed to spark new, unconventional insights. It is unconstrained by our
typical broad consensus-formation process to deliver breakthrough, innovative and disruptive ideas
from our research incubator.
Gartner, Inc. | G00300742
Page 9 of 10
GARTNER HEADQUARTERS
Corporate Headquarters
56 Top Gallant Road
Stamford, CT 06902-7700
USA
+1 203 964 0096
Regional Headquarters
AUSTRALIA
BRAZIL
JAPAN
UNITED KINGDOM
For a complete list of worldwide locations,
visit http://www.gartner.com/technology/about.jsp
© 2016 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. or its affiliates. This
publication may not be reproduced or distributed in any form without Gartner’s prior written permission. If you are authorized to access
this publication, your use of it is subject to the Usage Guidelines for Gartner Services posted on gartner.com. The information contained
in this publication has been obtained from sources believed to be reliable. Gartner disclaims all warranties as to the accuracy,
completeness or adequacy of such information and shall have no liability for errors, omissions or inadequacies in such information. This
publication consists of the opinions of Gartner’s research organization and should not be construed as statements of fact. The opinions
expressed herein are subject to change without notice. Although Gartner research may include a discussion of related legal issues,
Gartner does not provide legal advice or services and its research should not be construed or used as such. Gartner is a public company,
and its shareholders may include firms and funds that have financial interests in entities covered in Gartner research. Gartner’s Board of
Directors may include senior managers of these firms or funds. Gartner research is produced independently by its research organization
without input or influence from these firms, funds or their managers. For further information on the independence and integrity of Gartner
research, see “Guiding Principles on Independence and Objectivity.”
Page 10 of 10
Gartner, Inc. | G00300742