Analytics: Optimizing the Data Center
Continuously operate at the intersection of Business Performance and IT Efficiency
John Miecielica
Director Product Management
TeamQuest
Copyright © 2014 TeamQuest Corporation. All rights Reserved.
Presentation Agenda
• Analytics and Optimization challenges
• Desired state and results
• Approach:
Automated & Predictive IT Analytics
Copyright © 2014 TeamQuest Corporation. All rights Reserved.
Pop quiz:
What is the business
more worried about?
Adjusting to what we
know is changing in our
market
© 2013 Forrester Research, Inc. Reproduction Prohibited
Adjusting to what we
don’t know
3
True business
visibility
is limited
What they know:
• Sales growth
• Seasonality
• Customer feedback
© 2013 Forrester Research, Inc. Reproduction Prohibited
What they don’t:
• How well services are
performing
• Why customer
experiences are poor
• What IT knows
4
Business decisions today are based on a pea
0,52cm3
Copyright © 2013 TeamQuest Corporation. All rights Reserved.
When this is available to make better
business decisions
1x1012 km3
Copyright © 2013 TeamQuest Corporation. All rights Reserved.
Intelligence—not data—
will be the difference
between success and
failure.
$600B
1.2 yrs
2.7 Zettabytes
Source: Forrsights Strategy Spotlight: Business Intelligence And Big Data, Q4
2012
Copyright © 2013 TeamQuest Corporation. All rights Reserved.
We don’t leverage
IT data because . . .
• It’s a mess
• Isn’t standardized
• Value isn’t intrinsically measurable
• Systems can’t talk to each other
• Isn’t easily presented & understood
© 2013 Forrester Research, Inc. Reproduction Prohibited
8
The business values analytics…
Improve the use of data analytics to
improve business decision making
Copyright © 2013 TeamQuest Corporation. All rights Reserved.
Healthcare Provider: Unified Analysis & Reporting
Unified data across hundreds of IT systems to
improve hospital process efficiency & patient
care
© 2013 Forrester Research, Inc. Reproduction Prohibited
10
Optimization Challenges
• Traditional metrics & analysis vs. “Sabermetrics”
– Resource Utilization versus Work Efficiency and Cost
– Availability versus Work Accomplished
– Technology Metrics versus Application, Service and Workloads
“Measure and Analyze what Matters!”
• Democratization of Information
– Software Defined Data Centers: Big Data, Cloud, Virtualization,
Dynamism, etc…
– Spanning ALL silos: Technology, Business, Financial, etc…
• Ruthless Drive for Efficiency
– If you don’t do it, you’ll be “done” by others who do!
Copyright © 2014 TeamQuest Corporation. All rights Reserved.
Optimization Challenges
• Inclusion of legacy or non-virtualized hardware
resources?
• Interoperability of multiple vendors’ converged
infrastructure systems?
• Management remains a mystery
– Lack of real time data
– Lack of global optimization strategies
Copyright © 2014 TeamQuest Corporation. All rights Reserved.
Cloud, Virtualization and SDDC ->
Changing Demands on Enterprise IT
Business Services/Applications
SDDC
Copyright © 2013 TeamQuest Corporation. All rights Reserved.
•
•
•
•
•
•
•
Asset Management
Smart Devices
Virtualized Storage
Virtualized Servers
Virtualized NW
VDI
Etc….
Customer
•
•
•
•
•
•
•
Call Center Operations
POS Optimization
Demand Response
Campaign Management
Credit & Collections
Billing
Etc….
Increasing Planning and
Optimization Challenges
Business Services/Applications
SDDC
Copyright © 2013 TeamQuest Corporation. All rights Reserved.
•
•
•
•
•
•
•
Asset Management
Smart Devices
Virtualized Storage
Virtualized Servers
Virtualized NW
VDI
Etc….
Customer
•
•
•
•
•
•
•
Call Center Operations
POS Optimization
Demand Response
Campaign Management
Credit & Collections
Billing
Etc….
Management is WAY more
than monitoring
• SDDC management will place a premium on new
management models
– Real time data collections
– Embedded Analytics
– Ability to span multiple data source domains intelligently
• Analytics will have different goals – efficiency, cost, root
cause analysis
• Goals include workload-centric optimization, global cost
and energy efficiency, global availability … very tough
challenges for traditional management vendors
• Source: Forrester Research, September 2013
Copyright © 2014 TeamQuest Corporation. All rights Reserved.
IT doesn’t analyze business data
because…
• Existing tools don’t accept it
– ETL into acceptable format(s) is a lot of work, cost
– Manual efforts cannot scale
– Don’t adapt to dynamic, virtual everything realities
• IT has no expertise in business data
– It isn’t easily presented or understood
– We’ve never had the time to deal with it
• What can we really DO with it?
– Where do we start?
– What is the value?
Copyright © 2014 TeamQuest Corporation. All rights Reserved.
Negative consequences
of the current state
• Lack of understanding of relationship of dynamic
technology to services
– Over and under provisioning – High Costs
– Service risks
– Market risks
• Too many disparate tools and processes
– Expensive and in silos
– Error prone impacting service delivery
• Vendor dependence and “lock in”
– High costs
– Reduced agility
Copyright © 2014 TeamQuest Corporation. All rights Reserved.
Desired state:
Continuous Optimization
• Continuously financially optimized IT environment
– Always know where and when performance problems will affect the
bottom line
– Identify cost and performance inefficiencies in support of business
processes and eliminate them
• Continuously optimized customer experience
– Understand when, where and why customer experiences fail
– Resolve, predict and prevent customer dissatisfaction issues
Copyright © 2014 TeamQuest Corporation. All rights Reserved.
Desired State:
Answer the Questions!
“What is the health
of the
infrastructure?”
“What’s the risk
assessment?”
“How efficiently
are we using the
infrastructure?
What does it
cost?”
“How many of
those do we have?
Need? When?”
“What were the
exceptions? Do we
Care?”
“What’s the
capacity forecast?
What should/will it
cost?”
“Changes
compared to the
last reporting
period?”
Result:
Continuous IT Optimization
• Significantly Reduce initial CapEx, and ongoing OpEx
– Make, and keep making, more money!
• Optimize resources for systems of customer engagement
• Deploy and refresh new applications faster
– E.g Retailers need to capture their share of mobile commerce as it
grows from $6 to $31b (2016)
• Respond faster to business spikes
• Prevent business impacting outages and slowdowns
Copyright © 2014 TeamQuest Corporation. All rights Reserved.
Method: Continuously Automated &
Aligned Analytics
• Merge Business &IT Processes and Tools to Achieve
Alignment
– IT Technology data into Business Analytics
– Business data into IT Analytics
• Ruthless Drive for Efficiency
– Use Analytics
– Use Automation
– Adopt ever-increasing proactivity
• Continuous Optimization =
– Alignment + Analytics + Proactivity
Copyright © 2014 TeamQuest Corporation. All rights Reserved.
Methodology:
Aligned Business and IT Analytics
Big Data Collection
Underlying IT
Infrastructure
Outage
Management
Customer
Operations
Distribution
Automation
Asset
Management
Enterprise IT
Optimization
• Correlate business
& IT performance
• Insight into how
business process
changes impact IT
Services
Applicatio
ns
• Understand and
optimize IT costs
by business
unit/process and
technology
Server/OS
• Insight into
business
performance
across technology
stack
Network
Storage
Business Intelligence
Aligned Business and IT Intelligence
Copyright © 2014 TeamQuest Corporation. All rights Reserved.
22
Federated IT Analytics
• Federates existing data into purpose-designed optimization
process
–
–
–
–
Technology data (e.g. server, network, storage, etc.)
Service data (catalog, metrics, tickets, etc.)
Financial data
Business data (Analytics, KPIs, plans, TXNs, etc.)
• Automates analytics across all data sources
– Flexible and adaptive to dynamic SDDC environments
– Raw (commodity) data -> actionable information for IT
• Single-pane-of-glass IT Optimization
Copyright © 2014 TeamQuest Corporation. All rights Reserved.
Automated, Aligned IT Analytics
• Analyze - optimize decision making
• Integrate - with the business
• Automate – drive efficiency & repeatability
Copyright © 2014 TeamQuest Corporation. All rights Reserved.
Result:
Automated Financial Optimization
• Continuous Optimization
– Pre-purchase validation
– Re-purposing
– Consolidation
• Fully Automated, low cost
• Integrate with Risk and Service Management
• Changed new VMware
Clusters from every 6 weeks to:
– None for 18+ months…
– Consolidated 1000’s of
VM’s (Saving $M)
Copyright © 2014 TeamQuest Corporation. All rights Reserved.
Result:
Automated Financial Optimization
Copyright © 2013 TeamQuest Corporation. All rights Reserved.
Result:
Automated Financial Optimization
Copyright © 2013 TeamQuest Corporation. All rights Reserved.
Result:
IT Power Capacity Optimization
• Proactive Power Optimization
– Actual versus DC Limits
– Power by Application/Service
– Project Savings via optimization efforts
• Data Sources
– Server/Virtual Server performance
– Power Consumption from DCIM
power management
– Service Catalog and CMDB
– Asset Database
Copyright © 2014 TeamQuest Corporation. All rights Reserved.
An Optimized Data Center…
• Uses modern, appropriate metrics
– Utilizations don’t cut it anymore
– Sabermetrics for IT!
• Democratizes ALL your information
– Leverage both Federation and Centralization
– Fully-aligned Business, Service and IT Performance
• Ruthlessly (and continuously) drives for efficiency
– Performance/throughput (business)
– Capacity
– Cost
Copyright © 2014 TeamQuest Corporation. All rights Reserved.
29
Summary and Recommended Steps
• Inventory IT processes and ALL your tools
– Data collection?
– Data storage?
– Capacity Analysis/Reporting?
• Inventory your business KPIs, factor your BI analytic
initiatives
• Identify “low hanging fruit”
–
–
–
–
By Service?
By BU?
By Platform?
By Technology/silo?
• Get started bringing it together, don’t wait
Copyright © 2014 TeamQuest Corporation. All rights Reserved.
30
TeamQuest:
Insight Automated. Optimization Achieved
“I know what my
risks to
performance are
and will be!”
“I know how
efficient my IT
environment is
and can be and
what it will cost”
“I know what we
have, what we
need, and when we
need it!”
“I know the
performance and
costs of my
infrastructure!”
“I understand the
exceptions and their
importance!”
“I have a Capacity
and Financial
Plan!”
“I know what has
changed and why
from the last
period!”