The Importance of Telecommunication for an
Integrated Energy Network
Rick Geiger
Executive Director, Energy, Cisco Systems Inc.
2016 Summer Seminar
August 2, 2016
Distributed Energy Resources
2
© 2016 Electric Power Research Institute, Inc. All rights reserved.
Functional Domains
Situational
Awareness
Market
Interaction
3
Active
Control
© 2016 Electric Power Research Institute, Inc. All rights reserved.
4
© 2016 Electric Power Research Institute, Inc. All rights reserved.
Electric Grid Transition
Application Specific Comms
Individually Procured and Deployed
Separately Managed and Secured
Many EOL/EOS
Shared Infrastructure
Unified Security and Management
Critical Traffic Separation
CENTRALIZED Analytics, Control,
and Protection Applications
5
NERC-CIP
Application No. 1
Application No. 2
Application No. 3
Network No. 1
Network No. 2
Network No. 3
Device No. 1
Device No. 2
Device No. 3
DISTRIBUTED Analytics, Control,
and Protection Applications
Application No. 1
Application No. 2
Application No. 3
Converged IP Based Network
Device No. 1
Device No. 2
Device No. 3
© 2016 Electric Power Research Institute, Inc. All rights reserved.
Smart Cities
Mobile Apps
Applications and Urban Services
Sensors
6
© 2016 Electric Power Research Institute, Inc. All rights reserved.
GridBlocks™
Reference Model
• A forward looking view
• Bulk Electricity System
• Wide Area to the Edge
7
© 2016 Electric Power Research Institute, Inc. All rights reserved.
9
© 2016 Electric Power Research Institute, Inc. All rights reserved.
Appendix
10
© 2016 Electric Power Research Institute, Inc. All rights reserved.
Electric Utility Operators Dealing with TDM Discontinuance
Example Utility Operations Issues - Journey Map
Business Transformation (BTX)
Business Alignment
STAGES
Discovery
Receive
“Discontinuance
Letters”
from Telecom
Service Providers
Telecom Operations
How Big is the Issue?
# of circuits
# of substations
O&M Budget
Impact:
Expect 100-400%
OPEX increase for
substitution circuits
Impact on Grid
Operations:
• SCADA
• Tele-Protection
• Fault Recording
• Land Mobile Radio
?
Action Required!
These functions are
affected and likely in
jeopardy!
Impact Awareness
Have active discussions with
Contracts and Grid Operations
personnel to fully comprehend the
risks, financial and operational
implications of losing TDM service
to substations & other key
locations
Solution Enablement
Strategy &
Analysis
Inform
Change Is Required!
No ‘like-for-like’ replacement
Debrief &
Executive
Summary
Public
Privat
VS e
Single
Service
MultiService
Design
Implement
Design Artifacts
• Application Architectures
• SP Interconnection
• WAN Transport
• Substation LAN Design
• Security & L4-7 Services
• Network Management Solution
• Validation & Acceptance Testing
Public
• On-site
Preparation
Provisioning
Boundaries
• Regulatory Compliance
• Public vs Private Solution
Selection Governance
• Multi-Service Segregation
Policy
• Transition Pace Alignment
Business transformation
opportunity
Business Outcomes
• Recognize scope, scale,
timeframes and other critical
success factors associated
with TDM discontinuance
• Effectively manage impact to
critical business operations
• Understand ramifications to
cost recovery and regulatory
obligations
• Lay out next steps toward
problem remediation
Site Work
Private
Business Outcomes
• Determine best course(s) of
action among multiple
options
• Create guidance for
deployment option variations
• Establish program framework
• Establish formal Action Plan
• Obtain project funding
• Communicate rationale to
affected parties
Implement
Integration
Cisco GridBlocksSM
Framework
Business Outcomes
• Holistic and strategic solution
development
• Fully vetted customer
requirements that have
driven solution development
• Optimal system performance
• Reduce operational risks
• Incorporate holistic security
Manage / Operate
Implementation • Off-site
ROI Analysis
Rationalization
• Clarify TDM service
restrictions and negative
financial impacts leading up
to discontinuance
• Seek input regarding
potential business process
changes
• Identify possible courses of
action
• Clarify time to react including
plan, approve, implement,
and outage windows
Continuous Improvement
Migrate
• GPR Study &
Remediation
• Power Rqmts.
• Circuit Order &
Install
• Equipment
acquisition
logistics
Equipment :
• Assembly
• Configuration
• Testing
• Installation
• Turn-up
• Integrate NMS
• Schedule
Outage
• Migrate Svcs
• App Testing
• Verification
Business Outcomes
• Minimal risk and impact to
Electric Service Delivery
• Alignment and coordination
between Grid Ops and
Telecom Ops
• Minimize staff impact by offloading non-critical work
Network & Service Level
Dashboards
Regulatory, Governance
& Risk Compliance
Security Orchestration
ITIL Processes
Measure / Optimize
 Develop / Capture
Service Level Metrics
 Capacity Optimization
 NetworkGrid-Ops
Correlation Analytics
Exceed Expectations
Granular cost allocations
for per service chargebacks
End-State Solution
Utility
Private WAN
Maximized infrastructure
investments
Multi-Service agile WAN
High performance
Policy-based security
Regulatory & NERC CIP
compliance
Service Provider
Public WAN
 Off-Net reach
 Diverse/Backup network
 Temporary service
enablement
 Inter-Utility comms
 Out-tasked services
Business Outcomes
• Optimize per service CAPEX and OPEX through
infrastructure and services virtualization
• Improve system reliability and security
• Enable new services – Condition Based Maintenance,
Renewables integration, Wide Area Management
• Enhance grid operations and Asset Management
• Simplify telecom operations thru automation
• Audit ready compliance
v1.2
Exploring the Options – “Where we’re coming from”
• Dominant TDM solution
• Each application gets its own circuit
• Each circuit delivers a single service
• No flexibility to make changes
• Changes are measured in months/years
• Concept of ‘performance’ is rarely
an issue
• ‘Service management’ is
non-existent
12
© 2016 Electric Power Research Institute, Inc. All rights reserved.
Exploring the Options – Small Substation
• Virtually all end-points remain TDM
20% TDM
80% Packet
• Virtually all transport is packet-based
• Channel banks out – Multi-Service Routers in
• Transport infrastructure becomes multi-service
• Smallest transport connection necessitates multi-service
approach
• Services are virtualized and changes can be made in minutes
• Service Management and performance become important
engineering consideration
13
© 2016 Electric Power Research Institute, Inc. All rights reserved.
Exploring the Options – Small Substation
Past
14
© 2016 Electric Power Research Institute, Inc. All rights reserved.
Exploring the Options – Small Substation
Future
15
© 2016 Electric Power Research Institute, Inc. All rights reserved.
Exploring the Options – Large Substation
• Legacy devices are ‘capped’ and remain... growth
devices are packet-based
• Channel bank remains or evolves to gateway…
packet equipment is high-performance
• Redundant transport becomes used for reliability
benefitting all users
• Availability of alternate routes extend beyond legacy
TDM, however care must be taken to use them wisely
• Timing and time distribution are key
• Importance of managing ‘service flows’ becomes
increasingly obvious
16
20% TDM
80% Packet
© 2016 Electric Power Research Institute, Inc. All rights reserved.
Exploring the Options – Large Substation
Past
17
© 2016 Electric Power Research Institute, Inc. All rights reserved.
Exploring the Options – Large Substation
Future
18
© 2016 Electric Power Research Institute, Inc. All rights reserved.
Field Area Network
19
© 2016 Electric Power Research Institute, Inc. All rights reserved.