ITU Kaleidoscope 2013
Building Sustainable Communities
Design and implementation of
virtualized ICT resource management
system for carrier network services
toward cloud computing era
Yoshihiro Nakajima, Hitoshi Masutani, Wenyu Shen,
Hiroyuki Tanaka, Osamu Kamatani, Katsuhiro Shimano,
Masaki Fukui, and Ryutaro Kawamura
NTT Network Innovation Laboratories
Kyoto, Japan
22-24 April 2013
nakajima.yoshihiro@lab.ntt.co.jp
Contents
1.
2.
3.
4.
5.
6.
Background & Motivation
Contribution
Requirements for virtualized ICT
resource management
Carrier network service architecture
design
Implementation for mobile network
service
Conclusion
Kyoto, Japan, 22-24 April 2013
ITU Kaleidoscope 2013 – Building Sustainable Communities
Background and motivation

High flexibility in provisioning, control, and
management is indispensable to satisfy new type
demands of customers in cloud computing era


Network carriers face to reduce OPEX/CAPEX while
ensuring variety, reliability, availability, and
management flexibility with shared ICT resource


e.g. Speed to market, service elasticity for traffic
demands, cooperation of NW and IT resources
Disaster-tolerant network services
Advanced technology in ICT resource virtualization


Virtualization middleware, cloud computing in IT
Software-defined networking/OpenFlow in NW
Kyoto, Japan, 22-24 April 2013
ITU Kaleidoscope 2013 – Building Sustainable Communities
Approach

Management Engine:
Redesigned software component-based
management system + Virtualized NW/IT
resources for carrier network service
Virtualized ICT resource information modeling
for cooperation of NW and IT resources
 Decoupling the functionality from the entity of
the physical ICT resources
 Software defined networking
 Matured IT virtualization technologies

Kyoto, Japan, 22-24 April 2013
ITU Kaleidoscope 2013 – Building Sustainable Communities
Contributions




A virtualized ICT resource information model is
designed to take advantage of ICT virtualization
technology in carrier network service
Designing a modular/layered management
system architecture for virtualized ICT resource
Flexible service cooperation to ensure dynamic
resource accommodation between services with
virtual ICT resources is demonstrated
Future standardization and improvement issues
in the virtual ICT resource management field are
summarized
Kyoto, Japan, 22-24 April 2013
ITU Kaleidoscope 2013 – Building Sustainable Communities
Existing network service architecture:
NGN and Internet
Application service functions and network
functions are separately managed
 Cooperation functions between application
service and ICT resource are limited


Poor support for global optimization
NGN
Internet
ASF
AS
SCF
TCF
UE
TF
UE
TF
Other
NGN
UE: User Equipment
ASF: Application Support Functions
SCF: Service Control Functions
TCF: Transport Control Functions
TF: Transport Functions
Kyoto, Japan, 22-24 April 2013
ITU Kaleidoscope 2013 – Building Sustainable Communities
TF
TF
Other
Internet
UE: User Equipment
AS: Application Servers
TF: Transport Functions
Approach portfolio of
virtualized resource management
Resource
Resource Area
Type
Network Resource
(e.g. Carrier Network)
Physical
resource
Conventional Approach
for Network Service,
Architecture, Management,
and Modeling
Network Virtualization
Technologies
Virtual
resource
New Approach
for Virtualized Network Service,
Architecture, Management,
and Modeling
IT Resource
(e.g. Data Center)
Conventional Approach
for Data Center Service,
Architecture, Management,
and Modeling
Server Virtualization
Technologies
Cloud Computing Approach
for Cloud Computing Service,
Architecture, Management,
and Modeling
New Approach for Virtualized Network and IT Service,
Architecture, Management, and Modeling
This study’s Focus area/issues
Kyoto, Japan, 22-24 April 2013
ITU Kaleidoscope 2013 – Building Sustainable Communities
ITU-T Y.3011:
NW virtualization for future NW

Various services run over logical isolated
network partition (LINP) using shared
virtualized network resource
Service2
Service1
Service4
Service3

Various Services
Four main issues
LINP1 Manager
LINP2
LINP1
LINP4
LINP2 Manager
LINP3

LINP3 Manager
Virtual Networks
LINP4 Manager
Virtual
Resource
Manager


Virtual Resources
Physical NW1
Physical Resources
Physical NW2
Physical NW3
Kyoto, Japan, 22-24 April 2013
ITU Kaleidoscope 2013 – Building Sustainable Communities
Physical NW1
Manager
Physical NW2
Manager
Physical NW3
Manager

Coexistence of
multiple NW
Simplified access
to resources
Flexibility in
provisioning
Evolvability
Requirements of virtualized ICT
management for carrier network

Virtualized ICT resource information model

Extended/integrated resource information
model for virtualized NW and IT resource


cf cloud technologies for virtualized IT resources,
ITU-T Y.3011 for virtualized NW resources
Additional requirements to ITU-T Y.3011
Multi-tenant support
 Cooperation control and resource provisioning
for virtualized ICT resource
 Traceability and mapping relationship
information between virtualized and physical
resources

Kyoto, Japan, 22-24 April 2013
ITU Kaleidoscope 2013 – Building Sustainable Communities
Concept design of
the proposed network architecture

Encourages flexible network service operations
and dynamic service reconfigurability for service
providers and carrier operators
Public
northbound API
New neck of
hourglass (cf IP)
Kyoto, Japan, 22-24 April 2013
ITU Kaleidoscope 2013 – Building Sustainable Communities
Management system design

Layering/modularizing architecture

For long-term evolution and rapid development
Utilizing software component technologies
 Leveraging software-defined networking
technologies

Decoupling systems functionality from physical
resource entities with programmability and ICT
resource virtualization
 Using function-aware ICT resource abstraction
model and model-based control

Kyoto, Japan, 22-24 April 2013
ITU Kaleidoscope 2013 – Building Sustainable Communities
Architecture overview of
Management Engine
Management policies
Converts request into
resource allocation or
resource control request
Changes in network or IT resources
Management logic
Management engine
Resource compiler
Handle differences
between model and
actual ICT equipment
Abstracted NW/IT resource model
Open innova on with
so ware components
OSGi bundles
Resource coordina on broker
Network resource
manager
IT resource
manager
Device　controllers
Search optimal
combinations and multi-ICT resource coordina on
layer-aware resource
Network resources
coordination/control
(e.g., Call control node,
OpenFlow switch)
Mobile
terminals
Kyoto, Japan, 22-24 April 2013
ITU Kaleidoscope 2013 – Building Sustainable Communities
Bundle repositories
U liza on of bundles
IT resources
Function-aware virtualized ICT
resource information model

Unified information model based on ITU-T G.805,
TM Forum SID, and NDL for ICT resources


Allows multi-layer-capable & ICT coordination processing
Consists of function block, layer adaptation, and service
U_IF1
D_IF1
Switching Table
D_IF2
Resource parameter
ingress
port
ingress
label
egress
port
egress
label
U_IF1
X
D_IF2
X
D_IF1
Y
D_IF2
Z
function block
NW:IP,MPLS,VLAN
IT: storage, computer
inter-layer
connection
function block
Service
paramete
r
value
switching
capacity
N (G)
function block
Masking fine details
(upper layer)
Layer adaptation
upper label
X
Z
function block
（lower layer）
(lower layer)
lower label
Kyoto, Japan, 22-24 April 2013
ITU Kaleidoscope 2013 – Building
Sustainable Communities
Node
M
Node
Architecture implementation for
mobile network services

Voice and Video service run on prototype
network designed by referencing
architecture of 3GPP LTE
IMS with dynamic scale-out/scale-down
extension for voice
 Flash over HTTP for video


Management Engine dynamically controls
both OpenFlow network and virtualized IT
resources
Kyoto, Japan, 22-24 April 2013
ITU Kaleidoscope 2013 – Building Sustainable Communities
Configuration and
its information modeling
OpenFlow Network

Physical configuration




Two DC, Three APs:PCSCF of IMS and HTTP
video server on three VM
One backend DC:
{S,I}-CSCF of IMS
OpenFlow network
Information modeling


Layer-4-level path as
minimum elements of
NW virtualization view
Underlying resources are
systematically configured
Kyoto, Japan, 22-24 April 2013
ITU Kaleidoscope 2013 – Building Sustainable Communities
AP1
201
.11
.1
Data Center -A
OFS #6
OFS #1
202
OFS #4
.12
VM#2
.111
192.168.1.0/24
VM#3
AP2
203
.11
.1
VM#1
.111
.111
OFS #2
.111
.112
.113
Backend
Data
Center
.1
204
.12
Data Center -B
.121
192.168.2.0/24
OFS #7
AP3
205
OFS #5
.1
.12
.122
VM#2
.111
VM#3
OFS #3
206
VM#1
.111
IMS
(S-CSCF,
I-CSCF)
.111
.12
.123
192.168.110.0/24
192.168.100.0/24
192.168.3.0/24
IMS (Proxy-CSCF)
Video on demand server
Clients
Data Center -A
192.168.0.1/24
Server
192.168.100.1
.1
OpenFlow SW
OpenFlow SW
.2
Service
connec vity
Node#1
VoIP
Client 1
VoIP
Client 2
OpenFlow #1
Flow
Flow
ETH
ETH
User-defined
Label
Switching
(OF)
SIP (P-CSCF)
OpenFlow #2
Flow
ETH
DC-A
Node#4
ETH
Flow
ETH
ETH
Physical
NW
Management Engine Implementation



All modules are developed as OSGi bundles
ICT-tightly-coupled resource coordination and
function assignments are performed with multilayer resource coordination search engine
OpenFlow driver controls layer-3/4 flow as label
switching on OpenFlow switch
Service operator’s view
Client
Operator
view
Voice
Video
Topology
view
REST
OSGi
Bundle Viewer
REST
REST
Server
Management Logic
（Tomcat）
REST
Topology view
service layer
Management Engine （Equinox）
Resource compiler for mobile
Multilayer Resource Coordination Search Engine
(TSE)
Flow-based NW topology DB
virtual network layer
OF Driver(OpenFlowj)
OpenFlow
physical
Kyoto, Japan, 22-24
Aprillayer
2013
OpenFlowSwitch
OpenFlowSwitch
ITU Kaleidoscope 2013 – Building Sustainable
Communities
SQL
VM/process
control driver
Custom command
KVM
Abtracted
ICT resource
model（
PostgreSQL）
Operation strategy policy
Strategy 1: Simple management
• Maximize the performance of video-ondemand service
• Resource allocation for QoS guaranteed
voice service
NW link
failures and
burst demand
for voice service
Strategy 2: Intelligent management
•Preferential NW and IT resource allocation for voice
service
•Scale-down of Video on-demand service
Voice service
Video-on-demand service
Kyoto, Japan, 22-24 April 2013
ITU Kaleidoscope 2013 – Building Sustainable Communities
Switch policy strategy to
Strategy 2
Demonstration scenario:
disaster scenario
1.
2.
Normal state: Strategy #1
Network problems due to a
major earthquake

3.
link failure occurs and burst
emergency call demands for
voice service
Enforcement for voice
service with network
restorations

Strategy changeover from
#1 to #2.
Kyoto, Japan, 22-24 April 2013
ITU Kaleidoscope 2013 – Building Sustainable Communities
Demonstration
link to be disconnected
Voice service (R-CSCF)
Video-on-demand service
Strategy changeover from #1 to #2
Configuration is changed in one minute
path restoration
& enhancement
for voice service
scale-out of voice service
scale-down of video service
disconnected link
Kyoto, Japan, 22-24 April 2013
ITU Kaleidoscope 2013 – Building Sustainable Communities
Future research area and
standardization issues

Unified abstracted ICT resource information
model


Realizes carrier-grade network control and
management from physical entity to the service
level for
Standardized API for virtualized ICT
resource control and provisioning
Lowers entry barrier for new service creation
 Refers API of cloud middleware and DMTF


Operational policy description language
enables arbitration of resource allocation among
service and automatic service management
Kyoto, Japan, 22-24 April 2013

ITU Kaleidoscope 2013 – Building Sustainable Communities
Conclusion

“Management Engine”, a virtualized ICT
resource management system for carrier
network services is designed and
implemented
Function-aware virtualized ICT information
model
 Demonstration shows its flexibility and capability


Future work

Standardizing a virtualized ICT resource
information model
Kyoto, Japan, 22-24 April 2013
ITU Kaleidoscope 2013 – Building Sustainable Communities