QoS Management & Traffic Engineering
for IP Networks
Taesang Choi
2001. 5. 24.
Internet Technology Department
ETRI
Topics






QoS Management & TE Challenges
QoS Management & TE in Papers
QoS & TE Features in Devices
QoS Management & TE in Action
Summary
Q&A
KNOM2001
2
QoS Management & TE
Challenges
QoS Management Challenges

QoS Demand
Yes
No
Yes
No
No
16%
Yes
84%
WAN
No
44%
Yes
56%
LAN
Courtesy: Forrester, 8.98., Fortune1000 Companies
KNOM2001
4
IP Application Taxonomy
Muti-Way
(many-to-many
bidirectional)
Asynchronous Burst
- News
- Session
announcement
Interactive Stream
- Distance
learning
- Multi-Player
games
Interactive Burst
- Chat (IRC)
- Resource
discovery
- Shared editing
Isochronous Stream
- A/V
Conferencing
- Distributed
simulation
- Real-time
modeling
- Real-time Multimedia
Interactive Stream
Isochronous Stream
Transaction
Processing
- Thin client
Two-Way
- Telephone
- X-windows
(one-to-one
Isochronous Burst
Interactive
Burst
- Elastic or Bulk
Transfer
Traffic
bidirectional)
- Database updates
- Web browsing
-
One-Way
(one-to-one or
one-to-many
unidirectional)
Asynchronous Burst
- E-mail
- File Transfer
- Push Media
Best Effort Service
Delay Tolerant
KNOM2001
Mission-Critical
Burst
- Auction
Mission-Critical
Stream
- Telemedicine
- Remote control
Mission-Critical
Burst
- Financial Xactions
Resource Sharing
Database access
POS transactions
Remote login
Chat (text-based)
Synchronous
Stream
- Streaming media
- Data collection
- Push media
Mission-Critical
Stream
- Distributed
process
Isochronous Stream
- Data collection
- Process
monitoring
- Push media
Controlled Load
Mission-Critical
Stream
- Data collection
- Process
monitoring
- Push media
Guaranteed
Delay Intolerant
5
IP Nets: Enterprises
Extranet
IDC
Remote Office
E-commerce
site
- Low to High speed Intra Nets
IP VPN
- Heterogeneous net environ: intra,
extra,
Internet
VPN, etc.
- Heterogeneous app environ: simple ~ mission
Intranet
T3
critical
- Increased QoS ManagementCentral
requirement
Site
10Mbps
Ethernet
Remote Office
Remote Locations:
Low-speed Leased Line sites
100Mbps
Ethernet
Remote Locations:
High-speed Leased Line sites
10Mbps
Ethernet
Remote Location:
Low-speed FR sites
10Mbps
Ethernet
KNOM2001
100Mbps – 1Gbps
Ethernet
Campus Net &
NOC
Remote Location:
High-speed FR sites
6
IP Nets: Service Providers
POP
POP
POP
-IP over Frame Relay
-IP over ATM
POP
-IP over SONET
-IP over (D)WDM
-IP over DiffServ
-IP over MPLS
-T3 ~ OC768
-Billing & Service Mgmt
-Strong QoS & TE requirements
POP
POP
KNOM2001
7
QoS Management Challenges


To limit the amount of BW for web during the
day but be flexible enough to impose fewer
limits during off-hours
To ensure that file transfers don’t interfere
with mission-critical traffic during the day
but allow important ordering and financial
file transfers that run during the night to get
through during their time window
KNOM2001
8
QoS Management Challenges




To allow A/V to be delivered with minimum
delay
To ensure that the response time for SAP,
PeopleSoft, and Tn3270 traffic is three
seconds or less and consistent
To ensure that the remote offices serviced by
the VPN receive good service
To limit new peer-to-peer traffic such as
Napster
KNOM2001
9
QoS Management Challenges



To map and guarantee customer’s QoS
requirements in a service provider’s network
To monitor, measure, and analyze traffic to
ensure SLA and to account for billing
Not a few international firms adopted QoS
solutions already and some domestic firms
such as a national-scale bank is considering
QoS solutions for their mission-critical
applications
KNOM2001
10
TE Challenges





TE is particularly important concern to service
providers
Traffic increases much faster than expected
Thus, over-provisioning doesn’t seem to justify
the cost
Large NSPs & ISPs tend to depend on TE for
their traffic (QoS) & resource (utilization)
control
Current IGP control mechanism is limited
KNOM2001
11
TE Challenges

Ideally TE requires





Modification of traffic management parameters,
Modification of parameters associated with routing,
Modification of attributes and constraints associated
with resources
The level of manual intervention involved in the
TE process should be minimized whenever
possible
TE system includes



a set of interconnected network elements,
a network performance monitoring system,
a set of network configuration management tools
KNOM2001
12
TE Challenges


On-line TE and Off-line TE is not competitive but
complementary to each other
 This is particularly important from the Network
Management perspective
Although MPLS is designed to meet these
requirements, there are still some efforts to achieve
TE objectives by modifying the current routing
protocol mechanisms
 by changing link state flooding frequencies
 The integrated approach that achieves TE
objectives based on physical topology routing
instead of full-mesh overlaying routing (e.g.,
ATM, MPLS)
KNOM2001
13
QoS Management & TE Challenges

The Question is not, “Do you need a
QoS or TE manager?” but “Which QoS
or TE manager is right for you?”
KNOM2001
14
QoS Management & TE
in Papers
Related Standards

IETF Sub-IP Area’s WGs: MPLS, TE, CCAMP, etc.



IETF O&M Area’s WGs: Policy, RAP, SNMPConf, RMON





PHBs, PDBs, DiffServ PIB
DMTF(Distributed Management Task Force)


COPS(Common Open Policy Service)
SPPI (Structure of Policy Provisioning Info)
PIB (Policy Information Base)
SNMP Configuration MIB for DiffServ
IETF Transport Area’s WG: DiffServ


CR-LDP/RSVP-TE, ISIS-TE/OSPF-TE, MPLS MIBs
TE for TE requirements, framework, DiffServ-aware MPLS TE, and
TE MIB
DEN (Directory Enabled Networking)
IEEE 802.1p, 802.1Q and 802.1D: classify Ethernet frames
KNOM2001
16
QoS Management & TE Tools:
Control Plane Tools








Routing
 Intra-domain/Inter-domain
 Constraint-based Routing (OSPF-TE/ISIS-TE)
 Rerouting/Fast-rerouting (IGP-Shortcut LSPs)
Signaling and Reservation
 CR-LDP/RSVP-TE
Path selection/Class mapping based on QoS requirements
(DiffServ-aware MPLS TE)
Policy and admission control (DiffServ PDB)
Load sharing/balancing
Path protection/restoration
Accounting, authorization and authentication
Policy-based off-line control


DiffServ-based QoS configuration
MPLS, MPLS VPNs configuration
KNOM2001
17
QoS Management & TE Tools:
Data Plane Tools





Classification, metering, marking, policing,
shaping
Buffer management
Queue scheduling
Congestion control
Merging, aggregation and de-aggregation
KNOM2001
18
QoS Management & TE Tools:
Data Plane Tools
SLA Management
Policy-based
Off-line Configuration
Automation
Signalling
Traffic Analysis/
Reporting
Policing
Admission
Control/
Classification
Traffic Monitoring/
Measurement
Constrain-based
Routing
Queue
Management
Congestion
Control
Shaping
KNOM2001
19
QoS & TE Features in Devices
Cisco’s QoS Features


Classification:
 Committed Access Rate (CAR)
 Policy Based Routing (PBR)
 QoS Policy Propagation through BGP
Congestion Management:
 First In First Out (FIFO)
 Priority Queueing (PQ)
 Custom Queueing (CQ)
 Weighted Fair Queueing (WFQ)
 Weighted Random Early Detection (WRED)
KNOM2001
21
Cisco’s QoS Features

Policing and Shaping:




Link Efficiency Mechanisms:



Compressed Real Time Protocol
Link Fragmentation and Interleaving (LFI)
Signalling:


Committed Access Rate (CAR)
Generic Traffic Shaping (GTS)
Frame Relay Traffic Shaping (FRTS)
RSVP
IP-ATM CoS (Class of Service)
KNOM2001
22
The Cisco QoS Framework
POLICY-BASED NETWORKING
IntServ
Multimedia
Video Conference,
Collaborative Computing
DiffServ
MPLS
VPNs
Hybrid
Signaling Techniques (RSVP, DSCP*, ATM (UNI/NNI))
Classification & Marking Techniques (DSCP, MPLS EXP, NBAR, etc.)
Congestion Avoidance Techniques (WRED)
Traffic Conditioners (Policing, Shaping, CAR)
Congestion Management Techniques (WFQ, CBWFQ, LLQ)
PROVISIONING & MONITORING
Mission Critical
Services
VoIP
Link Efficiency Mechanisms (Compression, Fragmentation)
Frame
Relay
KNOM2001
PPP
HDLC
SDLC
ATM, POS
FE,Gig.E
10GE
Wireless
Fixed,Mobile
BroadBand
Cable,xDSL
Courtesy: 2001@ Cisco Systems Inc.
23
Cisco’s MPLS TE Features

MPLS TE is built on the following IOS mechanisms


LSP tunnels
Link-state IGPs



Path Calculation Module
Link Management Module





with extensions for the global flooding of resource info. and for
the automatic routing of traffic onto tunnels as appropriate
link admission control, bookkeeping of the resource info to be
flooded
Label Switching and Forwarding
Signaling Module
Load Sharing Module
Link Protection/Restoration Module
KNOM2001
24
Juniper’s QoS & TE Features



No DiffServ Support yet
Mostly focused on MPLS TE & MPLS-based VPN
Not many QoS features like Cisco are provided


Policing, Classification, IP Precedence Rewrite, Queuing and
WRR, and RED
But MPLS TE features are superior to that of Cisco’s
in some aspects


BGP-based LSP (enable transit traffic ride on it)
per-interface reoptimize timer, etc.
KNOM2001
25
Juniper’s MPLS TE Features









LSP tunnels
Link-state IGPs
Path Calculation Module
Link Management Module
Label Switching and Forwarding
Signaling Module
Load Sharing Module
Link Protection/Restoration Module
Fast-Reroute for IGP shortcuts
KNOM2001
26
Cisco’s DiffServ Config Example
Edge Router 1
Core Router
Edge Router 2
Internet
Internet
DiffServ Domain
KNOM2001
27
Cisco’s DiffServ Config Example

SETDSCP Policy Map







class-map match-all EF match access-group 101
class-map match-all AF1 match access-group 102
class-map match-all AF21 match access-group 108
class-map match-all AF22 match access-group 109
class-map match-all AF23 match access-group 110
class-map match-all AF3 match access-group 104
policy-map SETDSCP

class EF set ip dscp 46
class AF1 set ip dscp 10
class AF21 set ip dscp 18
class AF22 set ip dscp 20
class AF23 set ip dscp 22

class AF3 set ip dscp 26




KNOM2001
28
Cisco’s DiffServ Config Example

VOIP Policy Map






class-map match-all premium match ip dscp 46
class-map match-all gold match ip dscp 10 12 14
class-map match-all silver match ip dscp 18 20 22
class-map match-all bronze match ip dscp 26 28 30
class-map best-effort match access-group 105
policy-map VOIP





KNOM2001
class premium priority 500
class gold bandwidth percent 35
class silver shape average 320000 bandwidth percent 25
class bronze bandwidth percent 15
class best-effort police 56000 1750 1750 conform-action setdscp-transmit 0
29
Cisco’s DiffServ Config Example







access-list 101 permit udp any any range 16384 327
68
access-list 102 permit tcp any any eq tacacs
access-list 104 permit tcp any any eq www
access-list 105 permit ip any any
access-list 108 permit tcp any any eq telnet
access-list 109 permit tcp any any eq smtp
access-list 110 permit tcp any any eq ftp
KNOM2001
30
Cisco’s MPLS Config Example

Configuring MPLS TE comprises





Configuring a device to support tunnels
Configuring an interface to support RSVP based
tunnel signaling and IGP flooding
Configuring IS-IS or OSPF for MPLS TE
Configuring an MPLS TE tunnel
Configuring a tunnel that an IGP can use
KNOM2001
31
Cisco’s MPLS Config Example

Sample MPLS TE Configuration
KNOM2001
32
Global Configuration

Sample for router 1
ip cef
mpls traffic-eng tunnels
interface loopback0
ip address 11.11.11.11 255.255.255.255
interface s1/0
ip address 131.0.0.1 255.255.0.0
mpls traffic-eng tunnels
ip rsvp bandwidth 1000
KNOM2001
33
Tunnel Configuration

Configuring tunnel 1
interface tunnel1
ip unnumbered loopback0
tunnel destination 17.17.17.17
tunnel mode mpls traffic-eng
tunnel mpls traffic-eng bandwidth 100
tunnel mpls traffic-eng priority 1 1
tunnel mpls traffic-eng path-option 1 dynamic
 Verifying tunnel 1
show mpls traffic-eng tunnels
show ip interface tunnel1
KNOM2001
34
Tunnel Configuration – cont’d
 Configuring an explicit IP path
ip explicit-path identifier 1
next-address 131.0.0.1
next-address 135.0.0.1
next-address 136.0.0.1
next-address 133.0.0.1

Configuring tunnel 2
interface tunnel2
ip unnumbered loopback0
tunnel destination 17.17.17.17
tunnel mode mpls traffic-eng
tunnel mpls traffic-eng bandwidth 100
tunnel mpls traffic-eng priority 1 1
tunnel mpls traffic-eng path-option 1 explicit identifier 1
KNOM2001
35
JunOS MPLS Config Example:
Minimum & Named Path Config
[edit]
interfaces {
interface-name {
logical-unit-number {
family mpls;
# required to enable MPLS on this intf.
}
}
}
protocols {
mpls {
interface (interface-name | all); # required to enable MPLS on this intf.
path to-san-jose {
14.1.1.1 strict;
11.1.1.1 loose;
}
}
}
rsvp {
interface interface-name;
}
KNOM2001
# required to setup explicit LSP
# required for RSVP signaled MPLS only
36
JunOS MPLS Config Example:
LSP Creation Config & Attributes

adaptive

admin-group

bandwidth

class-of-service
# lots of statements for setting various LSP attributes;

fast-reroute
primary path-name {

hop-limit

no-cspf

optimize-timer

preference

priority

retry-timer

record or no-record

standby
[edit protocols mpls]
label-switched-path lsp-path-name {
to address;
# egress address
from address; # ingress address
# lots of statements for setting various path attributes;
}
secondary path-name {
# lots of statements for setting various path attributes;
}
}
KNOM2001
37
QoS Management & TE
in Action
PacketShaper: Application QoS

Packeteer’s QoS solution




Classify Traffic



Apps bandwidth consumption rate, response time, etc.
Control Performance


Based on 5-tuples, mime-types, users, etc.
Analyze Behavior


Enterprise Edge Solution
PacketShaper/AppCelera ICX
Hardware and Software bundle
Apply policy based on the analysis results
Report Trends
http://www.packeteer.com
KNOM2001
39
QoSWorks

Sitara Networks’ QoS Solution



Bandwidth Management


Proxies, signaling, caching, redirection for specific
application types
Policy Management


Layer2 through 7 classification, switching, shaping, queuing,
statistics and bridging
Application-specific Traffic Management


Enterprise Edge Solution
Hardware and Software bundle solution
Analysis, decisions, and enforcement across the network
http://www.sitaranetworks.com
KNOM2001
40
ServicePoint System

ADC’s QoS Solution






Policy-based bandwidth management
Service partitioning
WAN performance analysis



WAN QoS solution (e.g. FR-based Intranet)
Hardware and Software bundle solution
ServicePoint SDU & Manager
Puts SDUs at the boundary of LAN & WAN
TCP rate control
http://www.adc.com/access
KNOM2001
41
FloodGate-1: Secure QoS


Checkpoint’s integrated solution for VPNs, Firewalls,
and QoS
Bandwidth control


Traffic classification




Upto 4Mbps bidirectional
Over 150 IP services and applications based on src, dst, file
designator, URL, time of day
Policy-based Management
Scalability and Ease of use
http://www.checkpoint.com
KNOM2001
42
FloodGate-1: Secure QoS
DMZ
Internet
VPN
LAN
Firewall
Standalone
QoS Device
• When the VPN encrypts packets,
classification is impossible
• NAT is performed in Firewall,
Classification/prioritization is
impossible
KNOM2001
43
FloodGate-1: Secure QoS
DMZ
Internet
Standalone
QoS Device
LAN
KNOM2001
VPN
Firewall
• When located behind
VPN/Firewall, bandwidth
management decisions
corrupted by VPN encryption
and Firewall traffic
44
FloodGate-1: Secure QoS
DMZ
Internet
Firewall
VPN
LAN
KNOM2001
Standalone
QoS Device
• Integration solves all
45
Cisco’s QoS & Service Mgmt
VERIFICATION
XML
Qos network
QPM
policy configuration
TROUBLESHOOT
XML
Network
CW2000service
SMS
level verification
ServiceRWAN
level
CW2000
troubleshooting
(IPM)
Device
Network Wide
CONFIGURE
QDM, ...
Per-device
traffic
class configuration
KNOM2001
QDM, ... traffic
Per-device
class monitoring
Courtesy: 2001@ Cisco Systems Inc.
46
Orchestream 2.1





Market leading Policy-based QoS & MPLS VPN
Manager
Multi Protocol Label Switching (MPLS) control
module for implementing network-based IP-Virtual
Private Networks (IP-VPNs)
QoS control module for managing the Quality of
Service (QoS) levels of specific traffic
Security control module for managing access to
specific parts of the network
Integration Module for integration with other IP
network management software
KNOM2001
47
Orchestream 2.1
KNOM2001
Courtesy: 2001 @ Orchestream Inc.
48
NPAT & MPLSView









WANDL’s MPLS Modeling Tools
Leading provider of MPLS modeling tools
Design and simulate IP/MPLS networks
Multi-vendor config file parsing and integrity
checking
Bottleneck discovery and solutions
Prediction of e2e delays, throughputs, packet drops,
and link utilization
Failure scenario simulations
Reports and topology diagrams
http://www.wandl.com
KNOM2001
49
MPLSView Screenshot
KNOM2001
50
ETRI’s QoS&MPLS TE Server





Topology & Resource Status Visualization
Policy-based QoS Provisioning & TE control
Traffic Monitoring, Measurement & Analysis
Routing Control for Traffic Engineering
Targeted for Backbone network’s QoS & TE
management but can be applied to Enterprise
networks as well
KNOM2001
51
Visualization

Various topology views


Elements & Link status


Live visualization over L3 topology with source-destination, and
flow direction and TT, ES-LSP, Lightpath, etc.
TE views


General & element specific info, traffic in colors, etc.
Flow & Path views


Layer 3, OSPF, BGP, DiffServ Domain, MPLS Domain, Optical
Domain, etc.
Traffic Statistics Matrix (AS-to-AS, Prefix-to-prefix), LSP statistics,
LSP tables (LDP signaled, Explicitly signaled, Primary,
Secondaries), etc.
Policy views

Network-wide DiffServ and/or MPLS policy rules and enforced
network elements relationship map
KNOM2001
52
Visualization: Examples
TE Console
File(F)
Edit(E)
View(V)
TC TM
MPLS
NEs
Simulation(S)
Option(O)
Tool(T)
Help(H)
FS GO
Views: MPLS View
DiffServ
Statistics View Interval
root
Traffic
Trunks
TT 1
LSP Tunnel
1 Primary
LSP
Path
Secondary
LSPs
LSP 1
Path
LSP 2
FEC
Filter 1
RSVP TP
LSP Tunnel
2
TT 2
TT 3
LSP
Tunnels
Tunnel 1
Tunnel 2
RSVP
TPs
TP 1
0 ~ 20 %
20~40 %
40~60 %
60~80 %
80 ~100 %
From :
To
:
서울
+
2001년 2월 23일 12:00
2002년 2월 23일 24:00
5분
-
수원
하루
일주일
적용
한달
취소
대구
대전
광주
부산
Status Console
Server Initiating...
35 %
KNOM2001
Status console example.
53
Policy-based Provisioning







Away from individual device mgmt
Away from individual traffic trunk and LSP mgmt
Consistent configuration and admission control
according to network policies
Independent of signaling/management protocol
High level support for the operation of DiffServ &
MPLS networks
Automate QoS provisioning and traffic engineering
(huge relief to NA, hopefully)
Automate TE decision enforcement to multi-vendor
network environment
KNOM2001
54
Traffic Monitoring & Analysis

MIB Polling


Passive Traffic Measurement


MIB II, DiffServ MIB, MPLS MIBs(LDP, LSR, TE, etc.)
Flow-based traffic measurement (DiffServ, MPLS LSP, MPLS VPN
flows etc.) using SNMP Polling and Netflow mechanism
Measurement Results Analysis



Traffic characterization, Network monitoring, and Traffic control
Traffic distribution based on flows, interfaces, node-pairs(ingressegress), path, destination, prefix, or AS
Traffic load estimation based on class types
KNOM2001
55
Routing Control for TE






MIB Polling
 OSPF, BGP MIBs
Topology Auto discovery
 With the help of QRMS
Path Calculation
 L3 path, CSPF + alpha(DS ClassType, etc.)
TED Import & Processing
 Via passive OSPF participation
Measurement-based Admission Control
Simulations
 Path availability simulation
 Path attribute modification simulation
 Failure scenario simulation
 Global path optimization simulation
KNOM2001
56
System Architecture: Overview
CSI (Common Service Interfaces)
GUI
TMS
Configuration
Package
Measurement
Package
Global
Config
Package
Misc
Package
CORBA
RMS
RATE
PS
COPS
CORBA
Measured
Traffic Data
TMS
Agent
RMS
Agent
COPS
Agent
Cisco
CLI
Junoscript
Client
ACE
CLI
Proxy Agent
SNMP
OSPF/BGP
KNOM2001
CISCO
Router
Juniper
Router
ACE2000
57
Summary

Talked about



KNOM2001
QoS management & TE requirements
Efforts from standard bodies, industries,
research & academic communities
Solutions from device and management
viewpoints
58
References







Geoff Huston, Internet Performance Survival Guide: QoS Strategies for
Multiservice Networks, Wiley, 2000
ITU-T E.800, “Telephone Network and ISDN Quality Of Service,
Network Management and Traffic Engineering”, 1994
Stardust.com Inc, “A White paper - QoS Protocols & Architectures”,
1999: http://www.stardust.com
Internet Protocol Journal, “QoS-Fact or Fiction”, Vol 3. Num 1, 2000
IETF, Internet Draft: draft-iab-qos-02.txt, “Next Steps for the IP QoS
Architecture”, August 2000
Vijay P. Kumar, T.V. Lakshman, Dimitrios Stiliadis, “Beyond Best
Effort: Router Architectures for the Differentiated Services of
Tomorrow’s Internet, IEEE Communications Magazine, May 1998
P. Aukia, et. al., “RATES: A Server for MPLS Traffic Engineering”,
IEEE Network, March/April 2000
KNOM2001
59
Thank You
&
Q&A