crm
BT Wholesale Planned Engineering Works (PEW) 90 day overview
– October to December 2011.
The information contained in this presentation is confidential information as per your terms
and conditions with BT. Please do not forward, republish or permit unauthorised access.
The content is accurate at the time of writing and is subject to change.
customer relationship managemen
1
BTW 2011 Network Changes – 3 month rolling plan
•
Whilst BTW has continually worked to enhance its network, we are currently
undergoing an exceptional level of change driven by four main drivers:–
–
–
–
•
•
•
•
Stability – to improve the reliability of the network, BTW is targeting certain network elements with
hardware and software improvements.
Capacity – the need for additional capacity is driven by an increase in the number of broadband users on
the 21C network (through migration from 20C and growth) and also by the ever-increasing bandwidth
demands of those users.
Resilience –to improve the resilience of the network , BTW is actively removing single points of failure from
the network
New Functionality – to meet the needs of the market BTW needs to enhance its network to deliver the
services its customers require. There is a current focus on efficient content delivery that will be offered
through the Wholesale Content Connect product.
This presentation outlines the key upgrade programmes, their drivers, customer impact
and the number of upgrades per programme per week.
BTW is keen to deliver all the required improvements as quickly as possible whilst
actively managing the risk to customers. For this reason a range of run-rates against
each programme has been outlined. The actual run-rates achieved will be determined
by this ongoing live analysis of risk.
Customer outage times for the PEWs start between 00:01 and 02:00 with the aim of
completing customer impacting work by 04:00. This allows 2 hours for roll-back should
the PEW be unsuccessful.
Business as usual capacity upgrades and upgrades to resilient structures have not been
listed here.
2
20C Upgrades
Prog No:
Upgrades
per week
Av 11000
Min 3000
Max 18000
1-8
IPSC
45
2-4
Av 250
Up to 60
IPSC
3
300
Progress
Mar 12
530/2801
Av. End
user
outage
(Mins)
Mar12
Capacity
2
20C
DSLAM
Cards
Affected
Products
Planned End
8/117
Upgrades
per PEW
Dec
Stability
14
20C BRAS
Code
Upgrade
EUs per
upgrade
Nov
Upgrades
Complete /
Total
Oct
Key Drivers
Sept
Upgrade
Key:Outage is defined as full loss of service
Planned month for upgrades
Contingency month for upgrades – 20% likelihood
Contingency month for upgrades – 50% likelihood
#
See diagram on slides 8&9 for network location
High Impact Programme
Programme Complete
3
20
in
im
BR
20
ad
lin
ex
21C Upgrades
Non Customer
Impacting
6
SVLAN
moves
Capacity,
Stability
Resilience
382/589
Code Update
Phase 1
80/83 (No
Customer
impact)
Phase 2
1/25
Capacity
0
WBC
0
16-30
Av 800
Min 0
Max 1000
1–5
WBC
35
Up to 75
Av 2500
Min 0
Max 8000
1
WBC
1
8 - 12
Av 20000
Min 0
Max 100000
1
WBMC
Phase 1 –
No Outage
Phase 2180
(240 Max)
1-4
5-8 minutes
TBA
(will not
start
until
2012)
TBA
1
WBC
MEAS
ETHERNET
Feb 12
MSE
Upgrades
Ongoing
Up to 12
Mar 12
Access
MCLAG
MPLS Core
Router
11 Upgrades
20
Progress
Ongoing
9
Av. End user Upgrade
outage
s per
(Mins)
week
Sept
Prog No:
164/302
Affected
Products
Dec 11
Capacity
3
21C BRAS
Core
Migration
Upgrades
per PEW
Planned End
EUs per
upgrade
Dec
Upgrades
Complete /
Total
Nov
Key Drivers
Oct
Upgrade
21C
com
enha
the c
151
Thro
SVLA
offlo
Broa
to an
allev
Acces
point
(most
aggre
and M
overa
MPLS
requir
soon
Phase
impac
comm
MSE U
functi
additi
by up
Edge
21C Upgrades
Key Drivers
Upgrades
Complete
/ Total
BB EUs
and/or
Ethernet
Circuits per
upgrade
Upgrades
per PEW
Affected
Products
Av. End
user
outage
(Mins)
Upgrades
per week
Progress
None
0
Up to 480
EAD
Chassis
16 Code
Upgrade
Stability
2837/6950
Up to 15
Ethernet
Circuits
Up to 200
Ethernet,
Mobile
Ethernet
<1
Up to 1000
BEA VS
17 Card
Upgrade
Capacity
9/20
Copper
21 MSAN
Upgrade
2nd vendor
Stability
223/641
Feb12
Up to 120
Jan 12
NonCustomer
Impacting
Dec
2838/4562
Nov
Functionality
Oct
Sept
Copper
15 MSAN
Upgrade
Planned End
Progr No:
Upgrade
1
None
0
Up to 4
3000
50-60
WBC
2
Up to 360
Jan 12
NonCustomer
Impacting
Coppe
code
Conne
The E
requir
stabil
Broad
Upgra
new p
curren
Dec 12
Coppe
vendo
stabil
Completed 20C Upgrades
20C BRAS
Code &
Card
Functionality/
Stability
Pt1 194/194
Pt2 194/194
Progr No:
Upgrades
Complete
/ Total
1
BB EUs
and/or
Ethernet
Circuits per
upgrade
Upgrades
per PEW
Affected
Products
Av 10500
Min 3000
Max 18000
1-3
IPSC
Av. End
user
outage
(Mins)
120
Upgrades
per week
18– 48
Oct11
Key Drivers
Date Ended
Upgrade
6
Completed 21C Upgrades
Progr No:
Key Drivers
Upgrades
Complete
/ Total
BB EUs
and/or
Ethernet
Circuits per
upgrade
Upgrades
per PEW
Affected
Products
Av. End
user
outage
(Mins)
Upgrades
per wee
Av 17000
Min 0
Max 32000
1
WBC
100
24-48
Capacity
15 / 15
Av 20000
1
WBMC
(host link)
180
0-1
5
Provider
Edge switch
Separation
BB EU’s
Av 20000
Max 120000
Ethernet:
Av 60 Ccts
Max 990
Ccts
1
WBC
MEAS
ETHERNE
T
5
60 – 100
Av 600
Min 0
Max 1000
1
WBC
3
7-44
Ethernet
Av 7 Ccts
Max 60 Ccts
1
ETHERNE
T (Copper
Access
Only)
15
(30 max)
80-100
78/78
Functionality
768/ 768
Jun 11
Stability
July 11
12
EFM Code
Upgrade
1230/1230
Jun 11
Copper
10 MSAN
Capacity
Apr 11
8
7750 Code
Upgrade
[EES, EEA &
IEA ]
Oct11
Stability,
Capacity,
Functionality
151/151
3
21C BRAS
code & card
upgrade
Date Ended
Upgrade
7
Completed 21C Upgrades
Upgrades
Complete
/ Total
BB EUs
and/or
Ethernet
Circuits per
upgrade
Upgrades
per PEW
Affected
Products
Resilience,
Capacity
14 / 14
Av 50000
Min 1000
Max 132000
1
WBMC
(host link)
60
1-2
7
FER MCLAG
& Virtual
Switch
Stability
476/476
NonCustomer
Impacting
1
None
0
15-80
13
7750 Minor
Code UG
Stability
20/20
Av 120000
1
WBC
20
Up to 8
18
BEA VS
IOS Code
Upgrade
Nov
11
Stability
560/560
Completed
Av 500
Up to 25
WBC
3
19
Copper
MSAN
Upgrade
Up to
100
Oct
11
Progr No:
Key Drivers
Av. End
user
outage
(Mins)
Upgra
des
per
wee
Date Ended
Upgrade
Aug
11
Aug
11
8
Re-planned PEWs
•
•
•
The level of network change that BTW is driving through inevitably leads to a need
to re-plan a number of PEWs.
The reasons for these re-plans include:- unforeseen technical issues specific to (or
indirectly impacting) that programme, re-prioritisation of work, insufficient time to
complete all work on the night and operational decisions.
BTW have made some improvements to the management of re-planned PEWs and
where possible will seek to avoid using Emergency PEWs for this re-planned work.
In some cases re-planned work will need to be carried out with less notice.
9
Broadband Services on 21CN
2
1
14
11
19
15
9
21
20
8 13
8
3 4
18
17
8 13
6
8 13
5
11
7
10
Ethernet Service on 21CN
16
ADVA
Chassis
8 13
ADVA
Chassis
EEA/EES
EEA/EES
F
8 13
16
12
EFM
21CN Core
8 13
EEA/EES
F ADVA
8
Key
ETHC Ethernet Circuit
ETHA Ethernet Access
(Fibre/Copper)
EEA/EES
EFM
7750 Edge Router
EFM Router
Customer / CP Site
EEA/EES
13
ADVA
ADVA Chassis16
Chassis
16
Chassis
16
Descriptions
•
•
•
•
•
•
•
•
•
•
•
•
•
•
Colossus refers to BT's 20C UK core Internet backbone network mesh
which runs on IP technology
DSLAM - A Digital Subscriber Line Access Multiplexer (DSLAM, often
pronounced dee-slam) allows telephone lines to make faster
connections to the Internet. It is a network device, located in the
telephony exchanges of the service providers, that connects multiple
customer Digital Subscriber Lines (DSLs) to a high-speed Internet
backbone line using multiplexing techniques.
BRAS - A broadband remote access server (BRAS or BBRAS) routes
traffic to and from the digital subscriber line access multiplexers
(DSLAM) on an internet service provider's (ISP) network. The BRAS
manages the logical path from the consumers modem through to the
IP core network.
Fibre MSAN – Fibre MSAN provides both direct access for Fibre fed
customer services and aggregation/resilience protection to the
Network. MSAN is essential a next generation DSLAM. This is
essentially the edge of 21C transmission backhaul.
Copper MSAN -Copper Multi Service Access Node equipment provides
all Access for Copper/Metallic fed services, PSTN Voice DSL,
Broadband, Slow Speed Ethernet and converts the end user service to
IP.
EEA – Ethernet Edge Aggregator (a 7750)
EFM – Ethernet in the First Mile. Ethernet over copper access
IEA – Internet Edge Aggregator (a 7750)
EES – Ethernet Edge Switch (a 7750)
MSIL - Multi-service Interface Link is the Ethernet pipe connectivity
between BT’s and CPs’ 21CN networks. MSIL provides for the needs of
WBC, WBC (Converged) and NGN Call Conveyance.
BEA - Broadband Edge Aggregator.
FER – Front End Router
MSPE – Multi-service Provider Edge Takes 20C BRAS capability closer
to the end user. Less latency.
MCLAG – Multi-chassis Link Aggregation Group –
•
•
•
•
•
•
•
•
•
•
•
•
NGA – Next generation architecture. Fibre based internet access such
as FTTC/FTTP (Fibre to the cabinet/premises)
GEA – Generic Ethernet access, allows local loop equipment (e.g.
Openreach) to be connected to fibre.
EU – End User. The consumer or business that uses the WBC
connection
Access Node – A local exchange containing one or more MSANs
Metro Node – The backhaul network from the Access Nodes
terminates on the metro nodes.
Core Node – One of 20 sites where WBC traffic is aggregated and
handed over to CPs
LPA - Logical PoP Aggregator (a router that aggregates the traffic from
BRASs at a 20C broadband point of presence)
MPLS Core- Multi-Protocol Label Switching Core network. A high speed
IP network, where packets are given a predefined route and pass
straight through, Unlike a normal IP network where each packet is
inspected and routed by each node in the network.
AP - Aggregation Point. This is where multiple end users are
aggregated into a single path for connection to the CP. Allow CPs
access to broadband end users
EP - Extension Path. This is the connection from the AP at the WBC
Interconnect Node to the CP.
Multiplexing – Many of these network elements perform the same
functions of multiplexing many transmission pathways onto a single
pathway, such that a point is reached where a single physical
connection can route connections into an ISPs network.
Alcatel 7750 Infrastructure Ethernet Aggregation Switch (IP
Multiplexor)
12
Management of risk
• In addition to the standard risk mitigation that would be in place for any
network upgrade project, BT is applying additional rigour as outlined
below:– Co-ordination of PEW activities to avoid co-incident clashes with other
network and systems changes.
– Geographical rollout to focus Field Engineering resource and spares for 72
hour post-PEW support following higher-risk PEWs
– Daily calls to sanction all PEW activity for following night based on latest
available information
– Separate Go / No go calls for all key upgrades
– On-the-night efficiencies to reduce risk of failures and overruns.
– Combinations of co-incident BRAS upgrades scheduled to minimise impact on
RADIUS servers
– Additional resource being mentored to widen the skill sets and spread
available hands
– Review of previous night’s PEWs with full root-cause analysis of issues and
over-runs and mitigations put in place to minimise re-occurrences
13