21CN Testing Approach Proposal

advertisement
In Commercial Confidence
CONSULT21
BRIEFING
21CN Migration:
Pathfinder – Entry & Exit
Issue 2: Briefing Number C21–IM-002
Date:24th October 2006
IMPORTANT NOTE
This document is circulated for the purposes of consultation.
As such, the contents are subject to change following such
consultation.
This document is supplied to you in confidence as part of the
Consult21 Process. It should not be circulated outside the
Consult21 Communications Providers.
Copyright © British Telecommunications plc 2006
Document Control
This document will be updated as further information becomes available
Issue 1.0 – 310806
First Issue as a consequence of Consultation initiated through
BTW’s revised 21CN Implementation Strategy and Plan – issued
28th April (C21-MG-002)
Issue 2.0 – 241006
Updated issue to include Pathfinder 1A Exit criteria and the CP
feedback process for risks and issues regarding entry into any
Pathfinder Phase
In Commercial Confidence
CONTENTS
1
INTRODUCTION & OVERVIEW ........................................................................................... 3
1.1 Industry Consultation ............................................................................................... 3
1.2 Purpose of this document ........................................................................................ 3
1.2.1
Fit within the Implementation Document Library ......................................... 4
1.3 Next Steps.................................................................................................................. 4
2
PATHFINDER ENTRY /EXIT CRITERIA .............................................................................. 5
2.1 Overview .................................................................................................................... 5
2.2 Approach ................................................................................................................... 5
2.2.1
Definitions .................................................................................................... 6
2.3 Overview of Genric Entry & Exit Criteria ................................................................ 6
3
CP FEEDBACK PROCESS .................................................................................................. 8
3.1 Overview .................................................................................................................... 8
3.2 CP participation in the feedback process .............................................................. 8
3.2.1
Confidence in 21CN programme: (Entry & Exit gate criteria) ...................... 8
3.2.2
CP Operational readiness: (Own awareness) ............................................. 9
3.2.3
CP Operational readiness: (Testing) ........................................................... 9
3.2.4
CP Operational readiness: (Communications to end users) ....................... 9
3.3 Operation of the CP feedback process ................................................................... 9
3.3.1
Timeline ..................................................................................................... 10
3.4 CP Feedback & BT response - Tracking ............................................................... 11
ANNEX A – SPECIFIC PATHFINDER PHASE ENTRY CRITERIA ............................................. 13
PATHFINDER PHASE 1A - ENTRY & EXIT ................................................................................. 13
PATHFINDER INTERCONNECT MIGRATION ............................................................................ 14
PATHFINDER PHASE 1B ............................................................................................................. 14
Author: BT Issue: 1
© British Telecommunications plc 2006
Page 2 of 14
In Commercial Confidence
In Commercial Confidence
1 Introduction & Overview
BT has committed to a radical new 21st Century Network (21CN). This network will replace the
existing multi-layered network and will require end customers to be migrated from the old to the
new. The first step in migrating live end customers to 21CN will take place in Cardiff and the
surrounding areas from November 2006 (Pathfinder).
This document discusses the BT entry and exit criteria that wil be used to govern decisions to
proceed with the various phases of Pathfinder. The document also discusses the key areas of CP
readiness that need to be addressed that form part of the overall entry criteria.
1.1 Industry Consultation
BTW initiated a period of industry consultation on 28th April 2006 (through issue of its revised
21CN Implementation Strategy & Plan - C21-MG-002) on the definition of Pathfinder Entry and
Exit Criteria. This consultation operated until 9th June 2006 and was open to all CPs. The
objective of this consultation was to enable BTW to define clear entry and exit criteria
incorporating CP concerns and feedback to support both BTW and CPs in effective planning for
Pathfinder and also ensuring that an appropriate operational review process was in place to
capture the learning from each phase.
The consultation comprised:

a formal consultation to which three CPs (BT’s retail divisions, C&W and Thus)
responded

two multi-lateral sessions (Pathfinder Experts on 10th and 24th May) which were attended
by a number of CPs and provided positive feedback that BTW had identified the right
areas with its criteria
In summary the consultation identified no new criteria but did generate some feedback on their
definition which BTW has considered during the development of the Entry and Exit Criteria
contained within this Briefing.
1.2 Purpose of this document
This briefing seeks to provide confirmation of the:

approach to entry & exit criteria definition and the generic Pathfinder Entry and Exit
criteria following the period of Industry consultation (section 2 of this briefing)

the specific Pathfinder Phase 1A entry and exit criteria (section 3 of this briefing)

the process by which Communication Providers may put forward their key concerns,
issues and risks for consideration by BTW regarding entry into any specific phase of
Pathfinder (section 4 of this briefing)

The timeline initially for Phase 1A

the key areas of CP readiness that need to be addressed that form part of the overall
entry criteria.
Author: BT Issue: 1
© British Telecommunications plc 2006
Page 3 of 14
In Commercial Confidence
In Commercial Confidence
1.2.1 Fit within the Implementation Document Library
The Implementation & Migration and Conformance Testing Working Groups have developed a
library of information for CPs to facilitate their greater understanding of BT’s migration plans.
These documents will updated regularly as further information becomes available or as
experience from the testing and pilot phases enables further refinement of clarification of the
documents.
Figure 1 – I&M Documentation Library
Mass Migration
Pathfinder / Pilots
Pathfinder Definition
Migration Command &
Business Continuity
C21-IM-013
Control (MCC)
C21-IM-012 (E&C Nunbers
C21-IM-016 Design Briefing
Migration
TE Briefings
C21-IM-016 Design
TE Impact Matrix
Pathfinder Entry & Exit
C21-IM-002
C21-IM-010/018/019
Pathfinder Review
C21-IM-011
C21-IM-016 Design
TE Test Briefings
BB First Pilot Definition
C21-CT-013/TBC for BB
C21-IM-021
21CN Testing Database
 Test purposes
 Test results
 Testing bulleitins
1.3 Next Steps
Following discussion at the Pathfinder Experts in September and October 2006, Consult21
intends to implement the CP feedback process as outlined in section 4 of this briefing.
This process will be tracked via a Pathfinder Phase specific RAG, supplementary to the IMWG
RAG.which will be updated as appropriate through the Implementation & Migration Working
Group or specific “Operational Readiness Review audios” which will be scheduled via the
Consult21 meeting planner.
Author: BT Issue: 1
© British Telecommunications plc 2006
Page 4 of 14
In Commercial Confidence
In Commercial Confidence
2 Pathfinder Entry /Exit Criteria
2.1 Overview
As debated and agreed at the Pathfinder Experts:
Entry Criteria will provide a basis for the reviewing of working group plans to ensure that the
appropriate discussions are undertaken, information is made available and effective preparations
made ahead of each Pathfinder Phase and appropriate focus is placed on their attainment.
Exit Criteria will provide a status which when achieved will trigger the initiation of the operational
review process, enabling the development/definition of any action plans to address gaps. ie exit
from the phase would have been achieved following the stability period after the migration of the
requisite end customer lines to 21CN. (NB The stability period is defined within the relevant
Transfer Engineering method (IM-010/IM-019)
The evaluation of whether the Exit Criteria was achieved successfully, including for example MCC
operational performance and processes;and whether any corrective action is required will be
determined through the Operational review process (C21-IM-011)
2.2 Approach
BT has defined generic Pathfinder Entry & Exit criteria in order to provide a consistent framework
for review of end customer migration to 21CN during all phases of Pathfinder. These criteria are
identified within section 2.3 of this document and are derived from a snapshot of what BT’s 21CN
implementation programme will have achieved at a particular point in time. This is illustrated in the
diagram below.
BT 21 CN Programme preparation: building, developing, testing, training, briefing etc.
GO
GO
GO
Entry point
Exit point
Phase 1a
Entry point
review
27th Nov 06
Exit point
Phase 1b
Mar 07
Entry point
review
Exit point
Phase 2a
Apr 07
Time line – not to scale
As such each Pathfinder phase has three distinct activities associated with it, namely:
preparation, actual migration and review. In order to allow the review activity to be effective, a
clear understanding of when a phase has been exited is vital.
Author: BT Issue: 1
© British Telecommunications plc 2006
Page 5 of 14
In Commercial Confidence
In Commercial Confidence
For each generic Entry or Exit criteria, BTW will define a specific version of Entry/Exit as
appropriate to each Phase of Pathfinder and specific entry/exit criteria are outlined in the annex.
2.2.1 Definitions
Criterion – an area which through the Consult 21 Consultation process has been identified for
BTW and CPs to focus on - in terms of Pathfinder preparation and Pathfinder Review
Entry Criterion – the state which BTW expects to achieve/activities expects to complete prior to
the commencement of a Pathfinder phase in relation to this area (or criterion)
Exit Criterion – the state which BTW expects to achieve/activities expects to complete during a
Pathfinder phase in relation to this area (or criterion)
Success Benchmarks – the benchmarks (underpinned by metrics) which will be used to
determine whether any given Pathfinder Phase has been successfully completed and inform the
operational review process (covered in the Operational Review Process – C21-IM-011)
Review period – the period between phases (or for long phases during the transfer engineering
activities) where lessons learnt can be documented and acted upon.
2.3 Overview of Genric Entry & Exit Criteria
The following table lists the generic criteria that will be used throughout the pathfinder phases.
Criterion
P
R
E
R
E
Q
U
I
S
I
T
E
BT confirmation of
WG?
SB
Entry Criteria
Exit Criteria
See Industry Implementation Plan
N/A
ability to manage
service assurance,
fulfilment and billing
during and Pathfinder
post migration end/CP
Customers
1 Infrastructure
IMWG
Requisite Technology and
Post Transfer Stability
Infrastructure has been installed,
period has been completed
configured and tested and declared
“ready for migration”
2 Test & Trials
CTWG
Testing programme (as defined)
N/A
completed and appropriate mitigation
in place for:
 Core Product Tests
 Interoperability
 CPE
 TE/RTE
 New products
 CP Tests completed
Author: BT Issue: 1
© British Telecommunications plc 2006
Page 6 of 14
In Commercial Confidence
In Commercial Confidence
Criterion
WG?
3 Migration Command &
IMWG
Control
Entry Criteria
Exit Criteria
MCC structure as defined tested
MCC handed back
including CP and Emergency and
(DLE/MSAN or DSLAM) to
Critical Services interfaces.
BAU and sufficient
information gathered to
enable an end of phase
report to be compiled
4 Reverse/ Transfer
IMWG
Prepare Network Activities Completed
All transfer engineering
Engineering
with TE Methodologies tested &
activity completed for the
Methodologies
trialled including any special
defined migration activity
processes to safe guard availability of
including any deferred
emergency and critical services
migrations for emergency
during migration (eg monitoring of
and critical services as
calls in progress, special TE
appropriate
methodology/process)
5 Industry Business
IMWG
BT Compliance statement against
Continuity
Industry Business Continuity
Requirements
Requirements reviewed and accepted
Compliance
by TIEPF
6 Notification of end
customers
End
End customer communication
Cust
programme complete for Pathfinder
Comm
area
s
7 Risk Mitigation
ISB
Framework
N/A
N/A
CP toolkit made avaialble
Risk Mitigation framework in place (bi-
Pathfinder activities
lateral agreement)
completed as defined [and
subsequently operationally
reviewed]
8 Pathfinder Operational
IMWG
Operational Review process in place
Sufficient information
including clearly defined review
gathered by BTW to enable
points/evidence to be collected
an end of phase report to
underpinned by a timetable
be compiled
I&P/IM
All Orders placed and agreed RFT
All CP interconnect circuits
WG
slots assigned for migrating routes
migrated (and tested) from
Review process
9 Interconnect route
migration (DLE to
NGS)
Author: BT Issue: 1
© British Telecommunications plc 2006
Pathfinder DLEs
Page 7 of 14
In Commercial Confidence
In Commercial Confidence
3 CP Feedback Process
3.1 Overview
In practical terms, Operational Readiness increases as entry into a particular Pathfinder phase
draws close and a regular review cycle is in place within BT to provide clarity on its current state
of operational readiness including:

the risks that exist and those which still require to mitigation to be put in place

the key issues which are impacting on effective planning and implementation
Pathfinder is a complex undertaking and in setting out the Entry and Exit criteria, BT has sought
to give its Communication Provider customers clarity on the key areas it will be considering as
part of internal review its operational readiness to enact each of the Pathfinder phases, starting
with Phase 1A – Wick.
As outlined (by Matt Beal, BT Director, 21CN Core Convergence & Capabilities) at the Pathfinder
Experts on 19th September), BT is keen to ensure that it is able to give appropriate consideration
to issues and risks identified by CPs as part of their own preparation for Pathfinders within BTs
own internal review process which will ultimately lead to its decision to go or not with any specific
phase of Pathfinder as previously communicated.
BT would ask that any issues / risks raised by CPs through this process relate to significant
barriers to the ability to manage end customers, and are as specific as possible
3.2 CP participation in the feedback process
In recognition of the fact that CPs’ own plans for any activities associated with Pathfinder require
the interlocking with BT’s, the feedback process will consider two main areas:

CP confidence in the 21CN programme (against Entry & Exit critera)

CP operational readiness (specifically ensuring that there is no BT impediment for CPs
implementation activities including CP internal awareness, testing and end customer
communications.)
3.2.1 Confidence in 21CN programme: (Entry & Exit gate criteria)
The process provides for the opportunity for CPs to

raise specific concerns and issues on the Entry and Exit criteria which will be fedback by
Consult21 into BT’s own internal Operational Readiness Review for consideration and
appropriate response.
Author: BT Issue: 1
© British Telecommunications plc 2006
Page 8 of 14
In Commercial Confidence
In Commercial Confidence
3.2.2 CP Operational readiness: (Own awareness)
The process provides for the opportunity for CPs to

raise specific issues regarding migration processes (eg MCC, PEWs, updates, fallback &
fault reporting) which will impact the ability to manage end customers through migration
process.
3.2.3 CP Operational readiness: (Testing)
The process provides for the opportunity for CPs to:

raise specific issues regarding their ability to utilise the CP Test Facility at Swansea to
undertake testing within the CP testing window (e.g. for Phase 1A by no later then 22nd
November)

identify issues arising from their test results to the CP test facility team to be progressed
for investigation and regression (NB - in line with the established processes associated
with the facility, the CP Test Facility team should be made aware at the time of
testing/failure). All failures will be assessed bilaterally between BT and CPs to agree
appropriate action.
3.2.4 CP Operational readiness: (Communications to end users)
The process provides for the opportunity for CPs to

raise any issues regarding communications support to manage their end customers
during migration (NB: Q&A framework doc, comms toolkit, reseller awareness)
3.3 Operation of the CP feedback process
Consult21 would appreciate CPs:

raising only items relevant only to the next Pathfinder phase with as much specific
information as possible (including with suggested corrective actions) and in a timely
manner

differentiating between issues against the entry criteria (section 2 of this document) and
their own state of operational readiness.
to enable them to be progressed effectively for resolution.
Author: BT Issue: 1
© British Telecommunications plc 2006
Page 9 of 14
In Commercial Confidence
In Commercial Confidence
The feedback loop will be managed as per the diagram below.
Go/ No Go
BT 21 CN Operational Readiness review
BT
ck
ba
ed
Fe
ba
ed
CP
CP
e
Fe
se
on
sp
s
on
sp
Re
Re
ck
BT
Feedback can be provided into the process either:

Multi-laterally – through the IMWG and Operational Readiness Review audios (please
see the the Consult21 meeting planner for details)

Bi-laterally by emailing the Consult21 mailbox and cleared marked as Pathfinder Phase
(X) – issues.
3.3.1 Timeline
Consult21 will use the Industry Steering Board and the Implementation & Migration Working
Group to operate and manage this process. The following diagram shows the detailed countdown
milestones to Phase 1A.
The 2 weeks before migration
27/10/06
C21 Audio
Checkpoint
10/11//06
C21 Audio
Checkpoint
17/11//06
C21 Audio
Checkpoint
24/11//06
C21 Audio
Checkpoint
CPs
Days
BT
30/10/06
Countdown
audio initiated
within BTW
Author: BT Issue: 1
© British Telecommunications plc 2006
13/11/06
End Customer
Comms triggered to
confirm the night of
migration MCC
takes operational
control of migration
20/11/06
Final prep
Go/no Go audio
Door drop
commences
Network stability
confirmed
27/11/06
(10 PM)
Ph1a
Start
27/11/06 (AM)
Ph1a - GO
Page 10 of 14
In Commercial Confidence
In Commercial Confidence
3.4 CP Feedback & BT response - Tracking
In line with established working practice throughout the Consult21 Working Group structure,
feedback and BT responses to the issues raised will be tracked via a Phase specific RAG (as
illustrated in the diagram below). This RAG will be reviewed multi-laterally at various points along
the timeline illustrated in 3.3.1 above.
RAG Feedback Process
Entry Gate
Review
+
CP Operational
readiness
IMWG
Pathfinder
RAG
This RAG will be the basis of feedback provided by Consult21 to BT’s own Operational Readiness
Reviews as outlined in the previous time line chapter. The RAG will be kept updated with regards
to progress in their resolution. A example RAG template is illustrated below:
Author: BT Issue: 1
© British Telecommunications plc 2006
Page 11 of 14
In Commercial Confidence
In Commercial Confidence
Author: BT Issue: 1
© British Telecommunications plc 2006
Page 12 of 14
In Commercial Confidence
In Commercial Confidence
Annex A – Specific Pathfinder Phase
Entry Criteria
Pathfinder Phase 1a - Entry & Exit
Criterion
(1) Infrastructure
Phase 1a Entry
As per diagram in section 3.1.1 of
Phase 1a Exit
see below
Briefing C21-IM-013
(2) Testing & Trials
Testing programme (as defined)
see below
completed and appropriate mitigation
in place for:
 Core Product Tests
 Interoperability
 CPE
 TE/RTE
 New products
 CP Tests completed
(2i) Pathfinder
N/A
(3) MCC
As per section 6 of Briefing C21-IM-
see below
013 (issue 2)
(4) Transfer
PSTN Transfer Engineering method
engineering
and fallback understood
see below
Emergency calls management in
place
(5) Business
BT Compliance statement against
Continuity
Industry Business Continuity
see below
Requirements reviewed and
accepted by TIEPF (for PSTN on
AXE10 migration and Release 1
infrastructure)
(6) End Customer
Notifications completed for end
Communications
customers impacted by WIck
(7) Risk Mitigation
bi-lateral agreement in place
see below
(8) Pathfinder
Review timetable and responsibilities
see below
Operational review
understood for Phase
Author: BT Issue: 1
© British Telecommunications plc 2006
see below
Page 13 of 14
In Commercial Confidence
In Commercial Confidence
Pathfinder Interconnect migration
Interconnect Route migration does not fit simply within the strict definitions of the Pathfinder
phases so for reasons of simplicity has for the purposes of this document been split out into its
own section
Criterion
Entry
Exit
(9) interconnect
All Orders placed and agreed RFT
All CP interconnect circuits
route migration
slots assigned for migrating routes
migrated (and tested) from
Pathfinder DLEs
Pathfinder Phase 1b
TBC @ next issue – target date Jan 07.
End
For Enquiries relating to this Briefing please contact:
Bill du Cann
Consult21
019 7759 4313
Liz Walsh
Consult21
019 7759 8398 or 077 1110 7364
www.btwholesale.com/consult21
Author: BT Issue: 1
© British Telecommunications plc 2006
Page 14 of 14
In Commercial Confidence
Download