ITU WORKSHOP ON NGN CONFORMITY AND
INTEROPERABILITY TESTING CENTRE (S)
FOR THE AFRICA REGION
Nairobi, Kenya
August 2 - 4, 2010
The global of testing approach in ITU
Dmitry Tarasov
Rapporteur Q 8/11 (WP 4/11),
4/11), ITUITU-T
Director on science questions
Central Science Research
Telecommunication Institute (ZNIIS),
Moscow
WSP10_AFR - Nairobi, Kenya - August 2 - 4, 2010
Contents
Conformance testing on the model
networks
Model networks for conformance
testing
Project for regional Testing Centre
WSP10_AFR - Nairobi, Kenya -August 2 -4, 2010
Conformance testing on the model networks
Features of NGN implementation
Increase in the number of manufacturers due to
increased share of software in implementing the
technical
means
of
telecommunication
Reducing
the
period
introduction
of
new
of
the
development
and
technologies
and
services
lag standardization process from the process of
development and implementation, increase the share of
corporate regulatory documents
The increasing complexity of the compatibility problems
of equipment from different manufacturers
WSP10_AFR - Nairobi, Kenya -August 2 -4, 2010
Conformance testing on the model networks
Features of NGN implementation
Testing procedure play an important
role
Changing the testing methodology –
creation Model network – as common
measurement instrument
Centralization and cooperative
activities in the analysis and
evaluation of different solutions
(Knowledge DataBase)
WSP10_AFR - Nairobi, Kenya -August 2 -4, 2010
Conformance testing on the model networks
The approach of NGN testing
Functional Interop. testing – verification
the functionality on TM (EUT) and systemnetwork solutions (NUT) different vendors
for compatibility in accordance with basic
ITU-T Recs.
Service testing – testing the services on
“end-to-end” scenarios including call flow
testing and testing with existent provider’s
operation systems (Billing, OSS/BSS and
etc.)
QoS testing – testing the QoS parameters
and RACF functionality
WSP10_AFR - Nairobi, Kenya -August 2 -4, 2010
Conformance testing on the model networks
Current situation in testing standardization
area in ITU-T
Present time
Conformance testing which includes
protocols and interfaces testing (TTCN 1
(X.292(X.292-1995), TTCN 2 (X.292(X.292-1998), TTCN 3 (Z.140(Z.1402003)
TSS&TP,
TSS&TP, PICS/PIXIT proformas for different protocols
testing)
Future
NGN based on the functional entity
which
interworks
using
some
protocols
Interoperability testing
(Q.3901 for NGN, Q.3904 for IMS)
WSP10_AFR - Nairobi, Kenya -August 2 -4, 2010
Conformance testing on the model networks
NGN testing methods
Conformance testing or type
testing
The purpose of conformance testing is to determine to
what extent a single implementation of a particular
standard conforms to the individual requirements of
that standard
Interoperability testing
Interoperability testing is the activity of proving that
end-to-end functionality between (at least) two
communicating systems is as required by those base
systems' standards
*
*Note: Martin Brand, Test creation principles, International training seminar ‘Testing of System
and Network Solutions’ ZNIIS, Moscow December 10-11 2009
WSP10_AFR - Nairobi, Kenya -August 2 -4, 2010
Conformance testing on the model networks
NGN - Interoperability testing
methods
Network Integration Tests/End-to-End Tests
Benchmark/Load Tests
QoS Tests
Security Tests
Roaming Tests
Interconnection Tests
Functional tests/Real Equipment Tests
WSP10_AFR - Nairobi, Kenya -August 2 -4, 2010
Conformance testing on the model networks
Testing method
Interoperability Testing
Operator‘s business
Multi-VendorIntegration
Interconnection
Interconnection Tests
Tests
Conformance
Conformance for
for
Interoperability
Interoperability
Roaming
Roaming
Tests
Tests
Type
Type acceptance:
acceptance:
Functional
Functional
testing
testing +
+
Load
Load &
& stress
stress
Multi-Vendor-Integration
Multi-Vendor-Integration
Load
Load &
&
Stress
Stress
Testing
Testing
Network
Network
monitoring
monitoring
QoS
QoS surveillance
surveillance
Conformance
Conformance for
for
Interoperability
Interoperability
Functional
Functional Testing
Testing
Real
Real Equipment
Equipment
Tests
Tests
Supplier‘s business
WSP10_AFR - Nairobi, Kenya -August 2 -4, 2010
Conformance testing on the model networks
Combining Interoperability and
Conformance Testing
Conformance and Interoperability
both important and useful approaches to the testing of
standardized protocol implementations
although it is unlikely that one will ever fully replace the
other
Conformance testing
able to show that a particular system complies with all of
the protocol requirements specified in the associated base
standard
the different Vendors similar systems which is tested on
conformance could not be guarantee to be compatible
WSP10_AFR - Nairobi, Kenya -August 2 -4, 2010
Conformance testing on the model networks
Combining Interoperability and
Conformance Testing
Interoperability testing
can clearly demonstrate that two systems
will interact and provide the specified
end-to-end functions
the different Vendors similar systems which
is tested on interoperability could not be
guarantee that the interact protocol is realized
on the associated base standard
WSP10_AFR - Nairobi, Kenya -August 2 -4, 2010
Model networks for conformance testing
ITU-T Rec. Q.3900 as a global
approach of testing
Purpose – determination of the Model network as
a basic solution for NGN testing
Model network – a network which simulates the
capabilities similar to those available in present
telecommunication networks, has a similar architecture
and
functionality
and
uses
the
same
telecommunication equipment
Contents of Q.3900
Classification of NGN TM regarding the NGN
functionality (Y.2012)
Determination of testing procedures
Requirements to the Model network
WSP10_AFR - Nairobi, Kenya -August 2 -4, 2010
Model networks for conformance testing
Basic Methodology of NGN testing.
ITU-T Recommendation Q.3900 (09/2006)
WSP10_AFR - Nairobi, Kenya -August 2 -4, 2010
Classification of NGN Technical
Means to be tested
- Call Session Control System
-Media Gateway Controller (MGC)
-Proxy Server SIP (PS)
-IP Multimedia Subsystem (IMS)
- Voice and signaling transmit system
-Media Gateway (GW)
-Signaling Gateway (SG)
-Transport Network Environment
(TNE)
- Application servers
-Application Server (AS)
-Media server (MS)
-Messaging Server (MeS)
-
Management and billing
system
-Management System (MS)
-Billing system (BS)
-Access Environment
-NGN Integrated Access
Devices (NGN-IAD)
-Media gateway for Legacy
Terminal Equipment (GWLTE)
14
RDF09_CIS - Chisinau, Moldova -August 24-26, 2009
NGN functional architecture
Recommendation of ITU-T Y.2012
A p p lic a tio n s
Management functions
( m a y in c lu d e o w n A u th e n tic atio n , A u th o riza tio n a n d A cc o u n tin g )
S e rvic e
c o n tro l
S -5 : S . U se r
P r o f ile F E
S - 7 : In te rc o n n e c tio n
B o r d er G a tew a y
C o n tro l F E
S -1 5 : G e n e r a l
S e r v ic e s C o n tr o l F E
S - 2 : P r o x y C a ll S e ssio n
C o n tr o l F E
S - 1 : S er v in g
C a ll S e ssio n C o n tr o l F E
S -8 : A cc e ss G W
C o n tr o l F E
S - 1 3 : M e d ia R e so u r ce
C o n t ro l F E
L e g a cy
T er m in a l
T - 1 6 : P o lic y D ec isio n F E
T -1 0 :
N e tw o r k A c c e s s
C o n fig ur a tio n F E
RGW
T - 4 : A cc e ss
R e la y F E
C o re tra n sp o rt
T -9 :
S ig n a llin g
G a te w a y
FE
T -8 :
M e d ia
R e so u rc e
P ro ce ss in g
FE
T -6 :
In te r co n n e c tio n
B o r d er
G a tew a y F E
A c ce ss tra n sp o rt
T -3 : E d g e
N ode FE
T -2 : A c ce ss
Node FE
T -1 : A c ce ss
M e d ia
G a tew a y
FE
IP
M u ltim e d ia
N e tw o rk s
T -1 7 : T r a n sp o r t
R e so u r ce C o n tr o l F E
T -1 7 : T r a n s p o r t
R e so u rc e C o n tro l F E
T -1 4 : A c c e s s M a na g e m e n t F E
C u st o m e r
N e tw o r k
O th e r N G N
T -1 6 : P o lic y D ec isio n F E
T -1 3 : T . L o c a tio n
m a n ag em e n t F E
T -1 1 :
T . A ut h e n tic a tio n
& A u th o r iza t io n
FE
S -1 0 : B re a ko u t
G a tew a y C o n tr o l
FE
S -9 : M e d ia
GW
C o n t ro l F E
RACF
RACF
T -1 5 : H o m e G a te W a y
C o n fig ur a t io n F E
T -1 2 : T . U s e r
P r o file F E
L eg a c y
T e r m in a l
S -1 2 : N e tw o r k
S ig n a lin g
In te rw o r kin g F E
S -3 : In ter ro g a t in g C a ll
S e ssio n C o n tr o l F E
S -4 : S u b sc r ip tio n
L ocator F E
NACF
NGN
T er m in a l
S -6 : S .
A u th e n tic a t io n &
A u t h o r iz a t io n F E
S - 1 4 : M e d ia
R e so u rc e B r o ke r F E
Application
A p p lic a tio n S u p p o r t F u n c tio n s & S er v ic e S u p p o rt F u n ctio n s
S -1 1 : U se r S ig n a lin g
I n te r w o r kin g F E
NGN
E n d -U se r U N I
F u n c tio n
ANI
*
T -5 :
A c ce ss
B o r d er
G a te w a y
FE
A c c e ss P a c k e t T ra n sp o rt F u n c tio n s
C o re P a c k e t T ra n sp o rt F u n c tio n s
T -7 :
T r u n ki n g
M e d ia
G a tew a y
FE
Scope of N G N
P S T N /IS D N
15
RDF09_CIS - Chisinau, Moldova -August 24-26, 2009
Conformance of NGN Functions to NGN
Technical Means to be tested
NGN Technical means
NGN Functionality
Call Session Control System
Media Gateway Controller (MGC)
S3, S7, S9, S10, S12
T10, T11, T12, T13
Proxy Server SIP (PS)
S2, S3, S7, S11, S12
T10, T11, T12, T13
IP Multimedia Subsystem (IMS)
S1, S3, S6, S7, S8, S10, S12, S13
T10, T11, T12, T13, T14, T15, T16, T17
Voice and signaling transmit system
Media Gateway (GW)
T7, T8
Signaling Gateway (SG)
T8, T9
Transport Network Environment (TNE)
T5, T6, T8
Application servers
Application Server (AS)
S4, S5, S6, S14, S15
Media server (MS)
S4, S5, S6, S14, S15
Messaging Server (MeS)
S4, S5, S6, S14, S15
Management and billing system
Management System (MS)
Billing system (BS)
Access Environment
NGN Integrated Access Devices (NGN-AD)
Media gateway for Legacy Terminal Equipment
(GW-LTE)
-
error processing management
equipment configuration management
billing system management
service management
security management
T2, T4, T3, T5, T15, T14
T1, T2, T3, T4, T5
16
RDF09_CIS - Chisinau, Moldova -August 24-26, 2009
Model networks for conformance testing
Architecture of model network
WSP10_AFR - Nairobi, Kenya -August 2 -4, 2010
Project for regional Testing Centre
Joint project ITU-ZNIIS
ITTC
WSP10_AFR - Nairobi, Kenya -August 2 -4, 2010
Project for regional Testing Centre
Preparation of ITTC project 1/2
Creation of Model
network in ZNIIS for
interoperability testing
Moscow, 2003
Lunch of the project
for JSC “Svyazinvest”
on NGN equipment
testing
Moscow, 2004
Regional preparation
meeting RCC.
Approved initiative of
Russia on creation of
International centre
for RCC contribution
on WTDC-06 (Doha,
Qatar) Moscow,
October 2005
Creation in ITU-T of the
new question Q.8
«Testing of NGN
protocols»
WTSA Brazil, 2004
Lunch of the Q.39хх
Recommendations series
in the scope of Q.8 SG11
ITU-T on testing of NGN
technical means
Switzerland, 2004
Termination of the JSC
“Svyazinvest” project
on NGN interoperability
testing for 15 leading
vendors
Moscow, 2004-2005
Resolution 17 WTDC,
approving RCC
contribution on creation
of International centers
of introduction and
testing new technologies
Doha, March 2006
RCC operators Council.
Presentation of ZNIIS
on principles of
creation and
functioning of
International centers.
Moscow, March 2006
WSP10_AFR - Nairobi, Kenya -August 2 -4, 2010
Project for regional Testing Centre
Preparation of ITTC project 2/2
Speech on seminars ITUD/ITU-T on thematic of testing
on Model networks
ITU-ATIS specialists forum
USA , March 2006
African region forum
Tanzania, October 2006
ITU-ETSI specialists forum
Switzerland, December 2006
Arabian region forum
Bahrain, May 2007
ETSI-ZNIIS joint
project on testing.
10 vendors.
Moscow, April 2007
Recommendations:
Q.3900
(in force, 2006)
Q.3901
(in force, 2007)
Q.3902
(in force, 2007)
Q.3903
(in force, 2008)
Q.3904
(in force, 2010)
ITU Project
«International Telecommunication Testing
Centre»
Switzerland, November 2007
Approved in project department of ITU-D
WSP10_AFR - Nairobi, Kenya -August 2 -4, 2010
Project for regional Testing Centre
ITTC project
International Telecommunication Union
Telecommunication Development Bureau
Central scientific-research Institute of Communication
(ZNIIS)
Russian Federation
Project Title:
International Telecommunication Union – Central
Science Research Telecommunication Institute
International Telecommunication Testing Centre
Shot project name:
ITTC ITU-ZNIIS
Start data:
January 2008
Deadline:
June 2011
Government agencies, attracted to work:
Administration and the Ministry of
Communications
Agency implementing the project :
International Telecommunication Union
Project location:
ITU Regional Representative Office in Moscow
Countries in whose favor a project:
CIS and other developing countries
WSP10_AFR - Nairobi, Kenya -August 2 -4, 2010
Project for regional Testing Centre
Project description
In this project, the ITU and ZNIIS start to cooperate for
creation of the International Telecommunication Testing
Centre (ITTC), operating in an environment of new technologies,
and training for professionals from developing countries in the
field of telecommunications. Methodical testing of next-generation
networks (NGNs), in particular, planning realized in ITTC through
the creation of a model network, through which enables
simulation of various network parameters and use a variety
manufacturers equipments. The results of these tests will be
documented and disseminated.
This project is developed in strict accordance with the
recommendations of the 2006 Qatar World Telecommunication
Development Conference (WTDC), establishing the International
Centre for NGN Testing.
WSP10_AFR - Nairobi, Kenya -August 2 -4, 2010
Project for regional Testing Centre
The project purpose
Education to test and introduce new
technologies for RCC and the developing
countries specialists (3 workshops, 3
methodical course of training)
Methodical equipment testing on a model
network for RCC and developing countries
WSP10_AFR - Nairobi, Kenya -August 2 -4, 2010
Project for regional Testing Centre
Expected results
Knowledge DataBase in according with of Q.3903
ITU-T recommendation
Testing manuals
Methodology for NGN testing
New technologies introduction examples on the
operators network
Results archive of technology and communication
services testing
WSP10_AFR - Nairobi, Kenya -August 2 -4, 2010
Project for regional Testing Centre
Current results
International Seminar on the system-network solutions
testing with the participation of specialists in 10 RCC
countries and Europe professionals (November 2008)
The test methodologies for system-network solutions
testing (Softswitch, IMS, Wireline Broad Band Access)
(March 2009)
Functionality and interconnection testing of system-network
solutions of different vendors, installed on a model network
(test results in agreement with the vendors will be provided
in the ITU, in a centralized ITU database). Conducted a
training course to the principles of NGN testing (June 2009)
International Seminar "Testing for compliance with
international standards" with the participation of specialists
in 10 RCC countries, the ITU administration , ITU-T
developers and experts from leading European operators
(DT, AT). Designed and launched the first version of the
Knowledge Base. At the moment Knowledge Base is filled
(November 2009)
WSP10_AFR - Nairobi, Kenya -August 2 -4, 2010
Project for regional Testing Centre
Planning events
Testing QoS parameters for different network
solutions and equipment from different vendors
(November - December 2010)
Develop training materials to ensure QoS testing
(November 2010)
International Workshop on the results of QoS testing
(February 2011)
Final version of the Knowledge Base in accordance
with the existing ITU-T recommendation Q.3903
(April 2011)
International Workshop on the testing results of the
ITTC project (July 2011)
WSP10_AFR - Nairobi, Kenya -August 2 -4, 2010
Project for regional Testing Centre
The common directions of the ITTC
development
Development
of
recommendations
on
telecommunications
development
strategy
with
national strategies for RCC operators networks
Develop standards for system-network solutions,
protocols and services for operators of RCC operators
networks
Develop recommendations to ensure quality of service
and principles of formation of service level agreements
on RCC operators networks
Research of NGN Information Security for RCC
operators
WSP10_AFR - Nairobi, Kenya -August 2 -4, 2010
Project for regional Testing Centre
Main ITTC activities
Joint research
Provision of model network and knowledge base resources for
testing
Development of analytical reports
Organization of seminars
Development of contribution, generalizing and systematizing ITTC
experience
Testing for compliance with standards
Realized of projects on issues of equipment interoperability
Assistance in the formation of technical policy
Accompanying the introduction of new technologies
Development of basic requirements for equipment
Development of Service Level Agreement
Works on adapting equipment
Consultations on the issue of terms of use of equipment
Analysis and recommendations on the interaction of equipment
from different manufacturers
WSP10_AFR - Nairobi, Kenya -August 2 -4, 2010
Project for regional Testing Centre
ITTC practical Model network
WSP10_AFR - Nairobi, Kenya -August 2 -4, 2010
Project for regional Testing Centre
Physical Architecture Model of
Communication Network
linearly cabling infrastructure
optical transport infrastructure based on xWDM and SDH
technology
transport infrastructure based on IP/MPLS packet-switched
infrastructure subscriber access, including: MSAN, xPON, xDSL,
FTTx, WiFi, WiMax, Ethernet
Infrastructure of gateways and switched controls
infrastructure of application servers
infrastructure support systems, operations and business (OSS /
BSS)
infrastructure of terminal equipment, including wired and wireless
types of terminal endings
infrastructure of remote access, including specialized mobile
workplaces
infrastructure of centralized database of test results, including the
storage, processing and reporting
infrastructure network providing operational processes MN
WSP10_AFR - Nairobi, Kenya -August 2 -4, 2010
Project for regional Testing Centre
The composition of the measuring
equipment MN
computer-aided testing specialized software based on TTCN-3
scripts that implement the generated test procedures for
compliance with local and international standards and
recommendations
generation system invariant payload (telephone networks, data
networks and supplementary telecommunications services)
system emulation network fragments (virtual hardware) emulation
scenarios passes network traffic data
system testing parameters and procedures for quality
management services, including the possibility of generating traffic
transmission and analysis of knowingly incorrect messages
WSP10_AFR - Nairobi, Kenya -August 2 -4, 2010
Project for regional Testing Centre
Formalization and availability of
testing results
WSP10_AFR - Nairobi, Kenya -August 2 -4, 2010
Project for regional Testing Centre
ITU-Т Recommendation Q.3903
FORMAT REPRESENTAVE
TESTING RESULTS
ZNIIS.RU
NGS.RU
WSP10_AFR - Nairobi, Kenya -August 2 -4, 2010
Project for regional Testing Centre
Virtual repository
Possibility for creation of dedicated area with
restricted access to Knowledge Database for
storing of different information of Administrations
and operators (methodologies, testing reports,
network schemes, normative documents and etc.)
Existence of virtual constructor of testing
methodic, for development of these documents in
the automatic mode using powerful set of libraries
of tests of functionalities, conformance and
interworking of different technical means, system
and network solutions, protocols and services of
NGN
Collection and distribution of testing results in the
worldwide mode
WSP10_AFR - Nairobi, Kenya -August 2 -4, 2010
Project for regional Testing Centre
Resume on implementing ITTC
activities
Reducing of digital gap by sharing experience of
introduction and maintenance of new technologies,
implemented on the operators networks from developed
countries, on the worldwide telecommunication market
Using ITTC as the effective mean of gathering experience
and consolidation of high-level specialists and experts in
the field of introductions, testing, standardization and
maintenance of new telecommunication technologies
Performance of regional initiatives and private initiative
projects for network operators in part of development
qualifying standards, which determine entire approaches
and rules in part of introduction of new technologies on
the operator networks
WSP10_AFR - Nairobi, Kenya -August 2 -4, 2010
Thank you for attention
Dmitry Tarasov
Rapporteur Q 8/11 (WP 4/11),
4/11), ITUITU-T
Director on science questions
Central Science Research Telecommunication Institute
(ZNIIS), Moscow
Tel: +7+7-495495-368368-9311
Fax: +7+7-495495-368368-9105
Email: dtarasov@zniis.ru
WSP10_AFR - Nairobi, Kenya -August 2 -4, 2010