ITU Forum on Conformance
& Interoperability
For the Arab & African Regions,
5-7 November 2012 Tunisia
Session 5:
Building
Test
Labs
S5-5: Testing Laboratory
Experience in the ARB
Region
AlaaAlDin (Aladdin) Al-Radhi
ICT / Telecom / Internet: Strategist & Consultant
alradhi2000@yahoo.ca , alaalradhi@gmail.com
6 November 2012
1
Agenda
1
Quick C & I Background
2
Arab Cases & Practices
3
Arab Conclusions &
Recommendations
4
6 November 2012
Annex:
ITU Reference Works
Main
Talk
Quick Wrap
-Up Recall
2
Agenda
1
6 November 2012
Quick C & I
Background
3
1
Quick C & I
Background
Conformity Assessments &
Conformance Testing
• The processes used to demonstrate that a product
(tangible) or a service or a management system or
body meets specified requirements.
• These requirements are developed by the
International Organization for Standardization (ISO)
& the International Electrotechnical Commission
(IEC). The processes that need to be followed to be
able to demonstrate that they meet the
requirements are also developed by ISO/IEC.
• The ISO committee on Conformity Assessment
(CASCO), develops standards & guides for conformity
assessment and these documents are referred to the
CASCO toolbox
6 November 2012
www.iso.org/iso/casco_toolbox
4
CASCO toolbox standards & guides for
telecommunication sector 1 / 2
ISO/IEC 17000:2004 : Conformity assessment –Vocabulary and
general principles
ISO/IEC 17011:2004 : Conformity assessment – General
requirements for accreditation bodies accrediting conformity
assessment bodies
ISO/IEC 17020:1998: General criteria for the operation of various
types of bodies performing inspection
ISO/IEC 17021:2011: Conformity assessment – Requirements for
bodies providing audit and certification of management systems
ISO/IEC 17024:2003: Conformity assessment – General
requirements for bodies operating certification of persons
ISO/IEC 17025:2005/Cor 1:2006: General requirements for the
competence of testing and calibration laboratories
ISO/IEC 17030:2003: Conformity assessment – General
requirements for third-party marks of conformity
1
•
•
•
•
•
•
•
Quick C & I
Background
6 November 2012
www.iso.org/iso/casco_toolbox
5
CASCO toolbox standards & guides for
telecommunication sector 2 / 2
ISO/IEC 17040:2005: Conformity assessment – General
requirements for peer assessment of conformity assessment
bodies and accreditation
ISO/IEC 17043:2009: Conformity assessment – General
requirements for proficiency testing
ISO/IEC 17050:2004: Conformity assessment – Supplier’s
declaration of conformity
ISO/IEC Guide 65:1996: General requirements for bodies
operating product certification systems
ISO/IEC Guide 67:2004: Conformity assessment – Fundamentals
of product certification
ISO/IEC Guide 68:2002: Arrangements for the recognition and
acceptance of conformity assessment results
1
•
•
•
•
•
•
Quick C & I
Background
6 November 2012
www.iso.org/iso/casco_toolbox
6
1
Quick C & I
Background
Interoperability Testing
Operator
Side
Customer
Side
• Network capabilities for support of services including
number format, identification, authentication;
• Network architecture and functional requirements of
network elements;
• Access network and terminal types;
• Scenarios for service assignment;
• Traffic flow characteristics;
• Protocol and interface types;
• Interworking with non-NGN networks;
• Interworking with other services
6 November 2012
7
The ECO System
SDO
SDO
SDO
I
t
e
r
o
p
Regulator
Performance,
Conformance,
Interoperability
Operator/
Service
Provider
Service Delivery
Consumer
Equipment Type
Approval
Vendor
6 November 2012
Source: Dr. Roman Kužnar, Sintesio, (Matej Žontar, SIQ) ITU CIS/EU CIT Forum
8
1
•
•
•
•
•
•
•
•
•
•
•
•
Quick C & I
Background
Technologies Testing Focus
NGN Architecture & Services
Fixed-Mobile Convergence
Mobile Multimedia Broadcast/Multicast
Optical Networks
Multimedia and IPTV
QoS,
Security and Identity Management
Emergency Communications
Smart Grid
Cloud Computing
IPv6
…etc
6 November 2012
9
1
Quick C & I
Background
Testing Specifications: Who is Who
ITU-T test Specifications :
Conformity Database
Project &
Recommendations
• NGN Architecture &
Services
• Fixed-Mobile
Convergence
• Optical Networks
• Broadband Cable
• Multimedia, IPTV
• ISDN
• QoS
OMA (Open Mobile Alliance)
• Security
www.openmobilealliance.org
6 November 2012
www.arib.or.jp
Alliance for Telecomm
Industry Solutions
www.atis.org
Telecomm Industry Association
www.tiaonline.org/
European Telecomm
Standards Institute
www.etsi.org
IETF (Internet Engineering
Task Force) www.ietf.org 10
1
Quick C & I
Background
Test Centers
Types
Purpose
1. Private: Belong to OEMs &
Testing laboratories
 Conformance testing of
2. International / Regional: Tests
equipment to meet
equipment to meet Standards
specific standards &
(ISO) & ITU Recommendations.
specifications as specified
e.g.
by vendors, SPs, &
• ETSI Plugtests
network operators.
 Interoperability testing of • ZNIIS: Russian Central
Scientific Research
equipment on networks.
Institute www.zniis.ru
 Testing & evaluation of
equipment which employs • University of Hampshire IOL
(Interoperability Lab)
new technologies before
www.iol.unh.edu
deployment in networks
6 November 2012
www.etsi.org/Website/OurServices/Plugtests/home.aspx
11
1
Quick C & I
Background
MRA: Mutual Recognition
Agreements / Arrangements
• Help avoid the cost of duplicative testing: Once in the exporting
country & again in the importing country
• Test once, Use any where! Will reduce testing costs
6 November 2012
12
1
Quick C & I
Background
Accreditation Bodies
International Laboratory
Accreditation Cooperation
(ILAC) www.ilac.org
• To develop a global network
of accredited testing Labs
• Has 3 Regional Cooperation
Bodies & MRAs:
1. Asia Pacific Lab Accreditation
Cooperation (APLAC)
2. EU co-operation for
Accreditation (EA)
3. Inter-American Accreditation
Cooperation (IAAC)
www.european-accreditation.org
6 November 2012
www.aplac.org
International Accreditation
Forum (IAF) www.iaf.nu
• To establish Multilateral
Recognition Arrangements
(MLA), between its members.
• Has 3 regional groups:
1. The EU co-operation for
Accreditation (EA)
2. The Pacific Accreditation
Cooperation (PAC)
3. The Inter-American
Accreditation Cooperation
(IAAC).
www.iaac.org.mx
13
Agenda
2
6 November 2012
Arab Cases &
Practices
14
2
Arab Cases
& Practices
NTRA Egypt
www.tra.gov.eg/english/main.asp?
Compliance with International Standards
Standards
Organization
Telecom / Radio
ITU, ETSI, ASA, FCC
EMC / EMI
CENELEC, IEC, ASA
Safety / Health
CENELEC, IEC, ASA, UL, FCC
6 November 2012
15
2
Arab Cases
& Practices
NTRA Egypt
www.tra.gov.eg/english/main.asp?
• Light Regime: Declaration of
Conformity certificate “DoC” or
“FCC ID”, (USA, Canada, EU, Japan,
South Korea, Australia),
• Tight Regime: Test reports from
accredited international test labs
over the 5 continents, (Other
countries not including China),
• Special Regime: Verification of
Conformity certificate (VoC) & Preshipment verification from NTRA
accredited labs in China,
6 November 2012
Source: dr. Roman Kužnar, Sintesio, (Matej Žontar, SIQ) ITU CIS/EU CIT Forum
16
2
Arab Cases
& Practices
NTRA Egypt
NTRA Accredited Test Labs in China
1. China Telecommunication Technology Labs
www.chinattl.com
2. Intertek China www.intertek.com
3. SGS-CSTC Standards Technical Services Co., Ltd.
www.sgs.com
4. Bureau Veritas ADT
www.cn.bureauveritas.com
5. TÜV Rheinland Group Greater China
www.chn.tuv.com
6 November 2012
www.tra.gov.eg/english/main.asp?
17
2
Arab Cases
& Practices
NTRA Egypt
NTRA ICT TE Test Lab

Wireless TE Test Set (3 MHz to 6 GHZ) Signalling test
Mobile GSM 2G/3G,CDMA 2000 FWT, Cordless Phones
.9/2.4/5.8 GHz, HF/VHF/UHF Transceivers);

1.88-1.9Ghz phones;

Analogue wired phones;

EMC Test system (Immunity/Emission, Semi-anechoic
chamber) (RFP – Jan 2012);
6 November 2012
Source: dr. Roman Kužnar, Sintesio, (Matej Žontar, SIQ) ITU CIS/EU CIT Forum
18
Arab Cases
& Practices
2
Central DB solution
NTRA ‘Master’ EIR
“NTRA database”
NTRA Egypt
Develop National
Black list
Management of all
EIR data
Developed
International
White List
ranges
System LVL
GSMA Global Database
(GSMA Agreement)
Lists &
configuration
data
Master/Slave relationship (download-reporting)
Vodafone
‘Slave’ EIR
Etisalat
‘Slave’ EIR
MobiNil
‘Slave’ EIR
Network LVL
Operation /
Authentication
Check IMEI requests with Black, White responses
SS7
SS7
MSC
MSC
Vodafone network
6 November 2012
Etisalat network
SS7
MSC
MobiNil network
Source: dr. Roman Kužnar, Sintesio, (Matej Žontar, SIQ) ITU CIS/EU CIT Forum
19
2
Arab Cases
& Practices
UAE Telecom Lab
• ADSL (Asymmetric Digital Subscriber
Line)
• Cable Modems
• FAX Machine
• GSM (Global System for Mobiles) and
In order to obtain the
3G Handsets
Type Approval and Site
• Hybrid Systems (Large Key System)
Approval Application
• Key Telephone Systems
Documents, you need to
• Leased Line Backup & ISDN Audio
contact UAE
Conferencing
Telecommunications
• Modems
Regulatory Authority
• PABX (Private Automatic Branch
(TRA) www.tra.ae
Exchange)
6 November 2012
www.uaelab.ae/Products/Products.htm
20
2
Arab Cases
& Practices
•
•
•
•
•
UAE Telecom Lab
Pagers
POS (Point of Sale Terminals)
Telephones
Telex Machine
Terminal Adapter & Network
Terminal
• VCS (Video Conferencing
Systems)
• WLAN (Wireless Local Area
Network)
6 November 2012
In order to obtain the
Type Approval and Site
Approval Application
Documents, you need to
contact UAE
Telecommunications
Regulatory Authority
(TRA) www.tra.ae
www.uaelab.ae/Products/Products.htm
21
2
Arab Cases
& Practices
Public Networks
CERT Tunisia
Technical Acceptance Profile
• Switching and data processing systems:
 Switching systems (AXE, EWSD, OCB ,HC3,C&C08, etc.)
 Data switching systems (X25, ATM, FR,…)
 Mobile networks (UMTS, GSM, GPRS)
 ISDN (Integrated Services Digital Network )
 IN (Intelligent Network) and NGN networks
 UMTS core network
• Transmission systems:
 Digital TX systems SDH/PDH on optical fibers & microwaves,
 Mobile networks GSM/GPRS and TETRA (Radio Sub system)
 Optical fiber civil work
6 November 2012
www.cert.nat.tn/?cont_id=00168&lang=EN
22
2
Arab Cases
& Practices
Public Networks
CERT Tunisia
Technical Acceptance Profile
• Access Networks:
Distribution networks
(copper, optical…)
WLL (Wireless Local
Loop )
• Telecommunication
Environment:
Power supply and Air
Condition equipments
Fire detection and
extinction systems
6 November 2012
Private Networks
• Communication Systems:
 PABXs
 Call centers
 LAN Buildings Cabling
 WAN Sites Interconnection
 WIFI networks
• Information Systems:
 Server
 ATM
 System security.
www.cert.nat.tn/?cont_id=00168&lang=EN
23
2
Arab Cases
& Practices
Go Global Compliance USA
• Middle East and North Africa Certifications:
 Algeria
 Bahrain
 Egypt
 Jordan
 Kuwait
 Lebanon
 Morocco
 Oman
 Qatar
 Saudi Arabia
 Tunisia
 United Arab Emirates (UAE)
• Services Covered:
 Safety/EMC Certifications, Certificates of Compliance (CoC)
 Wireless and Telecom Type Approvals
• Partnerships Certificates
6 November 2012
www.goglobalcompliance.com/services
24
2
Arab Cases
& Practices
www.citc.gov.sa
6 November
2012
CITC, KSA
IPv6 Test Lab
www.ipv6.org.sa/testlab
25
Agenda
Arab Conclusions
3
&
Recommendations
6 November 2012
26
Current Arab
3
Region Image
• Reliance on TA (Type Approval) process.
• Mostly relay on globally recognized Standards &
accredited Labs.
• Some have testing facilities but generally NOT
accredited.
• NO interoperability requirements or testing by
regulators towards operators
• Counterfeit equipment (mainly China-Made) is a
problem, specially in the mobile sets
• Regional Test Labs have difficulties to finance.
• Some regulators are reluctant about MRAs because
of revenues reduction i.e. loss of TA fees.
Arab Conclusions &
recommendations
6 November 2012
27
3
Arab Conclusions &
recommendations
The Way Forward
• Advise ITU of interoperability problems
• Regulators to establish market access requirements &
prioritize areas
• Regulators to simplify related C & I regulations
• Establishment of Accreditation Bodies & MRAs setup
• Technical Skills build-up
• Establishment of local / regional Test Centers
• Network-like test centers (common infrastructures) to
reduce costs & share experiences
• Develop an inventory & mapping of available resources
• Partnerships with industry, vendors, operators, etc
• Local & regional interactive sessions: Challenges, Possible
bi-lateral collaborations, Best practices, Action Steps,
International aid, Strategies, etc
6 November 2012
28
3
Arab Conclusions &
recommendations
The Way Forward
Interactive Sessions
Courtesy Use f ITU Forms
Pillar 1:
Conformity
Assessment
Pillar 2:
Interoperability
Events
Pillar 3:
Capacity
Building
Pillar 4:
Regional
test
centers
Main obstacles ?
Strategies / Action Steps ?
International Aid ?
Others ?
6 November 2012
29
3
Arab Conclusions &
recommendations
WORLDWIDE TEST
LABS 1
• USA NIST
http://ts.nist.gov/standards/scopes/programs.htm
http://ts.nist.gov/standards/scopes/ect.htm
• AUSTRALIA
www.austest.com.au/about_us.php
• European
http://start.europadev.com/Home/consultancy-1
• A4Labs
www.at4wireless.com/testing-certificationservices/accreditations.html
• TUNISIA
www.cert.nat.tn
6 November 2012
30
3
Arab Conclusions &
recommendations
WORLDWIDE TEST
LABS 2
• MIDDLE EAST
www.uaelab.ae/UAELAB/about_UAELAB.htm
www.goglobalcompliance.com/
www.ntra.gov.eg/arabic/main.asp
www.contractlaboratory.com/labclass/telecommunications.cfm
• RUSSIAN FEDERATION
http://zniis.ru/ITTC.html
• CANADA – INDUSTRY CANADA
www.ic.gc.ca/eic/site/smt-gst.nsf/eng/home
• AFRICA, CHINA, ASEAN, CIS, LATIN AMERICA TEST LABS (Link to
ITU webpage)
www.itu.int/dms_pub/itut/oth/06/24/T06240000010009MSWE.doc
6 November 2012
31
Agenda
Annex:
4
6 November 2012
ITU Reference
Works
Quick Wrap
-Up Recall
32
ITU Conformity & Interoperability Portal
http://www.itu.int/net/ITU-T/C-I/
• The ITU Conformity and Interoperability (C&I) Programme
Concepts and Guidance
• ITU Conformity Database
• Interoperability and “ITU Interop Events”
• Capacity Building & Guidelines for establishing test centers
• Vendors, Industry, Testing
• Laboratories
• Standards Developing Organizations & International
Organizations
6 November 2012
Contact on conformity: conformity@itu.int
Contact on interoperability: interop@itu.int
33
The ITU 4 “Pillars”
Standards Side:
 Conformity Assessment
 Interoperability Events
Developments Side:
 Capacity building
 Establishment of test centres in developing
countries.
6 November 2012
34
The ITU Conformity Database DB
http://www.itu.int/net/ITU-T/conformity/cdb.aspx
• Informative & voluntary database open both
to members & non-members
• Adoption of international ISO/IEC standards &
guidelines or self-assessment approach
• On-line entries directly made by Companies
• ITU is not participating in any Testing /
Certification activities
6 November 2012
35
Populating the ITU-T conformity DB
1. Companies can populate the DB via registering online &
Choose among 4 routes: http://www.itu.int/net/itut/cdb/secured/Register.aspx
6 November 2012
http://www.itu.int/net/ITU-T/conformity/cdb.aspx
36
Populating the ITU-T conformity DB
2. Companies can populate the DB via registering online &
Choose among 4 routes: http://www.itu.int/net/itut/cdb/secured/Register.aspx
2. PRODUCT
2.1 Name of
product:
2.2 Enter a
Category:
(e.g. DSLAM, modem, ADSL, optical fiber, home networking,
WDM, multimedia, IPTV etc.)
2.3
Comments/Re
marks:
(e.g. main functionalities implemented, etc.)
6 November 2012
http://www.itu.int/net/ITU-T/conformity/cdb.aspx
37
Populating the ITU-T conformity DB
3. Companies can populate the DB via registering online &
Choose among 4 routes: http://www.itu.int/net/itut/cdb/secured/Register.aspx
3. ITU-T RECOMMENDATION(S) IMPLEMENTED IN THE PRODUCT
3.1 Please select from the list below ITU-T Recommendations that are implemented in
your product.
Select Series:
3.2
Comments/Remarks:
6 November 2012
Select Number:
(Insert here edition of Recommendations if
different from the one in force at the
moment of submission of the form and/or
number/series of national/regional
standards adopted as equivalent to ITU-T
Recommendation(s), e.g. NMR
234/G.992.2; XYZ123/H.264)
http://www.itu.int/net/ITU-T/conformity/cdb.aspx
38
Populating the ITU-T conformity DB
4. Companies can populate the DB via registering online &
Choose among 4 routes: http://www.itu.int/net/itut/cdb/secured/Register.aspx
Drop Menu to Choose From
6 November 2012
http://www.itu.int/net/ITU-T/conformity/cdb.aspx
39
Populating the ITU-T conformity DB
5. Companies can populate the DB via registering online &
Choose among 4 routes: http://www.itu.int/net/itut/cdb/secured/Register.aspx
Route 1: Testing performed by a laboratory accredited as per ISO/IEC
17025 (Rec. ITU-T X.290 applies). A Supplier’s Declaration of Conformity
(SDoC) prepared according to ISO/IEC 17050 standard has to be submitted
to ITU to populate the ITU conformity database;
Route 2: Testing performed according to procedures adopted by a
Certification Body accredited as per ISO/IEC Guide 65 (Rec. ITU-T X.290
applies) which issues a Certificate of Conformity. The Certification Body is
fully responsible for the certification process that may include tests
performed in a non accredited Lab. An SDoC (ISO/IEC 17050) is submitted
to ITU to populate the ITU database.
6 November 2012
http://www.itu.int/net/ITU-T/conformity/cdb.aspx
40
Populating the ITU-T conformity DB
5. Companies can populate the DB via registering online &
Choose among 4 routes: http://www.itu.int/net/itut/cdb/secured/Register.aspx
Route 3: Testing performed in laboratories recognized by an SDO or
Forum or Consortium qualified as per Recommendation ITU-T A.5 or by
an Organization signatory of an MoU with the ITU. (Rec. ITU-T X.290
applies). A Conformity Statement is issued by the Laboratory and an
SDoC is submitted to ITU to populate the ITU database.
Route 4: For ITU members only. Self-assessment procedure directly
performed by the vendor. A Conformity Declaration is submitted by the
vendor to populate the ITU database. Please note that criteria to
populate the database under Route 4 are under review. Should the
criteria be changed, entries already posted in the database introduced
using Route 4 would be tagged as such and all future entries would be
required to comply with the revised criteria.
6 November 2012
http://www.itu.int/net/ITU-T/conformity/cdb.aspx
41
ITU Approach: ISO/IEC assessment
& self-assessment procedures.
Route 1: Accredited Testing Laboratories
Route 2: Accredited Certification Bodies
Route 3: Laboratories recognized by ITU-T A.5
qualified organizations or MoUs signatories
Route 4: for ITU members only
6 November 2012
42
4 routes to populate conformity DB
ISO/IEC Assessment Procedures
Conformity Assessment
& Certification
Route 1
Tests performed by an
accredited lab
(ISO/IEC 17025)
(Rec. ITU-T X.290)
Recommendation(s)
compliant test results
Self-assessment Procedures
Route 2
Route 3
Route 4
Tests performed in
a lab agreed by an
Accredited
Certification Body
(ISO/IEC 17065)
(Rec. ITU-T X.290)
Tests performed in
a lab selected by an
ITU-T A.5 agreed
SDO/Forum/MoUs
(Rec. ITU-T X.290)
ITU Members Only
Conformity Certificate
issued by the Certification
Body
Recommendation(s)
compliant test results
Tests performed in
any lab
Self-Declaration of
Compliance issued
by the Supplier
ITU C&I
services
Supplier’s Declaration of
Conformity (SDoC)
(ISO/IEC 17050)
6 November 2012
ITU Conformity
Database
43
ITU virtual Laboratory for remote tests of
equipment, new technologies & services
http://www.itu.int/ITU-D/projects/display.asp?ProjectNo=CALL-06
• Currently being developed in ITU-T : A powerful testing
& training tool for regional test centers.
• The objective is to provide remote access to an NGN
model network for testing new technology equipment
& services
• Benefits:
Reduced test preparation time
Availability & use of expensive test equipment via a
remote interface;
Testing Procedures & automation
Reduced testing costs compared with on-site tests
6 November 2012
44
6 November 2012
45
ITU virtual Laboratory Status
• ITU & FSUE ZNIIS Russia start collaboration in the
field of Virtual laboratory creation on the basis of the
ITU – FSUE ZNIIS International Telecommunication
Testing Center ITTC project
• The project currently;
– Seeking Funds
– Call for Partners
• Interested to have information? Write to :
BDTPRJHQ@itu.int
Subject Title: Request Information about Project
CALL-06
6 November 2012
http://www.itu.int/ITU-D/projects/display.asp?ProjectNo=CALL-06
46
“Handbook on Testing”, ITU-T,
November 2011
6 November 2012
www.itu.int/ITUD/tech/events/2011/CI_Moscow_November11/Presentations/Session2/SeminarCI_20
11_CIS_Presentation_JPieczerak_S2_3.pdf
47
ITU Guidelines for developing countries on establishing
conformity assessments test labs in different regions
May 2012
www.itu.int/ITU-D/tech/ConformanceInteroperability/ConformanceInterop/Guidelines/Test_lab_guidelines_EV8.pdf
6 November 2012
48
ITU Conclusions & Recommendations
• Members to advise the ITU of interoperability problems,
their mitigation, & successful procedures that were
helpful in the process: http://groups.itu.int/itut/StandardsQA.aspx
• Members to establish market access requirements for
telecom equipment to avoid interference, and safety of
life issues in their marketplace.
• Members to examine their existing legislation and
regulations to ensure that they enable participation in
MRAs on Conformity
• Assessment and testing with foreign partners
6 November 2012
49
ITU Conclusions & Recommendations
• Members to prioritize areas of concern related to
telecommunication products and systems
• Accreditation bodies in member states should become
signatories of the ILAC MRA or the IAF MLA.
• Test centers should be established on a regional basis to
take advantage of the similar networks in a region with
common infrastructures
• Make use of ITU training: http://academy.itu.int
• Focus on the Test Centers as a Centre of Excellence CoE
• Interoperability testing should utilize the model
network concept under development in ITU-T
6 November 2012
50
6 November 2012
51