TSAG-12
C&I Informative Session
Geneva, 12 January 2012
The ITU Conformity and
Interoperability Programme:
Status
Paolo
1 Rosa & Riccardo Passerini,
ITU
PP-10 Res. 177 on C&I
• Endorsement Resolution 76, Resolution 47 and
decisions of Council-09
• C&I programme to be implemented in parallel
and without any delay
• Parallel development of a long-term business plan
in consultation with each region
• Assist developing countries in establishing regional
or subregional conformity and interoperability centres
• Studies in view to introducing the use of ITU Mark
for a possible future ITU Mark programme
The ITU C&I Programme
(Council 2011)
Four Pillars:
TSB lead:
1.Conformity database
2.Interoperability events
BDT lead:
1.Capacity building
2.Establishment of test centres in
developing countries.
3
The ITU Conformity Database
 Informative and voluntary database open
both to members and non-members for
conforming products
 Adoption of international ISO/IEC standards
and guidelines or self-assessment approach
 On-line inputs directly made by Companies
 ITU Liability: ITU is not participating in any
testing/certification activities
 Products conforming to standards increase
the probability of interoperability
Some other existing DBs
• IEEE – ICAP Product Conformance Registry + Labs
www.ieee-isto.org/icap-program/products
• Open Mobile Alliance – Products Listing
www.openmobilealliance.org/Application/ProductListing/products
• FCC part 68
- www.fcc.gov/wcb/iatd/part68faqs.pdf
Doc.:FCC – 00 – 171 Notice of proposed rulemaking and
https://apps.fcc.gov/oetcf/eas/reports/GenericSearch.cfm
• WiMAX Forum Spectrum and Regulatory Database:
www.wimaxforum.org/resources/wimax-forum-spectrum-and-regulatorydatabase
• Wi-Fi certified products database:
www.wifi.org/certified_products.php
• Global Certification Forum (GCF)
http://www.globalcertificationforum.org/WebSite/public/home_public.aspx
5
……from WiMax Forum…
Conformity Assessment Testing Routes
ISO/IEC
assessment
procedures.
and
self
assessment
 Route 1: Accredited Testing Laboratories
 Route 2: Accredited Certification Bodies
 Route 3: Laboratories recognized by ITU A.5 qualified
SDO or Forum or Consortium and other Organization
signatory of an MoU with the ITU.
 Route 4: for ITU members only. Any 1st, 2nd or
party lab
3rd
Four routes to populate conformity DB
ISO/IEC Assessment Procedures
Conformity Assessment
& Certification
Route 1
Tests performed by
an accredited lab
(ISO/IEC 17025)
(Rec. ITU-T X.290)
Conformity
Certificate issued
by the test lab
Self-assessment Procedures
Route 2
Route 3
Route 4
Tests performed in
a lab agreed by an
Accredited
Certification Body
(ISO/IEC guide 65)
(Rec. ITU-T X.290)
Tests performed in
a lab selected by
an
ITU-T A.5 agreed
SDO/Forum/MoUs
(Rec. ITU-T X.290)
ITU Members Only
Tests performed in
a 1st, 2nd or 3rd
party lab.
Conformity
Statement issued
by the test Lab
Self-Declaration of
Compliance
issued by the
Supplier
Conformity Certificate
issued by the
Certification Body
ITU C&I
services
Declaration of
Conformity (SDoC)
(ISO/IEC 17050)
ITU Conformity
Database
Testing: Res. 76 &
Study Groups
 ITU-T Recommendations to address
interoperability testing shall be progressed
asap by the Study Groups
 Conformance and Interoperability testing
requirements shall provide for verification of
the parameters defined by the Study Groups
in ITU-T Recommendations
 ITU-T Study Groups develop the necessary
conformance testing ITU-T Recommendations
asap
C&I testing and
Recommendations
 Guidelines to harmonize C&I Study Groups test
development activities
 SGs experts to decide about Recommendations
eligible for development of C&I test suites and to
establish a Clause/Appendix for a “minimum set of
interoperability-related parameters” as needed
 Missing test suites to be developed by ITU Study
Groups experts even in coordination with other
SDOs
 Minimize as much as possible the need of external
resources and relevant funding sources to develop
test suites in case of unavailability for SGs’ experts.
Long-term Business Plan
KPMG
 KPMG: an independent worldwide known consultancy,
excellent credentials.
 Business plan based on the 4 “Pillars” and on the current
ITU activities and SGs’ expertise on testing development, on
capacity building opportunities and regional test centres
 The Business Plan is also addressing the impact that the
database on BGS and on the effect and potential liability
that it may have on Member States, Sector Members and
stakeholders such as other SDOs
 Possible future ITU Mark programme
11
Preparation Strategy (KPMG)
12
Some elements of the
Business Plan (KPMG)
 AS-IS Analysis
 SWOT and Gap Analysis
 Options and Risk analysis
 Human Resource Model
 Roadmap for 2012 – 2016
 Budget/Finance
13
The ITU Global C&I Portal
One-stop-shop
The ITU
Conformity Database
ICT laboratories
database
ITU Interoperability
Events
The ITU C&I
Programme
Concepts and
Guidance
Accreditation,
Certification, testing,
MRAs
www.itu.int/C&I
ITU Capacity Building
on C&I and Regional
Test Centres
Partnerships,
SDOs, Forums,
Consortia, International
Organizations
International
Telecommunication
Union
Risks To Act
•Resourcing update and maintenance of database and
version control
• Study Groups to develop test suites, consider those by other
SDOs. Filling gap of missing test suites
•Resourcing negotiation of partnerships and linkages with
interop test houses and use/access to test results
•Ability to effectively create needed expertise/capacity and
test labs in developing countries in a timely way
•Alienation of some sector members
15
Risks Not to Act
•Concerns from developing countries remain unaddressed,
•A fundamental ITU mission goal will be missed
•Members could go to competitive SDOs
•Continue the erosion of the ITU’s position due to lack of
the essential C&I elements in its program
•New Forums, SDOs and Consortia will be created to
compensate for the absence of ITU in this field
16
ITU Interop Events on IPTV
 1st Event: Geneva, ITU headquarters, 20-23
July 2010
 2nd Event: Singapore, 23-24 and 27
September 2010
 3rd Event: Pune, India, 14-17 December
2010
 4th Event: Rio de Janeiro, Brazil, 18-22 July
2011
International
Telecommunication
Union
International
Telecommunication
Union
The Telecommunication
Development Bureau Side
1.Capacity building
2.Establishment of test centres in developing
countries.
The Telecommunication
Development Bureau Side
Meeting in the regions on the four pillars with deep
consideration for test centres and Capacity
Building in the Regions
Held:
 Africa (Ghana)
 CIS (Moscow)
Next:
 Arab States
 Americas
Questionnaire on the status
of Conformance and
Interoperability of
Equipment and Systems
Three main groups
Group 1
Limited variety of equipment, services and providers
Group 2
Medium variety of equipment, services and a few
providers
Group 3
Wide variety of equipment, services and providers
Questionnaire: Overall results
 Highlighted the kind of non interoperability




problems and their impacts being experienced
in practice
food for thought as to what areas the ITU,
within its scope and mandate, can provide
assistance and relief
capacity building and access to expertise is an
essential ingredient
initiatives to promote the use of global testable
standards for product implementations
compliance and interoperability test events
welcome
Guidelines for Developing Countries for
Establishing Test Labs in Different Regions














Situation in the Regions
Needs in Developing Countries for Test Labs
Existing Test Labs and Scopes
Criteria to establish Accreditation Bodies and Test Labs
Steps to establish an ISO 17025 Compliant Test Lab
Potential role of MRAs and MRA Frameworks
Lessons Learned
Funding and Training Sources
Test Suite Development for C&I Testing
Role and Scope of International
Telecommunicatuions Testing Centres (ITTCs)
Operational Procedures for ITTCs
Equipment needed for Type Approval Testing
Economics and Cost Implications for ITTCs
Roadmap for ITTC rollout
25
Conclusions from Guidelines
The Guidelines will have the following suggestions, among others:
 Members to advise the ITU of interoperability problems,
their mitigation, and successful procedures that were helpful in the
process
 Members to establish market access requirements for telecom
equipment to avoid interference, network harm and safety of life
issues in their marketplace.
 Members to examine their existing legislation and regulations
to ensure that they enable participation in MRAs on Conformity
Assessment and testing with foreign partners
 Members to prioritize areas of concern related to
telecommunication products and systems
 Accreditation bodies in member states should become
signatories of the ILAC MRA or the IAF MLA.
 Regional groups such as the African region to develop a framework
MRA similar to the APEC TEL MRA or the Inter-American MRA
 Test centres should be established on a regional basis to take
advantage of the similar networks in a region with common
infrastructures
26
ITU Training activities on C&I
Dedicated exclusively to C&I
(http://www.itu.int/ITU-D/tech/events/index.html)
Workshop on NGN Conformity and
Interoperability Testing Centre(s), Nairobi
(Kenya), 2-4 August 2010
ITU Regional Seminar for the Africa Region
on Conformance and Interoperability Testing
Center(s), Accra (Ghana), 4-6 July 2011
ITU Regional Seminar for the CIS Countries
on Conformance and Interoperability Testing
Center(s), Moscow (Russian Federation, 911 November 2011
www.itu.int
http://www.itu.int/ITU-D/ams/CMS/index.asp
Thank You !
Long-term Business Plan:
KPMG Profile
KPMG a service provider independent from any suppliers or products,
ensuring an independent view and position.
KPMGs advisory services include a wide range of functional areas, such as
financial planning and international benchmarking, public sector
restructuring, human resource management and training, public financial
management and many others.
KPMG's Advisory services span the private sector, UN entities, NGOs and
other Civil Society Organizations, Governments and public sector entities as
well as multilateral and bilateral Aid Agencies
KPMG is a global network of professional services providing audit, tax and
advisory services through over 140‟000 industry-focused and talented
people in over 140 countries. .
29
Questionnaire: Fixed & Mobile networks
Group 1
Limited variety of
equipment,
services and
providers
Internet/IP Gateway services
2G and 3G GSM network services
Group 2
Medium variety of
equipment,
services and a few
providers
TDM voice, fax, international voice, data
Internet/IP ADSL, Cybercafe, VoIP
NGN Softswitch voice, data
2G voice, SMS local and international,
prepaid
3G international SMS, local SMS, data and
Internet
Group 3
Wide variety of
equipment,
services and
providers
TDM voice, data, ISDN
Internet/IP VoIP, data, email, wimax, metro
ethernet
NGN Softswitch voice, fax, ISDN
NGN IMS VoIP, digital fax
2G GPRS/EDGE, circuit switched data, voice,
SMS
3G HPSA + mobile broadband, voice, AMR-WB
voice, CS video call, SMS, R99 PS data
No equipment
listed in response,
referred/deferred
to service provider
for detailed
information
Tended to have a
dominant
equipment supplier
Tended to have a
wide mix of
suppliers
Questionnaire: C&I issues
Group 1
Limited variety
of equipment,
services and
providers
Reported no problems – likely single operator
Type Approval regime reported in place
No Type Approval responsible body
Marking – recognized either a body recommended by service provider
or well known Mark such as EC, FCC
No national accreditation, certification bodies or test labs, No MRAs,
No market surveillance , No ICT labs
Group 2
Medium variety
of equipment,
services and a
few providers
New equipment can affect legacy systems - Lists of interoperability
problems such as: signalling in core networks, CDR equipment
malfunctions, problems implementing new features on all platforms Impact of interoperability problems high, affects QoS, customer
satisfaction and loss of business - Pre installation activities carried out
to mitigate interoperability problems - Half of this Group have Type
Approval regimes - Half have Type Approval bodies -No national
accreditation and certification bodies, No MRAs -No market
surveillance
Group 3
Wide variety of
equipment,
services and
providers
Longer lists of interoperability problems such as: MSAN-Softswitch
conformity, ISDN support, IMS core, software features in general
Lists of economic impacts such as: additional costs, company image,
QoS, project delay, upgrade costs, extra testing costs
Pre installation work always done to mitigate interoperability
problems - Type Approval regimes in place -Type Approval Bodies in
place - Recognize EU, or FCC , or IC or all three Accreditation and
certification bodies in place as well as test labs
MRAs active - Market surveillance in place
Training and Capacity Building
Group 1
Limited variety
of equipment,
services and
providers
Interested in follow-up training/capacity
building related to WTDC 2010 Res 47,
WTSA 2008 Res 76, PP-10 Res177
Would participate in development of
Group 2
regional program in capacity building and
Medium variety expert tutorials
of equipment,
services and a Interested in opportunities to establish
few providers
national, sub-regional and regional test
centres
Group 3
Wide variety of
Availability of ICT Labs to host test
equipment,
events or ITU activities
services and
providers
USEFUL LINKS
 ITU C&I webpage www.itu.int/net/ITU-T/cdb
 ITU Interop events webpage: www.itu.int/interop
 The workshop on “Conformance and Interoperability of IPTV”
Pune, India, 17 December 2010
(http://www.itu.int/ITU-
T/worksem/iptv/201012/index.html)
 Photos on Flickr:
 1st Event
: http://www.flickr.com/photos/itupictures/sets/72157624558743282/
 2nd Event:
http://www.flickr.com/photos/malcolm_johnson/sets/72157625339461904/with/5158278770/

3rd Event:
http://www.flickr.com/photos/malcolm_johnson/sets/72157625959693676/
 ITU IPTV News log:
http://www.itu.int/ITU-T/newslog/CategoryView,category,IPTV.aspx
International
Telecommunication
Union
WTSA-08 Res. 76
 Res. 76: addresses the needs of Developing
Countries for conformance and interoperability.
 Conformity is a first step to increase the
probability of interoperability
 Identification of Labs able to carry out tests
according to the ITU-T Recommendations
requirements, and training programs
 Voluntary-based ITU program promoting
compliance to ITU-T Recommendations and
possible creation of an ITU-Mark
WTDC Resolution 47
Hyderabad, India, 2010
 Enhancement of knowledge and
effective application of ITU
Recommendations in developing countries,
including conformance and interoperability
testing of systems manufactured on the
basis of ITU Recommendations
 Essentially supporting and endorsing WTSA
2008 Resolution 76
ITU Plenipotentiary Resolution 177
(Guadalajara Oct 2010)
Conformance and interoperability
 Reiterated essence of WTSA 2008 Res 76
 Added: invites Sector Members to:
a. populate the pilot conformity database according
to procedures and criteria adopted by ITU-T
b. participate in ITU-facilitated interoperability events;
 Added : further invites Member States
to contribute to the next radiocommunication
assembly in 2012 in order for it to consider and take
appropriate actions as deemed necessary
The GCF – Certification explained
•
Manufacturers who certify their mobile devices to GCF rules and
procedures are assured that:
– their products will benefit from a high degree of
interoperability
– time-to-market for new products is reduced using this
respected 'one-stop' verification process
– expensive and time-consuming duplication of testing
effort can be avoided
•
With GCF's 'tested once, use anywhere' maxim, manufacturers
can significantly reduce the requirement for operator acceptance
testing if presenting GCF certified devices.
Another example…the GCF DB
The ITU Global C&I Portal
(one-stop shop)
 Basic C&I Concepts
o
o
o
o
The ITU C&I Governing Rules
Terminology
and
definitions
(Accreditation,
certification,
inspection,
calibration)
National Accreditation Bodies, MRAs and MLAs concepts
Test only what is needed for interoperability with any recognized test
procedures
 The ITU-T C&I Programme
o
o
o
o
o
The ITU approach to C&I and to ITU Conformity Database
The ITU Interop activities
Capacity Building opportunities and Regional Test centres
ITU Study Groups test suites development
Worldwide Testing Labs database
 Cooperation with ITU-T A.5 SDOs, International Institutions
and Organizations
o
ISO, IEC, (CASCO), ILAC/IAF, BIPM, UNIDO, WTO, Accreditation Bodies,
Regulators, ITU Laboratories repository, best practices for conformity testing
schemes and market surveillance
International
Telecommunication
Union