DOCUMENT #:
GSC15-PLEN-92
FOR:
Presentation
SOURCE:
ETSI
AGENDA ITEM:
Plenary 6.10
CONTACT(S):
Jorgen.friis@etsi.org
Conformance and Interoperability
Testing
Jørgen Friis
ETSI
Global Standards Collaboration (GSC)
GSC-15
Highlight of Current Activities (1/3)
 In 2009 12 Plugtests (standards validation) for
following TBs
• TC ATTM, TC AERO, TC ERM, TC ESI, TC GRID, TC INT, TC PLT,
TC TISPAN, TC MTS
 Nov 2009 – March 2010 the following events took
place
• GRIDS&CLOUDS Interop: linked to TC GRID (Dec 2009)
• EUROCAE Gateway: linked to TC AERO (March 2010)
• Femtocell Staging Event: linked to TCs TSPAN/NGN/3GPP (Nov
2009)
• Femtocell Main Event: linked to TCs TSPAN/NGN/3GPP (March
2010)
• CAT-iq Plugtests (June 2010) linked to TC-DECT
2
Highlight of Current Activities (2/3)
• EP eHealth: HITCH (Healthcare Interoperability
Testing and Conformance Harmonisation)
• TC ESI: (Trust-service Status List) conformance
testing
• TC INT: Completed development of interop and
conformance test specifications
• TC MTS (with TC SCP): Started EC STF for the
development of ePassport reader test platform
• TC TISPAN: Development of IMS-based
IPTV interoperability test specifications.
3
Highlight of Current Activities (3/3)
 Other Events organised by ETSI Center for Testing
and Interoperability (CTI)
• TTCN-3 User Conference, India (Nov 2009)
• GRID Workshop (Dec 2009) linked to interop event
• Security Barcamp (open discussion event, Jan 2010)
• TTCN-3 User Conference (T3UC), China (June 2010)
 CTI supported CONNECTATHON 2010
• (eHealth) April 2010
 FP7 Future Internet architecture
• MOSQUITO project under FIRE (Future Internet Research and
Experimentation)
4
Strategic Direction (1/2)
 Protocol Specification, Validation and Testing
• Supporting ETSI committees on the application of best technical
practices in standards on a daily basis
• Protocol specification (UML, ASN.1, MSC, XML etc)
• Build on many years experience
• Development of test specifications (conformance and
interoperability)
• Further develop Validation techniques in TC MTS
• Continued developing 3GPP LTE conformance test specifications
5
Strategic Direction (2/2)
 ETSI Interoperability testing (Plugtests™)
• Validation of standards and prototypes through interoperability
events
• Strengthen the organization of Plugtests™ www.etsi.org/plugtests
• Support interoperability for ETSI and other standards developed by
other organizations.
6
Challenges
 Aim is to validate standards
• Not implementations or products
• Give useful feedback (CRs) to relevant technical bodies

But testing and debugging are useful by-products!
• Achieve in one week
what would take months otherwise
A tool to develop and mature
standards
 Promote technology
and community
 Ensure Testing Expertise

7
Next Steps/Actions
 Plugtests™ Calendar 2010 on
• http://www.etsi.org/WebSite/OurServices/plugtests/cale
ndar.aspx
 IMS Interoperability Event 4
12-19 November 2010, Sophia Antipolis (FR)
XAdES/CAdES
25 October - 05 November 2010, Remote (FR)
GPON
11-15 October 2010, Sophia Antipolis (FR)
 CAT-iq #2
13-16 September 2010, Sophia Antipolis (FR)
8
Appendix
9
TC MTS (1/4)
 Evaluate available methods and techniques
for the advanced and/or formal specification
of standards with respect to efficiency and
quality and with particular regard to
testability,
TC MTS (2/4)
 Assist the ETSI Secretariat regarding ETSI
positions on Testing and Certification, both
internally and in relation with CEC initiatives,
such as mandates and the Conformance
Testing Services program;
 Give guidance on the use of selected
methods;
TC MTS (3/4)
 Provide methodologies for the specification
of standardized tests including formal
definition languages, definition of proformas
etc.;
 Specify the required environment for testing,
covering operational and procedural
aspects;
 Provide methodologies for the generation,
processing and verification of test suites;
TC MTS (4/4)
 Provide methodologies for the execution of
tests and analysis of results;
 Co-operate with e.g.ITU-T SG 10, European
Committee for IT Testing and Certification
CTS programs.