International Telecommunication Union TTCN-3 Amardeo Sarma Chairman, ITU-T Study Group 10 ITU-T and ITU-D Workshop Bangalore (India), 30-31 August 2001 Testing Specifications ISO/IEC-9646 Standard TPs Standardised Test Purposes (in English) ATS Standardised Abstract Test Suite (in TTCN) Standardised (Protocol) Implementation Conformance Statement (tables) IXIT ICS Standardised (Protocol) Implementation eXtra Information for Testing (tables) 31.05.2016 ITU-T and ITU-D Workshop - Bangalore (India), 30-31 August 2001 2 Typical Test Suites o o o o o o o o o o 31.05.2016 3G (3GPP) GSM GPRS TETRA TIPHON DECT IN, INAP ISDN, B-ISDN VB5 Etc. ITU-T and ITU-D Workshop - Bangalore (India), 30-31 August 2001 3 Typical Test Suites o Behaviour oriented • Layer 2 (e.g., Data link, MAC) • Layer 3 (UNI, RLC) • Supplementary Services o Data 0riented • IN, (INAP) • Data-oriented o IP Telephony • H.225, H.245, H.248, SIP and OSP 31.05.2016 ITU-T and ITU-D Workshop - Bangalore (India), 30-31 August 2001 4 Development of TTCN o Versions 1 and 2 developed by ISO SC21 WG3 (1984 - 1997) as part of the widelyused ISO/IEC 9646 conformance testing standard • ISO/IEC 9646-3 (edition 2) and ITU-T X.292 o Version 3 developed by ETSI TC MTS and ITU-T SG 10 (1998 - 2000) o Specialist Task Forces STF 133 & STF 156 31.05.2016 ITU-T and ITU-D Workshop - Bangalore (India), 30-31 August 2001 5 Kinds of testing to which TTCN-3 could be applied 31.05.2016 o Conformance o Interoperability o Configuration o Compatibility o Performance o Stress o Robustness o Integration o Functional o Load o Reliability o Fault tolerance o Scalability o Degraded mode o Unit o Product o Development o Design o Interface o System ITU-T and ITU-D Workshop - Bangalore (India), 30-31 August 2001 8 Main Capabilities of TTCN-3 o Dynamic concurrent testing configurations o Various communication mechanisms (synch and asynch) o Data and signature templates with powerful matching o o o o o o o o 31.05.2016 mechanisms Specification of encoding information Display and user-defined attributes Test suite parameterization Test case control and selection mechanisms Assignment and handling of test verdicts Harmonized with ASN.1 Different presentation formats Well-defined syntax, static semantics and operational semantics ITU-T and ITU-D Workshop - Bangalore (India), 30-31 August 2001 9 The Core Language Text format o Core format is a text Tabular Format TTCN-3 Core Language Graphical Format Presentation Format3 o o o o Presentation Formatn 31.05.2016 o based language Core can be viewed as text or in various presentation formats Tabular format for conformance testing Graphical format for visual overview Other standardized formats in the future Proprietary formats ITU-T and ITU-D Workshop - Bangalore (India), 30-31 August 2001 10 Use With Other Languages ASN.1 Types & Values Other types & Values2 Other types & Valuesn 31.05.2016 o TTCN can be TTCN-3 Core Language integrated with other 'type and value' systems o Fully harmonized with ASN.1 (1997) o Harmonization possible with other type and value systems (possibly from proprietary languages) ITU-T and ITU-D Workshop - Bangalore (India), 30-31 August 2001 11 Major Elements of TTCN-3 o Built-in and user-defined TTCN-3 Core Data Types Test Data Test System Architecture Test Behaviour 31.05.2016 generic data types (e.g., to define messages, service primitives, information elements, PDUs) o Actual test data transmitted/received during testing o Definition of the components and communication ports that are used to build various testing configurations o Specification of the dynamic test system behaviour ITU-T and ITU-D Workshop - Bangalore (India), 30-31 August 2001 12 Example Core (Text) Format function PO49901(integer FL) runs on MyMTC { L0.send(A_RL3(FL,CREF1,16)); TAC.start; alt { [] L0.receive(A_RC1((FL+1) mod 2)) { TAC.cancel; verdict.set(pass) } [] TAC.timeout { verdict.set(inconc) } [] any.receive { verdict.set(fail) } } END_PTC1() // postamble as function call } 31.05.2016 ITU-T and ITU-D Workshop - Bangalore (India), 30-31 August 2001 13 Example Tabular Format Test Case Definition Name : MyTestcase Group : Purpose : Example Testcase System I/f : MTC Type : MyComponentType Comments : Name Type Initial Value MyVar INTEGER 0 Behaviour Definition Comments Comments alt { [ ] MyPort.receive(Msg); [ ] : } DetailedComments: 31.05.2016 ITU-T and ITU-D Workshop - Bangalore (India), 30-31 August 2001 14 Example Graphical Format 31.05.2016 ITU-T and ITU-D Workshop - Bangalore (India), 30-31 August 2001 15 Use of TTCN-3 for XML Tests o Open Settlement Protocol (OSP) • EP TIPHON XML-based protocol • work on test specs. will start mid-April (STF 176) • will use TTCN-3 (Core Language) o 3GPP • currently extensively using TTCN-2 • initially will use TTCN-3 for testing XMLbased protocols • work on test specs. will start 2002 31.05.2016 ITU-T and ITU-D Workshop - Bangalore (India), 30-31 August 2001 16 Contact details o TTCN Rapporteur Prof. Dieter Hogrefe • hogrefe@itm.mu-luebeck.de o SG10 WP2 Chairman Ostap Monkewich • ostapm@nortelnetworks.com o ETSI PEX • pex@etsi.fr o Web • http://www.itu.int • http://www.etsi.org/ptcc 31.05.2016 ITU-T and ITU-D Workshop - Bangalore (India), 30-31 August 2001 18