TTCN-3 Amardeo Sarma Chairman, ITU-T Study Group 10 International Telecommunication Union

advertisement
International Telecommunication Union
TTCN-3
Amardeo Sarma
Chairman, ITU-T Study Group 10
ITU-T and ITU-D Workshop
Bangalore (India), 30-31 August 2001
Testing Specifications
ISO/IEC-9646
Standard
TPs
Standardised Test
Purposes (in English)
ATS
Standardised
Abstract Test Suite
(in TTCN)
Standardised (Protocol) Implementation
Conformance Statement (tables)
IXIT
ICS
Standardised (Protocol) Implementation
eXtra Information for Testing (tables)
31.05.2016
ITU-T and ITU-D Workshop - Bangalore (India), 30-31 August 2001
2
Typical Test Suites
o
o
o
o
o
o
o
o
o
o
31.05.2016
3G (3GPP)
GSM
GPRS
TETRA
TIPHON
DECT
IN, INAP
ISDN, B-ISDN
VB5
Etc.
ITU-T and ITU-D Workshop - Bangalore (India), 30-31 August 2001
3
Typical Test Suites
o Behaviour oriented
• Layer 2 (e.g., Data link, MAC)
• Layer 3 (UNI, RLC)
• Supplementary Services
o Data 0riented
• IN, (INAP)
• Data-oriented
o IP Telephony
• H.225, H.245, H.248, SIP and OSP
31.05.2016
ITU-T and ITU-D Workshop - Bangalore (India), 30-31 August 2001
4
Development of TTCN
o Versions 1 and 2 developed by ISO SC21
WG3 (1984 - 1997) as part of the widelyused ISO/IEC 9646 conformance testing
standard
• ISO/IEC 9646-3 (edition 2) and ITU-T X.292
o Version 3 developed by ETSI TC MTS and
ITU-T SG 10 (1998 - 2000)
o Specialist Task Forces STF 133 & STF 156
31.05.2016
ITU-T and ITU-D Workshop - Bangalore (India), 30-31 August 2001
5
Kinds of testing to which
TTCN-3 could be applied
31.05.2016
o Conformance
o Interoperability
o Configuration
o Compatibility
o Performance
o Stress
o Robustness
o Integration
o Functional
o Load
o Reliability
o Fault tolerance
o Scalability
o Degraded mode
o Unit
o Product
o Development
o Design
o Interface
o System
ITU-T and ITU-D Workshop - Bangalore (India), 30-31 August 2001
8
Main Capabilities of TTCN-3
o Dynamic concurrent testing configurations
o Various communication mechanisms (synch and asynch)
o Data and signature templates with powerful matching
o
o
o
o
o
o
o
o
31.05.2016
mechanisms
Specification of encoding information
Display and user-defined attributes
Test suite parameterization
Test case control and selection mechanisms
Assignment and handling of test verdicts
Harmonized with ASN.1
Different presentation formats
Well-defined syntax, static semantics and operational
semantics
ITU-T and ITU-D Workshop - Bangalore (India), 30-31 August 2001
9
The Core Language
Text format
o Core format is a text
Tabular
Format
TTCN-3
Core
Language
Graphical
Format
Presentation
Format3
o
o
o
o
Presentation
Formatn
31.05.2016
o
based language
Core can be viewed as
text or in various
presentation formats
Tabular format for
conformance testing
Graphical format for
visual overview
Other standardized
formats in the future
Proprietary formats
ITU-T and ITU-D Workshop - Bangalore (India), 30-31 August 2001
10
Use With Other Languages
ASN.1 Types
& Values
Other types
& Values2
Other types
& Valuesn
31.05.2016
o TTCN can be
TTCN-3
Core
Language
integrated with other
'type and value'
systems
o Fully harmonized with
ASN.1 (1997)
o Harmonization
possible with other
type and value
systems (possibly from
proprietary languages)
ITU-T and ITU-D Workshop - Bangalore (India), 30-31 August 2001
11
Major Elements of TTCN-3
o Built-in and user-defined
TTCN-3 Core
Data Types
Test Data
Test System
Architecture
Test
Behaviour
31.05.2016
generic data types (e.g., to
define messages, service
primitives, information
elements, PDUs)
o Actual test data
transmitted/received during
testing
o Definition of the components
and communication ports
that are used to build
various testing configurations
o Specification of the dynamic
test system behaviour
ITU-T and ITU-D Workshop - Bangalore (India), 30-31 August 2001
12
Example Core (Text) Format
function PO49901(integer FL) runs on MyMTC
{
L0.send(A_RL3(FL,CREF1,16));
TAC.start;
alt {
[] L0.receive(A_RC1((FL+1) mod 2)) {
TAC.cancel;
verdict.set(pass)
}
[] TAC.timeout {
verdict.set(inconc)
}
[] any.receive {
verdict.set(fail)
}
}
END_PTC1() // postamble as function call
}
31.05.2016
ITU-T and ITU-D Workshop - Bangalore (India), 30-31 August 2001
13
Example Tabular Format
Test Case Definition
Name
: MyTestcase
Group
:
Purpose
: Example Testcase
System I/f
:
MTC Type
: MyComponentType
Comments
:
Name
Type
Initial Value
MyVar
INTEGER
0
Behaviour Definition
Comments
Comments
alt
{
[ ] MyPort.receive(Msg);
[ ]
:
}
DetailedComments:
31.05.2016
ITU-T and ITU-D Workshop - Bangalore (India), 30-31 August 2001
14
Example Graphical Format
31.05.2016
ITU-T and ITU-D Workshop - Bangalore (India), 30-31 August 2001
15
Use of TTCN-3 for XML Tests
o Open Settlement Protocol (OSP)
• EP TIPHON XML-based protocol
• work on test specs. will start mid-April (STF
176)
• will use TTCN-3 (Core Language)
o 3GPP
• currently extensively using TTCN-2
• initially will use TTCN-3 for testing XMLbased protocols
• work on test specs. will start 2002
31.05.2016
ITU-T and ITU-D Workshop - Bangalore (India), 30-31 August 2001
16
Contact details
o TTCN Rapporteur
Prof. Dieter Hogrefe
• hogrefe@itm.mu-luebeck.de
o SG10 WP2 Chairman
Ostap Monkewich
• ostapm@nortelnetworks.com
o ETSI PEX
• pex@etsi.fr
o Web
• http://www.itu.int
• http://www.etsi.org/ptcc
31.05.2016
ITU-T and ITU-D Workshop - Bangalore (India), 30-31 August 2001
18
Download