The Signalling Programme Fjernbane Infrastructure East/West Concept on the JOINT TEST LABORATORY. Banedanmark Signalling Programme Amerika Plads 15 DK-2100 Copenhagen Ø Denmark Document1 Version 1.0 Author: Fjernbane Signalling System Project. Mail: fjernbane@bane.dk Phone: +45 8234 0000 Phone direct: www.banedanmark.dk Page 2 of 37 Joint Test Lab Concept Table of Contents Page 1 Executive Summary 7 2 Open Issues 9 3 3.1 Introduction and Purpose Introduction 10 10 4 4.1 4.2 4.3 4.4 4.5 4.5.1 4.5.2 4.5.3 4.6 4.6.1 4.7 4.8 4.8.1 4.8.2 4.8.3 4.9 4.10 4.11 4.11.1 4.11.2 4.11.3 4.11.4 4.12 4.13 The Joint Test Lab Guiding Principles for the JTL Core Objectives of the JTL Secondary Objectives of the JTL Stakeholders Key Roles within the JTL Customer Suppliers Third parties Delivery Constraints Schedule Proposal Preconditions JTL Practicalities Building & Utilities Fitment & Facilities People Lifecycle of the Joint Test Lab Management of Processes Architecture and Testing Scope System Level Subsystem Level Product Level LRU level Types of Tests Type of Demonstrations 13 13 14 15 16 17 18 18 20 20 20 22 23 23 26 28 28 30 31 31 32 32 33 33 35 5 Conclusion 36 Document1 Version 1.0 Page 3 of 37 History Made by Version Commented by Approved by Status XRZL 1.0 GULO, JHM, GULO Concept paper approved. 2011-06-15 LGRN. PBJ, REGA, XDIS, XBDA, XGER, XTGJ. Document1 Version 1.0 Page 4 of 37 Input documents [1] Email from XCLA referencing existing Contract Clause on JTL. 11.02.11 [2] Interoperability Assessment Modules and Process. SP-12-025541. XSMU. 16.03.11. [3] XTGJ Minutes from Infrastructure & Onboard Workshop. 16.02.11. [4] Criteria for the ERTMS Laboratories, v5. (http://www.era.europa.eu/DocumentRegister/Documents/Criteria for ERTMS reference labs v5 (2).pdf ).19.10.09 [5] Document1 Version 1.0 Page 5 of 37 Abbreviations ATC BAFO BDK CA CAB CCTV CSD ERA ERTMS ESB ETCS EVC GPRS GPS GSM-R HHT ISA IXL JRU JTL KMC KMS MMI NDA NoBo NSA PC PSD QMS RAMS RBC SP STM TCC TMS TOC1 TSI UNISIG UPS VoIP Automatic Train Control “Best and Final Offer” Banedanmark Certification Authority Short for “cabin” Closed Circuit Television Circuit Switched Data European Rail Agency European Rail Traffic Management System Enterprise Services Bus European Train Control System European Vital Computer General Packet Radio Service Global Positioning System Global System for Mobile Communications – Rail(way) Hand Held Terminal Independent Safety Assessor Interlocking Juridical Recording Unit Joint Test Lab Key Management Centre Key Management System Man Machine Interface Non Disclosure Agreement Notified Body National Safety Authority Personal Computer Packet Switched Data Quality Management System Reliability, Availability, Maintainability and Safety Radio Block Centre Signalling Programme Specific Transmission Module Traffic Control Centre Traffic Management System Train Operating Company Technical Specification for Interoperability Union Industry of Signalling Uninterruptible Power Supply Voice over Internet Protocol See also the: - Glossary List of the Signalling Programme - Glossary of UNISIG Terms and Abbreviations (Unisig subset 023 [14]) 1 Document1 Version 1.0 TOC is a Signalling Programme term. In directives etc. the official term is Railway Undertaking (RU). Page 6 of 37 1 Executive Summary The Joint Test Laboratory (JTL) is an initiative from the Customer in recognition of the manifold benefits it presents to mitigating technical and schedule risks to the Fjernbane Infrastructure and Onboard projects. Consequently it presents an opportunity for considerable cost savings. The JTL is a fundamental part of the Fjernbane Infrastructure and Onboard test strategies. It mitigates risk to the projects by providing an easily accessible location to the Suppliers, the Customer as well as relevant third parties e.g. the NSA and TOCs to either undertake or witness a test campaign. The JTL does not substitute the Supplier’s test facilities or obligations. In addition, it will be possible for the Customer as well as the peer-supplier (i.e. the West counterpart for the East Supplier and vice-versa) to observe and ensure fitment with the counterpart system - thus ensuring an effective interface management regime and end-toend system functionality. This possibility is also shared with the ETCS Onboard System and the GSM-R / GPRS suppliers. Primarily, the JTL helps the Customer achieve a fully integrated and functional solution that is uniform and seamless as far as is possible across solutions as provided by the East and West suppliers as well as the Trainborne System Supplier respectively. Furthermore, the JTL is anticipated to contribute hugely towards gaining the confidence in the system that in conjunction with the test campaign on the Early Deployment line will lead to significant time and hence financial savings at the point of roll-out of the System across Denmark. The co-location of the JTL members provides scope for close collaboration. This yields benefits regarding identifying and resolving system issues that impact on functionality, operation or maintenance – (for example by making use of test scenarios and playback of recorded data). Co-location also provides opportunity for Customer and Supplier personnel to gain and consolidate familiarity with the system components and associated installation, diagnosis and maintenance equipment and methodology. The Customer also recognises the close coupling between Joint Testing facilities and Joint Design. Though the former can proceed without the latter, creating a JTL also provides an environment where design options and early optimisation (through a controlled iteration process) can occur more rapidly and efficiently - once again owing to the co-location of the stakeholders and the relative ease of access to the products that constitute the System. After System handover and project closure, the JTL has potential to continue as part of the operational system. It will hold the current baseline of the East and West deliveries as well as access to the configuration history of hardware and software components as well as continue to provide the simulation facilities that can be used either for specialised training (e.g. of maintenance staff ) or for scenario investigation purposes. In addition, any new upgrades can be fully tested both within and across systems, to ensure compliance, compatibility and interoperability of the proposed changes. Naturally to ensure the efficient use of the JTL, the Customer acknowledges that a range of technical, operational and strategic management processes and procedures are called for. Chief amongst these procedures and processes is arguably the “Configuration and Change-Management” process, as it will be exercised throughout the lifecycle of the JTL. Further possibilities lie in the JTL becoming an ‘Accredited Lab’ as discussed in the Technical Specifications for Interoperability and detailed in the ISO standard 17025. Document1 Version 1.0 Page 7 of 37 This paper recognises more analysis, consultation and strategic commitment based on a recognised Quality Management System and peer-reviewed competence-building is called for, in order for this potential to be achieved. It would also require organisational separation from Banedanmark and ultimately, the SP. On balance, this paper concludes that this specific aim is therefore not a core objective for the JTL. Finally, the JTL can only perform optimally and provide the anticipated benefits to the Fjernbane projects, if an investment is made in developing the supporting management procedures - in parallel to the technical infrastructure. Document1 Version 1.0 Page 8 of 37 2 Open Issues No open issues are identified within this version of the document. 1. Document1 Version 1.0 No Open Issues. Page 9 of 37 3 Introduction and Purpose The purpose of this document is to explore, develop and present the range of ideas and issues that arise from the Customer initiating and developing a Joint Test Laboratory (JTL). The JTL will be employed as part of the overall effort required in delivering a fully functional and integrated Fjernbane overall System, incorporating both the Infrastructure and Onboard systems. The JTL is an integral part of the test strategies for both these projects. The JTL will create the required collaboration between the Fjernbane Infrastructure System (FbIS) Suppliers, the Onboard system supplier, the GSM-R / GPRS suppliers as well as the Customer - in order to identify, evaluate and mitigate technical and operational risks to the Overall System. This document discusses the introduction of the JTL but also follows up by considering how the role of the JTL will evolve and change as both the project and the System complete their lifecycles. Consequently, the concepts and ideas within this document can be used to formulate requirements and actions towards the FbIS suppliers but also the Onboard System Supplier. Furthermore, the contents of this document also identify and address issues that the Customer will need to resolve to prepare the way for a successful JTL environment. 3.1 Introduction The Customer will establish a JTL. Whereby in cooperation with the various suppliers of the systems that make up the Overall Fjernbane Infrastructure System (hereafter discussed as the Overall System), the JTL shall contain the latest representation of the integrated hardware and software components from all the suppliers – i.e. Fjernbane East, Fjernbane West, and the Onboard systems respectively. The components will be baselined and hence in a state that they can be tested meaningfully in test cases that demonstrate the maturity, interface readiness and end-toend functionality of the overall system. This means the JTL is an important step between testing at the supplier’s labs and testing on the running railway. In the early stages of the Fjernbane projects, where components are still undergoing design iterations, the JTL will contain more simulation components based on running prevalidated software programmes. But the JTL in fact must rely on simulation engines to compensate for limitations, such as not having real trains running (on demand) over real rails. But in so far as is practicable, over time, the Simulation engines will make way for real products of increasingly mature and finalised representation. Document1 Version 1.0 Page 10 of 37 This above indicates that the JTL is foreseen to play a role in the Joint Design activities planned by the Customer to achieve common and seamless functionality between (and across), critical system components employed in the FbIS east and west deliveries. This applies for example to the hand-held terminals, the dual-mode Balises (i.e. Balises supporting GPRS for ETCS), the on-line Key Management System etc. Furthermore, it also applies to the delivery of the ETCS Onboard System. As ERTMS test labs already exist and all the ETCS suppliers claim to have Lab facilities to undertake and support factory testing, one may wonder why the Customer is pursuing test lab facilities. The answer lies in the benefits foreseen by the Customer through the creation of a Joint Test Laboratory environment, owned and administrated by the Customer. In this way, the Customer can provide an arbitration role as well as an environment that (because it houses all the offered systems making up the FbIS), offers the valuable advantages of proximity, visibility and co-location of people and equipment such that it can speed up identification, prioritisation and resolution of any issues that are discovered. In this way, the technical risk and its components are considerably diminished and can then translate to more confidence in delivering the Overall System. Hence the JTL is foreseen by the customer as a locus of installation, Test & Commissioning, maintenance, Diagnostics as well as Configuration & Release management activities - in conjunction with other engineering processes that together demonstrate the viability of the overall System. This demonstration not only offers the evidence to the Customer but also to key third parties such as the independent assessors, NoBos and the National Safety Authority (NSA). The Customer appreciates that the JTL is not an alternative to testing conducted in-situ on the running line but rather a strong complimentor that proves the System ready for line testing – thereby avoiding waste of costly resources. Conducting line testing only once the systems are proven in the JTL also mitigates those basic problems such as interface matching or hardware / software configuration matching. Such problems are indeed much easier to resolve within a lab environment, (making use of real products) rather than on the line, normally under ‘possession-window’ time pressure. Subject to final planning and agreement, the Customer deduces that the JTL must be ready at the start or as early as possible within the design phase pertaining to the Onboard Contract – as this is in the lead with respect to the time schedule. Fulfilling this will allow timely and effective participation of the Customer with the Supplier, but in addition allow effective participation of all stakeholders in the Joint Design exercise. Having the Lab available as early as possible maintains the interoperability and integration design criteria at prominent visibility whilst delivering the respective projects. Issues can rapidly be discovered and can therefore be addressed a lot sooner in the lifecycle. Document1 Version 1.0 Page 11 of 37 This notion is the cornerstone of the so called “Iterative Confidence Growth Model” for making best use of the JTL as the projects develop. In basic terms, the model follows the following steps for a product to be used as part of the overall System: 1. The Suppliers complete prototyping of products with input from the Project team. 2. Subject to the needs for proprietary factory environment testing, Prototype testing is then completed in the end-to-end environment of the JTL (i.e. Joint Lab FATs). 3. JTL integration testing (i.e. basis for Site Integration Testing on the Early Deployment Sections). 4. Initiating Early Deployment Sections (EDS) with extensive nightly testing – leading to the fine tuning of the JTL as a result of validation on the real line as well as Site Acceptance Test (SAT) results. 5. EDS operations - leading to further fine tuning of the JTL as required by changes in Configuration / Release status of the Overall System or its components. 6. JTL holds strictly controlled System Baselines – used as the reference / demonstration of engineering for the roll-out lines. 7. Roll out of the System on the remainder of the railway network. This stage benefiting from reduced-line-testing as a result of confidence gained through earlier steps. Document1 Version 1.0 Page 12 of 37 4 The Joint Test Lab 4.1 Guiding Principles for the JTL The following points articulate the guiding principles from the perspective of the BDK Signalling Programme with respect to the JTL. They are further expanded and elaborated within specific subsections of the document below. 1. The JTL will be established by the BDK SP Fjernbane Infrastructure Project utilising a sub-project to deliver the JTL. 2. The JTL will be used both within the lifecycle of the Fjernbane Projects (i.e. up to formal project closure, once System Commissioning and Handover is completed) and also within the Operational life of the Overall System. This sets the Operational lifetime of the JTL up to the year 2046. 3. The JTL and its contents are the property of BDK – throughout its Operational lifetime. 4. The JTL provides mitigation of technical risk that in turn mitigates project delivery risk. 5. The JTL will act as a common and co-located platform representing both the FbIS East and West deliveries from the two respective suppliers as well as the Onboard Supplier. 6. The JTL project will be responsible for providing a location for the JTL in the greater Copenhagen Area with appropriate coverage from the BDK GSM-R / GPRS network. 7. The JTL project will also be responsible for providing the interface to the BDK FTN and the ESB. 8. The JTL project will ensure its delivery milestones are arranged in such a way as to provide overall benefit to the FbIS project by being able to provide testing and simulation facilities to the FbIS project and the Onboard project. This includes the infrastructure to conduct “Joint Lab FATs” – already specified as programme milestones to coordinate deliveries between the individual Suppliers. 9. The JTL testing and simulation facilities will be provided through representative sets of integrated hardware and software provided by the FbIS East and West as well as the Onboard Suppliers respectively. 10. The JTL will provide an environment demonstrating the current baselined overall System (across Suppliers), as well as the test platform for testing SW and / or HW upgrades related to all or any of the constituent systems. 11. The Integrated Hardware and Software representing the current baselined System, will be subject to configuration management processes – including “change”, “approval”, “acceptance” and “release” principles. 12. Prior to ‘final handover and acceptance’ of the FbIS by BDK, the JTL will be used to support and demonstrate results for system testing and usability which in turn provide the necessary evidence to achieve the NSA approvals and the Customer acceptance of the offered systems. 13. Post ‘final handover and acceptance’ the JTL will be maintained by BDK and will continue to be used to demonstrate the baselined versions of the overall FbIS systems as well as act as a repository for all previous baselines and interim configuration builds. Document1 Version 1.0 Page 13 of 37 14. Post ‘final handover and acceptance’ the JTL will be maintained by BDK and will continue to provide Simulation facilities for the FbIS East and West Systems, as well as the Onboard System. 15. The JTL will be treated as an asset for BDK and will be subject to management processes commensurate with the stage of the lifecycle it has reached. 16. The JTL management processes will be owned and implemented by BDK. 17. Where possible, the JTL subproject will endeavour to reduce JTL lifecycle costs by seeking to share or lease resources such as building facilities, furnishings, telecommunication facilities, specialist lab software and tools over the JTL operational lifetime. 18. An independent management infrastructure will be created and equipped with corresponding management processes to ensure the continued benefit of the JTL through its lifecycle. 4.2 Core Objectives of the JTL Core Objectives determine the core activities that will be undertaken within the JTL. The rationale of these activities is such that once completed, confidence will be achieved in the systems being delivered by the various suppliers and the reliable interaction with each other. This factor puts the focus on the “project phase” of the JTL lifecycle, regarding the majority of the core objectives. The assumption therefore, is that once a working overall system is delivered, any further changes, modifications or upgrades will be both backward compatible and under strict configuration management. This way, should a (proposed) change destabilise the baselined working overall system, the JTL would “discover” this risk as a result of the mandatory testing and hence prevent the proposed change from impacting the operational railway until it is properly resolved. The rationale for the above argument is that once the overall system is proven, it is a question of maintaining the interoperability achieved across the Eastern and Western deliveries - in conjunction with remaining interoperable with the trainborne subsystem. In fact, as the scope of the Overall System goes beyond ERTMS systems – where the term “Interoperability” has gained a reserved meaning, it would be correct of this paper to use the term “Intraoperability” of all Systems that have a role to play within the Overall System. The core objectives for the JTL are hence proposed as follows: 1. Supporting the Joint Design process 2. Exercising the System solutions through trial and feedback processes 3. Minimise risk and cost exposure arising from conducting tests on the line-side. 4. Use the JTL for test campaigns to iteratively grow the confidence in the System, such that the testing evidence contributes to the NSA Approvals and Customer Acceptance of the delivered solutions. 5. Demonstration of Products , Tools and Methodology 6. Demonstration of Interface, functional, and non–functional behaviour. Document1 Version 1.0 Page 14 of 37 7. Demonstrate the progressive maturity and completeness for the novel design elements of the delivered System – (e.g. Online Key Management, GPRS based communication etc.) 8. Demonstration of the maturity of the Overall System design for the stage-gate review process 9. Be used to resolve Interoperability issues amongst the JTL members. 10. Compatibility testing and demonstration within and across delivered systems. 11. Conducting Validation campaigns on novel Traffic Management Processes across the Overall System. 12. Demonstrate the technical solution compatibility with the operational-rule set. 13. Contribute (mainly through simulation or analysis of real data), to the validation of ETCS configuration parameters. 14. Contribute to Safety Case elaboration / update - by the JTL acting as a source of reliable test evidence. 15. Contribute to validation of supplier Release Notes. 16. Allow interaction between technical, operational, maintenance and management staff. 17. Demonstrate a clear boundary between System builds and Releases both during project evolution and after formal acceptance and handover of the project. 18. Provide simulation and playback facilities either from recorded events (e.g. from JRU data) or from scenario configuration tools as part of Simulator engines. 19. Protect the Service level agreement goals by avoiding System errors progressing into the operational railway environment. 20. Act as the BDK in-house expert on interoperability and as such be able to confirm that overall system interoperability and compatibility is retained as the two infrastructure and the onboard subsystems are upgraded. 21. Retain an archive of hardware and software baselines and corresponding documentation (particularly in electronic format) to allow access to and demonstration of a particular baseline of the system - throughout its design lifecycle. 22. Provide validation (when necessary) of test results from other test laboratories given identical test cases and system configurations. 4.3 Secondary Objectives of the JTL Maintaining the continued interoperability of the overall system is the foundation for determining the secondary objectives of the JTL. Document1 Version 1.0 Demonstration of Baselines and application of Configuration management and Interface Register practises. “Sand box” environment for Maintenance practise to help maintenance staff gain confidence and familiarity with products, tools and processes. Access to Simulation environment for Maintainers and experienced Operational Staff. As opposed for general classroom / education purposes. Assist in defining the boundary for testing based on the idea of “regression testing”. Page 15 of 37 4.4 Stakeholders Over its lifecycle, the JTL has to satisfy a diverse range of interests and demands from a range of stakeholders. Although all stakeholders share the common interest, that is, to achieve and maintain an integrated and fully functioning end-to-end overall System solution, it is also recognised that stakeholders may hold specialised interests in the JTL. The table below lists the stakeholders contributing to and benefiting from the JTL as well as indicates sensitivity to the fact that stakeholders may hold specialised interests. Furthermore it is also important to note that specialised interests can be an ‘emergent property’ of interacting with the JTL and can therefore change in both nature and intensity over time. This fact suggests further management procedures, aimed at stakeholder management is required when employing the JTL. Stakeholder Document1 Version 1.0 BDK Certification Authority (NoBo) Civils Contractor European Rail Agency (ERA) Independent Labs e.g. CEDEX International Neighbours Other Supplier Labs (UNISIG Members) Others Supplier - East Supplier - Onboard Supplier - STM Supplier - West The Onboard project Specialised Interest Benefit from the JTL as a recognised national centre of excellence for ERTMS testing of Baseline 3 products. Early exposure to ERTMS system architecture and behaviour. Evidence base to progress assessment and certification tasks. None identified. Change request and / or Validation data Input. JTL can be source of real data on system behaviour completeness and performance against ETCS Specifications. Share Best practise on Test Cases and Tools and (perhaps) ensure market share is not “eroded” to another test lab. Ensure compatibility of technical and operational interfaces. Other Labs arguably offer an alternative test path to ensure ETCS interoperability issues do not arise. None identified. The progress and effective performance of peer suppliers. The progress and effective performance of peer suppliers. The progress and effective performance of peer suppliers. But also to verify STM operation in transitions to and from ETCS and using such results to reduce the safety-case documentation overhead. The progress and effective performance of peer suppliers. Ensure Onboard delivery is compatible with Infrastructure solutions from other UNISIG Page 16 of 37 Stakeholder The Signalling Programme TOCs – e.g. DSB Witnesses - e.g. NSA, G-ISA, Specialised Interest Suppliers. Also to: Perform Integration trials during Joint Design Phase. Run scenarios to validate equipment functions safely and correctly. Generate test based evidence to reduce the safety case overhead. Validate transition from ETCS baseline 2.3.0d to baseline 3 for the Onboard System. Validate transition to the national signalling system for train protection, by means of the respective STM solution for Denmark, Sweden and / or Germany being fully functional. Effective introduction of the JTL as well as ensuring maturity of processes such as Operational Rules are ready and available. Early exposure to System behaviour and input on end-user issues. Also to facilitate stakeholder processes for themselves and other groups such as trade unions, drivers etc. Early exposure to System behaviour and input on Safety-Approval / Safety-Case issues. As important as identifying the stakeholders, is identifying possible conflicts of interest or even grounds for potential conflict in accessing, using and responding to the JTL test campaign results. In response to this potential risk, we propose that management procedures are put in place as a precondition to initiating the JTL. The role of the management procedures is developed further in a specific subsection below. Within this document the term “JTL members” is used to describe the group of stakeholders consisting of the Customer and the individual suppliers. 4.5 Key Roles within the JTL The following subsections propose which activities within the scope of the JTL, will be led by the Customer, the Supplier and / or 3rd parties respectively. In other words, “who does what”. This section can, (once agreed by all JTL members), form the basis of a Work Breakdown Structure and hence a JTL project plan. This of course, requires time-schedules, durations and dependencies to be properly clarified. Document1 Version 1.0 Page 17 of 37 4.5.1 Customer The customer will lead the following activities and ensure coordination with other JTL members: 1. Initiate and establish the JTL building. 2. Facilitate access to the GSM-R network and eventually also access to the GPRS network. 3. Provide the interface to the FTN including Internet access authorisation from BDK IT. 4. Provide the interface to make use of the Enterprise Services Bus and / or other external interfaces. 5. Provide the necessary Insurance and liability cover 6. Facilitating the use of a “first-of-class” train equipped with both ETCS and STMDK. 7. Provide and maintain the utility infrastructure for the JTL. 8. Establish, agree and supervise the Management processes and procedures. 9. Establish and administrate the booking, access and use of the JTL for Customer, Supplier and third-party staff. 10. In collaboration with the other JTL members, establish the “Central Control Area” of the JTL based on agreed System interfaces. 11. Establish the benefit of, and thereafter source the lab specialised software and diagnosis tools that will facilitate the “trouble-shooting” and integration of the diverse solutions from the Suppliers. – This will help achieve the end-to-end functionality demonstration of the Overall System. 12. Coordinate and supervise the integration testing campaigns. 13. Review, validate and accept test documentation for such campaigns. 14. Arbitrate test results, actions and objectives amongst the JTL members. 15. Coordinate and supervise the resolution of System issues and / or anomalies. 16. Coordinate the involvement and witnessing of testing by 3rd parties, particularly the ISA, the NoBo and the NSA. 17. Coordinate and supervise the correct use of the System Interface Register as per information and data agreed with all the JTL Members. 18. Create and administrate the correct and effective use of a common ‘System Anomalies Database’ for the JTL members. 19. In collaboration with the other JTL members, lead the Escrow arrangements for managing software baselines. 20. Retain accountability for Overall System integration 4.5.2 Suppliers The Supplier is required to lead / assume responsibilities for the following activities: 1. Elaborate and present a System Integration Plan detailing preparation and use of the JTL. 2. Supply products and subsystems that are successfully factory tested and certified where applicable. 3. Provide current baselined hardware and software packages. 4. Install, test and commission integrated products within the corresponding Subsystem to build a representative and physically accurate instance of the Supplier’s delivery – including those parts that are allocated to the CentralControl-Area of the JTL. Document1 Version 1.0 Page 18 of 37 5. Install, test and commission “simulation engines” within the corresponding Subsystem - where a representative and physically accurate instance of the Supplier’s delivery is not practically possible within the JTL environment. 6. In collaboration with the Customer, assist in completing the “Central Control Area” of the JTL. 7. Contribute to the identification, evaluation, trial and adoption of any specialised lab software and / or diagnosis tools that improve the efficiency of the JTL efforts. 8. To ensure the successful interfacing of the overall System and having it represented within the JTL environment, undertake to provide the agreed interface and data protocols. 9. Configure and label all products, wiring, and interface junctions as agreed with and directed by the Customer. 10. Provide and Maintain the documentation corresponding to the Solution delivered. 11. In conjunction with the other JTL members, and relevant 3rd parties, participate in the Escrow arrangements for managing software baselines. 12. Undertake to maintain their respective part of the JTL in full working order in accordance with maintenance agreements currently in place. This may include providing maintenance training to a subset of Customer Staff and other such maintenance related requirements. 13. Ensure accuracy of Configuration Management Process Records. 14. Establish and deliver timely statements of formal product and System baselines by means of “Release Notes” or equivalent method as agreed with the Customer. 15. Ensure timely adherence to the change and configuration management process as agreed with and directed by the Customer. 16. Provide a “Test Engine” computer that (if necessary), in conjunction with a “Simulation Engine” computer, facilitates the choice for testing and / or playback scenarios - based on Software and data configuration parameters - applied to a specific hardware baseline. 17. Collaborate and cooperate with the Customer and peer suppliers in order to establish and maintain a JTL environment that supports end-to-end demonstration of the Overall System. 18. Participate in Overall-System Analysis and / or testing with a view to resolve functional, non-functional or interface based issues and / or anomalies. 19. Employ and contribute to the common System Anomalies Database. 20. At an agreed point in System Design maturity, and in collaboration with the Customer and other JTL members, undertake to demonstrate that the results achieved in the Lab may be validated by real line behaviour. 21. Subsequently and as agreed with the Customer, undertake to complete any required iteration to ensure that lab results are indeed valid and may (once approved and accepted) be used a sound platform to prepare line-side test campaigns. 22. Ensure adherence to the agreed Management Processes including Security, Access rights, Staff and / or Sub-supplier Management and Non-Disclosure agreements. 23. Provide tools, manuals and training to the Customer JTL members to ensure proficiency in using and exercising the delivered system. 24. Should the Supplier incorporate COTS products into the delivered System, then the Supplier will also ensure to also provide a copy of the corresponding device drivers as part of the Baseline package. Document1 Version 1.0 Page 19 of 37 25. Facilitate response and closure to input from third parties such as the TOCs, the ISA, the NoBo and the NSA. 26. In the event of the Customer exercising an option, then the Supplier will assist and participate in the new configuration of the JTL to represent the new baseline of the overall System. 27. Up to the point of formal handover, provide the requisite human resources to ensure the JTL remains operational and up-to-date with respect to the delivered system representation. 28. Comply with JTL management procedures. 4.5.3 Third parties The following activities will be allocated to 3rd parties: Witness test results either with an assessment viewpoint or certification viewpoint. Validate the “release” and “acceptance” documentation sets, with a view to provide “Approvals” Comply with JTL management procedures. 4.6 Delivery Constraints At a global level, the JTL can only play its part fully if it is established and delivered in time to assist with the Joint Design Phase of the Fjernbane Infrastructure and Onboard projects. As the JTL will accommodate equipment from all the Fjernbane Projects and as the Contract will be let for the Onboard project approximately 3 months before the Infrastructure projects, availability of the JTL is more critical for accommodating the Onboard schedule. However, it is prudent to avoid unnecessary dependency amongst the projects that may create “artificial” time pressure on delivering the JTL. One example of this, is the Onboard objective of using the ETCS 2.3.0d baseline – which in fact is out of scope for the Fjernbane infrastructure projects. Hence this would suggest a convergence on using JTL facilities not on the availability of 2.3.0d products but rather on the design activities for the baseline 3 product range. This argument is the basis for the proposed JTL commissioning date as discussed in the section below. 4.6.1 Schedule Proposal The date for the Onboard System’s preliminary design requirements to be in place is scheduled for 01-May-2012, whilst agreement on the Joint Test Lab facilities with respect to the Conceptual Design, is scheduled for the 30-March-2012. Treating this as the Document1 Version 1.0 Page 20 of 37 ultimate delivery date for the JTL, implies a “commissioning” date in the first quarter of 2012. As a working assumption for the purpose of this document, the 30-March-2012 is nominated. However, as the following high level time plan demonstrates, applying some logical and reasonable durations and dependencies suggests a more realistic commissioning target (at the earliest) to be circa 01-July-2012. An accelerated and / or intermediate delivery plan can still be explored at the point of formally initiating the JTL subproject and once it is more clear what assistance can be provided by the System Supplier’s and by when. This means that the following time-plan schematic can be expected to undergo further detailing and logic and there is every chance this will alter the proposed JTL commissioning date. Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 2011 2011 2011 2011 2012 2012 2012 2012 Secure budget for JTL establishment Secure budget for JTL upkeep Establish recruitment plan Recruit JTL Manager Recruit JTL Staff Conduct and Complete JTL training for staff Find JTL premises Create JTL Management Processes Furbish / refurbish premises to accommodate JTL needs Connect Facilities Install Furniture and Fittings Commission Facilities and Infrastructure – including any access to lab specialised software / common diagnosis tools Introduce Suppliers to JTL and Issue Access Keys / Fobs Begin to Install, Test and Commission representative solutions from Suppliers Prepare Documentation Library Handover from Suppliers to BDK of iterative, Solution-Baselines, including corresponding documentation Commission JTL Document1 Version 1.0 Page 21 of 37 4.7 Preconditions Further to the ‘Schedule Proposal’ above, this subsection lists and explains the entities that must be prepared and / or resolved in order to ensure a smooth delivery of the JTL. Also, and equally importantly, allow for the JTL to be used for its intended purposes. The preconditions to smoothly delivering the JTL are proposed as follows: 1. Human Resources. The JTL requires the appropriate professionals with the relevant competencies to deliver, administrate and manage the JTL and its services. 2. Management Practise. Efficient processes and procedures must be put in place to manage the flow of people, products and data that enters and / or leaves the JTL. (Amongst others, this document has highlighted the need for strong change and configuration management processes for example). 3. Clear Test strategy. An agreed approach to the scope of JTL testing including when and how this will come about with respect to project stage-gates and other milestones. The test strategy will be based on the “iterative confidence growth” model as discussed in the introduction section of this paper. 4. Agreed Baseline approach. An agreed approach to both the ETCS product baseline that will be introduced as well as a transparent approach on how the suppliers will manage respective system evolutions. 5. Baseline 3 Products roadmap available. This factor aims at understanding when baseline 3 products will become available and how we can ensure readiness for the customer environment (including the JTL) as efficiently as possible. Not least, this will require a level of coordination between the Suppliers, from the Customer. 6. Location. The physical location and characteristics of the JTL must be established. Consequently issues such as Access rights, Security, Logistics etc can be developed and resolved. 7. Building Fitment and Furniture. Clear understanding and consensus on infrastructure, dimensions and quantities to be agreed. 8. Establishment of Services, Utilities and Facilities as well as the access to External Interfaces. Topics include: - Power, - UPSs, - Heating /Cooling /Ventilation / Fire-Protection, - FTN, - GSM-R and eventually GPRS coverage - IT, - Security, e.g. CCTV - including archiving and playback systems - GPS Antenna with external mast mounting - Telephones, or as is most likely, VoIP Communication technology (e.g. Office Communicator) running on PCs need to be sourced and activated. 9. Apportionment of Space within the JTL. Endeavour (as far as practical building limitations allow), to create a working space that caters for: - Common Zones – including the “Test Control Area”, thereby allowing the JTL members to initiate, control, exchange, observe and participate in test campaigns and results. But also, to benefit from convenience facilities such as kitchen or bathroom services. One foreseen benefit of a common zone, is Document1 Version 1.0 Page 22 of 37 10. 11. 12. 13. 14. 15. 16. the demonstration of the current overall System baseline in terms of products and interfaces. - Supplier Zones – thereby allowing test campaign preparation, anomaly and incident investigation as well as protect confidential information / product status. Access to Supplier zones by default is limited to supplier staff and BDK personnel. Third parties may gain access only by arrangement. Establishment of Security procedures and equipment for the JTL as well as to establish: - Access Rights for the JTL Members. - Access Rights (If any), for the JTL member’s Sub-Suppliers. - Access rights for 3rd Parties, e.g. NSA or TOC representatives. Establish and put in place procedures to ensure Confidentiality and protection of IP. This could include: - Drafting and signing of Mutual Non Disclosure Agreements (NDAs). - Agreement of “House Rules” such as the exclusion of sub-suppliers from the JTL, for example. Familiarity training for Customer Engineers that will make use of, and administer the JTL. Preparation of the Documentation Library relevant to the System and its ‘baselined’ solution. The Creation, introduction and baselining of the common Interface Register. Subject to availability, the preparation and baselining of the JTL “System” Including Products, LRUs, Simulator Engines, Application Data Files, Configuration and Diagnosis tools etc. from the respective suppliers. Availability and agreement on the Customer's baselined “Ops Rules” as they apply to the overall System. 4.8 JTL Practicalities The JTL will nominally be established in the greater Copenhagen area of Denmark. The following subsection considers the practicalities of establishing the JTL. It provides some provisional targets (which will be agreed with the respective suppliers) with respect to the JTL building, its fitments and its people. The targets are derived from the pre-conditions discussed earlier in the document. The results are stated as provisional, (and for now) rather high level, Customer requirements. 4.8.1 Building & Utilities Provisional requirements applicable to the JTL building are as follows: Id. 1. 2. Document1 Version 1.0 Requirement The JTL shall have partitioned areas for use by the separate suppliers to establish their section of the JTL. The walls of the partitioned areas of the JTL shall only be allowed to move after being Guidance / Rationale / Substantiation Thus creating movable partitions. When partitions locked in place, they Page 23 of 37 Id. Requirement “unlocked” to do so by an authorised person. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. Upon rolling back of the partition walls, the JTL shall be so arranged as to reveal the chain of systems that make up the end to end functionality of the Overall Fjernbane system. The JTL shall be so arranged such that from the common area of the Lab, it will be possible to view all JTL member systems – provided the partition walls are rolled back. The JTL shall be equipped with one ‘Central Control Area’ containing all relevant MMIs for the supplier-installed systems – including the associated simulation engine(s). From the ‘Central Control Area’ within the JTL, it shall be possible for a test team of 2-3 people (making use of the MMIs provided), to run a full scale test, exercising the end-to-end functionality of the Overall System. Entry into the JTL building shall also be protected with access control equipment. The JTL building shall have a goods-handling area. The goods-handling area within the JTL building shall also have a self enclosed lockable secure area. The JTL building shall have an external yard for placing of physical equipment (such as Level Crossing barriers), of at least 10 metre width and of an area of no less than 200m2 The JTL building shall possess windows that overlook the external yard. To secure the external yard, the JTL shall be equipped with security fencing and gates. The JTL building shall be dimensioned to easily accommodate up to 30 people working within it at any one time across all the individual areas. 13. 14. Document1 Version 1.0 Guidance / Rationale / Substantiation contribute to privacy and security. When rolled back, they contribute to demonstration of the overall System. The Customer also refers to this as the “Central Control Area”. The level of usage is anticipated to peak during the project delivery phase of the overall lifecycle – before dropping to “operational” levels. Working assumptions are each JTL member will place a team of circa 7 people (approx 28 people) – dropping to JTL full time staff + occasional guests. Anticipated at around 6 people + guests. The JTL shall be equipped with emergency exits in accordance with Danish safety regulations. Page 24 of 37 Id. 15. 16. 17. 18. 19. Requirement The JTL shall have an office area reserved for BDK personnel – including JTL management. The JTL shall be equipped with a reception area. The JTL shall be equipped with a building facilities and administration office. The JTL shall be equipped with a Food consumption space and facilities. The JTL shall be equipped with Toilet and Shower facilities. The JTL shall be equipped with a Meeting room accommodating up to 30 people. 20. 21. 22. The JTL shall have individual Plant rooms to accommodate the heating, cooling and electrical supply equipment. Each Supplier area within the JTL shall offer at least 75m2 of useable floor space. In order to accommodate the JTL members needs for both private and common areas, the total useable indoor floor space shall be no less than 600m2 23. 24. 25. Document1 Version 1.0 Guidance / Rationale / Substantiation This will provide kitchen facilities rather than a fully serviced canteen. To maximise space and lower costs, we propose to use such a meeting room to also act as the documentation library – by providing adequate shelving on the walls. Applied assumptions (averaged out), are as follows: 3*75m2 – Supplier space, including ‘self-enclosed’ server room. 1*75m2 – BDK space for goods in, handling, archiving, CentralControl-Area, Simulation viewings, Equipment Training, etc. Subtotal = 300m2 Then, 9 * 30m2 – (Meeting room / Library, + Management office, + Kitchen facilities, + Reception, + Toilet / Shower areas, + 3 Plant Rooms, + Access / Hallways/ Piping / Cabling risers). Subtotal = 270m2 Total = 570m2 + 30m2 tolerance factor, to account for using lower end of lab space estimates from suppliers feedback & lab space experiences. Grand Total = 600m2 Each Supplier area within the JTL shall be protected with access control equipment. Each Supplier area of the JTL shall have independent cable routing / riser paths. Page 25 of 37 Id. 26. 27. 28. Requirement Guidance / Rationale / Substantiation The JTL shall have areas accessible to all members of the JTL. Supplier areas within the JTL shall be provided with a self-enclosed Server-Room. Both the common and supplier areas shall be climatically controlled to automatically maintain a temperature range of between 15 and 25 degrees centigrade. 29. 4.8.2 Fitment & Facilities Provisional requirements applicable to the JTL fitment and facilities are as follows: Id. 1. 2. 3. 4. 5. 6. 7. Requirement The JTL shall be fitted with the necessary service utilities. To facilitate cabling and maintenance, the JTL shall be fitted with both false-flooring and false-ceilings. The false flooring of the JTL shall be able to withstand loading pressure of 1200Kg / m2 The JTL shall have an electrical mains supply of 240v AC. The JTL shall also have an electrical mains supply of 415v AC The JTL shall be fitted with broadband facilities The JTL shall be provided with a redundant access node to the BDK FTN UPSs shall be provided at the JTL. 8. 9. 10. 11. Document1 Version 1.0 Should back-up generators be required to support the UPSs in the JTL, then, they shall be located as to have them protected from fire and flooding risks. The JTL shall be fitted with an emergency lighting system - illuminating (at the minimum) the access ways and paths to emergency exits. Both private and common area zones of the JTL shall be furnished with appropriate furniture, for the corresponding purpose of the JTL zone in question. Guidance / Rationale The JTL will have electricity, fresh water and waste-water utilities. The Customer will provide fire-walled access to the FTN. The UPS and back-up generators will be scaled in agreement with the JTL members. This accounts for shelves, racks, test benches, tables, desks, chairs, cupboards, white-boards, windowblinds, etc. as appropriate for the JTL room being furnished. Page 26 of 37 Id. 12. 13. 14. 15. 16. 17. 18. 19. 20. 21. 22. 23. Requirement Each private area shall be fitted with a meeting table accommodating at least 8 people. The meeting room within the JTL common area shall be fitted with Video Conferencing facilities. The Meeting room space within the JTL, shall be fitted with wall shelves to accommodate system documentation. Access control equipment shall be centrally administered and configurable to allow the required profile for each JTL User to be applied. Each Supplier area within the JTL shall be protected with access control equipment. Each Supplier area within the JTL shall contain a series of floor level and ceiling level power outlet sockets. Should the JTL be arranged over several floors, a Lift shall be provided In the case where a Lift is provided within the JTL, it must be able to accommodate the height, weight, length and depth of the bulkiest lab equipment and with manoeuvring room. The JTL shall be equipped with a pallet trolley to assist with transporting heavy / large boxes. The JTL shall be fitted with a fire detection and protection system commensurate with the sensitive electrical and electronic equipment housed within it. The JTL shall be fitted with a CCTV system. The JTL shall be fitted with an Intruder Alarm System. The JTL shall be equipped with a mast mounted external GPS antenna with connection sockets in all the private areas. 24. 25. Guidance / Rationale The candidate products have to be checked with suppliers. Nominally these may include the RBC and / or IXL racks. This will be managed by the Customer. This will be managed by the Customer. This is to cater for operating the ETCS trackside and onboard products that rely on the GPS signal for timestamping (e.g. the JRU). Further refinement e.g. using the “network time protocol” instead may be agreed with the JTL members. Within the Server rooms and spaces accommodating technical equipment making up the Fjernbane Overall System, the JTL shall be fitted with floor coverings that do not create the build-up of static electricity. 26. Document1 Version 1.0 Page 27 of 37 4.8.3 People Provisional requirements applicable to the JTL personnel are as follows: Id. 1. Requirement The JTL shall be staffed with a JTL Manager responsible for the everyday operations of the JTL. The JTL shall be staffed with a JTL Test and System Configuration manager. 2. The JTL shall be staffed with a Test technician. 3. The JTL shall be staffed with a Receptionist. 4. Guidance / Rationale Such a role will hold responsibility for ensuring the “RAMS” of the Overall System as well as the integrity of the delivery from all the Suppliers – throughout the lifetime of the JTL. Such a role will hold responsibility for ensuring the correct configuration and health status of the Overall System components as well as to organise and supervise simulation and playback testing and to undertake the management of the JTL assets. Such a role will hold responsibility for ensuring the well-being and safety for visitors, including the booking of access to personnel as well as management of goods inward and outward of the JTL. 5. 4.9 Lifecycle of the Joint Test Lab As with other systems, we can expect the JTL to go through phases of introduction, growth and decline. We can also expect regular maintenance, upgrades and ultimately, disposal. This section considers what special and foreseeable events, may have an impact on the JTL. For simplification the identified events are displayed within the following table, as those that arise during the Fjernbane projects, those that come after project commissionings and those that can occur in both timeframes. In all cases, the JTL members must be prepared to accommodate and deal with these events and to ensure continual benefit from the JTL investment. Event FbIS Overall System Upgrades Mid-life Upgrades Evolution of the ETCS baseline Migrating from Simulators to Real Products Document1 Version 1.0 Occurs During Project Occurs Post Project Page 28 of 37 Event Availability of GSM-R and GPRS coverage Key Management System – Offline to Online Ensure JTL remains consistent with developments in project phases; for example, Joint Design, Early Deployment, Rollout etc. Responsibilities for ‘Lot not awarded’ Incident / Anomaly Investigation ‘System Configuration’ Upgrades External or 3rd party interface change Centre of Excellence / ERTMS Reference Lab for CSD and PSD operated railway evolving into an official “Accredited” Laboratory as per TSI definitions. Decommissioning and Disposal Occurs During Project Occurs Post Project The FbIS solution requires the introduction of novel products, such as, dual mode RBCs, EVCs and Balises to accommodate GSM-R as well as GPRS technology. The Customer has also called for Hand held terminals and On-line crypto key management systems. Naturally, development and testing of such products will also ultimately require certification (as per the Technical Specifications for Interoperability) before these products may be freely applied. Unless it is established that the product in question will remain a “National Domain Product” and that it has no impact on system interoperability. As there are only 3 “recognised” laboratories (Cedex Lab in Madrid -Spain, - having the most established reputation for ETCS testing), equipped to complete certification processes in Europe at the moment, and none with GPRS competence, then there may be a time-schedule risk to the Fjernbane projects as products face certification bottlenecks. In the face of potential bottlenecks, ERA has published a proposal [4], based on the objectives of the ‘Standard for Accreditation of Test Laboratories’ (ISO 17025:2005), outlining the salient points of competences and cooperation required between the Labs, Unisig Suppliers, National members of the “Accreditation Bodies Network” and ERA. This situation suggests that the JTL could be from the outset planned as an Accredited Laboratory. The consideration that must be kept in mind however, is that a process based on adherence to a quality management system (QMS) as well as evidence of technical competence and applying that competence over time as stipulated by the requisite standard (ISO-17025:2005) and subjected to “peer” review, is called for. Though this is all within what the JTL could achieve, it is not compulsory for achieving the objectives of its “core business” – as discussed in section 4.2 above. Because of this, and despite the criticality of the need for certified products, this paper considers the potential evolution of the JTL to ‘Accredited Laboratory’ as an event that may occur once the System is commissioned and the project is closed. It is certain at present that the contribution of the JTL and the continued success of ERTMS in Denmark, up to and beyond 2021, does not depend on the JTL being a formally accredited laboratory. As a consequence, the Customer will therefore need the Suppliers to be carefully prepared regarding their product roadmap strategy and going beyond testing of these products, also declare how these products will achieve certification for use within the BDK network. Document1 Version 1.0 Page 29 of 37 This issue will have to be further discussed and developed with the respective suppliers and stakeholders such as the NoBo and the NSA and the outcome reflected in planning the JTL lifecycle. 4.10 Management of Processes As mentioned above, embedding the JTL within firstly the SP and subsequently within BDK, requires the creation and launch of a range of management processes as befits any other new ‘department’. The list below introduces some the more prominent and / or urgent processes in the context of the JTL. 1. Establishing procedures to take ownership of the JTL products - i.e. formalisation of the transfer of baselined products from suppliers to the customer. 2. Establishing the Escrow procedures for managing delivered baselines of Software packages over the JTL lifetime. 3. Booking of specialised resources / people, for example to conduct a compatibility test. 4. Responsibility for Spares for the JTL. 5. Replenishment of Spares (if and when used) for field maintenance. 6. Ensuring and Preserving compatible maintenance procedures across the overall System. 7. JTL asset management - including inventory management and bringing in / taking out of equipment into / from Lab. 8. Procedure to archive examples of product types / evolutions. 9. Responsibility for Obsolescence Management for the JTL. 10. Maintaining consistency with the Training and e-learning practise, (as delivered by the Fjernbane projects) - regarding use and maintenance of equipment. 11. Consider the Interaction and knowledge sharing process with the user-support and / or maintenance “Hotline”. 12. Ensuring accurate Configuration baselines for products, a. including agreed “default configurations” and values b. agreed timescales for when new baselines will be “activated” in the JTL by the respective suppliers. 13. Establishment and benefiting from Configuration Audits. 14. Arrangements for the witnessing of Tests and reviewing test results. 15. The management of Documentation as apply to the JTL environment. 16. Arrangements for preserving Confidentiality. 17. Escalation and Arbitration process to manage JTL member issues that may arise from the sharing of resources as well as the use and / or abuse of the JTL itself. Arbitration may also be required for assessing results from parallel development efforts from the Suppliers, for those areas outside Joint Design collaboration. 18. Establishing Support agreements from the Suppliers to cover the lifetime of the JTL. Document1 Version 1.0 Page 30 of 37 4.11 Architecture and Testing Scope In order to be able to support and allow for various test campaigns and simulation objectives, the JTL will be fitted out with physical examples of real equipment that interface with each other to create a representation of the Overall System. Where physical products are not yet available, too cumbersome for the JTL space envelope, dependant on external interfaces, or are immature, then a simulator engine will act as a substitute. Simulator engines are also foreseen to be used to represent the trackside and trainborne environment – for example to simulate a passing of a series of trains over a track section, hence gaining an insight of how the technical system stands up to timetable and other operational demands. This subsection catalogues the range of products expected by the Customer to be available within the JTL. They are organised in top – down arrangement. The respective Suppliers are responsible for providing, installing and maintaining the products within the JTL under the most current and customer approved Baseline. The Supplier will also support the customer with the relevant training, tools and documentation entities. For the purposes of this section, products are understood as an integrated package of hardware, software and where appropriate firmware. The product is also understood to possess the correct and functioning interface characteristics such that several products may be integrated to form a subsystem which in turn are integrated to form a representation of the Supplier’s system solution. Where applicable, the Customer also expects that the JTL will be populated by precertified products. That is to say, the Customer does not foresee the need to sponsor a certification campaign as discussed by the Technical Specifications for Interoperability. The following subsections provide a high level outline of the architecture and the testing scope. The architecture is presented on a ‘candidate’ basis as opposed to the finalised version that is yet to come. 4.11.1 System Level The System level represents the Fjernbane East or West solutions as well as the ETCS Onboard solution. The System level solution is essential for conducting test campaigns leading to Site Integration Testing (SIT) and Site Acceptance Testing (SAT) evidence. The System level also allows for campaigns to prove interfacing across the East / West border as well as across the national borders with Sweden and Germany. In addition, and by using Customer provided access to the Fixed Transmission Network (FTN) as well as other IT services, it will be possible to conduct test campaigns by networking with remote 3rd party test laboratories. Document1 Version 1.0 Page 31 of 37 The System solution is made up of integrated subsystems as detailed in the next subsection. 4.11.2 Subsystem Level The JTL will be populated with the subsystems as listed below. Each subsystem will be introduced under careful configuration management and a corresponding ‘Release Note’ document to provide assurance to the Customer that the Subsystem is properly baselined. ETCS Trackside (East) ETCS Trackside (West) ETCS Trainborne (Including the Danish STM) IXL and peripherals (East) IXL and peripherals (West) TMS (East) TMS (West) GSM-R / GPRS KMS / CA (East and West, or as per the outcome of Option 10 in the contract). Note that presently, with regards to GSM-R and GPRS subsystems, BDK will make use of specialised 3rd party Lab facilities. However in the future, the benefits of having these facilities as part of the JTL are being assessed – especially with regard to End-to-End system testing. This assessment may result in physical products being maintained as part of the JTL facilities. 4.11.3 Product Level Although it is not possible to ensure an exhaustive product breakdown structure until the System Design is in place, it is possible to generate a close approximation, in ‘candidate’ terms as listed below: Document1 Version 1.0 TMS Servers TMS Workplaces Other TMS products and relevant simulators. IXLs Track Vacancy Proving equipment (e.g. axle-counters and evaluator units) Object Controller equipment Point Machine equipment Level Crossing equipment Marker board representation RBCs Balises HHTs JRUs KMS products (KMC, download / upload tools,) Clocks (driven by System Time-Source or GPS signal as agreed with JTL members) Peripheral computers as needed. E.g.: - Simulators (Track, Train, Weather Conditions, Driver Reaction, etc.) Page 32 of 37 4.11.4 - Communication Gateways and Routers - Test Campaign Administration - Data Logging - Scenario Composition and Playback parameters - Alarm Management - Application Data Programming / Analysis tools - Etc. ETCS Onboard products (Including the EVC, DMI, JRU, STM –with trackside ATC simulator, and Odometry products) GSM-R and GPRS products and relevant simulators (including BTS, BSC, MSC, mobile devices and corresponding SIM cards) LRU level For completeness and also because the JTL can be used to demonstrate maintainability design, maintenance tools and methodology proposed by the suppliers, there is an opportunity to agree the approach to handling the ‘Line Replaceable Units’ (LRU)s pertaining to a specific product. Customer expectation is that this will be jointly agreed with the Suppliers during the Joint design Phase. This will create an LRU philosophy that is feasible for Fjernbane East, Fjernbane West and Onboard operations. The philosophy can then be justified on the basis of system RAM targets as well as first line maintenance infrastructure. 4.12 Types of Tests Essentially, the JTL is all about mitigating the risk of putting flawed products, processes, subsystems and their interfaces into operation. Doing so, can lead to a negative and potentially fatal impact on the running railway. The mitigation is based on a coordinated and progressively inclusive, and hence complex series of test campaigns. The results of the testing vouch for the maturity and effectiveness of the solutions provided in order to offer fully-functional, safe and seamless operation. Testing at the JTL is expected to follow on from the testing conducted and proven at the supplier’s premises. This is up to and including the formal witnessing of the Factory Acceptance Testing (FAT) campaign. However, with Customer agreement, the JTL offers the flexibility to emulate FAT campaigns within Denmark and hence local to the application environment for emergent supplier solutions. Naturally, such tests will require the same level of detailed diligence as those completed on Supplier premises – including validating product serial numbers for example. The Customer recognises the mutual advantage of using the JTL for FAT level testing with respect to successful preparations for joint FAT testing, (i.e. solutions integrated Document1 Version 1.0 Page 33 of 37 with the other supplier’s solutions), site Integration Testing as well as Site Acceptance Testing. Furthermore, the JTL offers cost, safety as well as time efficiencies to the JTL members by allowing the minimisation of lineside testing prior to Early deployment and Rollout phases. With this in mind, the customer expects mutual advantages to be gained by the JTL members from using the JTL facilities. As per classic testing, test campaigns using the JTL resources can only progress if approved and comprehensive test documentation (including plans, methodologies as well as test cases) are in place. The customer expects close collaboration between JTL members and their respective Quality Assurance departments to achieve this aim. Post System-Commissioning, when the JTL will move to the next phase of its lifecycle, the approach and discipline of using test-cases to specify various test scenarios, based on preconditions, actions and expected post-conditions will continue. The customer expects the JTL members will adhere to management processes to ensure this level of integrity continues to be the norm in using the JTL resources. In parallel, test campaigns, (like the hardware, software and interfaces that are the subjects of the testing) will be subject to strict configuration management practise. By doing so, JTL members can benefit not only from scenario based testing but also play those scenarios according to different software and hardware evolutions. The customer expects the following set of high level test themes to be exercised within the JTL environment in order to gain confidence that the proposed solutions are ready to install and apply within the operational environment. 1. End to End Functional Testing – making use of both “black box” and “white box” levels of testing. 2. Performance Testing (Latency and Delay at System level as well as product performance speeds). 3. Interface testing with External interfaces. 4. East / West Interface Testing (RBC Handover, KMS, IXL synching, TMS messages). 5. Technology Switchover Testing to cover CSD to PSD modes and back again (This also needs close collaboration with the Trainborne Subsystem). 6. Integration test support for LRUs into Products. 7. Integrating Products into Subsystems - including Interfaces. 8. Integrating Subsystem into the Overall System : (Note, once this is done, reverts to integrating Products into Subsystems). 9. Hardware and Software Integration. 10. Application Data Testing. 11. Interoperability testing. 12. Backward Compatibility testing. 13. Regression Testing. 14. Soak / Durability Testing. Document1 Version 1.0 Page 34 of 37 15. Representative EMC testing (e.g. using detectors and meters to assess shielding and interference-proofing at product level). 16. Stress / Robustness Testing - including Dimensioning testing of the RBC, IXL, and Communications network. 17. The verification, validation and (if needed), adjustment of the new TMS processes. 18. Anomaly Diagnosis and Testing. 19. Alarm effectiveness Testing. 20. Pre SAT Readiness Testing. 4.13 Type of Demonstrations Aside from testing, the JTL is foreseen to be used to showcase the end-to-end functionality and performance of the overall System. To do this, it is not strictly necessary to launch a test-scenario. Rather it is sufficient to replay a previously tested (and successful) scenario from the playback simulator. In fact, (depending on the audience), demonstrations may be more relevant. Hence the differentiation placed between using the JTL resources either for testing, or for demonstration. However, that is not to say that JTL demonstrations do not require a management process that is in place to capture any anomalies or abnormal system behaviour that may potentially occur. Just as for testing activities, anomalies will require investigation and rectification in accordance with change and configuration management processes. The following list records the type of demonstrations possible at the JTL: 1. Current System Baseline Demonstration – 2. Ergonomics and Usability demonstration a. e.g. for HMIs, test, programming, diagnostic and maintenance tools 3. Demonstration of BDK owned Interface Protocols and details. 4. Time-Source Synchronisation Demonstration (Across East & West) 5. Accelerated Time Demonstrations (Scenarios speeded up / fast-forwarded, to view predicted results). 6. Installation & Test Readiness Methodology demonstration 7. Product Maintainability Demo 8. Shadow mode Monitoring (i.e. Observing the System Behaviour on the available MMIs in the “Central Control Area”). 9. Playback of Operational Scenarios 10. Stimulation by Event Case or by Timing Case 11. Playback of Maintenance / Fault / Legal-Data Scenarios 12. Degradation and Recovery Methodology Demonstration a. Fall back Scenarios standardisation 13. Handover / Takeover of “Lot Not Awarded” readiness demonstration Document1 Version 1.0 Page 35 of 37 5 Conclusion Though the understanding that the JTL is an integral part of the Fjernbane Infrastructure and Onboard test strategy, providing clear and beneficial outcomes, (such as demonstrating the end-to-end functionality of the Overall System), there remains the need to actually establish the JTL. This paper, by considering a high level delivery schedule has identified the 3rd quarter of 2012 as the target date for commissioning the JTL. This document also shows that a coordinated philosophy on the primary and secondary objectives of the JTL need to be further developed with input from the System Suppliers. The JTL can fulfil act as a Denmark based centre of excellence for the integration testing and demonstration of interoperability between ETCS, GSM-R, GPRS systems as well as more specialised systems such as the TMS and the On-line KMS. Remote interconnection (via the BDK FTN), with other test labs, be they from ERTMS equipment suppliers or with other specialised labs - also becomes a distinct possibility for the JTL scope. The JTL therefore encompasses a broader view of testing than just “interoperability” of ETCS systems. This is because it also includes overall functionality of other systems as named in the paragraph above, but also incorporates the verification and validation of the TMS and the applicable operational rules of the railway. Indeed, one broad range concept yet to be explored and evaluated, is of the JTL also providing a home for the KMC / CA needed to manage the cryptographic keys required for both Danish and Foreign train authentication in order to run on Danish ETCS infrastructure. To achieve the JTL objectives it is necessary to mobilise both Customer and Supplier resources within a management processes framework to plan, design, build and maintain the JTL and to create the supporting documentation. Third party stakeholders are also involved. Provisional figures have been offered to illustrate the practicalities of the JTL, for example quoting anticipated floor size for the lab and the various uses of space anticipated. The JTL will span both the project and the operational period of the Banedanmark Signalling Programme. This crossover leads to the recognition that the JTL has an independent lifecycle with many events occurring within it that require further management processes. It is also recognised that a dedicated team needs to be recruited and allocated to manage the JTL. The efficiencies that can be drawn from the JTL with respect to time, cost and overall risk reduction to the Fjernbane projects (Infrastructure and Onboard) suggest that this work stream is of urgent value and provides opportunity for close cooperation between the Customer and potential Suppliers leading up to the BAFO period and onwards. Section 4.5 of this document has shown the need for close collaboration between the JTL members and each party will need to provide a range of the identified skills and Document1 Version 1.0 Page 36 of 37 competencies to deliver their contribution to the JTL. Having the JTL members being collocated within the Lab, as soon as the JTL is commissioned, suggests that there are also benefits to be gained for the successful completion of the Joint Design phase of the Fjernbane projects. Comparisons with current practise, largely inspired by the Cedex lab of Spain and experience of other test laboratories, have inspired a collection of preconditions and apportionment of roles between the Customer, the Suppliers and relevant 3rd parties. The JTL preconditions and apportionment of roles also created the context for the subsequent requirements for delivering the JTL. As a next step, the contents of this concept paper (including the outlines for Supplier responsibilities, System requirements and statements dealing with JTL practicalities), will be shared with prospective suppliers and hence further developed, elaborated and therefore integrated into the BAFO material for the Fjernbane Project Tenders. Document1 Version 1.0 Page 37 of 37