RB (<text (RBname) to be inserted by RB>) E-Bulk System
Test Exit Report <Template>
COMMERCIAL
The RB must use the template,update it as necessary and submit the completed
version of the report for review and approval at the end of System Test . The approval
of the report will be confirmation from DBS that the RB has demonstrated it has met
the System Test exit criteria.
Completed Report -Author
Version Date
Purpose
<text to <text to be
Completed Draft
be
inserted by
inserted RB >
30/10/08
Author
<text to be inserted by RB >
Criminal Records Bureau
E-Bulk RB System Test Exit Report (Template) Page 1 of 9
Commercial
by RB >
Completed Report - Approval
Version
Name
Organisation
<text to <text to be DBS
be
inserted by
inserted
DBS >
by RB >
Title
<text to be inserted
by DBS >
Signature
Date
<text to
be
inserted
by DBS
>
Completed Report -Reviewers
Version
Date
of Name
Organisation
Issue
<text to <text to be <text
to
be DBS
be
inserted by inserted by DBS
inserted RB >
>
by RB >
Reference Documentation
Document Name
E-Bulk RB System Test Scenarios
RB System Test Cases 1, 2, 3, 4, 5, 6, 7, 9,
10,11,12,13,15,18,19,20,21,23,24,25,26,27
E-Bulk RB System Test Plan
Title
<text to be inserted
by DBS >
Version No.
Location
V1.0
V1.0
PSO Library
PSO Library
V1.0
PSO Library
CONTENTS
1
Introduction ...................................................................................................... 4
1.1
Background .............................................................................................. 4
1.2
Purpose .................................................................................................... 4
2 Test Results..................................................................................................... 5
2.1
Summary of Test Conditions .................................................................... 5
2.2
Test Cases (incl. Test Scripts /Conditions) Results .................................. 5
2.3
Alterations to Test Scripts or Test Conditions........................................... 6
3 Defects Raised During Testing ........................................................................ 6
3.1
Resolved Defects ..................................................................................... 6
3.2
Unresolved Defects .................................................................................. 6
3.3
Test Evidence........................................................................................... 7
4 Risk, Assumptions, Issues and Dependencies (RAIDS) .................................. 8
4.1
Risks......................................................................................................... 8
4.2
Assumptions ............................................................................................. 8
4.3
Issues ....................................................................................................... 8
4.4
Dependencies .......................................................................................... 8
5 Test Observations/variances ........................................................................... 8
6 Successes ....................................................................................................... 9
Exit Criteria from DBS System Testing ................................................................ 9
7 Recommendations........................................................................................... 9
1
1.1
INTRODUCTION
Background
The DBS is introducing a facility to enable applications to be bulk-submitted electronically
and to return information regarding the result of those applications by a similar means. This
facility is known as the “E-Bulk” interface.
The Registered Bodies (RBs) who meet the E-Bulk criteria will be invited to use the E-Bulk
facilities. RBs that are using E-Bulk will be referred to as E-RBs. The RBs who wish to use
the E-Bulk facility will sign a confidentiality agreement to initiate the process of becoming an
E-RB.
Use of the E-Bulk interface will alleviate the need for the production and mailing of paper
forms by the E-RBs and form scanning, and data keying by the DBS. It also makes it
possible to reduce the volume of printed Certificates sent by post to the E-RBs
1.2
Purpose
The purpose of this document is to summarise and provide DBS with an assurance and
overall assessment of the quality of the System Testing undertaken by the RB.
This document will:
 Provide an overview of testing undertaken
 Show the planned and unplanned activities
 Detail the test results
 Outline all defects found
 Outline any outstanding issues
 Highlight successes
 State conclusions
 State recommendations
 Detail all Risks, Assumptions, Issues and Dependencies (RAIDS) raised during
testing.
This document will give CRB e-bulk Roll-out manager information on whether the RB has
satisfactorily completed System Testing.
Any section of this document containing <text to be inserted> sections require completion by
the relevant party
30/10/08
Criminal Records Bureau
E-Bulk RB System Test Exit Report (Template) Page 4 of 9
Commercial
2
2.1
TEST RESULTS
Summary of Test Conditions
Test Conditions Status
Number
Passed
Failed
Not Tested
Total
2.2
Test Cases (incl. Test Scripts /Conditions) Results
This section details the result of each condition tested within this phase of testing. The
Conditions are grouped into Test Scripts which form part of Test Cases(or scenarios) The
embedded excel spreadsheets below contain the Test Cases ,scripts , Input Data ,conditions
and results of tests contained in a System Test log for each executed run. It is fully
completed with details of each run of each test script showing the results of each Test
Condition (i.e. Pass, Fail or Not Tested-indicated by a blank field).The Test log also details a
cross reference to the actual evidence provided to prove the test conditions.
Example: (Test Case 1 listed below . Please insert an excel file for each of the Test
Cases preceded by the Test Case Description. In the Test Case 1 example below the
results have not been completed but when this document is produced each test case
needs to have completed test results included .)
Test case 1 - Valid DataTest - This case will test that an eBulkApplicationsBatch (CRB01) file
with valid data can be produced correctly with the correct data and filename as specified. This should
then be sent to DBS where no match of records will occur and an eBulkApplicationReceiptsBatch
(CRB03) file will be correctly produced and sent to the correct Registered Body and applied to the
correct application. An eBulkResultsBatch (CRB04) xml file will also be produced containing correct
data for the application with an eresult and this file will be sent to the appropriate RB for processing
against the correct application. This is covered by scripts RB1 (CRB01) , CAP1 (CRB03) and
CAP1(CRB04).
<text to be inserted by RB> i.e. All Test Case descriptions including excel spreadsheets as
defined above
30/10/08
Criminal Records Bureau
e-Bulk RB System Test Exit Report (Template) Page 5 of 9
Commercial
2.3
Alterations to Test Scripts or Test Conditions
<This section describes any changes to Test Cases or Test Conditions that occurred after
the System Test Pack was signed off.>
Script No
Detail of Change
Reason for Change
<text to be inserted by
RB>
<text to be inserted by RB>
<text to be inserted by
RB>
3
DEFECTS RAISED DURING TESTING
<This section will detail the defects that were raised during testing. It will detail both resolved
and unresolved defects>
3.1
Resolved Defects
Defect
Number
Defect Description
Approx
Severity
Comments
<text to
be
inserted
by RB>
<text to be inserted by
RB>
<text to
be
inserted
by RB>
<text to be
inserted by
RB>
3.2
Status and Effect on
Operations/
Workarounds
<text to be inserted by
RB>
Unresolved Defects
Defect
number
Defect
Description
<text to <text to be
be
inserted by RB>
inserted
Severity Comments
<text to
be
inserted
<text to be
inserted by RB>
30/10/08
Status and
Effect on
Operations/
Workarounds
<text to be
inserted by RB>
Resolution
timescales and
Owner Name
<text to be
inserted by RB>
Criminal Records Bureau
e-Bulk RB System Test Exit Report (Template) Page 6 of 9
Commercial
by RB>
3.3
by RB>
Test Evidence
<This section should be completed by the RB, listing the evidence provided from the
System Test phase to prove successful completion. It should include screenshots,
any files sent/received, confirmation emails, details of any witness testing etc. The
evidence should be annotated with details of the Test Cases/Scripts, Application
References , Test Condition References and Unique Evidence Identifier cross
referenced from the System Test Log . An example of evidence is attached below>
30/10/08
Criminal Records Bureau
e-Bulk RB System Test Exit Report (Template) Page 7 of 9
Commercial
4
RISK, ASSUMPTIONS, ISSUES AND DEPENDENCIES (RAIDS)
4.1
Risks
This section should document all risks (additional to those already outlined in the E-Bulk RB
System Test Plan) (if any) that have been identified during testing.
Risk
No
Risk
Description
Impact
Owner
Mitigation
Severity
Priority
<text
to be
insert
ed by
RB>
<text to be
inserted by
RB>
<text to be
inserted by
RB>
<text to
be
inserted
by RB>
<text to be inserted by
RB>
<text to
be
inserted
by RB>
<text to
be
inserted
by RB>
4.2
Assumptions
<RB should list any assumptions made during System Testing>
4.3
Issues
Date Issues
Identified
Issue
number
Issue
Details
Owner Name
Comments
Current status
(Open/Closed)
<text to be
inserted by
RB>
<text to
be
inserted
by RB>
<text to
be
inserted
by RB>
<text to be
inserted by RB>
<text to be
inserted by RB>
<text to be inserted by
RB>
<RB should list any Issues found during System Testing>
4.4
Dependencies
<RB should list any dependencies found during System Testing>
5
TEST OBSERVATIONS/VARIANCES
<This section should be completed by RB to give a summary of their findings during
RB System Test phase, to include:>
30/10/08
Criminal Records Bureau
e-Bulk RB System Test Exit Report (Template) Page 8 of 9
Commercial
Confirmation of way in which testing has been performed against the specification i.e.
any variances.
6 SUCCESSES
<RB to complete and include >
Affirmation of compliance with Test Exit Criteria specified below
Exit Criteria from CRB System Testing
Criterion
The RB must have attempted the execution of all test
scripts provided by the DBS. DBS will sign off the system
testing if all scripts are passed and the required evidence
is provided. There may be exceptional circumstances
where DBS will sign off the system testing if adequate
work-arounds are available or it is agreed that certain
scripts cannot be executed.
7
Evidence
 Screen shots of the RB
test system at steps
specified in the test
scripts
 All CRB01 messages
generated by the RB test
system due to execution
of the test scripts
 DBS
representative
witnessing the RB test
execution.
RECOMMENDATIONS
<RB to affirm that it has met exit criteria from System Test >
30/10/08
Criminal Records Bureau
e-Bulk RB System Test Exit Report (Template) Page 9 of 9
Commercial