Version 1.0 Test Plan and Results Template Infrastructure WG SIF 2.1 Testing Document Page 1 of 9 Version 1.0 Test Plan and Results Template VERSION CONTROL Draft Specification Document Version Control Version Date: Author/Organization: Comments v1.0 05/05/2007 Andrew Elmhorst/ Edustructures Testing Plan submission Testing Form Data ITEM 1.1. Application Date 1.2. Work Group (Author of Object) 1.3. Work Group Leader/Sponsor 1.4. Objects for Testing 1.5. First Agent selected for Testing (Developer Organization and Authorized Representative) 1.6. ZIS selected for Testing (Developer Organization and Authorized Representative) 1.7. Second Agent selected for testing (Organization Name and Authorized Representative) 1.8. Testing Site 1.9. Testing Site Type (Showcase, Production, Connect-A-Thon) APPLICATION RESPONSE 05/05/2007 Infrastructure Andrew Elmhorst SIF_CancelRequest message N/A N/A N/A Walk through cases Testing Level 1 Page 2 of 9 Version 1.0 Test Plan and Results Template Example SIF_Message <SIF_Message Version="2.1" xmlns="http://www.sifinfo.org/infrastructure/2.x"> <SIF_SystemControl> <SIF_Header> <SIF_MsgId>C332B8A9DFA5480AB89B6B6F62BE57B3</SIF_MsgId> <SIF_Timestamp>2006-12-27T08:39:40-08:00</SIF_Timestamp> <SIF_SourceId>AcmeAgent</SIF_SourceId> </SIF_Header> <SIF_SystemControlData> <SIF_CancelRequests> <SIF_NotificationType>None</SIF_NotificationType> <SIF_RequestMsgIds> <SIF_RequestMsgId>C332B8A9DFA5480AB89B6B6F62BE57B3</SIF_RequestMsgId> <SIF_RequestMsgId>1058ABCDE028D076F08365109BE7C892</SIF_RequestMsgId> </SIF_RequestMsgIds> </SIF_CancelRequests> </SIF_SystemControlData> </SIF_SystemControl> </SIF_Message> 1) Use Cases used for Testing Object USE CASE (S) NAME 1. Agent Cancels Data Collection USE CASE NUMBER Number: 001 USE CASE REFERENCE See 216 Change Proposal 2) Test Cases used for Testing Object TEST CASE (S) NAME Agent Sends SIF_CancelRequests ZIS Processes SIF_CancelRequests ZIS Sends SIF_CancelRequests Agent Receives SIF_CancelRequests TEST CASE NUMBER 1 2 3 4 TEST CASE REFERENCE 4.1.1.15 Agent Sends SIF_CancelRequests 4.2.2.17 ZIS Processes SIF_CancelRequest 4.2.1.5 ZIS Sends SIF_CancelRequests 4.1.2.8 SIF_CancelRequests (Push-Mode only) (optional) Page 3 of 9 Version 1.0 Test Plan and Results Template Test Case 1: Agent Sends SIF_CancelRequests Actors: SIF Agent (AGENT) Zone Integration Server (ZIS) Preconditions: The AGENT has sent a SIF_Request to the ZIS, but has not received all SIF_Responses Outcomes: All processing on the SIF_Responses has been stopped. The agent may choose to receive a “final” SIF_Response message from the ZIS with an error code that indicates the SIF_Request has been cancelled. Test Steps: Follow 4.1.1.15 Agent Sends SIF_CancelRequests Test Script Procedures Log OBJECT TEST NUMBER 1 – Initial Test 2 – Retest 3 – Retest DATE OF TEST TEST RESULTADMINISTRATOR PASS 1 05/11/2007 Andrew Elmhorst Including: Mark Reichert, Laurie Collins, Zac Jensen RESULT- REASON FOR ERROR ERROR Pass Page 4 of 9 Version 1.0 Test Plan and Results Template Test Case 2: ZIS Processes SIF_CancelRequests Actors: SIF Agent (AGENT) Zone Integration Server (ZIS) Preconditions: The AGENT has sent a SIF_Request to the ZIS, but has not received all SIF_Responses Outcomes: All processing on the SIF_Responses has been stopped. The agent may have received a “final” SIF_Response with an error code, if it has requested one. Test Steps: 4.2.2.17 ZIS Processes SIF_CancelRequest Result We may want add an error code that the ZIS uses when it sends the “Final” SIF_Response message to the requesting agent. We may not see much use in the SIF_CancelRequest message that is sent to the responding agent. Test Script Procedures Log OBJECT TEST NUMBER 1 – Initial Test 2 – Retest 3 – Retest DATE OF TEST TEST RESULTADMINISTRATOR PASS RESULT- REASON FOR ERROR ERROR Page 5 of 9 Version 1.0 1 Test Plan and Results Template 05/11/2007 Andrew Elmhorst Including: Mark Reichert, Laurie Collins, Zac Jensen Pass Test Case 3: ZIS Sends SIF_CancelRequests Actors: SIF Agent (AGENT) Zone Integration Server (ZIS) Preconditions: The ZIS has previously sent a SIF_Request to the agent, but the agent has not yet sent all SIF_Response packets Test Steps: See 4.2.1.5 ZIS Sends SIF_CancelRequests Test Script Procedures Log OBJECT TEST NUMBER 1 – Initial Test 2 – Retest 3 – Retest DATE OF TEST TEST RESULTADMINISTRATOR PASS 1 05/11/2007 Andrew Elmhorst Including: RESULT- REASON FOR ERROR ERROR Pass Page 6 of 9 Version 1.0 Test Plan and Results Template Mark Reichert, Laurie Collins, Zac Jensen Test Case 4: Agent Receives SIF_CancelRequests Actors: SIF Agent (AGENT) Zone Integration Server (ZIS) Preconditions: The ZIS has previously sent a SIF_Request to the agent, but the agent has not yet sent all SIF_Response packets Test Steps: See 4.1.2.8 SIF_CancelRequests Results We may want to add to the description that the responding agent may need to remove the SIF_Request from a local queue if it queues such messages locally. Test Script Procedures Log OBJECT TEST NUMBER 1 – Initial Test 2 – Retest DATE OF TEST TEST RESULTADMINISTRATOR PASS RESULT- REASON FOR ERROR ERROR Page 7 of 9 Version 1.0 Test Plan and Results Template 3 – Retest 1 05/11/2007 Andrew Elmhorst Including: Mark Reichert, Laurie Collins, Zac Jensen Pass Other Review Items that were discussed - Double-check that how plan was incorporated into spec in the four or five impacted sections reflects the authors' intent. - Nowhere was it specified that support for this message is optional in Push-Mode Agents, which would be a requirement to get it into 2.x. I've made it optional for them and tried to address this where it seemed prudent. Please review. - Just a note that the ability to send SIF_CancelRequests to a Push-Mode agent only seems to have worth if that agent processes more than one request at a time. Does that justify that particular aspect of the feature? - As NotificationType has no bearing on the Push-Mode Agent that receives it, I had it set to None when a ZIS sends CancelRequests to a Push-Mode Agent. Seem reasonable? - In the ZIS handling of SIF_CancelRequests, when the ZIS produces the "final" SIF_Response for Standard notification, the spec says to indicate the reason the SIF_Response packet was cancelled. Well, it was cancelled per another agent's request. There is no error code for this, while there are error codes for requests being gone due to timeout and manual removal--seems like an oversight. (This or a similar comment might apply elsewhere too, but not following my notes to find it at the moment.) Final Results Object Name WorkGroup /TF WorkGroup/TF LEVEL DATE OF COMMENTS Page 8 of 9 Version 1.0 N/A Test Plan and Results Template Sponsor Lead Infrastructure Andrew Elmhorst OF TESTING PASSED 1 TEST COMPLETE 05/11/2007 In 4.1.2.8, We may want to add to the description that the responding agent may need to remove the SIF_Request from a local queue if it queues such messages locally. In 4.2.2.17, We need to add an error code that the ZIS uses when it sends the “Final” SIF_Response message to the requesting agent. We may not see much use in the SIF_CancelRequest message that is sent to the responding agent, but we agreed that it should be kept. Page 9 of 9