EIS Market Release 1.0
Market Participant Test Plan
Project Name: EIS Market Release 1.0
Project Number: PR20100051
MAINTAINED BY
Shannon Shirley
PUBLISHED: May 19, 2011
LATEST REVISION: August 25, 2011
Copyright © 2011 by Southwest Power Pool, Inc. All rights reserved.
EIS Market Release 1.0
Market Participant Test Plan
Table of Contents
1. Introduction ................................................................................................................................................... 2 1.1 1.2 2. Expectations ................................................................................................................................................. 2 2.1 2.2 2.3 2.4 2.5 3. Testing Overview ................................................................................................................................... 2 Document History .................................................................................................................................. 2 Testing Contacts .................................................................................................................................... 2 Test Environment ................................................................................................................................... 2 Testing Defects ...................................................................................................................................... 2 Reporting Test Results .......................................................................................................................... 3 Testing Certification ............................................................................................................................... 3 Test Scope..................................................................................................................................................... 3 3.1 Overview of Changes ............................................................................................................................. 3 3.2 Market Participant Test Conditions ........................................................................................................ 4 3.2.1 PRR211 – Curtailment of Non-Dispatchable Resources .................................................................. 4 3.2.2 PRR214 – Offer Price Floor............................................................................................................... 4 3.2.3 SPR21099 – RTB Manual Approval .................................................................................................. 4 3.2.4 SPR22000 – External BA Inadvertent and Delta Term Adjustment .................................................. 4 3.2.5 SPR22061 – Publish Total Production Cost...................................................................................... 4 3.2.6 SPR22089 – Exclusion of External Loads ......................................................................................... 4 3.2.7 SPR22092 – XGEN Resources to use QuickStart Logic .................................................................. 4 3.2.8 SPR22096 – QueryViolationRelaxationLimitType Fix ....................................................................... 4 3.2.9 SPR22120 – Allow Supplemental Reserves for Pumping Resources .............................................. 5 4. Test Preparation ........................................................................................................................................... 5 4.1 Test Execution Prerequisites ................................................................................................................. 5 5. Test Schedule ............................................................................................................................................... 5 6. Exit Criteria.................................................................................................................................................... 6 7. Acronyms ...................................................................................................................................................... 6 1
EIS Market Release 1.0
Market Participant Test Plan
1. Introduction
1.1 Testing Overview
The purpose of this document is to provide Market Participants (“MPs”) instructions and information
that will aid in the preparation and execution of Market Participant Testing for the EIS Market Release
1.0 project.
This Market Participant Testing Phase is designed to ensure the MPs systems continue to function
properly after the changes have been implemented in production.
Changes implemented by this project impact all SPP Market Participants.
1.2 Document History
Version
Date
Author
Change Description
1.0
5/19/2011
Shannon Shirley
Initial Draft
1.1
5/23/2011
Shannon Shirley
Changes from 5/23 review
1.2
8/25/2011
Shannon Shirley
Updates for project revisions
2. Expectations
2.1 Testing Contacts
Testing Contacts will be requested from each organization. The Testing Contacts will be responsible
for communications and statuses back to SPP during the Market Participant testing phase. Each MP
will complete testing at their convenience during the time allotted.
2.2 Test Environment
We expect Market Participants to test connectivity to the ITE Environment’s systems and portal prior
to start of MP Testing. If Market Participants have connectivity issues, they should contact the
Customer Relations Representatives (CRR) for your organization.
Market Participants (MP) are required to submit the data requested by SPP according to the test
scripts. If possible, MPs are encouraged to create the same data sets that are provided by SPP using
internal upstream business processes and test systems. Market Participants are encouraged not to
use production systems for testing purposes.
2.3 Testing Defects
During MP testing, there will be test scenarios that are expected to result in data being rejected upon
submission. Unexpected error messages should be well documented and submitted by the MP to
their CRR for logging as a testing defect. Documentation should include steps taken prior to receiving
the unexpected error message, a print screen of the error message and a contact for the testing
defect. SPP staff will review all submitted testing defects and determine if the error message was an
expected result of the testing scenarios.
2
EIS Market Release 1.0
Market Participant Test Plan
In the event that a reported error message is not an expected result of a testing scenario, SPP staff
will notify the MP that an SPP system testing defect will be logged.
System-wide testing issues will be communicated to MP’s during the status meetings with the EIS
Market Release 1.0 Testing Contacts.
2.4 Reporting Test Results
MPs are asked to record their actual test results in the Market Participant Test Script provided by
SPP. At the end of each week, SPP will request MPs to report completed status in a meeting or by
email. Each MP will return the completed test checklist via email or fax to the test liaison and their
CRR for historical record at the end of testing. When in doubt, please use the account representative
lookup to find out which customer relations rep is assigned to your company.
All testing results will be recorded on the Market Participant Scorecard, posted in the CWG Projects
folder on the SPP.org website, and provided to the CWG.
Market Participants that code to prevent invalid scenarios from being generated may report the test
script as “Failed, coded to never happen” with an attached example.
2.5 Testing Certification
At the end of the Market Participant Testing Phase, all MP will certify they are ready to send and
receive data with the specified changes. Once this certification has been completed, necessary steps
will be taken by all parties involved to propagate the data and systems into the production
environment.
3. Test Scope
3.1 Overview of Changes
This project is incorporating three PRRs and seven SPRs. The PRR changes include modifications to
CAT to include curtailment of non-dispatchable Generation, creating an Offer Price Floor, and posting
offer caps to the portal. The SPRs include various smaller system changes as outlined below. The
following will be included in this release:
•
•
•
•
•
•
•
•
•
PRR211 – Curtailment of Non-Dispatchable Resources
PRR214 – Offer Price Floor
SPR21099 – RTB Manual Approval
SPR22000 – External BA Inadvertent and Delta Term Adjustment
SPR22061 – Publish Total Production Cost
SPR22089 – Exclusion of External Loads
SPR22092 – XGEN Resources to use QuickStart Logic
SPR22096 – QueryViolationRelaxationLimitType fix
SPR22120 – Allow Supplemental Reserves for Pumping Resources
3
EIS Market Release 1.0
Market Participant Test Plan
3.2 Market Participant Test Conditions
Market Participants will test the following test conditions through scripted testing. Unscripted testing
of any processes and procedures related to the release are also encouraged during this testing
phase.
3.2.1 PRR211 – Curtailment of Non-Dispatchable Resources
•
•
A new notification will be provided to Market Participants with the Calculated Curtailment
Level immediately following receipt of the information from CAT. The notification via XML
should include the following:
o Resource (Type-Name Format)
o Start Time
o Stop Time
o Calculated Curtailment Level
o Update Time
It will also be possible for Market Participants to query the same data via the MUI. The
following will be displayed:
o The Resource (Type-Name format), Start Time, Stop Time, and Calculated
Curtailment Level
o It should be possible to filter on Resource, Day
o Each MP should only be able to query the Calculated Curtailment Level for
resources they own
3.2.2 PRR214 – Offer Price Floor
•
•
•
EIS Offer submission will return an error if the price is less than the “Submittal EIS Offer
Floor”
EIS Offer submission will return an error if the price is greater than the “Submittal EIS Offer
Cap”
EIS Offer submission will return an error if Submittal EIS Offer Floor or Submittal EIS Offer
Cap parameters are not set.
3.2.3 SPR21099 – RTB Manual Approval
•
Market participant testing not required.
3.2.4 SPR22000 – External BA Inadvertent and Delta Term Adjustment
•
Market participant testing not required.
3.2.5 SPR22061 – Publish Total Production Cost
•
Market participant testing not required.
3.2.6 SPR22089 – Exclusion of External Loads
•
Market participant testing not required.
3.2.7 SPR22092 – XGEN Resources to use QuickStart Logic
•
Market participant testing not required.
3.2.8 SPR22096 – QueryViolationRelaxationLimitType Fix
•
QueryViolationRelaxationLimitType will be changed in the following manner:
4
EIS Market Release 1.0
Market Participant Test Plan
o
o
o
<Resource> changed to <ResourceEntity>
<Constraint> changed to <ContraintEntity>
<ConstraintType> changed to optional
3.2.9 SPR22120 – Allow Supplemental Reserves for Pumping Resources
•
Market participant testing not required.
4. Test Preparation
4.1 Test Execution Prerequisites
The following test preparation actions must be completed prior to the start of test execution:
• Testing Contacts representative identified by CWG and communicated to CWG Secretary.
• Review the test scenarios and expected results.
• Successfully test access to ITE Portal by all Market Participants
5. Test Schedule
Two Weeks prior to start of testing we will hold a conference call to provide the Market Participants an
opportunity to ask questions regarding the upcoming MP testing. A kick-off call will also be held the
day prior to the open of the scripted testing session. All dates below are listed for 2011 unless
otherwise noted.
Date
Activity
8/1 – 9/2
9/5
9/6
9/6 – 9/9
SPP Internal Testing
SPP Holiday - Labor Day
MP Testing Documentation Review
MP Connectivity Testing
Vendor Testing
MP Testing Kick Off
MP Test Script Execution
Vendor Testing
Last Day for MP Testing
Final Testing Status Call
Additional SPP Internal Testing
Implement Release into Production
9/9
9/12 – 10/21
10/21
10/24 – 11/4
Week of 11/7
Weekly debrief conference calls will be held every week of the MP test phase by SPP. All MPs are
expected to participate in the weekly debrief conference calls, where attendance will be noted by
SPP. The topics covered during the debrief conference call will include:
•
•
•
Review of results and issues discovered during the current week
Review Market Participants test status
Address any MP questions
5
EIS Market Release 1.0
Market Participant Test Plan
6. Exit Criteria
The Market Participant Testing Phase will be considered completed when all participants have
completed all testing conditions and significant issues have been resolved.
7. Acronyms
Acronym
A/S
API
BA
CRR
CWG
GUI
LSA
MP
MUI
NSI
RP
RSS
RTOSS
SPP
XML
CSV
EIS
LIP
OOME
URD
ACE
EI
ICCP
kV
MW
Description
Ancillary Service
Application Programmatic Interface
Balancing Authorities
Customer Relations Representatives
Change Working Group
Graphical User Interface
Local Security Administrator
Market Participant
Market User Interface
Net Schedule Interchange
Resource Plan
Reserve Service Sharing
RTO Scheduling System
Southwest Power Pool
Extensible Markup Language
Comma separated value (file type)
Energy Imbalance Service
Locational Imbalance Pricing
Out of Order Merit Energy
Uninstructed Resource Deviation
Area Control Error
Energy Imbalance
Inter-Control Center Communications Protocol
Kilovolts
Megawatt
6