Objectives of the Performance Test
Which environment will be tested (environment needs to closely mirror
production environment)?
Is the environment OLTP, Batch or a combination of both?
Will the test environment be a specially created Performance Test Environment?
Will a Development/Test environment be used?
Will the production environment be used?
How will the environment be restored back to pre-load test database to re-run
test (Flashback database, etc.)?
What is the timeline for the test?
Is the test before production go-live?
Is the test a production baseline test?
Is the purpose of the test code/design to test changes in application?
What is the purpose of Performance Test?
Is it a load Test?
Is it a stress Test?
Is it a regression Test?
Is it a goal Oriented Test?
What is the scope of Test?
Is the test a system test?
Is the test an analysis of performance?
Is the purpose of the test for application/database tuning?
Is the purpose of the test to predict performance in terms of future growth?
Design of the Performance Test
What transactions will be tested?
How many scenarios will be tested?
Will ""noise"" scenarios be added (i.e. other actions conducted on system during
main action - browsing, etc.)?
What userids will be used for the test – existing or test ids?
What URL will be used for the test?
How many users are concurrently logged onto system at peak load?
How many vusers will be used for test?
How will users be divided among the script tasks to be tested (i.e. test 4 actions
during test and divide users among scripts 100 for script 1, 200 for script 2, 50
for script 3 and 150 for script 4)?
Will vuser pause before re-logging in again to perform action - pacing (i.e. wait 30
seconds before logging in again)?
How long will users spend on each web page of application during test (wait
time)?
Will each user logoff after action performed and log back on to go through again?
How will quickly will vusers log into system - ramp-up (i.e. 1 per second until all
vusers are logged in)?
How will test conclude - ramp-down (i.e. 1 vuser logs off every second)?
How long will the test run?
Data for Test
What data is to be used for the test?
What volume of data needs to be tested (similar to real-life)?
Does extra data need to be generated for test (testing future growth)?
Will data be entered into the system during the test?
Can vuser re-run action over again without new data?
Can this data be reused during the test or only one time per user?
Performance Test
Will OAAIS/ITS assistance be needed to analyze performance issues
(database/load test)?
What performance monitoring tools were used for load test (Enterprise Manager,
scripts, server-side tools)?
How will errors were captured during test?
How/when will tuning recommendations are instituted?
Will another performance test be necessary after fixes implemented?