Testing Tools
Categories of testing tools

Black box testing, or functional testing


Testing performed via GUI. The tool helps in
emulating end-user actions and generating
data input
White box testing, or static analysis

The tool scans the source code for logical
errors
Functional Testing Tools

Advanced Testing Tools Capabilities

Produce test scripts via Wizard that allows to








Record business processes by emulating a user’s actions
Insert checkpoints to compare actual and expected results
Verify database value
Run test scripts
Provide detailed reports of errors
Provide the ability to customize test scripts or to program more
sophisticated test cases
Ensure reusability of test scripts
Can test both web applications and regular client/server apps
Functional Testing Techniques

The following technique is used to produce test scripts




The following technique is used to run test scripts





Create the GUI map
Create test scripts with Test Script Language
Create user-defined functions
The engine interprets the script, line by line
Verify – compare expected and actual results
Debug – record the test traces for analysis
Update – runtime changes of the expected results or scripts
The following technique is used to analyze the results



Review reports
Analyze the results
Report defects
Functional Testing Tools Demo

WinRunner – HP product
http://en.wikipedia.org/wiki/WinRunner#DE
MO

QTP (HP)

Functional Testing Tools





WinRunner from HP
Test Partner from Compuware
LoadRunner from HP
Rational Functional Tester from IBM
A lot of others
Performance and Load Testing

Advanced Testing Tools capabilities:








Create virtual users
Generate load requests
Capture runtime settings of the server environment
Run load requests
Monitoring of servers
Produce the log
Produce the reports
Produce the diagrams to show time and resource
consuming diagnostic
Load vs. Functional Testing



Load testing tools emulate thousands of users
when a functional testing is doing with a single
user emulating
Load tests do not emulate user’s actions, they
produce loading via API calls using the same
protocols as the application does
Load tests differentiate application from its
infrastructure and give specific results for each
of them
Load testing tools



LoadRunner from HP
NRG Performance Management Suite
Other
Static analysis




Advanced testing tools capabilities:
Visualize and re-engineer software architecture
Reconstruct the workflow logic
Discover inconsistency and errors in regards to the
code, such as






Initial and late state
Looping
Race conditions
Workflow control
Incorrect object references
Null pointers
Static analysis

Capable to discover security holes:












Buffer overflow
Memory leak
Resource leak
Unvalidated Input
Broken Access Control
Broken Authentication and Session Management
Cross Site Scripting
Buffer Overflow
Injection Flaws
Improper Error Handling
Insecure Storage
Application level Denial of Service
Static Analysis Tools



Fortify
Klocwork
Open source – FindBugs for Java