Lekcija13 - 01_Selenium_2012_11_29 - files-ante-lv
advertisement
Testing Web applications
Selenium
What is Selenium?
• Selenium is a suite of tools to automate web
application testing across many platforms
• Tests run directly in the browser
• Selenium is implemented entirely with browser
technology
•
•
•
JavaScript
DHTML
Frames
Traditional approach for testing
Feature developed
Acceptance Testing
Bug found!
Regression Testing
Regression found!
Release
Development
Faster feedback
Development
Regression Testing
• Write test as you go
• Run them as often as you can
• Problems are found quickly
Release
Acceptance Testing
Why automated tests?
• Manual testing is slow, tedious and error-prone
• Especially for regression!
Regression Testing
3 months
• Either take long time or less thorough
• What now? Start again?
With automated tests
Regression Testing
10 minutes
• Consistently thorough
• Fast enough to start again and again and again…
Selenium components
• Selenium IDE
•
an integrated development environment for Selenium tests
• Selenium WebDriver
•
•
a Java library
write Java code, WebDriver sends commands to a browser
• Selenium-Grid
•
allows to run tests on different machines against different
browsers in parallel
Selenium usages
• Browser compatibility testing
Test your application to see if it works correctly
on different browsers and operating systems. The
same script can run on any Selenium platform.
• System functional testing
Create regression tests to verify application
functionality and user acceptance.
How to start
• Download and install Selenium IDE
• It is implemented as a Firefox extension, and
allows you to record, edit, and debug tests
http://seleniumhq.org/download/
• To launch Selenium IDE in Firefox select
Tools Selenium IDE
Selenium IDE
• Firefox extension
• Easy record and playback
• Not just a recorder
• Intelligent field selection
will use IDs, names,
or XPath as needed
Selenium IDE
• Auto-complete for all
common Selenium
commands
• Walk through tests
• Debug and set breakpoints
• Save tests as HTML, Ruby
scripts, or any other format
Selenium test format
• Selenium saves all information in an HTML table
format
• Each record consists of:
•
Command – tells Selenium what to do using actions or
assertions (e.g. “open”, “type”, “click”, “assertText”)
•
Target – tells Selenium which HTML element a
command refers to (e.g. textbox, header, table)
•
Value – used for any command that might need a value
of some kind (e.g. “Hello”)
Example: Selenium test
Test writing strategy
1. Start recording in Selenium IDE
2. Execute scenario on a running web application
3. Stop recording in Selenium IDE
4. Add assertions
Adding tests to Web app (deprecated)
To include Selenium tests into your Web
application need to do the following:
1. Download Selenium Core from
http://release.seleniumhq.org/selenium-core/1.0/
2. Unzip in under “webapp” directory:
\your_app\src\main\webapp\selenium-core
3. Place your tests into e.g.
\your_app\src\main\webapp\tests
Creating tests and test suite
• Create several tests in Selenium IDE
• Save them as e.g.
•
•
\webapp\tests\discussions-suite\MyTest1.html
\webapp\tests\discussions-suite\MyTest2.html
• Create HTML file for test suite, e.g.
\webapp\tests\discussions-suite\MyTestSuite.html
<table>
<tr><td>Music Test Suite</td></tr>
<tr><td>
<a target="testFrame" href=“MyTest1.html">My Test 1</a>
</td></tr>
<tr><td>
<a target="testFrame" href="MyTest2.html">My Test 2</a>
</td></tr>
</table>
Entering point: /tests/index.html
Prepare initial page with a link to your test suite
<html>
<head>
<title>Selenium tests</title>
</head>
<body>
<h1>Music Portal Selenium Tests</h1>
<p>
<a href="../selenium-core/core/TestRunner.html?test=
../../tests/discussions-suite/MyTestSuite.html">
Run tests</a>
</p>
</body>
</html>
Selenium TestRunner view (deprecated)
Browser will display Selenium TestRunner
Selenium Concepts
•
•
•
•
•
Element Locators
• Specify HTML elements
Patterns
• Used for pattern matching values
Action
• Manipulate the state of the application
• Upon failure, testing stops
Accessors
• Store results in variables
• Automatically generates assertions
Assertion
• Verifies that the application generated the appropriate value
Element Locators
• id=id
•
Select the element with the specified @id attribute.
• name=name
•
Select the first element with the specified @name attribute.
• identifier=id
•
•
Select the element with the specified @id attribute
If no match is found, select the first element whose @name id.
• dom=javascriptExpression
•
Find an element using JavaScript traversal of the HTML
DOM. DOM locators must begin with "document."
• dom=document.forms['myForm'].myDropdown
• dom=document.images[56]
Element Locators
• xpath=xpathExpression
•
Locate an element using an XPath expression. XPath
locators must begin with "//".
• xpath=//img[@alt='The image alt text']
• xpath=//table[@id='table1']//tr[4]/td[2]
• link=textPattern
•
Select the link (anchor) element which contains text
matching the specified pattern.
• link=The link text
Locator Defaults
Without a locator prefix, Selenium uses:
•
•
•
dom, for locators starting with "document."
xpath, for locators starting with "//"
identifier, otherwise
Actions
• Represent something a user would do
• Manipulate the state of the application
• Actions generally come in 2 forms: action and
actionAndWait
• action performs the action
• actionAndWait assumes a server call and thus
waits longer for a response
• open automatically waits
Command Actions
• open
•
Opens the target URL
• click*
•
Clicks on the target element
• type*
•
Enters the value specified by the value into the
specified target element
• select*
•
Selects a drop-down value specified by the value in
the specified target element
Command Actions
• selectWindow
• Selects a popup window using the id specified by the
target. If NULL, it returns to the main window
• goBack
• Simulates user clicking back in the browser
• close
• Simulates user clicking the close button of a popup
window
• pause
• Pauses the execution of a script for an amount of
time in milliseconds specified in the target
Command Actions
• fireEvent
•
Simulate an event to trigger the onevent handler
where the target specifies the element and the value
specifies the event
• waitForValue
•
Waits for an input, specified by the target, to have a
certain value, specified by the value (Warning: If
event doesn’t occur, apply previous fix to stop
running script)
• store
•
Stores the value specified by the target into the
variable specified by the value
Command Actions
• chooseCancelOnNextConfirmation
•
Instructs Selenium to select cancel on the next
JavaScript dialog raised
• answerOnNextPrompt
•
Instructs Selenium to return the specified target in
response to the next prompt
Assertions
• Allows user to verify the state of the application
• Three modes:
• assert - upon failure, test is aborted
• verify - upon failure, the test continues running
(logging the failure)
• waitFor
• Waits timeout time for a condition’s truthiness
• Great for testing background Ajax behavior
Selenium WebDriver
• Selenium 2.0 has many new exciting features and
improvements over Selenium 1
• The primary new feature is the integration of the
WebDriver API
• The goal is to develop an object-oriented API that
provides additional support for a larger number of
browsers along with improved support for modern
advanced web-app testing problems
http://seleniumhq.org/docs/03_webdriver.html
Selenium WebDriver
• WebDriver makes direct calls to the browser
using each browser’s native support for
automation
• Can be used equally well in a unit testing or from
a plain old “main” method
• Java, C#, Python, Ruby, Perl, PHP bindings are
provided
Selenium WebDriver
• Maven dependency:
<dependency>
<groupId>org.seleniumhq.selenium</groupId>
<artifactId>selenium-java</artifactId>
<version>2.26.0</version>
</dependency>
• Now you can use WebDriver just as any normal
library: it is entirely self-contained, and you don’t
need to start any additional processes or run any
installers before using it
Selenium WebDriver Example
import org.openqa.selenium.*;
public class SeleniumExample {
public static void main(String[] args) {
WebDriver driver = new FirefoxDriver();
driver.get("http://www.google.com");
WebElement element = driver.findElement(By.name("q"));
element.sendKeys("Cheese!");
element.submit();
System.out.println("Page title is: " + driver.getTitle());
// Google's search is rendered dynamically with JavaScript.
// Wait for the page to load, timeout after 10 seconds
(new WebDriverWait(driver, 10)).until(new
ExpectedCondition<Boolean>() {
public Boolean apply(WebDriver d) {
return d.getTitle().toLowerCase().startsWith("cheese!");
}
});
System.out.println("Page title is: " + driver.getTitle());
driver.quit();
}
}
http://seleniumhq.org/docs/03_webdriver.html
Selenium-Grid
Selenium-Grid
allows to run your
tests on different
machines against
different browsers
in parallel
http://seleniumhq.org/docs/07_selenium_grid.html
Selenium-Grid
Reasons to use Selenium-Grid:
• To run your tests against multiple browsers,
multiple versions of browser, and browsers
running on different operating systems
• To reduce the time it takes for the test suite to
complete a test pass.
Selenium Resources
• Selenium Home Page
http://seleniumhq.org/
• Selenium dokumentācija
http://seleniumhq.org/docs/
• Par Selenium latviski
http://www.ante.lv/xwiki/bin/view/TrainingWebProgrammi
ng/Selenium
HttpUnit
HttpUnit framework
• HttpUnit is an open source software testing
framework used to perform testing of web sites
without the need for a web browser
http://httpunit.sourceforge.net/
Obtaining a web page response
• The center of HttpUnit is the WebConversation
class, which takes the place of a browser talking
to a single site
• Responsible for maintaining session context,
which it does via cookies returned by the server
• Must create a request and ask the
WebConversation for a response
Starting the conversation
WebConversation wc = new WebConversation();
WebRequest req = new GetMethodWebRequest(
"http://www.meterware.com/testpage.html");
WebResponse resp = wc.getResponse(req);
• The response may now be manipulated either as
pure text, as a DOM, or by using the various
other methods
Examining and following links
• The simplest and most common form of
navigation among web pages is via links
• HttpUnit allows users to find links by the text
within them, and to use those links as new page
requests
WebConversation wc = new WebConversation();
WebResponse resp = wc.getResponse(
"http://www.httpunit.org/doc/cookbook.html");
WebLink link = resp.getLinkWith("response");
link.click();
WebResponse jdoc = wc.getCurrentPage();
Using the table structure of a web page
• The getTables() method will return an array of
the top-level tables in the page, in the order in
which they appear in the document
• Given a table, you can ask for one of its cells, and
treat the result either as text or a DOM or ask for
and tables, links, or forms nested within it
Table manipulation example
• The following code will confirm that the first
table in the page has 4 rows and 3 columns, and
that there is a single link in the last cell of the first
row:
WebTable table = resp.getTables()[0];
assertEquals("rows", 4, table.getRowCount());
assertEquals("columns", 3,table.getColumnCount());
assertEquals("links", 1,
table.getTableCell(0,2).getLinks().length );
Working with forms
• There are a few basic things that a tester is likely
to want to do with a form
• The most obvious first step is to verify the
controls and their default values
• If they are correct, the tester will generally make
some changes and submit the form to see how the
system responds
Testing a form
WebForm form = resp.getForms()[0];
assertEquals("La Cerentolla",
form.getParameterValue( "Name" ));
assertEquals("Chinese",
form.getParameterValue( "Food" ));
assertEquals("Manayunk",
form.getParameterValue( "Location" ));
assertEquals("on",
form.getParameterValue( "CreditCard" ));
form.setParameter( "Food", "Italian" );
form.removeParameter( "CreditCard" );
form.submit();
HttpUnit Resources
• HttpUnit home page
http://httpunit.sourceforge.net/
