Testing Tools using Visual Studio Randy Pagels Sr. Developer Technology Specialist Microsoft Corporation Plan REQUIREMENTS Monitor + Learn BACKLOG Development Collaboration Develop + Test Production Release Agenda • • • • • • • Web Performance Testing Load Testing Unit Testing Manual Testing Exploratory Testing Coded UI Testing Lab Management Test Manager Manual Testing Tools • • • • • • • • Test Plan Management Test Case Management Shared Steps Management Exploratory Testing Test Configuration Management Test Fast Forwarding Test Data Collection Test Lab Management Visual Studio Automated Testing Tools • • • • • • • Coded UI Tests Web Performance Tests Load Tests Generic Tests Ordered Tests Developer Unit Tests Database Unit Tests New Test Runner Unit Testing with Code Coverage Exploratory Testing • Exploratory testing is the testing of an application without a set of tests defined in advance. During an exploratory test session, you are not restricted to a script or a set of predetermined steps. Some improvements have been made to the exploratory testing in Microsoft Test Manager. Coded UI Testing • Coded UI tests provide a way to create fully automated tests to validate the functionality and behavior of your application’s user interface. You can create coded UI tests directly from existing action recordings. Action recordings contain the steps taken during manual testing of an application. Web Performance Testing • Any new Web performance and load testing efforts you create in Visual Studio are now created in a Web performance and load test project type instead of a test project. A Web performance test consists of a series of HTTP requests. Web performance tests work at the protocol layer by issuing HTTP requests. Load Testing • Load tests consist of a series of Web performance tests or unit tests which operate under multiple simulated users over a period of time. Load tests can also include automated coded UI tests. Coded UI tests should be included only under specific circumstances. All the scenarios that use coded UI tests in load tests involve using the coded UI tests as performance tests. View the performance data from Application Insights Application counters are correlated with the user load Understand what issues may be causing any performance problems Easily go to Application Insights if you need to do a more detailed analysis Load Test Manager Demo Testing Tools using Visual Studio REST APIs for tags Query on Tag Tags in Visual Studio Tag Permissions Exclude non-working days Cumulative Flow Start Dates Pinning of Work Item Charts Export your test plan to HTML Choose the level of detail you want Create sets of test data Reference by various test cases Easily bind to automated tests Permissions Reference Set alerts, get notified when changes occur Lab Management • Testing a complex multi-tiered application and creating different configurations in a user-flow can be challenging. Lab Management provides teams a powerful and flexible development and test lab environment to enable scalable build-deploy-test workflow and continuous integration through environment templates. Testing Architecture Team Foundation Server Test Controller Team Build System Center Virtual Machine Manager (SCVMM) VM Template Library VM Template 1 Test Agent VM Template 2 Test Agent SCVMM Environment VM Host Web Server VM Database Server VM VMMAgent Test Agent Test Agent Standard Environment Web Server Test Agent Database Server Test Agent Build-Deploy-Test (1) Get Source Code (2) Compile projects Team Build Team Foundation Server (8) Publish results to Team Foundation Server (3) Copy build to running environment SCVMM Environment Test Controller (7) Send test results (6) Execute automated tests VM Host Web Server VM Database Server VM VMMAgent Test Agent Test Agent (4) Run deployment scripts for each machine (5) Create environment snapshot Related Content http://msdn.microsoft.com/en-us/library/tfs/bb385901%28v=vs.110%29 http://msdn.microsoft.com/en-us/library/tfs/dd293547%28v=vs.110%29 http://blogs.msdn.com/b/visualstudioalm/archive/2012/07/09/javascript-unit-tests-on-teamfoundation-service-with-chutzpah.aspx http://blogs.msdn.com/b/visualstudioalm/archive/2012/07/31/writing-a-visual-studio-2012-unittest-adapter.aspx http://msdn.microsoft.com/en-us/library/tfs/ms182539%28v=vs.110%29.aspx http://blogs.msdn.com/b/visualstudioalm/archive/2012/06/04/getting-started-with-loadtesting-in-visual-studio-2012.aspx Visit Team System Café Today! The door is open 24/7 at the café! Stop by for a cup of joe and delicious tidbits on AppDev topics! http://www.teamsystemcafe.net Resources What's New for Application Lifecycle Management in Visual Studio 2012 http://bit.ly/baSMz5 What's new for Microsoft Test Manager 2012 http://bit.ly/wN2JrH Quick Start Guide for Manual Testing using Microsoft Test Manager 2012 http://bit.ly/d4l9qN Test Scribe for Visual Studio 2012 http://bit.ly/Nim0gH What is new in Coded UI Tests 2012 http://bit.ly/zWIbVf Platforms for Coded UI Tests and Action Recordings http://bit.ly/b5m32u