User Vision Request for Quote: Usability testing with disabled people Request for Quote: Usability testing with disabled people Created by: User Vision July 2015 Contact: Chris Rourke, CEO chris@uservision.co.uk Edward Chandler, Principal UX Consultant ed@uservision.co.uk 0131 225 0850 © User Vision™ Limited, 2015. All rights reserved. Page 1 User Vision Request for Quote: Usability testing with disabled people 1. Research brief 1.1. Background Our client has requested User Vision to engage the services of an organisation representing people with a disability, preferably based in the United States of America to conduct usability testing of their website with disabled people and specifically blind and visually impaired people. The focus of the research will be to test an internet booking engine and associated account and booking management on our clients website. We are currently working with our client to make their website accessible to people with disabilities. We are measuring the site against WCAG 2.0 Level AA. Having conducted audits on the site, we are now integrated within their business and development teams to deliver a more accessible site. 1.2. Purpose The objective is to test the usability of our client’s accessible site and to sign off compliance against web accessibility guidelines. The research is to be able to comply with appropriate American legislation and the selected organisation must be knowledgeable on US Disability related legislation. 1.3. Roles and responsibilities User Vision's role is to facilitate the successful delivery of the usability testing. This will include liaison between you and our client, overall management of the project, setting of deliverables and signing off all project work. User Vision is seeking the services of an organisation representing people with a disability, preferably based in the United States of America who has the capacity, experience and knowledge to successfully conduct this research. This will include the following responsibilities: Recruitment of appropriate end users and payment of an incentive Provision of a test room with adjoining observation room Preparation of the test plan in discussion with User Vision and our client Provision of appropriate computer equipment along with all relevant assistive technologies for the end users to use Conducting the usability testing Recording of the sessions with picture in picture of the participant Analysis of the test sessions and report write up with recommendations Accessibility statement summarising the accessibility of the site © User Vision™ Limited, 2015. All rights reserved. User Vision Request for Quote: Usability testing with disabled people There should be an option of a face to face presentation following completion of the report. 1.3.1 Recruitment The chosen organisation will be responsible for all aspects of the recruitment of participants for the usability testing in accordance with the recruitment criteria Once recruitment has started, User Vision will expect an update twice a week with participant numbers recruited and participant profiles. User Vision and our client is happy to be guided in terms of participant numbers, however we expect additional participants to be recruited in case of no shows. All participants should be familiar computer users, who use assistive technologies and the web. Our client requires a robust methodology with a variety of different type of users. Participants for each of the following screenreaders: o JAWS (on windows) o NVDA (on windows) o Any other screenreader felt important to test with Participants for each of the following magnification solutions: o Zoomtext (on windows) o Any other magnification software felt important to test with 60% Males / 40% Females 30% Intermediate / 70% Expert AT users 30% regular / 70% Prolific web users Even splits across age ranges: 18-75 All must have travelled by air (preferably internationally) Each participant will receive an incentive of $100 for their time. The chosen organisation will be expected to handle all payments to the participant. Neither User Vision nor our client will be liable for any tax implications connected with the participants as a result of the incentive. 1.3.2 Provision of test room with observation room We require that the selected organisation provide an appropriate test room for conducting one on one usability testing that is accessible for disabled people. The test room must have an adjoining observation room preferably connected by a one-way mirror or connected via video link to a screen. The observation room will need to accommodate between 3-5 people and include refreshments throughout the test days. We would prefer the testing to be conducted in one of the following US cities: © User Vision™ Limited, 2015. All rights reserved. User Vision Request for Quote: Usability testing with disabled people Boston New York Los Angeles Chicago Washington Orlando Houston Dallas San Francisco Seattle We will consider alternative cities however preference will be given to testing in one of the above US cities. In addition to the onsite observation facility, provision for remote observation is highly desirable. Please note that neither User Vision nor our client will be liable for any complaints by the participants related to the accessibility of the test venue. 1.3.3 Preparation of the test plan The selected organisation will be responsible for creating the test plan, which is to be used during the usability testing with input from User Vision and our client. Appropriate quantitative and qualitative metrics will be provided by the selected organisation to meet the needs of the research. The main objectives of the research will be defined in consultation with successful organisation. User Vision and our client will need to sign off the test plan so it will need to be provided well in advance of the test days. 1.3.4 Provision of appropriate computer equipment User Vision and our client expect the successful organisation to provide relevant computer equipment along with all assistive technologies for the participants to use. All software must be fully licenced versions and not trial versions. 1.3.5 Conducting the usability testing We will expect the successful organisation to facilitate the test sessions with the participants. The facilitator must have a proven track record of conducting usability testing with disabled people and a background in relevant fields such as User Experience, Human Factors and User Research. © User Vision™ Limited, 2015. All rights reserved. User Vision Request for Quote: Usability testing with disabled people We expect the successful organisation to have a proven test methodology including informed consent. We are happy to be guided on the number of test sessions per day. We anticipate that each test session will last for 60 minutes. 1.3.6 Recording of the sessions with picture in picture of the participant We expect the test sessions to be recorded for evidence as well as providing clips in the report to highlight and support insight. The recordings should be of the screen, any assistive technology running and include a picture in picture of the participant. All the recordings will need to be handed over to User Vision and our client following completion of the testing. 1.3.7 Analysis of the test sessions and report write up with recommendations Following the completion of the testing with disabled people, the successful organisation is expected to deliver a comprehensive report. The report will detail the findings of the testing in addition to nature and methodology of the testing. The report needs to be delivered in Word or PowerPoint and PDF format. The report must be delivered no later than two weeks following the end of the testing. An optional presentation of the findings back to User Vision and our client should be included. 1.3.8 Accessibility statement summarising the accessibility of the site Along with the delivery of the report, our client wishes to be provided with a signed statement from the organisation confirming the accessibility of the website and that usability testing with disabled people has been performed. This should be provided on headed letterhead. 1.4. Quote submission Submissions are to be made to Edward Chandler (ed@uservision.co.uk) in either Word or PowerPoint format as well as a version in pdf format. The quote needs to be received by close of business (6pm BST) 31st of July 2015. Quotes should detail your approach to this research addressing all aspects mentioned in this RFQ. Profiles of the facilitator and any project team members should be included. Venue information should also be included in the submission © User Vision™ Limited, 2015. All rights reserved. User Vision Request for Quote: Usability testing with disabled people 1.5. Costs Budgets have yet to be agreed by our client, however as a UX Consultancy that is experienced in delivering this type of research, we will review costs for value for money and ability to meet the requirements of the RFQ. Costs should be broken down into different project segments with any expenses (e.g. incentives, room hire etc) individually accounted for. Submissions should be in US Dollars. 1.6. Testing timescales The user testing must be conducted in October or early November 2015 with a hard deadline for the report being delivered by close of business (6pm GMT) 20th November 2015. 1.7. Confidentiality and ownership The successful organisation will be required to sign a non-disclosure agreement with ourselves and our client. All material generated by the successful organisation for or as a result of the usability testing including but not limited to; the test plan, any recordings, the report and any presented material will be proprietary property of our client and cannot be used for any other purpose other than conducting and reporting on the usability testing. © User Vision™ Limited, 2015. All rights reserved.