User Vision RFQ Usability Testing with Disabled People

User Vision Request for Quote: Usability testing with disabled people
Request for Quote:
Usability testing with disabled people
Created by: User Vision
July 2015
Contact:
Chris Rourke, CEO
chris@uservision.co.uk
Edward Chandler, Principal UX Consultant
ed@uservision.co.uk
0131 225 0850
© User Vision™ Limited, 2015. All rights reserved.
Page 1
User Vision Request for Quote: Usability testing with disabled people
1.
Research brief
1.1. Background
Our client has requested User Vision to engage the services of an organisation
representing people with a disability, preferably based in the United States of
America to conduct usability testing of their website with disabled people and
specifically blind and visually impaired people.
The focus of the research will be to test an internet booking engine and associated
account and booking management on our clients website.
We are currently working with our client to make their website accessible to people
with disabilities. We are measuring the site against WCAG 2.0 Level AA. Having
conducted audits on the site, we are now integrated within their business and
development teams to deliver a more accessible site.
1.2. Purpose
The objective is to test the usability of our client’s accessible site and to sign off
compliance against web accessibility guidelines.
The research is to be able to comply with appropriate American legislation and the
selected organisation must be knowledgeable on US Disability related legislation.
1.3. Roles and responsibilities
User Vision's role is to facilitate the successful delivery of the usability testing. This
will include liaison between you and our client, overall management of the project,
setting of deliverables and signing off all project work.
User Vision is seeking the services of an organisation representing people with a
disability, preferably based in the United States of America who has the capacity,
experience and knowledge to successfully conduct this research. This will include
the following responsibilities:








Recruitment of appropriate end users and payment of an incentive
Provision of a test room with adjoining observation room
Preparation of the test plan in discussion with User Vision and our client
Provision of appropriate computer equipment along with all relevant
assistive technologies for the end users to use
Conducting the usability testing
Recording of the sessions with picture in picture of the participant
Analysis of the test sessions and report write up with recommendations
Accessibility statement summarising the accessibility of the site
© User Vision™ Limited, 2015. All rights reserved.
User Vision Request for Quote: Usability testing with disabled people
There should be an option of a face to face presentation following completion of the
report.
1.3.1 Recruitment
The chosen organisation will be responsible for all aspects of the recruitment of
participants for the usability testing in accordance with the recruitment criteria
Once recruitment has started, User Vision will expect an update twice a week with
participant numbers recruited and participant profiles.
User Vision and our client is happy to be guided in terms of participant numbers,
however we expect additional participants to be recruited in case of no shows.
All participants should be familiar computer users, who use assistive technologies
and the web.
Our client requires a robust methodology with a variety of different type of users.

Participants for each of the following screenreaders:
o JAWS (on windows)
o NVDA (on windows)
o Any other screenreader felt important to test with

Participants for each of the following magnification solutions:
o Zoomtext (on windows)
o Any other magnification software felt important to test with





60% Males / 40% Females
30% Intermediate / 70% Expert AT users
30% regular / 70% Prolific web users
Even splits across age ranges: 18-75
All must have travelled by air (preferably internationally)
Each participant will receive an incentive of $100 for their time. The chosen
organisation will be expected to handle all payments to the participant.
Neither User Vision nor our client will be liable for any tax implications connected
with the participants as a result of the incentive.
1.3.2 Provision of test room with observation room
We require that the selected organisation provide an appropriate test room for
conducting one on one usability testing that is accessible for disabled people.
The test room must have an adjoining observation room preferably connected by a
one-way mirror or connected via video link to a screen.
The observation room will need to accommodate between 3-5 people and include
refreshments throughout the test days.
We would prefer the testing to be conducted in one of the following US cities:
© User Vision™ Limited, 2015. All rights reserved.
User Vision Request for Quote: Usability testing with disabled people










Boston
New York
Los Angeles
Chicago
Washington
Orlando
Houston
Dallas
San Francisco
Seattle
We will consider alternative cities however preference will be given to testing in one
of the above US cities.
In addition to the onsite observation facility, provision for remote observation is
highly desirable.
Please note that neither User Vision nor our client will be liable for any complaints
by the participants related to the accessibility of the test venue.
1.3.3 Preparation of the test plan
The selected organisation will be responsible for creating the test plan, which is to
be used during the usability testing with input from User Vision and our client.
Appropriate quantitative and qualitative metrics will be provided by the selected
organisation to meet the needs of the research.
The main objectives of the research will be defined in consultation with successful
organisation.
User Vision and our client will need to sign off the test plan so it will need to be
provided well in advance of the test days.
1.3.4 Provision of appropriate computer equipment
User Vision and our client expect the successful organisation to provide relevant
computer equipment along with all assistive technologies for the participants to use.
All software must be fully licenced versions and not trial versions.
1.3.5 Conducting the usability testing
We will expect the successful organisation to facilitate the test sessions with the
participants.
The facilitator must have a proven track record of conducting usability testing with
disabled people and a background in relevant fields such as User Experience, Human
Factors and User Research.
© User Vision™ Limited, 2015. All rights reserved.
User Vision Request for Quote: Usability testing with disabled people
We expect the successful organisation to have a proven test methodology including
informed consent.
We are happy to be guided on the number of test sessions per day.
We anticipate that each test session will last for 60 minutes.
1.3.6 Recording of the sessions with picture in picture of the participant
We expect the test sessions to be recorded for evidence as well as providing clips in
the report to highlight and support insight.
The recordings should be of the screen, any assistive technology running and include
a picture in picture of the participant.
All the recordings will need to be handed over to User Vision and our client following
completion of the testing.
1.3.7 Analysis of the test sessions and report write up with recommendations
Following the completion of the testing with disabled people, the successful
organisation is expected to deliver a comprehensive report.
The report will detail the findings of the testing in addition to nature and
methodology of the testing.
The report needs to be delivered in Word or PowerPoint and PDF format.
The report must be delivered no later than two weeks following the end of the
testing.
An optional presentation of the findings back to User Vision and our client should be
included.
1.3.8 Accessibility statement summarising the accessibility of the site
Along with the delivery of the report, our client wishes to be provided with a signed
statement from the organisation confirming the accessibility of the website and that
usability testing with disabled people has been performed. This should be provided
on headed letterhead.
1.4. Quote submission
Submissions are to be made to Edward Chandler (ed@uservision.co.uk) in either
Word or PowerPoint format as well as a version in pdf format.
The quote needs to be received by close of business (6pm BST) 31st of July 2015.
Quotes should detail your approach to this research addressing all aspects
mentioned in this RFQ.
Profiles of the facilitator and any project team members should be included.
Venue information should also be included in the submission
© User Vision™ Limited, 2015. All rights reserved.
User Vision Request for Quote: Usability testing with disabled people
1.5. Costs
Budgets have yet to be agreed by our client, however as a UX Consultancy that is
experienced in delivering this type of research, we will review costs for value for
money and ability to meet the requirements of the RFQ.
Costs should be broken down into different project segments with any expenses
(e.g. incentives, room hire etc) individually accounted for.
Submissions should be in US Dollars.
1.6. Testing timescales
The user testing must be conducted in October or early November 2015 with a hard
deadline for the report being delivered by close of business (6pm GMT) 20th
November 2015.
1.7. Confidentiality and ownership
The successful organisation will be required to sign a non-disclosure agreement with
ourselves and our client.
All material generated by the successful organisation for or as a result of the
usability testing including but not limited to; the test plan, any recordings, the report
and any presented material will be proprietary property of our client and cannot be
used for any other purpose other than conducting and reporting on the usability
testing.
© User Vision™ Limited, 2015. All rights reserved.