Can Survey Respondents with Visual
Deficits Complete My Web Survey?
DC-AAPOR
Web Survey Workshop
September 10, 2009
Lawrence A. Malakhoff
U.S. Census Bureau
1
Overview
•
•
•
•
•
•
•
•
Defining Accessibility
Testing Methodology
Usage of Color
Visual Focus
Reading Order
Techniques to Reduce Memory Burden
Navigation Instructions
Types of Web Surveys
2
An Unfamiliar Requirement
• A RFP from a Federal
Agency for a Web Survey
requires the software to
conform to Section 508.
• 13.8 million hits on “Section
508” from Google with
references to standards
and checklists.
• The Web survey designer
must understand this
requirement before design
begins.
3
Defining Accessibility
• “Section 508 requires that when Federal
agencies develop, procure, maintain, or use
electronic and information technology,
Federal employees with disabilities have
access to and use of information and data
that is comparable to the access and use by
Federal employees who are not individuals
with disabilities, unless an undue burden
would be imposed on the agency.” (1194.1)
• Applies to Federal Internet & Intranet Web
sites, forms, Web surveys, and desktop
applications since 6/2001.
4
What is an Accessible Web Survey?
• Usable
• Conforms to Section 508
• Enables the screen-reader user to
experience the same visual sequence of
questions, answer choices, skip
patterns and instructions
• Single accessible version, versus
separate versions
• The design process includes
accessibility
5
Automated Tools
• Automated tools available – Cynthia Says
(free), AccVerify, and InFocus
• Tools do not interpret results within context of
the page.
• Content can be accessible, but not usable if it is
unstructured.
6
Testing Methodology
• Focused on persons with visual
impairments.
• Used the InFocus automated testing tool
• Used the Job Access With Speech (JAWS)
screen reader to verify accessibility findings.
• Tested related elements, HELP, FAQs, etc.,
with JAWS & Adobe Acrobat.
7
Usage of Color
• “Color coding shall not be
used as the only means of
conveying information,
indicating an action,
prompting a response, or
distinguishing a visual
element.” (1194.21(i))
• Users with a color deficit
see in shades of gray.
• Click on the green button
or the Go button?
GO
8
Visual Focus
• “A well-defined on-screen indication of the
current focus shall be provided that moves
among interactive interface elements as the
input focus changes. The focus shall be
programmatically exposed so that assistive
technology can track focus and focus
changes.” (1194.21(c))
• Visual Focus is shown as a dotted rectangle
around the current button or link and changes
when the user presses the tab key.
9
Visual Focus is shown when tabbing
10
Reading Order
Reading
starts
Here.
1
Response
options.
Navigation
buttons.
2
3
11
Placement of Instructions and
Memory Burden
• Lengthy instructions can interfere with recall of the original
question.
• Better to list topic, instructions, question, then response
data entry field or options, in that order.
Question?
Topic
•Instruction 1.
•Instruction 1.
•Instruction 2.
•Instruction 2.
•Instruction 3.
•Instruction 3.
response:
Preferred
Question?
12
Inferences and Memory Burden
Please check all that apply to your residence:
Condition 1.
If condition 2 is checked,
conditions 1 and 3
Condition 2.
do not need to
Condition 3.
be present in later questions.
Please tell us the number of rooms.
•If condition 1, …
•If condition 2, …
•If condition 3, …
number:
13
Inferences and Memory Burden(2)
• Use of “his”, “hers”, “he”, “she” is more engaging to the
respondent than “this person.”
• Personal pronouns are preferable to a first name because
they are less likely to be mispronounced by the screen
reader.
How many children did
this person have?
number:
How many children
did she have?
Preferred
14
Stem and Leaf Questionnaire
Structure
• Stem contains the first part of the question
• Two or more conditions (leaves) follow
• The second and later leaves pose a memory
burden for screen-reader users
• Backward navigation may be necessary if
stem text cannot be recalled
• Technically accessible but poor usability
15
Ste
m
These questions deal with your usage of some
accessibility features of MS-Windows just
during the last month. How much of the time
last month did you use:
Leaf 1
Always
Often
Sometimes
Seldom
Never
Mouse Keys
Sticky Keys
Filter Keys
Leaf 3
Leaf 2
16
Navigation Instructions
• Design for linear and
random access
differences
• Instructions to
choose a link to the left
left/right problematic
• Screen-reader users
must guess at
navigation strategy
• “Click the link below”
implies forward
navigation
Lorem ipsum dolor sit
amet, consectetur
adipisicing elit, sed do
eiusmod tempor
incididunt ut labore et
dolore magna aliqua.
Click the button on
the left. Ut enim ad
minim veniam, quis
nostrud exercitation
ullamco laboris nisi ut
aliquip ex ea
commodo consequat.
Click the button on
the right.
right
For more information,
click the link below.
www.census.gov
17
Types of Web Surveys
• Screen-based
• Scrolling/paging
• Screen-based form offers a key advantage
over a scrolling Web Survey – reduction of
memory burden.
18
Recommendations for Accessible
Web Surveys
•
•
•
•
•
Make it usable
Make it accessible
Ensure correct reading order
Create a single accessible version
Use questionnaire structures that reduce user
memory burden
• Use a screen-based Web survey
19
References
• Cynthia Says: http://www.contentquality.com/
• AccVerify:
http://www.hisoftware.com/products/accverify.html
• InFocus:
https://www.ssbbartgroup.com/amp/infocus.php
• Moss, Trenton (2007). The Problem With Automated
Accessibility Testing Tools, retrieved from
http://www.webcredible.co.uk/user-friendly-resources/
web-accessibility/automated-tools.shtml on 4/10/2009
• Window-Eyes: http://www.gwmicro.com/
• JAWS: http://www.freedomscientific.com/
20
References(2)
• Peterson, L.R., & Peterson, M.J. (1959).
Short-term retention of individual verbal
items. Journal of Experimental Psychology,
58, 193-198.
• Usability Basics:
http://www.usability.gov/basics
• Accessible forms:
http://www.jimthatcher.com/webcourse8.htm
• WebAIM: http://www.webaim.org/intro/
• Section 508: http://www.section508.gov/
21
Contact
• Lawrence.A.Malakhoff@census.gov
• 301-763-3688
• Survey Practice:
http://surveypractice.org/2009/06/29/508-guidelines/
• Questions?
22