EU Web Accessibility Observatory Madrid “November” 2009 INTECO 2 Web Accessibility Audit Public Administration Websites accessibility audit • Accessibility requirements of the Spanish Standard UNE 139803. • • Inclusion of solutions for the problems identified. Technical and executive summaries. Monitoring reports / Periodic reviews • • Analysis done based on previous reports. Tracks the tasks performed for correction and improvement. 3 Web Accessibility Monitor • • Based on WCAG 1.0 Comparativa de Puntuación entre oleadas Nivel I, Nivel II y Media Global. 30 Public Web sites studied in three segments 10,00 9,00 7,6 8 8,00 7,3 0 7,2 3 7,14 6 ,9 2 7,00 6 ,8 5 6 ,9 1 6 ,59 6 ,56 6,00 Ministerio del Interior (MIR) - Puntuaciones Medias Nivel II 5,00 10,00 Puntuaciones Medias de Resultados Twice per year (three so far) 7,00 10 ,0 0 6,00 10 ,0 0 9 ,0 0 8 ,0 0 5,00 4,00 5 ,0 0 Sample of 10 pages per site Accessibility check: • Level I: 11 points tested 2.1.1 2.1.2 0 ,0 0 2.1.3 0 ,0 0 2.1.4 2.1.5 2.2.1 2.2.2 2.2.3 2.2.4 2,00 1,00 0,00 Nivel I Nivel II Media Oleada I - Enero 2007 7,14 6,56 6,85 Oleada II - Octubre 2007 7,68 6,92 7,30 0,00 Oleada III - Mayo 2008 7,23 6,59 6,91 2,00 1,6 7 NP 3,00 1,00 3,00 3 ,0 0 (25 in the first and the second year) • 8,00 2.2.5 Puntos de Verificación Comparación de medias por verificación - Nivel II TOTALES Nivel A 70% Nivel AA 10,00 9,00 Puntuaciones Medias de Resultados • • 4,00 9,00 NV 10% 20% 8,00 7,00 6,00 9,53 5,00 8,33 7,77 4,00 8,40 7,66 6,75 3,00 6,14 5,23 4,86 2,00 1,25 1,00 0,00 2.1.1 2.1.2 2.1.3 2.1.4 2.1.5 2.2.1 2.2.2 2.2.3 2.2.4 2.2.5 Puntos de Verificación (Level I for WAI-A) • Analysis of the results • Data consolidation • Comparison charts • Global evaluation • Conclusions 9,00 MEH - Ministerio de Economía y Hacienda BOE - Boletín Oficial del Estado INE - Servicio Público de Empleo Estatal / INEM INJ - Instituto Nacional de la Juventud MEP - Ministerio de Educación, Política Social y Deporte MSC - Ministerio de Sanidad y Consumo MUJ - Instituto de la Mujer SEG - Seguridad Social TAS - Ministerio de Trabajo y Asuntos Sociales UNE - Universidad Nacional de Educación a Distancia 8,00 7,00 6,00 5,00 9,82 9,18 8,55 4,00 7,82 7,68 7,21 6,91 6,40 6,36 3,00 4,03 2,00 A: Nivel A AA: Nivel AA NV: No válido 1,00 0,00 BOE MEH SEG INE TAS MSC MUJ INJ UNE MEP Portales Comparación de Medias según puntos - Todos los portales - Nivel II 10,00 9,00 Puntuaciones Medias de Resultados (Level I + II for WAI-AA) 10,00 Puntuaciones Medias de Resultados • Level II: 10 points tested Puntuaciones Medias de Resultados - Segmento II - Nivel I 8,00 7,00 6,00 5,00 4,00 3,00 2,00 1,00 0,00 2 .1.1 2 .1.2 2 .1.3 2 .1.4 2 .1.5 2 .2 .1 2 .2 .2 2 .2 .3 2 .2 .4 2 .2 .5 O le a da I 9 ,4 8 1,2 5 1,5 7 6 ,5 7 9 ,7 6 9 ,0 5 2 ,8 0 9 ,4 5 7 ,3 5 8 ,3 6 O le a da II 9 ,4 8 3 ,13 2 ,6 5 4 ,7 6 9 ,8 8 9 ,5 1 3 ,7 9 9 ,5 7 7 ,6 7 8 ,7 3 O le a da III 8 ,3 3 1,2 5 7 ,7 7 4 ,8 6 9 ,5 3 6 ,7 5 6 ,14 7 ,6 6 5 ,2 3 8 ,4 0 Puntos de Verificación 4 INTAV: INTECO Accessibility Validator • Automatic Web Accessibility Checker using WCAG 1.0 and UNE 139803 standards. • Alerts the webmaster when there are changes in the accessibility level of a website. • Integrated with the INTECO’s web crawler. 5 Web Accessibility Audit Reports Solutions Advices Requirements Justification Problems 6 LENOX: Proper Language Use Analyzer • • Semantic Web analyzer for the use of sexist language. • Integrated with the INTECO’s web crawler. Alerts the webmaster when sexist terms are added to a website (only in Spanish). 7 EUROPEAN UNION WEB ACCESSIBILITY OBSERVATORY 8 Background: European Union Completed : • WAB Cluster • EIAO: Large scale accessibility benchmarking service • BenToWeb: EARL, WCAG 2.0 Test suites • Support-EAM: a European accreditation system • CEN Workshop Agreement Continuing: • Euracert Quality Label • e-Accessibility thematic network (scope is more than web – awarded? ) • eGovernment Monitor Network (eGovMoNet) (scope is more than web accessibility) 9 Ideas for the Project Scope: 1. Provide ongoing Automated Web Accessibility Conformance testing 2. Continuous Improvement of : Methods, Metrics, Tests, Tools 3. Verify “quality” of tools and results(are results reliable?)? 4. Provide access to verified? tools to: Partners, Public? 5. Serve as a meeting place for (or pointer to?) news, information and discussion. 10 Summary: Using the best tools available at the time, provide actionable data on the state of "web accessibility" in the EU in a timely and ongoing manner so that decision makers are properly informed. 11 Strategy Use a “loosely coupled” tool chain of Crawler(s?), Validator(s), Report Generator(s), Archiver. • • • • Use the Best of breed Allow for updating, testing, comparison, migration. Plan for migration to the future. Provide “hooks” for 3rd party tools and assistance for manual testing 12 Rational: A “loosely coupled” tool chain allows for: • • • • INCLUSION of those that meet requirements • Opens opportunities for cooperation and sharing More adaptability Easier updating, testing, research, migration. Facilitates the Integration of other needs such as Spanish “sexist language”. 13 Opportunities Archive • • Pages (selection/all) Results by Tool/page Research • • Portal tool Fingerprinting DOM Fingerprinting 14 Some Accessibility Validators: how “valid”? http://www.totalvalidator.com/ http://www.tawdis.net/ http://wave.webaim.org/ http://accessibility.egovmon.no/en/ http://achecker.ca/checker/index.php http://valet.webthing.com/access/url.html http://rastreador.inteco.es/intav/intavHomeAction.do http://validator.nu/ http://www.sidar.org/hera/ 15 Crawlers Harvestman crawler: http://code.google.com/p/harvestman-crawler/ Heritrix [Internet Archive] : http://crawler.archive.org/ Nutch based [e.g. INTECO]: http://lucene.apache.org/nutch/ Bixo [Apache Hadoop cluster, Cascading ] : http://bixo.101tec.com/about/ Bixolabs [Bixo in Amazon’s Elastic Compute Cloud (EC2) ]: http://bixolabs.com/ D-Harvestman [dead?] http://sourceforge.net/projects/dcrawler/ 16 Challenges Moving “Web Accessibility” requirements • Experience highlights current shortcomings (HTML5) Conformance testing follows laws and standards Additional Local Requirements (e.g. Sexist Language) • Harmonisation “plus” Continuous conformance Testing Continuous TOOL Testing. 17 Bibliography A comparative test of web accessibility evaluation methods http://portal.acm.org/citation.cfm?id=1414494 18