Section 508 Compliance Test
While XHTML validation may be a good indicator of the robustness of a website's design or the level of technical awareness and discipline of a website's developers, it does not present the whole picture. The Access Board has been charged with defining a set of standards for accessibility that will serve as the measuring tool to determine if a public website satisfies Section 508. Theoretically, all government and commercial websites must comply with Section 508; thus, the purpose of this test is to see if this is true and, if not, to gauge how bad the situation is.
The main tool for testing compliance with Section 508 is Bobby, a commercially available tool for parsing and analyzing a page to determine how many of the Access Board's 16 standards for compliance a test page satisfies. To test the level of Section 508 compliance of the test subjects, I ran Bobby on each page, recorded the number of accessibility errors -- which prevent a page from receiving 508 approval -- and the number of user checks -- which are triggered by potentially troublesome parts of a page but need to be checked by the page designer to see if they apply. Then I determined what percentage of the lines of code actually have accessibility errors.
- Popular Sites (news, sports, etc.)
- UNC Related
- Search Engines
- Government
- Standards advocates (sites that promote good design)
| Name/URL | 508 Errors | 508 User Checks | # Lines of Code | % Errors |
|---|---|---|---|---|
| ESPN | *** | *** | *** | *** |
| MTV | 120 | 426 | 1073 | 11.18 |
| CNN | 14 | 316 | 896 | 1.56 |
| Weather Channel | 41 | 167 | 525 | 7.81 |
| FoxSports Net | 114 | 298 | 935 | 12.19 |
| America Online | 18 | 125 | 310 | 5.81 |
| Macromedia | 2 | 130 | 507 | 0.39 |
| ABC News | *** | *** | *** | *** |
| Microsoft | 80 | 252 | 542 | 14.76 |
| Netscape | 69 | 175 | 660 | 10.45 |
| MSN | 0 | 125 | 942 | 0.00 |
| E*Trade | 35 | 114 | 525 | 6.67 |
| Average: | 49.30 | 212.80 | 753.67 | 7.08 |
[ Back to Top ]
| Name/URL | 508 Errors | 508 User Checks | # Lines of Code | % Errors |
|---|---|---|---|---|
| UNC-CH Home | 16 | 49 | 182 | 8.79 |
| UNC Students | 4 | 18 | 229 | 1.75 |
| Student Central | 15 | 48 | 265 | 5.66 |
| Tar Heel Blue | 125 | 387 | 1426 | 8.77 |
| Campus-Y | 13 | 26 | 222 | 5.86 |
| Disability Services | 0 | 30 | 136 | 0.00 |
| UNC Computer Science | 23 | 61 | 225 | 10.22 |
| UNC Libarary Catalog | 10 | 21 | 698 | 1.43 |
| UNC Dance Marathon | 0 | 116 | 334 | 0.00 |
| Carolina Web Servers | 1 | 66 | 523 | 0.19 |
| Daily Tar Heel | 5 | 458 | 1005 | 0.50 |
| Average: | 19.27 | 116.36 | 476.82 | 3.92 |
[ Back to Top ]
| Name/URL | 508 Errors | 508 User Checks | # Lines of Code | % Errors |
|---|---|---|---|---|
| 1 | 19 | 52 | 1.92 | |
| Yahoo | 16 | 178 | 376 | 4.26 |
| Altavista | 8 | 44 | 184 | 4.35 |
| Lycos | 139 | 412 | 222 | 62.61 |
| Average: | 41.00 | 163.25 | 208.50 | 18.28 |
[ Back to Top ]
| Name/URL | 508 Errors | 508 User Checks | # Lines of Code | % Errors |
|---|---|---|---|---|
| White House | 5 | 305 | 741 | 0.67 |
| US Army | 1 | 164 | 341 | 0.29 |
| House of Representatives | 8 | 77 | 303 | 2.64 |
| Senate | 6 | 92 | 302 | 1.99 |
| Section 508 | *** | *** | *** | *** |
| ADA | 0 | 71 | 607 | 0.00 |
| Average: | 4.00 | 141.80 | 453.67 | 1.12 |
[ Back to Top ]
| Name/URL | 508 Errors | 508 User Checks | # Lines of Code | % Errors |
|---|---|---|---|---|
| Zeldman | *** | *** | *** | *** |
| A List Apart | 1 | 22 | 275 | 0.36 |
| Use It | 1 | 14 | 242 | 0.41 |
| Netscape DevEdge | 0 | 3 | 230 | 0.00 |
| World Wide Web Consortium (W3C) | 0 | 31 | 490 | 0.00 |
| WaSP | 1 | 10 | 163 | 0.61 |
| Ibiblio | 1 | 48 | 503 | 0.20 |
| Universal Web Design | 0 | 19 | 160 | 0.00 |
| Average: | 0.57 | 21.00 | 0.23 | 0.14 |
[ Back to Top ]
