Botability
6,097 U.S. websites checked for botability. The average score is 82 out of 100. Help AI and search engines discover, crawl, and index your website.
Of 6,097 fully scanned sites, 42% (2,551) earn an A for botability, 38% (2,296) a B or C, and 21% (1,250) a D or F. The average score is 82.
Why botability matters
Smart technology can better process and share public information, making services faster and more efficient for users.
AI tools cannot find or understand your content.
What we check
Standards for helping search engines and AI tools find, read, and understand your website.
- Canonical: Each page declares a preferred URL so search engines show the right link.
- Content available in document: The page's main content loads without requiring JavaScript.
- Crawlable: The site allows search engines and AI agents to index its pages.
- GovernmentOrganization Schema.org type: Homepage is marked up as an official government organization.
- hreflang: Pages declare their language and region for international users.
- Link text: Links use descriptive text that tells users and search engines where they go.
- Robots allowed: The robots.txt file allows search engines and AI agents to crawl the site.
- Robots valid: The site's robots.txt file is written correctly so search engines can follow it.
- Sitemap in robots.txt: The robots.txt file links to the sitemap.
- Sitemap status: The sitemap file loads and returns a successful response.
- Sitemap XML: The sitemap file uses the required XML format.
Policy and guidance that supports making your website discoverable by search engines and AI. Guidance: 21st Century Integrated Digital Experience Act (IDEA), The Web Robots Pages, Schema.org, sitemaps.org, Google Search Central.
How sites score
All sites by botability grade
Share of the 6,097 fully scanned sites in each grade band
- A (90 to 100): 2,551 (42%)
- B to C (70 to 89): 2,296 (38%)
- D to F (below 70): 1,250 (21%)
| Grade band | Sites |
|---|---|
| A (90 to 100) | 2,551 |
| B to C (70 to 89) | 2,296 |
| D to F (below 70) | 1,250 |
Where sites fail
The most common botability failure is GovernmentOrganization Schema.org type: 55% (3,333 of 6,097 sites) fail it.
Highest and lowest scores
Highest botability scores
| Rank | Site | Checks passed | Grade |
|---|---|---|---|
| 1 |
semo.edu
Southeast Missouri State University |
10 of 10 checks pass | A |
| 1 |
unt.edu
University of North Texas |
11 of 11 checks pass | A |
| 1 |
polk.edu
Polk State College |
11 of 11 checks pass | A |
| 1 |
goldwaterscholarship.gov
Barry Goldwater Scholarship and Excellence in Education Foundation |
11 of 11 checks pass | A |
| 1 |
irsauctions.gov
Department of the Treasury |
11 of 11 checks pass | A |
Lowest botability scores
| Rank | Site | Checks passed | Grade |
|---|---|---|---|
| 23 |
integrity.gov
Office of Government Ethics |
4 of 9 checks pass | F |
| 23 |
sciotocountyoh.com
Scioto County, OH |
4 of 9 checks pass | F |
| 23 |
fhlbcin.com
Interagency Collaboration |
4 of 9 checks pass | F |
| 24 |
usmc-mccs.org
U.S. Marine Corps |
4 of 10 checks pass | F |
| 24 |
spinkcounty-sd.org
Spink County, SD |
4 of 10 checks pass | F |
Rankings and issues
- All sites ranked by botability: every site with a botability score, 100 to a page.
- States ranked by botability: 42 fully scanned sites.
- Counties ranked by botability: 2,471 fully scanned sites.
- Cities ranked by botability: 212 fully scanned sites.
- Federal ranked by botability: 688 fully scanned sites.
- Education ranked by botability: 2,687 fully scanned sites.
- Websites with sitemap problems: 2,559 of 6,007 fully scanned sites.
- Websites with robots.txt problems: 759 of 5,930 fully scanned sites.
- Websites that need JavaScript to show their content: 215 of 6,097 fully scanned sites.
- Pulse: how every indicator scores across all sites and each group.
- Botability standards and how ScanGov helps with botability.