Blog · Oct 13, 2026
We scanned 10,369 small business websites: here's how AI-ready they are
Real small business sites scored 67.1 out of 100 on average. FAQs are the biggest gap, and 152 sites (1.5%) blocked three or more of the ten AI crawlers we test.
Key takeaways
- The average AI-readiness score was 67.1 (median 68). Only 3.2% of sites reached the Ready band (90+), and 52.3% scored below 70.
- FAQ content is the weakest area: 81% of sites scored 40 or below on FAQ signals.
- 152 sites (1.5%) scored zero on crawler access. In our scoring, that means three or more of the ten AI crawlers we test were blocked. Most owners likely don't know.
When someone asks ChatGPT about your business, the answer comes from what it could read on your website. We wanted to know how well real small business sites are doing, so we scanned 10,369 of them.
How we measured it
Each site gets a score out of 100 from five weighted checks: crawler access, page structure, titles and descriptions (metadata), content readability, and load speed. The crawler-access check itself is scored on a simple scale: 100 when none of the ten AI crawlers we test is blocked, 40 when one or two are blocked, and zero when three or more are blocked — so wherever these posts say a site "scored zero" on crawler access, that is what it means. An FAQ adjustment adds up to 10 points for clear question-and-answer content and subtracts 10 for none. Sites whose crawler access scores zero are capped at 40.
The sites are real small businesses across the US, drawn from public business listings, on every major platform from WordPress to Wix to Squarespace. We attempted 13,342 sites. 10,369 loaded and were scored (77.7%), and every score below is out of those 10,369. The other 2,973 (22.3%) didn't answer, returned errors, or refused the connection, and we count them separately.
The results
| Score band | Share of sites |
|---|---|
| 90-100 (Ready) | 3.2% |
| 85-89 | 4.4% |
| 80-84 | 5.2% |
| 75-79 | 14.5% |
| 70-74 | 20.4% |
| 60-69 | 28.2% |
| 0-59 | 24.1% |
Most sites sit between 60 and 79. The sites in the 90s aren't doing anything exotic: they simply have the basics in place. Keep in mind that readable is not the same as recommended. Whether an AI assistant names you also depends on reviews, listings and the question asked. Our score measures the reading part.
Where sites lose points
| Category | Average score |
|---|---|
| Performance | 99.0 |
| Crawler access | 98.1 |
| Content | 84.2 |
| Metadata | 80.8 |
| Structure | 70.5 |
| FAQ signals | 43.9 |
Speed and basic access are largely solved. The gaps are in how pages are organized and described, and in the lack of question-and-answer content that AI can quote.
The access problem
Of the 13,342 sites we attempted, 449 (3.4%) answered our scanner with a 403 Forbidden error, and 303 (2.3%) required a login (401). A 403 means the server saw the request and refused it. It's usually caused by a security plugin, a firewall rule or a hosting default, not a deliberate choice, and the site still looks fine in a browser.
One caveat: a 403 to our scanner shows the effect, not the intent, and doesn't prove that every AI crawler is refused too. It is a strong signal to check. Separately, 152 scored sites (1.5%, about 1 in 68) scored zero on crawler access — three or more of the ten crawlers we test blocked.
Platforms
WordPress powers the most sites in our sample (3,784), followed by Wix (1,105) and Squarespace (354). Platform choice matters less than configuration: a well-set-up WordPress site can beat a neglected Squarespace site.
What to fix first
- Check that nothing blocks AI crawlers. Review your robots.txt and any security or bot-protection settings.
- Add an FAQ section with direct answers to the questions customers actually ask.
- Write a unique title and meta description for every important page.
- Use real headings, with one main headline per page.
- Put key facts in text, not images: name, address, phone, hours, services.
Most of these take an afternoon. A few, such as structured data, are easier with a developer.
Check your own site
We built CrawlReady so any business owner can see where they stand. Run a free scan to get your score and the specific fixes in plain English.
Download the full dataset (Excel)
All 13,342 sites we attempted — category scores, word counts, platform, and the census income join for the sites with a readable address — plus the methodology and headline tables. Contact details are not included.
About this data: 13,342 small business websites attempted in October 2026 from public business listings across the US; 10,369 loaded and were scored with the CrawlReady scorer (rescored October 11, 2026). Percentages are out of 10,369 unless marked "of attempts." Weights: crawler access 20%, structure 25%, metadata 25%, content 15%, performance 5%, plus an FAQ adjustment of -10 or +10. Bands: Ready 90+, Workable 70-89, Needs Work below 70. Scores reflect what AI systems can read, not search rankings, and readability alone never guarantees a citation or recommendation.