AI Crawler Access Report49/100 AI Access Score Partially blocked AI crawlers can reach lizbentley.com, but 2 critical problems hide content from them. The critical findings below name the page and the cause. Until they are fixed, AI answers work from a partial picture of what you sell. A critical finding caps the composite score at 49. 81 Live Answer Visibility 86 Search Index Foundation 88 Training Data Presence AI Access Score 49 is higher than 3 of the 84 B2B SaaS sites in our September 2026 benchmark (median 91). Full benchmark: check.citant.ai/benchmark The overall score weights Live Answer Visibility at 45%, Search Index Foundation at 30% and Training Data Presence at 25%, rounded to the nearest point. Critical findings can cap the score lower; any applied cap is stated next to it. Live Answer Visibility and Training Data Presence reflect crawler access plus on-page structure, with Training Data Presence also counting Common Crawl. Search Index Foundation reflects Googlebot and bingbot access plus indexability, sitemap and response health. Scanned Oct 9, 2026, 02:29 UTC · 6 pages · Platform: WordPress Findings| Severity | Finding | Why it matters |
|---|
| CRITICAL | noindex meta tag on /checkout/ https://lizbentley.com/checkout/ | Your /checkout/ page tells every crawler to ignore it while the rest of the site is open. Found: noindex, follow | | CRITICAL | noindex meta tag on /cart/ https://lizbentley.com/cart/ | Your /cart/ page tells every crawler to ignore it while the rest of the site is open. | | WARNING | Heading hierarchy issues: no H1, skipped heading levels | LLM retrieval splits pages into chunks along heading structure; broken hierarchy produces orphan chunks with no context. | | WARNING | Title or description needs work: meta description on / is 229 chars (aim for 50 to 160) https://lizbentley.com/ | These are the raw material that citation snippets are built from. Your meta description is over 160 characters, so AI systems and search snippets truncate it mid-sentence. Character counts are for the decoded text, so an entity like & counts as one character, not five. | | INFO | Organization schema is thin: fewer than 2 sameAs links | sameAs links to LinkedIn, Crunchbase and similar profiles are the entity-corroboration signal that confirms you are you. | | INFO | No llms.txt found | llms.txt is an emerging convention some AI crawlers read for site guidance. Adding one is a five minute quick win. | | INFO | Verify your Bing index manually | Microsoft Copilot answers from Bing's index; if Bing has not indexed you, Copilot cannot cite you. Automated Bing verification is unreliable without authenticated APIs, so we will not fake it. |
Per-page results| Page | Status | Indexable | Canonical | Title | Words | H1s |
|---|
| / | 200 | Yes | OK | Home - Liz Bentley Associates | 1231 | 0 | | /podcasts/ | 200 | Yes | OK | Podcast Archive - Liz Bentley Associates | 569 | 1 | | /privacy-policy/ | 200 | Yes | OK | Privacy Policy - Liz Bentley Associates | 822 | 1 | | /shop/ | 200 | Yes | OK | Shop - Liz Bentley Associates | 539 | 0 | | /checkout/ | 200 | NOINDEX | OK | Cart - Liz Bentley Associates | 327 | 1 | | /cart/ | 200 | NOINDEX | OK | Cart - Liz Bentley Associates | 327 | 1 |
Prioritized fix orderCriticals first. Quick wins are flagged with time estimates so you can bank momentum early. 1. Remove the noindex directive (WordPress) · est. 15 minAddresses: noindex meta tag on /checkout/ (CRITICAL) - Go to Settings, then Reading, and make sure 'Discourage search engines from indexing this site' is unchecked.
- If you use Yoast or Rank Math, open the page's SEO settings and set 'Allow search engines to show this page' to Yes.
- Clear any caching plugin (WP Rocket, W3 Total Cache) after saving, then re-run this scan.
2. Remove the noindex directive (WordPress) · est. 15 minAddresses: noindex meta tag on /cart/ (CRITICAL) - Go to Settings, then Reading, and make sure 'Discourage search engines from indexing this site' is unchecked.
- If you use Yoast or Rank Math, open the page's SEO settings and set 'Allow search engines to show this page' to Yes.
- Clear any caching plugin (WP Rocket, W3 Total Cache) after saving, then re-run this scan.
3. Repair the heading hierarchy · est. 1 to 2 hoursAddresses: Heading hierarchy issues: no H1, skipped heading levels (WARNING) - Use exactly one H1 per page and do not skip levels; LLM retrieval splits pages into chunks along heading structure, and broken hierarchy produces orphan chunks with no context.
- Restructure headings in the page template rather than styling text to look like headings.
4. Fix title and meta description · est. 30 minAddresses: Title or description needs work: meta description on / is 229 chars (aim for 50 to 160) (WARNING) - Write a title of 15 to 70 characters containing your brand or the page topic, and a meta description of 50 to 160 characters.
5. Add Organization schema with sameAs links · est. 30 minAddresses: Organization schema is thin: fewer than 2 sameAs links (INFO) - Add the JSON-LD below to your homepage head, filling in your real details.
- The sameAs links are the entity-corroboration signal that connects your site to your LinkedIn and other profiles.
- Validate at validator.schema.org.
<script type="application/ld+json">
{
"@context": "https://schema.org",
"@type": "Organization",
"name": "Liz Bentley Associates",
"url": "https://lizbentley.com",
"logo": "https://lizbentley.com/logo.png",
"description": "What Liz Bentley Associates does, in one sentence.",
"sameAs": [
"https://www.linkedin.com/company/lizbentley",
"https://x.com/lizbentley"
]
}
</script>6. Add an llms.txt file · est. 15 minAddresses: No llms.txt found (INFO) - Save the generated draft below as /llms.txt at your site root.
- It is a plain-markdown guide that tells AI systems what your most important pages are; adoption is emerging, and it costs nothing.
# Liz Bentley Associates
> One-sentence description of what lizbentley.com does, written for AI systems. Edit this line.
## Key pages
- [Home - Liz Bentley Associates](https://lizbentley.com/): Liz Bentley Associates helps people and companies grow into a better version of themselves through transformational
- [Podcast Archive - Liz Bentley Associates](https://lizbentley.com/podcasts/)
- [Privacy Policy - Liz Bentley Associates](https://lizbentley.com/privacy-policy/)
- [Shop - Liz Bentley Associates](https://lizbentley.com/shop/)
- [Cart - Liz Bentley Associates](https://lizbentley.com/checkout/)
- [Cart - Liz Bentley Associates](https://lizbentley.com/cart/)
The bot matrixrobots.txt policy next to what actually happened when each bot fetched your homepage. Live-answer bots| Bot | Owner | robots.txt policy | Real fetch |
|---|
| OAI-SearchBot | OpenAI | Partial | Reachable (200) | | ChatGPT-User | OpenAI | Partial | Reachable (200) | | PerplexityBot | Perplexity | Partial | Reachable (200) | | Perplexity-User (informational) | Perplexity | Partial | Reachable (200) | | Claude-SearchBot | Anthropic | Partial | Reachable (200) | | Claude-User | Anthropic | Partial | Reachable (200) | | DuckAssistBot | DuckDuckGo | Partial | Reachable (200) |
Training crawlers| Bot | Owner | robots.txt policy | Real fetch |
|---|
| GPTBot | OpenAI | Partial | Reachable (200) | | ClaudeBot | Anthropic | Partial | Reachable (200) | | CCBot | Common Crawl | Partial | Reachable (200) | | Meta-ExternalAgent | Meta | Partial | Reachable (200) | | Amazonbot | Amazon | Partial | Reachable (200) | | Bytespider (informational) | ByteDance | Partial | Blocked by firewall (Cloudflare) |
Search-index foundation| Bot | Owner | robots.txt policy | Real fetch |
|---|
| Googlebot | Google | Partial | Reachable (200) | | bingbot | Microsoft | Partial | Reachable (200) |
Verification appendixEvery claim in this report, verifiable by you. Run these yourself; do not take our word for it. | Finding | Verification |
|---|
| noindex meta tag on /checkout/ | macOS / Linux curl -s "https://lizbentley.com/checkout/" | grep -ioE '<meta[^>]*name=.?robots[^>]*>'Windows PowerShell (curl.exe -s "https://lizbentley.com/checkout/" | Select-String -Pattern '<meta[^>]*name=.?robots[^>]*>' -AllMatches).Matches.Value | | noindex meta tag on /cart/ | macOS / Linux curl -s "https://lizbentley.com/cart/" | grep -ioE '<meta[^>]*name=.?robots[^>]*>'Windows PowerShell (curl.exe -s "https://lizbentley.com/cart/" | Select-String -Pattern '<meta[^>]*name=.?robots[^>]*>' -AllMatches).Matches.Value | | Heading hierarchy issues: no H1, skipped heading levels | In your browser console: [...document.querySelectorAll("h1,h2,h3,h4,h5,h6")].map(h => h.tagName + ": " + h.innerText.trim().slice(0,60)).join("\n") | | Title or description needs work: meta description on / is 229 chars (aim for 50 to 160) | macOS / Linux curl -s "https://lizbentley.com/" | grep -ioE '<title[^>]*>[^<]*</title>|<meta[^>]*name=.?description[^>]*>'Windows PowerShell (curl.exe -s "https://lizbentley.com/" | Select-String -Pattern '<title[^>]*>[^<]*</title>|<meta[^>]*name=.?description[^>]*>' -AllMatches).Matches.Value | | Organization schema is thin: fewer than 2 sameAs links | Paste your URL into validator.schema.org and inspect the Organization block. | | No llms.txt found | macOS / Linux curl -sI "https://lizbentley.com/llms.txt" | head -1Windows PowerShell curl.exe -sI "https://lizbentley.com/llms.txt" | Select-Object -First 1 | | Verify your Bing index manually | Search "site:lizbentley.com" on bing.com and confirm your key pages appear. | | Fetch as OAI-SearchBot | macOS / Linux curl -sI -A "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; OAI-SearchBot/1.0; +https://openai.com/searchbot" "https://lizbentley.com/" | head -5Windows PowerShell curl.exe -sI -A "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; OAI-SearchBot/1.0; +https://openai.com/searchbot" "https://lizbentley.com/" | Select-Object -First 5 | | Fetch as ChatGPT-User | macOS / Linux curl -sI -A "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot" "https://lizbentley.com/" | head -5Windows PowerShell curl.exe -sI -A "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot" "https://lizbentley.com/" | Select-Object -First 5 | | Fetch as PerplexityBot | macOS / Linux curl -sI -A "Mozilla/5.0 (compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)" "https://lizbentley.com/" | head -5Windows PowerShell curl.exe -sI -A "Mozilla/5.0 (compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)" "https://lizbentley.com/" | Select-Object -First 5 | | Fetch as Perplexity-User | macOS / Linux curl -sI -A "Mozilla/5.0 (compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user)" "https://lizbentley.com/" | head -5Windows PowerShell curl.exe -sI -A "Mozilla/5.0 (compatible; Perplexity-User/1.0; +https://perplexity.ai/perplexity-user)" "https://lizbentley.com/" | Select-Object -First 5 | | Fetch as Claude-SearchBot | macOS / Linux curl -sI -A "Mozilla/5.0 (compatible; Claude-SearchBot/1.0; +https://www.anthropic.com/claude-searchbot)" "https://lizbentley.com/" | head -5Windows PowerShell curl.exe -sI -A "Mozilla/5.0 (compatible; Claude-SearchBot/1.0; +https://www.anthropic.com/claude-searchbot)" "https://lizbentley.com/" | Select-Object -First 5 | | Fetch as Claude-User | macOS / Linux curl -sI -A "Mozilla/5.0 (compatible; Claude-User/1.0; +https://www.anthropic.com/claude-user)" "https://lizbentley.com/" | head -5Windows PowerShell curl.exe -sI -A "Mozilla/5.0 (compatible; Claude-User/1.0; +https://www.anthropic.com/claude-user)" "https://lizbentley.com/" | Select-Object -First 5 | | Fetch as DuckAssistBot | macOS / Linux curl -sI -A "Mozilla/5.0 (compatible; DuckAssistBot/1.0; +https://duckduckgo.com/duckassistbot)" "https://lizbentley.com/" | head -5Windows PowerShell curl.exe -sI -A "Mozilla/5.0 (compatible; DuckAssistBot/1.0; +https://duckduckgo.com/duckassistbot)" "https://lizbentley.com/" | Select-Object -First 5 | | Fetch as GPTBot | macOS / Linux curl -sI -A "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; GPTBot/1.1; +https://openai.com/gptbot" "https://lizbentley.com/" | head -5Windows PowerShell curl.exe -sI -A "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; GPTBot/1.1; +https://openai.com/gptbot" "https://lizbentley.com/" | Select-Object -First 5 | | Fetch as ClaudeBot | macOS / Linux curl -sI -A "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" "https://lizbentley.com/" | head -5Windows PowerShell curl.exe -sI -A "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" "https://lizbentley.com/" | Select-Object -First 5 | | Fetch as CCBot | macOS / Linux curl -sI -A "CCBot/2.0 (https://commoncrawl.org/faq/)" "https://lizbentley.com/" | head -5Windows PowerShell curl.exe -sI -A "CCBot/2.0 (https://commoncrawl.org/faq/)" "https://lizbentley.com/" | Select-Object -First 5 | | Fetch as Meta-ExternalAgent | macOS / Linux curl -sI -A "Mozilla/5.0 (compatible; meta-externalagent/1.1; +https://developers.facebook.com/docs/sharing/webmasters/crawler)" "https://lizbentley.com/" | head -5Windows PowerShell curl.exe -sI -A "Mozilla/5.0 (compatible; meta-externalagent/1.1; +https://developers.facebook.com/docs/sharing/webmasters/crawler)" "https://lizbentley.com/" | Select-Object -First 5 | | Fetch as Amazonbot | macOS / Linux curl -sI -A "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot)" "https://lizbentley.com/" | head -5Windows PowerShell curl.exe -sI -A "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot)" "https://lizbentley.com/" | Select-Object -First 5 | | Fetch as Bytespider | macOS / Linux curl -sI -A "Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; spider-feedback@bytedance.com)" "https://lizbentley.com/" | head -5Windows PowerShell curl.exe -sI -A "Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; spider-feedback@bytedance.com)" "https://lizbentley.com/" | Select-Object -First 5 | | Fetch as Googlebot | macOS / Linux curl -sI -A "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" "https://lizbentley.com/" | head -5Windows PowerShell curl.exe -sI -A "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" "https://lizbentley.com/" | Select-Object -First 5 | | Fetch as bingbot | macOS / Linux curl -sI -A "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)" "https://lizbentley.com/" | head -5Windows PowerShell curl.exe -sI -A "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)" "https://lizbentley.com/" | Select-Object -First 5 |
What this scan cannot seeThis report measures whether AI systems can READ your site. It cannot measure whether AI RECOMMENDS you: your Share of Model, which competitors get cited in your place, or whether your content answers the questions buyers actually ask AI. That requires prompt-testing against your named competitors across ChatGPT, Claude, Perplexity, Gemini, Copilot and Google AI Overviews. That is the AI Search Audit by Citant.ai: a fixed-scope engagement at $440 that maps your citation gaps, names the competitors winning your queries, and hands you a prioritized plan. Our crawler tests send each bot's user agent from our own servers, not from the AI companies' verified IP ranges. Some firewalls, including Cloudflare, verify crawlers by network identity rather than user agent. That means a site can challenge our test request while allowing the real, verified crawler. When that happens this scan over-reports blocking; it never under-reports it. The Googlebot result is the most exposed to this, because fake Googlebots are the most common spoof and are policed hardest. Get every critical fixedThe AI Search Audit covers all six platforms and hands you the exact fix for every critical, with a 30 minute call. Book the $440 AI Search Audit Order at check.citant.ai/audit/order. The $440 is credited in full against the GEO Pilot if you sign within 30 days. Report generated by the AI Crawler Access Report by Citant.ai. Read-only scan; findings stored, page content not. Re-scan anytime; results reflect Oct 9, 2026 UTC. |