How this score is measured
The overall score weights Live Answer Visibility at 45%, Search Index Foundation at 30% and Training Data Presence at 25%, rounded to the nearest point. Critical findings can cap the score lower; any applied cap is stated next to it. Live Answer Visibility and Training Data Presence reflect crawler access plus on-page structure, with Training Data Presence also counting Common Crawl. Search Index Foundation reflects Googlebot and bingbot access plus indexability, sitemap and response health.
Our crawler tests send each bot's user agent from our own servers, not from the AI companies' verified IP ranges. Some firewalls, including Cloudflare, verify crawlers by network identity rather than user agent. That means a site can challenge our test request while allowing the real, verified crawler. When that happens this scan over-reports blocking; it never under-reports it. The Googlebot result is the most exposed to this, because fake Googlebots are the most common spoof and are policed hardest.
This scan of citant.ai checked 15 AI crawlers across 21 automated checks on 6 pages. None of the 13 scored crawlers are blocked. AI Access Score: 91/100 (Fully open).
The bot matrix
robots.txt policy next to what actually happened when each bot knocked. Rows where your policy says yes but the server says no are highlighted; those are the silent failures.
Live-answer botsFetch content in real time to build the answers and citations users see today.
| Bot | Owner | robots.txt policy | Real fetch | Verify |
|---|---|---|---|---|
| OAI-SearchBot Powers ChatGPT search results | OpenAI | Allowed | Reachable (200) | |
| ChatGPT-User User-triggered fetches from ChatGPT; Cloudflare classes this as Agent traffic, blocked by default on ad pages for new Cloudflare domains | OpenAI | Allowed | Reachable (200) | |
| PerplexityBot Index for Perplexity answers | Perplexity | Allowed | Reachable (200) | |
| Perplexity-Userinformational User-triggered; may ignore robots.txt | Perplexity | Allowed | Reachable (200) | |
| Claude-SearchBot Claude search indexing | Anthropic | Allowed | Reachable (200) | |
| Claude-User User-triggered fetches from Claude; Cloudflare classes this as Agent traffic, blocked by default on ad pages for new Cloudflare domains | Anthropic | Allowed | Reachable (200) | |
| DuckAssistBot DuckAssist answers | DuckDuckGo | Allowed (standard exclusions) line 5: Disallow: /wp-admin/ | Reachable (200) |
Training crawlersCollect content for model training. Blocking them removes you from future models' memory.
| Bot | Owner | robots.txt policy | Real fetch | Verify |
|---|---|---|---|---|
| GPTBot Training corpus | OpenAI | Allowed | Reachable (200) | |
| ClaudeBot Training corpus | Anthropic | Allowed | Reachable (200) | |
| CCBot Feeds many labs' training data; blocking it is the quietest way to disappear from future models | Common Crawl | Allowed | Reachable (200) | |
| Meta-ExternalAgent Llama training | Meta | Allowed (standard exclusions) line 5: Disallow: /wp-admin/ | Reachable (200) | |
| Amazonbot Alexa and Amazon AI features | Amazon | Allowed | Reachable (200) | |
| Bytespiderinformational Known to sometimes ignore robots.txt | ByteDance | Blocked line 58: Disallow: / | Reachable (200) |
Search-index foundationCopilot rides Bing's index and AI Overviews rides Google's. If these starve, the AI layer above them starves.
| Bot | Owner | robots.txt policy | Real fetch | Verify |
|---|---|---|---|---|
| Googlebot Google Search index; AI Overviews rides this. Cloudflare treats it as mixed Search and Training, so as of September 15, 2026 Cloudflare AI training blocks can hit it | Allowed | Reachable (200) | ||
| bingbot Bing index; Copilot and ChatGPT search lean on it. Cloudflare treats it as mixed Search and Training, so as of September 15, 2026 Cloudflare AI training blocks can hit it | Microsoft | Allowed | Reachable (200) |
Training opt-out tokensNot crawlers. Directives controlling whether already-crawled content trains AI.
| Token | Controls | Your robots.txt |
|---|---|---|
| Google-Extended | Gemini training use of Google's crawl Blocking Google-Extended does NOT affect your Google Search ranking, but it does remove your content from Gemini training use. | Allowed |
| Applebot-Extended | Apple AI training use Blocking Applebot-Extended does not affect Siri or Spotlight search. | Allowed (standard exclusions) |
Your scanned pages
Real defects live on money pages, not just homepages. We scanned 6 pages: your homepage plus pages picked from your sitemap, preferring product, pricing and services pages, because those are the pages AI assistants quote when buyers ask.
| Page | Status | Indexable | Canonical | Title | Words |
|---|---|---|---|---|---|
| / | 200 | Yes | OK | Generative Engine Optimization Agency… | 3276 |
| /pricing/ | 200 | Yes | OK | GEO Agency Pricing: $440 Audit, $7,875 Pilot… | 1635 |
| /services/entity-optimization/ | 200 | Yes | OK | Brand Entity Optimization for B2B SaaS… | 2872 |
| /services/ai-visibility/ | 200 | Yes | OK | AI Visibility Optimization for B2B SaaS… | 2598 |
| /services/answer-engine-optimization/ | 200 | Yes | OK | Answer Engine Optimization Services for SaaS… | 2362 |
| /services/generative-engine-optimization/ | 200 | Yes | OK | Generative Engine Optimization Services… | 3260 |
Warnings (2)
These are the raw material that citation snippets are built from. Your meta description is over 160 characters, so AI systems and search snippets truncate it mid-sentence. Character counts are for the decoded text, so an entity like & counts as one character, not five.
curl -s "https://citant.ai/" | grep -ioE '<title[^>]*>[^<]*</title>|<meta[^>]*name=.?description[^>]*>'Common Crawl feeds training data across the AI industry; absence here means most future models never read you during training.
Good to know (4)
OG tags control how shared and cited links render on every platform.
curl -s "https://citant.ai/" | grep -ioE '<meta[^>]*property=.?og:[^>]*>'llms.txt is an emerging convention some AI crawlers read for site guidance. Adding one is a five minute quick win.
curl -sI "https://citant.ai/llms.txt" | head -1Copilot and ChatGPT search lean on Bing's index; if Bing has not indexed you, two of six AI platforms cannot cite you. Automated Bing verification is unreliable without authenticated APIs, so we will not fake it.
Response headers identify Hostinger's shared hosting platform. Hostinger applies server-level per-crawler rate limits the site owner cannot tune, and a cache in front can hide them from a one-time test; the cache-busted origin probe in this scan is what checks for that.
Header evidence: platform: hostinger
curl -sI "https://citant.ai/" | grep -iE "server|platform|panel|litespeed|hcdn"Recommended robots.txt additions (free, no email needed)
# Recommended AI crawler access, generated by the AI Crawler Access Report by Citant.ai # Place these lines ABOVE any general User-agent: * block in robots.txt User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: PerplexityBot Allow: / User-agent: Claude-SearchBot Allow: / User-agent: Claude-User Allow: / User-agent: DuckAssistBot Allow: / User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: CCBot Allow: / User-agent: Meta-ExternalAgent Allow: / User-agent: Amazonbot Allow: / User-agent: Googlebot Allow: / User-agent: bingbot Allow: / # Optional training opt-outs. These are business decisions, not defects: # blocking Google-Extended removes you from Gemini training but does NOT # affect Google Search ranking. Leave them out to stay fully open. # User-agent: Google-Extended # Disallow: /
Your prioritized fix plan
No criticals found. Warnings are ordered by impact. Platform detected: WordPress. Open the print-ready report to save it as a PDF.
1. Fix title and meta description (/)
Fixes: Title or description needs work: meta description on / is 162 chars (aim for 50 to 160)
- Write a title of 15 to 70 characters containing your brand or the page topic, and a meta description of 50 to 160 characters.
curl -s "https://citant.ai/" | grep -ioE '<title[^>]*>[^<]*</title>|<meta[^>]*name=.?description[^>]*>'2. Get into Common Crawl
Fixes: Not present in Common Crawl
- Make sure CCBot is allowed in robots.txt and not firewall-blocked, then wait for the next crawl cycle; presence follows access plus inbound links.
3. Complete Open Graph tags
Fixes: Open Graph incomplete: missing og:image
- Add og:title, og:description and og:image meta tags to the page head.
curl -s "https://citant.ai/" | grep -ioE '<meta[^>]*property=.?og:[^>]*>'4. Add an llms.txt file
Fixes: No llms.txt found
- Save the generated draft below as /llms.txt at your site root.
- It is a plain-markdown guide that tells AI systems what your most important pages are; adoption is emerging, and it costs nothing.
# Citant > One-sentence description of what citant.ai does, written for AI systems. Edit this line. ## Key pages - [Generative Engine Optimization Agency | Citant.ai](https://citant.ai/): Citant.ai is a GEO agency for B2B SaaS, specializing in LLM visibility and AI search citation, backed by a 9-week - [GEO Agency Pricing: $440 Audit, $7,875 Pilot | Citant.ai](https://citant.ai/pricing/): Citant.ai GEO pricing, published and fixed: $440 AI Search Audit, $7,875 GEO Pilot with a money-back guarantee - [Brand Entity Optimization for B2B SaaS | Citant.ai](https://citant.ai/services/entity-optimization/): Citant.ai's Brand Entity Optimization builds entity recognition in Wikidata, Crunchbase, Bing and Brave, the indexes - [AI Visibility Optimization for B2B SaaS | Citant.ai](https://citant.ai/services/ai-visibility/): Citant.ai's AI Visibility Optimization tracks Share of Model monthly across ChatGPT, Perplexity, Gemini, Claude - [Answer Engine Optimization Services for SaaS | Citant.ai](https://citant.ai/services/answer-engine-optimization/): Citant.ai's answer engine optimization workstream gets B2B SaaS brands named in Google AI Overviews and featured - [Generative Engine Optimization Services | Citant.ai](https://citant.ai/services/generative-engine-optimization/): Citant.ai's Generative Engine Optimization service gets B2B SaaS brands named inside AI answers across 6 tracked ## Contact - [Contact](https://citant.ai/contact): How to reach Citant
curl -sI "https://citant.ai/llms.txt" | head -1