100
AI Access Score

arobis.aiFully open

ChatGPT, Claude, Perplexity, Google AI Overviews and Microsoft Copilot can all read arobis.ai. That makes you eligible to be recommended, not recommended. Whether AI names you when a buyer asks depends on what other sites say about you, which a crawler test cannot measure.
AI Access Score 100 is higher than 81 of the 84 B2B SaaS sites in our September 2026 benchmark (median 91). See the benchmark
Scanned Nov 20, 2026, 05:36 UTC
This is the permanent public report page for arobis.ai. It always shows the latest scan of the domain and stays online.
100
Live Answer Visibility
100
Search Index Foundation
100
Training Data Presence
How this score is measured

The overall score weights Live Answer Visibility at 45%, Search Index Foundation at 30% and Training Data Presence at 25%, rounded to the nearest point. Critical findings can cap the score lower; any applied cap is stated next to it. Live Answer Visibility and Training Data Presence reflect crawler access plus on-page structure, with Training Data Presence also counting Common Crawl. Search Index Foundation reflects Googlebot and bingbot access plus indexability, sitemap and response health.

Our crawler tests send each bot's user agent from our own servers, not from the AI companies' verified IP ranges. Some firewalls, including Cloudflare, verify crawlers by network identity rather than user agent. That means a site can challenge our test request while allowing the real, verified crawler. When that happens this scan over-reports blocking; it never under-reports it. The Googlebot result is the most exposed to this, because fake Googlebots are the most common spoof and are policed hardest.

This scan of arobis.ai checked 15 AI crawlers across 21 automated checks on 6 pages. None of the 13 scored crawlers are blocked. AI Access Score: 100/100 (Fully open).

The bot matrix

robots.txt policy next to what actually happened when each bot knocked. Rows where your policy says yes but the server says no are highlighted; those are the silent failures.

Live-answer botsFetch content in real time to build the answers and citations users see today.
BotOwnerrobots.txt policyReal fetchVerify
OAI-SearchBot
Powers ChatGPT search results
OpenAINot specified (allowed)Reachable (200)
ChatGPT-User
User-triggered fetches from ChatGPT; Cloudflare classes this as Agent traffic, blocked by default on ad pages for new Cloudflare domains
OpenAINot specified (allowed)Reachable (200)
PerplexityBot
Index for Perplexity answers
PerplexityNot specified (allowed)Reachable (200)
Perplexity-Userinformational
User-triggered; may ignore robots.txt
PerplexityNot specified (allowed)Reachable (200)
Claude-SearchBot
Claude search indexing
AnthropicNot specified (allowed)Reachable (200)
Claude-User
User-triggered fetches from Claude; Cloudflare classes this as Agent traffic, blocked by default on ad pages for new Cloudflare domains
AnthropicNot specified (allowed)Reachable (200)
DuckAssistBot
DuckAssist answers
DuckDuckGoNot specified (allowed)Reachable (200)
Training crawlersCollect content for model training. Blocking them removes you from future models' memory.
BotOwnerrobots.txt policyReal fetchVerify
GPTBot
Training corpus
OpenAINot specified (allowed)Reachable (200)
ClaudeBot
Training corpus
AnthropicNot specified (allowed)Reachable (200)
CCBot
Feeds many labs' training data; blocking it is the quietest way to disappear from future models
Common CrawlNot specified (allowed)Reachable (200)
Meta-ExternalAgent
Llama training
MetaNot specified (allowed)Reachable (200)
Amazonbot
Alexa and Amazon AI features
AmazonNot specified (allowed)Reachable (200)
Bytespiderinformational
Known to sometimes ignore robots.txt
ByteDanceNot specified (allowed)Blocked by firewall (Cloudflare)
Policy says yes; firewall says no.
Search-index foundationCopilot rides Bing's index and AI Overviews rides Google's. If these starve, the AI layer above them starves.
BotOwnerrobots.txt policyReal fetchVerify
Googlebot
Google Search index; AI Overviews rides this. Cloudflare treats it as mixed Search and Training, so as of September 15, 2026 Cloudflare AI training blocks can hit it
GoogleNot specified (allowed)Reachable (200)
bingbot
Bing index; Microsoft Copilot answers from it. Cloudflare treats it as mixed Search and Training, so as of September 15, 2026 Cloudflare AI training blocks can hit it
MicrosoftNot specified (allowed)Reachable (200)
Training opt-out tokensNot crawlers. Directives controlling whether already-crawled content trains AI.
TokenControlsYour robots.txt
Google-ExtendedGemini training use of Google's crawl
Blocking Google-Extended does NOT affect your Google Search ranking, but it does remove your content from Gemini training use.
Not specified (allowed)
Applebot-ExtendedApple AI training use
Blocking Applebot-Extended does not affect Siri or Spotlight search.
Not specified (allowed)

Your scanned pages

Real defects live on money pages, not just homepages. We scanned 6 pages: your homepage plus pages picked from your sitemap, preferring product, pricing and services pages, because those are the pages AI assistants quote when buyers ask.

PageStatusIndexableCanonicalTitleWords
/200YesOKGEO, AEO & AI Search Optimization Agency for…2924
/pricing200YesOKGEO, AEO & AI SEO Agency Pricing for B2B…2416
/blog/product-hunt-launch-seo-ai-visibility-lessons200YesOKHow Product Hunt Improves SEO & AI Visibility1916
/ai-visibility-checker200YesOKFree AI Visibility Checker (No Signup)…2996
/privacy-policy200YesOKPrivacy Policy | Arobis AI855
/ai-visibility-audit200YesOKAI Visibility Audit: Method, Scope and Cost…2787

Good to know (2)

INFOllms.txt: Found at /llms.txt

llms.txt is an emerging convention some AI crawlers read for site guidance. Yours is in place and follows the expected structure.

Verify it yourself
curl -s "https://arobis.ai/llms.txt"
INFOVerify your Bing index manually

Microsoft Copilot answers from Bing's index; if Bing has not indexed you, Copilot cannot cite you. Automated Bing verification is unreliable without authenticated APIs, so we will not fake it.

Verify it yourselfSearch "site:arobis.ai" on bing.com and confirm your key pages appear.

Recommended robots.txt additions (free, no email needed)

# Recommended AI crawler access, generated by the AI Crawler Access Report by Citant.ai
# Place these lines ABOVE any general User-agent: * block in robots.txt

User-agent: OAI-SearchBot
Allow: /
User-agent: ChatGPT-User
Allow: /
User-agent: PerplexityBot
Allow: /
User-agent: Claude-SearchBot
Allow: /
User-agent: Claude-User
Allow: /
User-agent: DuckAssistBot
Allow: /
User-agent: GPTBot
Allow: /
User-agent: ClaudeBot
Allow: /
User-agent: CCBot
Allow: /
User-agent: Meta-ExternalAgent
Allow: /
User-agent: Amazonbot
Allow: /
User-agent: Googlebot
Allow: /
User-agent: bingbot
Allow: /

# Optional training opt-outs. These are business decisions, not defects:
# blocking Google-Extended removes you from Gemini training but does NOT
# affect Google Search ranking. Leave them out to stay fully open.
# User-agent: Google-Extended
# Disallow: /

Your prioritized fix plan

No criticals found. Warnings are ordered by impact. Platform detected: Webflow. Open the print-ready report to save it as a PDF.

Nothing to fix

Every check passed. The next question is not whether AI can read you, but whether it recommends you.

This scan measures whether AI can READ you. It cannot measure whether AI RECOMMENDS you, or who it recommends instead. That requires prompt-testing against your named competitors across 6 platforms.

You're readable. Now find out if you're recommended

The AI Search Audit by Citant.ai prompt-tests your named competitors across ChatGPT, Claude, Perplexity, Gemini, Copilot and Google AI Overviews, and hands you the gap analysis. It includes a 30 minute walkthrough call.

Book the $440 AI Search Audit

The $440 is credited in full against the GEO Pilot if the Pilot is signed within 30 days of audit delivery.