How this score is measured
The overall score weights Live Answer Visibility at 45%, Search Index Foundation at 30% and Training Data Presence at 25%, rounded to the nearest point. Critical findings can cap the score lower; any applied cap is stated next to it. Live Answer Visibility and Training Data Presence reflect crawler access plus on-page structure, with Training Data Presence also counting Common Crawl. Search Index Foundation reflects Googlebot and bingbot access plus indexability, sitemap and response health.
Our crawler tests send each bot's user agent from our own servers, not from the AI companies' verified IP ranges. Some firewalls, including Cloudflare, verify crawlers by network identity rather than user agent. That means a site can challenge our test request while allowing the real, verified crawler. When that happens this scan over-reports blocking; it never under-reports it. The Googlebot result is the most exposed to this, because fake Googlebots are the most common spoof and are policed hardest.
This scan of isitemediagroup.com checked 15 AI crawlers across 21 automated checks on 6 pages. None of the 13 scored crawlers are blocked. AI Access Score: 92/100 (Fully open).
The bot matrix
robots.txt policy next to what actually happened when each bot knocked. Rows where your policy says yes but the server says no are highlighted; those are the silent failures.
Live-answer botsFetch content in real time to build the answers and citations users see today.
| Bot | Owner | robots.txt policy | Real fetch | Verify |
|---|---|---|---|---|
| OAI-SearchBot Powers ChatGPT search results | OpenAI | Partial line 2: Disallow: /sample-* | Reachable (200) | |
| ChatGPT-User User-triggered fetches from ChatGPT; Cloudflare classes this as Agent traffic, blocked by default on ad pages for new Cloudflare domains | OpenAI | Partial line 2: Disallow: /sample-* | Reachable (200) | |
| PerplexityBot Index for Perplexity answers | Perplexity | Partial line 2: Disallow: /sample-* | Reachable (200) | |
| Perplexity-Userinformational User-triggered; may ignore robots.txt | Perplexity | Partial line 2: Disallow: /sample-* | Reachable (200) | |
| Claude-SearchBot Claude search indexing | Anthropic | Partial line 2: Disallow: /sample-* | Reachable (200) | |
| Claude-User User-triggered fetches from Claude; Cloudflare classes this as Agent traffic, blocked by default on ad pages for new Cloudflare domains | Anthropic | Partial line 2: Disallow: /sample-* | Reachable (200) | |
| DuckAssistBot DuckAssist answers | DuckDuckGo | Partial line 2: Disallow: /sample-* | Reachable (200) |
Training crawlersCollect content for model training. Blocking them removes you from future models' memory.
| Bot | Owner | robots.txt policy | Real fetch | Verify |
|---|---|---|---|---|
| GPTBot Training corpus | OpenAI | Partial line 2: Disallow: /sample-* | Reachable (200) | |
| ClaudeBot Training corpus | Anthropic | Partial line 2: Disallow: /sample-* | Reachable (200) | |
| CCBot Feeds many labs' training data; blocking it is the quietest way to disappear from future models | Common Crawl | Partial line 2: Disallow: /sample-* | Reachable (200) | |
| Meta-ExternalAgent Llama training | Meta | Partial line 2: Disallow: /sample-* | Reachable (200) | |
| Amazonbot Alexa and Amazon AI features | Amazon | Partial line 2: Disallow: /sample-* | Reachable (200) | |
| Bytespiderinformational Known to sometimes ignore robots.txt | ByteDance | Partial line 2: Disallow: /sample-* | Blocked by firewall (Cloudflare) Policy says yes; firewall says no. |
Search-index foundationCopilot rides Bing's index and AI Overviews rides Google's. If these starve, the AI layer above them starves.
| Bot | Owner | robots.txt policy | Real fetch | Verify |
|---|---|---|---|---|
| Googlebot Google Search index; AI Overviews rides this. Cloudflare treats it as mixed Search and Training, so as of September 15, 2026 Cloudflare AI training blocks can hit it | Partial line 2: Disallow: /sample-* | Reachable (200) | ||
| bingbot Bing index; Copilot and ChatGPT search lean on it. Cloudflare treats it as mixed Search and Training, so as of September 15, 2026 Cloudflare AI training blocks can hit it | Microsoft | Partial line 2: Disallow: /sample-* | Reachable (200) |
Training opt-out tokensNot crawlers. Directives controlling whether already-crawled content trains AI.
| Token | Controls | Your robots.txt |
|---|---|---|
| Google-Extended | Gemini training use of Google's crawl Blocking Google-Extended does NOT affect your Google Search ranking, but it does remove your content from Gemini training use. | Partial |
| Applebot-Extended | Apple AI training use Blocking Applebot-Extended does not affect Siri or Spotlight search. | Partial |
Your scanned pages
Real defects live on money pages, not just homepages. We scanned 6 pages: your homepage plus pages picked from your sitemap, preferring product, pricing and services pages, because those are the pages AI assistants quote when buyers ask.
| Page | Status | Indexable | Canonical | Title | Words |
|---|---|---|---|---|---|
| / | 200 | Yes | OK | iSite Media | Sports Stadium & Arena… | 479 |
| /blogs | 200 | Yes | None | Sports Stadium & Arena Advertising | 91 |
| /advertising-inside-of-xcel-energy-center | 200 | Yes | None | Advertising inside of Xcel Energy Center | 248 |
| /intelligence-briefing | 200 | Yes | None | Intelligence Briefing | 244 |
| /nhl-stadium-advertising | 200 | Yes | None | Advertise Inside of the Enterprise Center | 248 |
| /our-work | 200 | Yes | OK | Our Work | 540 |
Warnings (1)
LLM retrieval splits pages into chunks along heading structure; broken hierarchy produces orphan chunks with no context.
Good to know (8)
A Sitemap: line in robots.txt lets every crawler find your sitemap without guessing.
curl -s "https://www.isitemediagroup.com/robots.txt" | grep -i sitemapA canonical tag prevents URL variants from splitting the page's identity.
curl -s "https://www.isitemediagroup.com/blogs" | grep -ioE '<link[^>]*rel=.?canonical[^>]*>'Same as "No canonical tag on /blogs" above.
curl -s "https://www.isitemediagroup.com/advertising-inside-of-xcel-energy-center" | grep -ioE '<link[^>]*rel=.?canonical[^>]*>'Same as "No canonical tag on /blogs" above.
curl -s "https://www.isitemediagroup.com/intelligence-briefing" | grep -ioE '<link[^>]*rel=.?canonical[^>]*>'Same as "No canonical tag on /blogs" above.
curl -s "https://www.isitemediagroup.com/nhl-stadium-advertising" | grep -ioE '<link[^>]*rel=.?canonical[^>]*>'sameAs links to LinkedIn, Crunchbase and similar profiles are the entity-corroboration signal that confirms you are you.
llms.txt is an emerging convention some AI crawlers read for site guidance. Adding one is a five minute quick win.
curl -sI "https://www.isitemediagroup.com/llms.txt" | head -1Copilot and ChatGPT search lean on Bing's index; if Bing has not indexed you, two of six AI platforms cannot cite you. Automated Bing verification is unreliable without authenticated APIs, so we will not fake it.
Recommended robots.txt additions (free, no email needed)
# Recommended AI crawler access, generated by the AI Crawler Access Report by Citant.ai # Place these lines ABOVE any general User-agent: * block in robots.txt User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: PerplexityBot Allow: / User-agent: Claude-SearchBot Allow: / User-agent: Claude-User Allow: / User-agent: DuckAssistBot Allow: / User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: CCBot Allow: / User-agent: Meta-ExternalAgent Allow: / User-agent: Amazonbot Allow: / User-agent: Googlebot Allow: / User-agent: bingbot Allow: / # Optional training opt-outs. These are business decisions, not defects: # blocking Google-Extended removes you from Gemini training but does NOT # affect Google Search ranking. Leave them out to stay fully open. # User-agent: Google-Extended # Disallow: /
Your prioritized fix plan
No criticals found. Warnings are ordered by impact. CMS not detected; generic instructions shown. Open the print-ready report to save it as a PDF.
1. Repair the heading hierarchy
Fixes: Heading hierarchy issues: no H1, skipped heading levels
- Use exactly one H1 per page and do not skip levels; LLM retrieval splits pages into chunks along heading structure, and broken hierarchy produces orphan chunks with no context.
- Restructure headings in the page template rather than styling text to look like headings.
2. Fix your sitemap
Fixes: Sitemap not referenced in robots.txt
- Ensure /sitemap.xml returns 200 and lists your live URLs; remove entries that 404.
- Reference it from robots.txt with a Sitemap: line so crawlers find it without guessing.
Sitemap: https://yourdomain.com/sitemap.xml
curl -s "https://www.isitemediagroup.com/robots.txt" | grep -i sitemap3. Fix the canonical tag (/blogs)
Fixes: No canonical tag on /blogs
- The canonical must be an absolute https URL on this same host. A canonical pointing at a staging domain or another host donates the page's identity elsewhere.
- Fix the template that renders the link rel=canonical tag, deploy, and verify with the command in this report.
curl -s "https://www.isitemediagroup.com/blogs" | grep -ioE '<link[^>]*rel=.?canonical[^>]*>'4. Fix the canonical tag (/advertising-inside-of-xcel-energy-center)
Fixes: No canonical tag on /advertising-inside-of-xcel-energy-center
- The canonical must be an absolute https URL on this same host. A canonical pointing at a staging domain or another host donates the page's identity elsewhere.
- Fix the template that renders the link rel=canonical tag, deploy, and verify with the command in this report.
curl -s "https://www.isitemediagroup.com/advertising-inside-of-xcel-energy-center" | grep -ioE '<link[^>]*rel=.?canonical[^>]*>'5. Fix the canonical tag (/intelligence-briefing)
Fixes: No canonical tag on /intelligence-briefing
- The canonical must be an absolute https URL on this same host. A canonical pointing at a staging domain or another host donates the page's identity elsewhere.
- Fix the template that renders the link rel=canonical tag, deploy, and verify with the command in this report.
curl -s "https://www.isitemediagroup.com/intelligence-briefing" | grep -ioE '<link[^>]*rel=.?canonical[^>]*>'6. Fix the canonical tag (/nhl-stadium-advertising)
Fixes: No canonical tag on /nhl-stadium-advertising
- The canonical must be an absolute https URL on this same host. A canonical pointing at a staging domain or another host donates the page's identity elsewhere.
- Fix the template that renders the link rel=canonical tag, deploy, and verify with the command in this report.
curl -s "https://www.isitemediagroup.com/nhl-stadium-advertising" | grep -ioE '<link[^>]*rel=.?canonical[^>]*>'7. Add Organization schema with sameAs links
Fixes: Organization schema is thin: fewer than 2 sameAs links
- Add the JSON-LD below to your homepage head, filling in your real details.
- The sameAs links are the entity-corroboration signal that connects your site to your LinkedIn and other profiles.
- Validate at validator.schema.org.
<script type="application/ld+json">
{
"@context": "https://schema.org",
"@type": "Organization",
"name": "Isitemediagroup",
"url": "https://isitemediagroup.com",
"logo": "https://isitemediagroup.com/logo.png",
"description": "What Isitemediagroup does, in one sentence.",
"sameAs": [
"https://www.linkedin.com/company/isitemediagroup",
"https://x.com/isitemediagroup"
]
}
</script>8. Add an llms.txt file
Fixes: No llms.txt found
- Save the generated draft below as /llms.txt at your site root.
- It is a plain-markdown guide that tells AI systems what your most important pages are; adoption is emerging, and it costs nothing.
# Isitemediagroup > One-sentence description of what isitemediagroup.com does, written for AI systems. Edit this line. ## Key pages - [iSite Media | Sports Stadium & Arena Restroom Advertising](https://www.isitemediagroup.com/): iSite Media is a sports venue advertising network delivering full-motion video ads inside stadium and arena restrooms - [Sports Stadium & Arena Advertising](https://www.isitemediagroup.com/blogs): Read about advertising across different NHL, NBA, MLS, NCAA venues and more. iSite Media, captive and affordable - [Advertising inside of Xcel Energy Center](https://www.isitemediagroup.com/advertising-inside-of-xcel-energy-center): Looking to advertise with the Minnesota Wild inside of Xcel Energy Center? Isite Media digital signage network offers - [Intelligence Briefing](https://www.isitemediagroup.com/intelligence-briefing): Intelligence Briefing - [Advertise Inside of the Enterprise Center](https://www.isitemediagroup.com/nhl-stadium-advertising): Advertise in the Enterprise Center with iSite Media's digital display network. Captive and affordable exposure inside - [Our Work](https://www.isitemediagroup.com/our-work): View work we've done for clients. Including creative video commercials as well as case studies. ## Contact - [Contact](https://isitemediagroup.com/contact): How to reach Isitemediagroup
curl -sI "https://www.isitemediagroup.com/llms.txt" | head -1