AI engines fetch a page before they cite it, so this is the citation pipeline in the open. The AI live-fetch count is pages being pulled into answers right now; the blind spots are pages AI never sees; the Verified checks separate real bots from impostors. This is the "watch your logs" step from the GEO Field Manual, made live.
AI crawler activity, last 14 days
Daily AI hits, stacked by what the crawler is doing. Hover any day for the breakdown.
What the AI crawlers want
Every AI fetch in the window, split by intent.
Of 3,269 AI fetches: 346 ai search, 1,483 ai training, 1,440 ai live-fetch.
Top AI engines
By hits. Click one to filter the page explorer below.
Pages AI is fetching
Search, filter by crawler intent or engine, and click any row to see which bots pull it. Showing the top 25 by default. 186 pages have AI activity.
| Page | AI hits | Live-fetch | Top type |
|---|---|---|---|
| /claude-fable-5-issues-fixes/ | 724 | 692 | AI live-fetch |
| / | 224 | 135 | AI live-fetch |
| /agent-zero/ | 221 | 202 | AI live-fetch |
| /claude-code-specification-workflow-mcp/ | 112 | 98 | AI live-fetch |
| /searxng-self-hosted-guide/ | 78 | 67 | AI live-fetch |
| /dify-self-hosted-guide/ | 78 | 68 | AI live-fetch |
| /ollama/ | 32 | 25 | AI live-fetch |
| /crewai-setup-production-guide/ | 26 | 16 | AI live-fetch |
| /security/ | 25 | 2 | AI training |
| /kidsevents/ | 24 | 9 | AI live-fetch |
| /claude-seo/ | 24 | 4 | AI training |
| /hometurf/ | 21 | 4 | AI training |
| /vision-dominates-half-your-brains-processing-power/ | 20 | 6 | AI training |
| /geo-ai-citation/ | 18 | 2 | AI training |
| /three-js-pattern/ | 17 | 1 | AI training |
| /military-application/ | 15 | 5 | AI training |
| /medical-training/ | 14 | 7 | AI live-fetch |
| /cyubevr/ | 14 | 2 | AI training |
| /babylon-js-clouds/ | 14 | 0 | AI training |
| /llm-etl-architecture/ | 14 | 1 | AI search |
| /ai-infrastructure/ | 13 | 1 | AI training |
| /about/ | 13 | 0 | AI training |
| /perplexica-self-hosted-guide/ | 13 | 1 | AI training |
| /the-gospel-according-to-kal-el/ | 12 | 0 | AI training |
| /building-an-advanced-ai-workflow-josie-with-persisten | 12 | 0 | AI training |
Blind spots
Indexed pages AI has not fetched in this window, your fix-list (orphan pages, weak internal links, stale content). 1 total.
Freshness: how fast AI picks up updates
| Page | Updated | First AI fetch | Lag |
|---|---|---|---|
| /geo-answers/ | 2026-06-19 | 2026-06-19 | 0d |
Crawlers, verified
| Crawler | Type | Hits | Verified | Last |
|---|---|---|---|---|
| ChatGPT user-fetch | AI live-fetch | 1,332 | 8/8 ✓ | 2026-06-19 |
| Anthropic ClaudeBot | AI training | 522 | 0/3 | 2026-06-19 |
| ByteDance Bytespider | AI training | 285 | pending | 2026-06-19 |
| Amazonbot | AI training | 245 | pending | 2026-06-19 |
| Meta AI | AI training | 187 | pending | 2026-06-19 |
| ChatGPT search | AI search | 171 | 1/1 ✓ | 2026-06-19 |
| OpenAI GPTBot | AI training | 171 | pending | 2026-06-19 |
| Perplexity | AI search | 170 | 19/19 ✓ | 2026-06-19 |
| Claude user-fetch | AI live-fetch | 92 | 0/1 | 2026-06-19 |
| Common Crawl | AI training | 46 | pending | 2026-06-17 |
| You.com | AI training | 23 | pending | 2026-06-17 |
| Perplexity user-fetch | AI live-fetch | 16 | pending | 2026-06-16 |
| Claude search | AI search | 5 | pending | 2026-06-18 |
| Anthropic (other) | AI training | 3 | pending | 2026-06-06 |
| Google-Extended | AI training | 1 | pending | 2026-06-06 |
Search engines
| Crawler | Type | Hits | Verified | Last |
|---|---|---|---|---|
| Googlebot | Search index | 969 | pending | 2026-06-19 |
| Bingbot | Search index | 884 | 7/7 ✓ | 2026-06-19 |
| Petal (Huawei) | Search index | 586 | pending | 2026-06-19 |
| Yandex | Search index | 195 | 1/1 ✓ | 2026-06-19 |
| Applebot | Search index | 148 | pending | 2026-06-19 |
| Seznam | Search index | 107 | pending | 2026-06-17 |
| DuckDuckGo | Search index | 99 | pending | 2026-06-18 |
Vulnerability scanners
88,207 requests probing for exposed files and admin panels. All 404. 1,390 forged a crawler UA.
| Probed path | Hits |
|---|---|
| /wp-login.php | 17,111 |
| /wp-cron.php | 7,459 |
| /wp-admin/index.php | 4,517 |
| /wp-json/wp/v2/users/me | 618 |
| /.env | 613 |
| /wp-admin/admin-ajax.php | 607 |
| /wp-json/wp/v2/users | 524 |
| /wp-content/uploads/2022/02/cropped-cropped-cropped-favicon5 | 389 |
| /.git/config | 324 |
| /wp-json/rankmath/v1/getHead | 226 |
Verified counts cover traffic since real-IP logging was enabled, filling in daily. Log retention is ~2 weeks, so "blind spots" means "not fetched recently." The playbook: GEO Field Manual, and the answers it produces: GEO answers.