AI engines fetch a page before they cite it, so this is the citation pipeline in the open. The AI live-fetch count is pages being pulled into answers right now; the blind spots are pages AI never sees; the Verified checks separate real bots from impostors. This is the "watch your logs" step from the GEO Field Manual, made live.
Who's actually visiting
Real IP analysis: ip-api.com org lookup on non-bot request IPs, classified by network type. 42,913 unique IPs in the past 7 days. Updated weekly (Sundays) · data as of 2026-07-05.
• Techoff SRV Limited (4 nodes, 14,367 hits): Andorra/Netherlands-based infrastructure, single-visit behavior across unknown pages — consistent with automated content harvester or mirror scraper operating at scale.
• (2a07:e01:3:1f8::1) Privex Sweden, 7,471 hits: IPv6 residential proxy from Sweden, single visit to unknown pages — rank-tracking proxy inflating impressions without genuine user engagement.
• Microsoft Azure Cloud (7 nodes, 2,972 hits): Brazil, Hong Kong, Singapore, India, Spain, Japan — distributed cloud scraper with single-visit pattern, likely commercial content indexing or SEO aggregation service.
• (129.150.38.224) Oracle Corporation Singapore, 513 hits: Single-visit behavior suggests Oracle-hosted bot or crawler, possibly legitimate infrastructure audit but operating as automated scraper.
• AWS EC2 (2 nodes, 674 hits): Australia/France regions, single-visit pattern — commodity cloud hosting used for distributed scraping, likely content replication or price-comparison crawler.
• Cross-reference with GSC: /claude-fable-5-issues-fixes/ shows 4,753 impressions but only 58 clicks (1.2% CTR) — rank-tracking and proxy traffic are heavily inflating this site's GSC impression count relative to real search interest; /agent-zero/ and /ollama/ show similar patterns (low CTR despite impressions), suggesting proxy bots are triggering SERP appearances without actual user demand.
Real human traffic represents approximately 2% of total unique IPs this site received, concentrated in /claude-fable-5-issues-fixes/ and /d-lusion-rubberduck/ (35.3% CTR) where legitimate clicks actually occur.
Search Console: top pages by impression (last 7 days)
| Page | Impressions | Clicks | CTR | Avg pos |
|---|---|---|---|---|
| /claude-fable-5-issues-fixes/ | 4,753 | 58 | 1.2% | 8.1 |
| /agent-zero/ | 1,373 | 3 | 0.2% | 13.0 |
| /ollama/ | 1,236 | 3 | 0.2% | 35.8 |
| /searxng-self-hosted-guide/ | 591 | 3 | 0.5% | 8.4 |
| /claude-code-specification-workflow-mcp/ | 363 | 0 | 0% | 11.3 |
| /dify-self-hosted-guide/ | 173 | 0 | 0% | 26.2 |
| /geo-ai-citation/ | 126 | 0 | 0% | 37.7 |
| /perplexica-self-hosted-guide/ | 110 | 1 | 0.9% | 17.9 |
| /geo-field-manual/ | 37 | 0 | 0% | 15.9 |
| /cyubevr/ | 27 | 0 | 0% | 9.2 |
| /babylon-js-clouds/ | 18 | 1 | 5.6% | 13.1 |
| /d-lusion-rubberduck/ | 17 | 6 | 35.3% | 4.9 |
| /claude-seo/ | 12 | 0 | 0% | 16.9 |
| /hometurf/ | 9 | 0 | 0% | 6.4 |
| /anythingllm-self-hosted-guide/ | 6 | 0 | 0% | 30.5 |
Red CTR = impression volume likely inflated by rank trackers (they query Google, not real searchers).
AI crawler activity, last 14 days
Daily AI hits, stacked by what the crawler is doing. Hover any day for the breakdown.
How to read this: daily counts of AI-crawler hits from 2026-07-05 to 2026-07-12, one bar per day, each segmented by crawler intent (AI live-fetch, AI search, AI training). Busiest day was 2026-07-07 with 774 AI hits. Data window first-seen 2026-07-05, latest 2026-07-12; last updated 2026-07-12 06:40 UTC.
What the AI crawlers want
Every AI fetch in the window, split by intent.
Of 3,848 AI fetches: 295 ai search, 1,084 ai training, 2,469 ai live-fetch.
How to read this: the 3,848 AI fetches in this window split by intent: 295 ai search, 1,084 ai training, 2,469 ai live-fetch. Window 2026-07-05 to 2026-07-12.
Top AI engines
By hits. Click one to filter the page explorer below.
How to read this: AI crawlers ranked by hit count, 2026-07-05 to 2026-07-12. Top engine ChatGPT user-fetch with 2,435 fetches, then Meta AI (285).
AI assistants pulled 59 pages of this site mid-answer in the window (2,469 live fetches in all). The most active was LiteLLM Proxy: One OpenAI-Compatible API for 100-Plus LLM Providers, fetched 462× by ChatGPT: live-answer agents, meaning it was read to compose a reply to a real question, not archived for training.
Pages AI is fetching
Search, filter by crawler intent or engine, and click any row to see which bots pull it. Showing the top 25 by default. 176 pages have AI activity.
| Page | AI hits | Live-fetch | Top type |
|---|---|---|---|
| /litellm-proxy-guide/ | 470 | 462 | AI live-fetch |
| / | 470 | 215 | AI live-fetch |
| /dify-self-hosted-guide/ | 418 | 401 | AI live-fetch |
| /searxng-self-hosted-guide/ | 322 | 305 | AI live-fetch |
| /agent-zero/ | 235 | 225 | AI live-fetch |
| /n8n-self-hosted-guide/ | 211 | 200 | AI live-fetch |
| /anythingllm-self-hosted-guide/ | 153 | 146 | AI live-fetch |
| /claude-fable-5-issues-fixes/ | 138 | 129 | AI live-fetch |
| /crewai-setup-production-guide/ | 61 | 53 | AI live-fetch |
| /claude-code-specification-workflow-mcp/ | 48 | 42 | AI live-fetch |
| /ollama/ | 41 | 33 | AI live-fetch |
| /librechat-self-hosted-guide/ | 32 | 22 | AI live-fetch |
| /open-webui-self-hosted-guide/ | 31 | 18 | AI live-fetch |
| /vision-dominates-half-your-brains-processing-power/ | 31 | 23 | AI live-fetch |
| /medical-training/ | 29 | 27 | AI live-fetch |
| /hometurf/ | 29 | 16 | AI live-fetch |
| /perplexica-self-hosted-guide/ | 27 | 16 | AI live-fetch |
| /psychedelic-vr-visual-effects-meta-quest/ | 25 | 1 | AI training |
| /kidsevents/ | 23 | 14 | AI live-fetch |
| /qwen2-5-vl/ | 23 | 17 | AI live-fetch |
| /driftlights/ | 19 | 0 | AI training |
| /geo-observatory/ | 19 | 0 | AI training |
| /cyubevr/ | 18 | 10 | AI live-fetch |
| /claude-seo/ | 18 | 0 | AI training |
| /aiscan/ | 16 | 2 | AI training |
Blind spots
Indexed pages AI has not fetched in this window, your fix-list (orphan pages, weak internal links, stale content). 0 total.
- None: every indexed page has been fetched by AI in the window.
Freshness: how fast AI picks up updates
| Page | Updated | First AI fetch | Lag |
|---|---|---|---|
| /kidsevents/neighbourhoods/ | 2026-07-06 | 2026-07-06 | 0d |
| /d-lusion-rubberduck/ | 2026-07-06 | 2026-07-09 | 3d |
AI referrals: humans who clicked through
47 click-throughs from AI platforms — Copilot/Bing leads with 32. Last 7 days: 22 (18 Copilot/Bing, 2 Copilot, 1 Claude.ai, 1 Perplexity). These are real visitors whose browser sent a Referer header from an AI platform — proof the citation converted to a visit. Country and ISP come from the real visitor IP (via Cloudflare).
| Date | Platform | Page | Location | ISP / Org |
|---|---|---|---|---|
| 2026-07-12 | Copilot | /ollama/ | 🇺🇸 Maiden, United States | Spectrum |
| 2026-07-11 | Copilot/Bing | /searxng-self-hosted-guide/ | Foshan, China | Chinanet GD |
| 2026-07-11 | Copilot/Bing | / | 🇺🇸 New York, United States | LogicWeb Inc |
| 2026-07-10 | Copilot/Bing | /litellm-proxy-guide/ | 🇮🇳 Chennai, India | Netskope MAA |
| 2026-07-10 | Copilot/Bing | /geo-ai-citation/ | 🇺🇸 Portland, United States | Cloudflare, Inc. |
| 2026-07-10 | Copilot/Bing | /litellm-proxy-guide/ | 🇩🇪 Fuldabrück, Germany | Vodafone NRW GmbH |
| 2026-07-10 | Copilot/Bing | /kidsevents/ | 🇨🇦 Toronto, Canada | The Hospital Sick Children |
| 2026-07-10 | Copilot/Bing | /kidsevents/ | 🇨🇦 Toronto, Canada | Rogers Communications Canada Inc |
| 2026-07-09 | Copilot/Bing | /litellm-proxy-guide/ | Guangzhou, China | China Mobile |
| 2026-07-09 | Copilot/Bing | /searxng-self-hosted-guide/ | 🇩🇪 Berlin, Germany | ecotel communication ag |
| 2026-07-09 | Copilot/Bing | /crewai-setup-production-guide/ | Guangzhou, China | China Unicom |
| 2026-07-09 | Copilot/Bing | /crewai-setup-production-guide/ | Jinrongjie, China | China Unicom Network |
| 2026-07-09 | Copilot/Bing | /litellm-proxy-guide/ | Beijing, China | CHINANET |
| 2026-07-09 | Copilot/Bing | /d-lusion-rubberduck/ | 🇳🇱 Heerenveen, The Netherlands | Vodafone Ziggo |
| 2026-07-08 | Copilot | /vision-dominates-half-your-brains-processing-powe | 🇳🇱 Amsterdam, The Netherlands | Hotel StadsThuis B.V. |
| 2026-07-07 | Claude.ai | /claude-fable-5-issues-fixes/ | 🇯🇵 Chiyoda City, Japan | SOFTBANK Corp |
| 2026-07-07 | Perplexity | /perplexica-self-hosted-guide/ | 🇩🇪 Frankfurt am Main, Germany | SERV.HOST GROUP LTD |
| 2026-07-07 | Copilot/Bing | /dify-self-hosted-guide/ | Jinrongjie, China | China Mobile |
| 2026-07-07 | Copilot/Bing | /kidsevents/ | 🇺🇸 Chicago, United States | Zscaler, Inc |
| 2026-07-07 | Copilot/Bing | /kidsevents/ | 🇨🇦 Toronto, Canada | TELUS Mobility-Ontario |
| 2026-07-06 | Copilot/Bing | / | 🇺🇸 Ashburn, United States | BraveWay |
| 2026-07-06 | Copilot/Bing | / | 🇨🇦 Toronto, Canada | 3xK Tech GmbH |
| 2026-07-04 | Copilot/Bing | /searxng-self-hosted-guide/ | 🇵🇭 Tagaytay, Philippines | Eastern Telecoms Philippines, Inc. |
| 2026-07-04 | Copilot/Bing | /dify-self-hosted-guide | 🇺🇸 Ashburn, United States | AWS EC2 (us-east-1) |
| 2026-07-04 | Copilot/Bing | /dify-self-hosted-guide/ | 🇺🇸 Ashburn, United States | AWS EC2 (us-east-1) |
| 2026-07-04 | Claude.ai | /searxng-self-hosted-guide/ | 🇺🇸 Boston, United States | Cdnext BOS |
| 2026-07-04 | Copilot/Bing | /kidsevents/ | 🇨🇦 North York, Canada | Rogers Communications Canada Inc |
| 2026-07-04 | Copilot/Bing | /kidsevents/ | 🇨🇦 Richmond Hill, Canada | Rogers Cable Inc. WLFDLE |
| 2026-07-03 | Copilot | /models/ | 🇮🇳 Hyderabad, India | Reliance Jio Infocomm Limited |
| 2026-07-03 | Perplexity | /perplexica-self-hosted-guide/ | 🇺🇸 Portland, United States | Cloudflare, Inc. |
| 2026-07-02 | Copilot/Bing | /dify-self-hosted-guide/ | Guangzhou, China | China Mobile |
| 2026-07-02 | Copilot | /vision-dominates-half-your-brains-processing-powe | 🇳🇱 Maastricht, The Netherlands | Universiteit Maastricht |
| 2026-07-02 | Copilot/Bing | /geo-field-manual | 🇺🇸 Ashburn, United States | AWS EC2 (us-east-1) |
| 2026-07-02 | Copilot/Bing | /geo-field-manual/ | 🇺🇸 Ashburn, United States | AWS EC2 (us-east-1) |
| 2026-07-02 | Gemini | /geo-field-manual | 🇦🇪 Fujairah, United Arab Emirates | Etisalat |
| 2026-07-02 | Gemini | /geo-field-manual/ | 🇦🇪 Fujairah, United Arab Emirates | Etisalat |
| 2026-07-01 | ChatGPT | /searxng-self-hosted-guide/ | 🇺🇸 Portland, United States | Cloudflare, Inc. |
| 2026-07-01 | Copilot/Bing | / | 🇺🇸 Ashburn, United States | 3xK Tech GmbH |
| 2026-07-01 | Copilot/Bing | /vision-dominates-half-your-brains-processing-powe | Hanoi, Vietnam | Vietnam Internet Network Information Cen |
| 2026-07-01 | Copilot | /architectural-visualization/ | 🇪🇸 Valencia, Spain | Xtra Telecom S.A. |
| 2026-07-01 | Perplexity | /kidsevents/ | 🇨🇦 Mississauga, Canada | Rogers Communications Canada Inc |
| 2026-07-01 | Perplexity | /perplexica-self-hosted-guide/ | 🇺🇸 Sacramento, United States | AT&T Internet Services |
| 2026-06-30 | Claude.ai | /searxng-self-hosted-guide/ | 🇺🇸 Portland, United States | Cloudflare, Inc. |
| 2026-06-30 | Copilot/Bing | / | 🇳🇱 Amsterdam, The Netherlands | Techoff SRV Limited |
| 2026-06-30 | Copilot/Bing | /vision-dominates-half-your-brains-processing-powe | Hanoi, Vietnam | Vietnam Internet Network Information Cen |
| 2026-06-30 | Copilot/Bing | /kidsevents/ | 🇨🇦 Toronto, Canada | Sympatico HSE |
| 2026-06-29 | Copilot/Bing | / | Andorra la Vella, Andorra | Techoff SRV Limited |
Who is crawling
Search engines
Classic index crawlers, by hits.
Are they who they claim?
Crawler traffic checked against each operator's published IP ranges and reverse-DNS.
Full crawler tables (raw numbers)
AI crawlers
| Crawler | Type | Hits | Verified | Last |
|---|---|---|---|---|
| ChatGPT user-fetch | AI live-fetch | 2,435 | 2413/2435 | 2026-07-12 |
| Meta AI | AI training | 285 | pending | 2026-07-12 |
| Amazonbot | AI training | 279 | pending | 2026-07-12 |
| Anthropic ClaudeBot | AI training | 180 | 0/180 | 2026-07-12 |
| ByteDance Bytespider | AI training | 178 | pending | 2026-07-12 |
| Perplexity | AI search | 159 | 138/159 | 2026-07-12 |
| ChatGPT search | AI search | 136 | 104/136 | 2026-07-12 |
| OpenAI GPTBot | AI training | 83 | 40/83 | 2026-07-12 |
| Claude user-fetch | AI live-fetch | 29 | 0/29 | 2026-07-11 |
| Cohere | AI training | 19 | pending | 2026-07-07 |
| Google-Extended | AI training | 18 | 0/18 | 2026-07-07 |
| Common Crawl | AI training | 17 | pending | 2026-07-09 |
| Applebot-Extended | AI training | 15 | 0/15 | 2026-07-07 |
| Anthropic (other) | AI training | 7 | 0/7 | 2026-07-07 |
| Perplexity user-fetch | AI live-fetch | 5 | 0/5 | 2026-07-07 |
| You.com | AI training | 3 | pending | 2026-07-09 |
Search engines
| Crawler | Type | Hits | Verified | Last |
|---|---|---|---|---|
| Bingbot | Search index | 900 | 885/900 | 2026-07-12 |
| Googlebot | Search index | 180 | 174/180 | 2026-07-12 |
| Petal (Huawei) | Search index | 179 | pending | 2026-07-12 |
| Yandex | Search index | 113 | 113/113 ✓ | 2026-07-12 |
| Applebot | Search index | 46 | 39/46 | 2026-07-12 |
| DuckDuckGo | Search index | 37 | 0/37 | 2026-07-09 |
| Seznam | Search index | 15 | pending | 2026-07-12 |
Under attack: what scanners hunt for
3,062 requests probing for exposed files, admin panels, and known exploits, every one a 404 here. 114 forged a real crawler's user-agent to blend in.
Bot traffic reality
Every bot request in the window. Hostile scanning dwarfs the legitimate crawlers.
Of 8,380 bot requests: 3,062 scanner probes (37%), 3,848 AI, 1,470 search.
What they hunt for
Probes grouped by target. Mostly WordPress, on a site that runs none.
By target: 2,414 wordpress, 73 secrets & config, 49 admin / rce, 233 git exposure, 293 other.
Top probed paths
The most-hammered URLs. None of them exist here.
Full probed-path table
| Probed path | Hits |
|---|---|
| /wp-login.php | 632 |
| /aiscan/api/scan/stream | 80 |
| /wp-content/plugins/hellopress/wp_filemanager.php | 61 |
| /aiscan/api/report/c716161291e1 | 41 |
| /wp-content/uploads/ | 23 |
| //wp-includes/css/dist/ | 23 |
| /wp-content/themes/index.php | 21 |
| /wp-content/index.php | 19 |
| //wp-includes/assets/ | 19 |
| /wp-content/admin.php | 18 |
Verified counts cover traffic since real-IP logging was enabled, filling in daily. Log retention is ~2 weeks, so "blind spots" means "not fetched recently." The playbook: GEO Field Manual, and the answers it produces: GEO answers.