Joshua Opolko

The GEO Observatory

A live dashboard of which AI and search engines crawl this site, which pages they pull for answers, and what they ignore. Parsed from raw server logs, verified against operator IP ranges. Rolling 8-day window (2026-08-11 to 2026-08-18). Generated 2026-08-18 06:40 UTC.

AI engines fetch a page before they cite it, so this is the citation pipeline in the open. The AI live-fetch count is pages being pulled into answers right now; the blind spots are pages AI never sees; the Verified checks separate real bots from impostors. This is the "watch your logs" step from the GEO Field Manual, made live.

AI impact · Bing/ChatGPT
28
AI click-throughs
past 7 days, from AI platforms
25
search clicks (GSC)
past 7 days
1,648
AI citations (Bing/ChatGPT)
read 2026-07-28 · 21d old

Top 10 Queries Driving Citations (Bing/ChatGPT)

QueryImpr.Citation rateTopic
VR collaboration requirements team types organizational use cases12841%Augmented & Virtual Reality
ollama setup tutorial9618%Generative AI
VR visualization software CAD integration comparison vendors6967%Augmented & Virtual Reality
VR visualization architecture construction best practices software teams5872%Construction Software & BIM
litellm install5522%AI Programming & Frameworks
how to install litellm4420%AI Programming & Frameworks
VR applications pharmaceutical drug discovery companies4444%AI in Healthcare
VR visualization architecture construction software best practices growing teams4486%Construction Software & BIM
enterprise VR visualization platforms key features evaluation4341%Augmented & Virtual Reality
VR walkthrough solutions for AEC firms4093%Augmented & Virtual Reality
AEC platforms immersive project walkthroughs client sharing4048%Construction Software & BIM
n8n LangChain LLM implementation evaluation3153%Generative AI
AEC immersive design review BIM visualization tools2528%Construction Software & BIM
n8n LangChain AI orchestration evaluation2437%AI Programming & Frameworks
n8n LangChain enterprise operations scale evaluation2342%Enterprise Technology

Who's actually visiting

Real IP analysis: ip-api.com org lookup on non-bot request IPs, classified by network type. 20,323 unique IPs in the past 7 days. Updated weekly (Sundays) · data as of 2026-08-15.

Rank-tracking / residential proxy (M247 Ltd Paris, M247 LTD, CDN77 Denver)
0%
Cloud / VPS scraper (Microsoft Azure Cloud (swedencentral), Microsoft Azure Cloud (italynorth), Microsoft Azure Cloud (switzerlandnorth))
53%
Real visitor (residential ISP) (Sympatico HSE, Bell DSL Internet Ontario, Verizon Business)
28%
Unclassified (Alibaba Cloud - US, Chinanet SH, Techoff SRV Limited)
18%

• (76.69.36.149) 5,318 hits, Sympatico HSE Canada — residential ISP, single visit pattern suggests real human visitor, though high hit count in one session is unusual; cross-referencing with GSC shows this IP likely accessed multiple pages during one browsing session

• Microsoft Azure Cloud (13 nodes, 4,158 hits total) — distributed across Sweden, Poland, Spain, Switzerland, Germany, US, Italy, Singapore, South Korea with "pages=unknown" and single-visit behavior; classic content harvester or aggressive scraper using cloud infrastructure to distribute requests and avoid rate-limiting

• (47.251.40.48) 493 hits, Alibaba Cloud US — cloud-based scraper showing single-visit pattern; lower hit count than Azure group but same harvesting signature suggests either a focused crawler or reconnaissance run

• Real human traffic to this site represents 28% of classified IPs (approximately 5,690 unique addresses), but GSC data shows pages like /agent-zero/ (1,292 impressions) convert at only 0.2% CTR while cloud scrapers likely inflate impression counts; legitimate visitor intent appears concentrated on self-hosted guides (/perplexica-self-hosted-guide/ at 1.3% CTR, /searxng-self-hosted-guide/ at 0.9% CTR) and niche content like /hometurf/guides/toronto-family-neighbourhoods-income-stability.html (5.0% CTR), indicating real human searchers are finding and engaging with specific, substantive pages rather than broad category pages.

Search Console: Top 10 Pages by Impression (last 7 days)

PageImp.Clck.CTRAvg pos
/agent-zero/1,29230.2%9.8
/searxng-self-hosted-guide/67660.9%16.5
/dify-self-hosted-guide/46600%21.0
/perplexica-self-hosted-guide/45161.3%8.4
/anythingllm-self-hosted-guide/30600%30.1
/open-webui-self-hosted-guide/26010.4%34.3
/geo-ai-citation/20600%40.8
/claude-code-specification-workflow-mcp/15300%8.6
/hometurf/15210.7%7.6
/vision-dominates-half-your-brains-processing-power/14721.4%22.7
/n8n-self-hosted-guide/10411.0%40.5
/ai-code-generation-claude-vs-gemini-a-developers-re4300%41.5
/hometurf/guides/toronto-family-neighbourhoods-incom4025.0%18.3
/ai-cost-maturity/3200%48.4
/geo-field-manual/2100%15.4

Red CTR = impression volume likely inflated by rank trackers (they query Google, not real searchers).

2,888
AI crawler hits
280 pages fetched
1,208
AI live-fetches
pulled into answers now
1,886
Search-engine hits
classic indexing
2,831
Verified bots
2831/3793 IP-checked
29,854
Scanner probes
hostile, all 404
Updated 2026-08-18 06:40 UTC · data 2026-08-11 → 2026-08-18 · rebuilt daily Dates are first-seen in the server log, not publication dates.

AI crawler activity, last 14 days

Daily AI hits, stacked by what the crawler is doing. Hover any day for the breakdown.

How to read this: daily counts of AI-crawler hits from 2026-08-11 to 2026-08-18, one bar per day, each segmented by crawler intent (AI live-fetch, AI search, AI training). Busiest day was 2026-08-13 with 619 AI hits. Data window first-seen 2026-08-11, latest 2026-08-18; last updated 2026-08-18 06:40 UTC.

What the AI crawlers want

Every AI fetch in the window, split by intent.

How to read this: the 2,888 AI fetches in this window split by intent: 333 ai search, 1,347 ai training, 1,208 ai live-fetch. Window 2026-08-11 to 2026-08-18.

Top AI engines

By hits. Click one to filter the page explorer below.

How to read this: AI crawlers ranked by hit count, 2026-08-11 to 2026-08-18. Top engine ChatGPT user-fetch with 1,106 fetches, then Anthropic ClaudeBot (442).

Live Desk · August 18 edition

AI assistants pulled 104 pages of this site mid-answer in the window (1,208 live fetches in all). The most active was Agent Zero: OS-as-Tool, MCP Integration, Security, and Install Guide, fetched 183× by ChatGPT and Claude: live-answer agents, meaning it was read to compose a reply to a real question, not archived for training.

Pages AI is fetching

Search, filter by crawler intent or engine, and click any row to see which bots pull it. Showing the top 25 by default. 280 pages have AI activity.

AllLive-fetchAI searchAI training
PageAI hitsLive-fetchTop type
/agent-zero/193183AI live-fetch
/148119AI live-fetch
/searxng-self-hosted-guide/133116AI live-fetch
/dify-self-hosted-guide/10588AI live-fetch
/litellm-proxy-guide/8772AI live-fetch
/n8n-self-hosted-guide/6451AI live-fetch
/anythingllm-self-hosted-guide/6049AI live-fetch
/perplexica-self-hosted-guide/6040AI live-fetch
/kidsevents/4635AI live-fetch
/hometurf/guides/toronto-neighbourhood-statistics.html4241AI live-fetch
/hometurf/3330AI live-fetch
/open-webui-self-hosted-guide/3225AI live-fetch
/self-hosted-ai-stack/3221AI live-fetch
/ollama/2112AI live-fetch
/hometurf/guides/best-toronto-neighbourhoods-for-famil2115AI live-fetch
/crewai-setup-production-guide/209AI training
/librechat-self-hosted-guide/2010AI live-fetch
/fetch207AI training
/claude-code-specification-workflow-mcp/1913AI live-fetch
/kidsevents/free-museum-days/1710AI live-fetch
/vr-platform-comparison-aec/1711AI live-fetch
/hometurf/guides/toronto-neighbourhoods-for-families.h1615AI live-fetch
/kidsevents/neighbourhoods/157AI live-fetch
/qwen2-5-vl/144AI training
/ai-cost-maturity/133AI training

Blind spots

Indexed pages AI has not fetched in this window, your fix-list (orphan pages, weak internal links, stale content). 0 total.

Freshness: how fast AI picks up updates

PageUpdatedFirst AI fetchLag
No pages updated within the log window yet.

AI referrals: humans who clicked through

44 click-throughs from AI platforms. Copilot/Bing leads with 31. Last 7 days: 27 (22 Copilot/Bing, 3 Gemini, 2 Claude.ai). These are real visitors whose browser sent a Referer header from an AI platform: proof the citation converted to a visit. Country and ISP come from the real visitor IP (via Cloudflare).

DatePlatformPageLocationISP / Org
2026-08-17Claude.ai/dify-self-hosted-guide/ Kaohsiung, TaiwanChunghwa Telecom Co. Ltd.
2026-08-17Copilot/Bing/searxng-self-hosted-guide/🇨🇦 Burlington, CanadaCogeco Cable Inc.
2026-08-16Copilot/Bing/agent-zero/🇺🇸 San Francisco, United StatesAbacus.AI, Inc.
2026-08-16Copilot/Bing/kidsevents/🇨🇦 Toronto, CanadaRogers Communications Canada Inc
2026-08-16Copilot/Bing/kidsevents/🇨🇦 North York, CanadaRogers Communications Canada Inc
2026-08-16Copilot/Bing/kidsevents/free-museum-days/🇨🇦 Toronto, CanadaBeanfield Technologies Inc
2026-08-16Copilot/Bing/perplexica-self-hosted-guide/🇪🇸 Bilbao, SpainEuskaltel S.A.
2026-08-15Copilot/Bing/kidsevents/🇨🇦 Toronto, CanadaFibernetics Corporation
2026-08-15Copilot/Bing/dify-self-hosted-guide/🇺🇸 San Francisco, United StatesAbacus.AI, Inc.
2026-08-15Copilot/Bing/vision-dominates-half-your-brains-processing-powe Guangzhou, ChinaChina Mobile
2026-08-15Copilot/Bing/kidsevents/🇨🇦 Waterloo, CanadaOxio
2026-08-14Copilot/Bing/kidsevents/🇨🇦 Montreal, CanadaVideotron
2026-08-14Copilot/Bing/vision-dominates-half-your-brains-processing-powe🇮🇹 Milano, ItalyIliad Italia S.p.A
2026-08-14Gemini/claude-seo🇬🇧 Hayes, United KingdomCommunity Fibre Limited
2026-08-14Gemini/claude-seo/🇬🇧 Hayes, United KingdomCommunity Fibre Limited
2026-08-13Copilot/Bing/kidsevents/🇨🇦 Toronto, CanadaSympatico HSE
2026-08-13Copilot/Bing/anythingllm-self-hosted-guide/🇦🇺 Maroubra, AustraliaCloudflare WARP
2026-08-13Copilot/Bing/anythingllm-self-hosted-guide/🇨🇦 Brampton, CanadaSympatico HSE
2026-08-13Copilot/Bing/perplexica-self-hosted-guide/🇳🇱 Hoofddorp, The NetherlandsVodafone Ziggo
2026-08-12Copilot/Bing/dify-self-hosted-guide/🇺🇸 San Francisco, United StatesAbacus.AI, Inc.
2026-08-12Copilot/Bing/kidsevents/🇨🇦 Ottawa, CanadaShared Services Canada
2026-08-12Copilot/Bing/kidsevents/🇨🇦 Toronto, CanadaRogers Communications Canada Inc
2026-08-12Gemini/agent-zero/🇬🇧 Camberwell, United KingdomHyperoptic Ltd
2026-08-12Copilot/Bing/kidsevents/🇨🇦 Montreal, CanadaNETPR-YUL-DP
2026-08-11Claude.ai/searxng-self-hosted-guide/🇮🇳 Kochi, IndiaBharti Airtel Limited
2026-08-11Copilot/Bing/librechat-self-hosted-guide/🇺🇸 San Francisco, United StatesAbacus.AI, Inc.
2026-08-11Copilot/Bing/d-lusion-rubberduck/🇬🇧 Stirling, United KingdomBT UK
2026-08-10Copilot/Bing/anythingllm-self-hosted-guide/🇦🇺 Sydney, AustraliaAustralian Academic and Research Network
2026-08-09Perplexity/perplexica-self-hosted-guide/🇪🇸 Gijón, SpainDigi Spain Telecom S.A
2026-08-09Gemini/perplexica-self-hosted-guide/🇵🇱 Poznan, PolandPTK CENTERTEL DSL data services
2026-08-08Copilot/Bing/searxng-self-hosted-guide/🇵🇹 Amora, PortugalNOS Comunicacoes S.A.
2026-08-08Copilot/Bing/searxng-self-hosted-guide/🇺🇸 Louisa, United StatesCentral Virginia Services, INC
2026-08-08Claude.ai/perplexica-self-hosted-guide/🇩🇪 Ubstadt-Weiher, GermanyVodafone BW GmbH
2026-08-08Gemini/perplexica-self-hosted-guide/🇵🇱 Poznan, PolandPTK CENTERTEL DSL data services
2026-08-07Claude.ai/d-lusion-rubberduck/🇺🇸 Portland, United StatesCloudflare, Inc.
2026-08-07Copilot/Bing/dify-self-hosted-guide/🇺🇸 Santa Clara, United StatesWinnie Gaming
2026-08-06Copilot/Bing/litellm-proxy-guide/🇮🇳 Chennai, IndiaZscaler Softech India Private Limited
2026-08-06Copilot/Bing/kidsevents/🇨🇦 Vaughan, CanadaGolf Town Canada Inc
2026-08-06Perplexity/agent-zero/🇳🇱 Amsterdam, The NetherlandsPacketHub S.A
2026-08-06Copilot/Bing/kidsevents/🇨🇦 Etobicoke, CanadaRogers Cable Inc. NBFB
2026-08-04Claude.ai/librechat-self-hosted-guide/🇺🇸 Ashburn, United StatesTELUS Communications Inc.
2026-08-04Copilot/Bing/perplexica-self-hosted-guide/🇺🇸 San Francisco, United StatesAbacus.AI, Inc.
2026-08-04ChatGPT/searxng-self-hosted-guide/🇩🇪 Stuttgart, GermanyARCOR-IP
2026-08-04Copilot/Bing/kidsevents/🇨🇦 Toronto, CanadaRogers Cable Inc. MTMC

Who is crawling

Search engines

Classic index crawlers, by hits.

Bingbot1,161
Googlebot232
Yandex215
Petal (Huawei)175
Applebot80
DuckDuckGo12
Seznam11

Are they who they claim?

Crawler traffic checked against each operator's published IP ranges and reverse-DNS.

Full crawler tables (raw numbers)

AI crawlers

CrawlerTypeHitsVerifiedLast
ChatGPT user-fetchAI live-fetch1,106940/11062026-08-18
Anthropic ClaudeBotAI training4420/4422026-08-18
Meta AIAI training335pending2026-08-18
ByteDance BytespiderAI training223pending2026-08-18
AmazonbotAI training185pending2026-08-18
PerplexityAI search158131/1582026-08-18
ChatGPT searchAI search11391/1132026-08-18
Claude user-fetchAI live-fetch1020/1022026-08-18
OpenAI GPTBotAI training7131/712026-08-17
Claude searchAI search620/622026-08-13
Google-ExtendedAI training390/392026-08-17
Common CrawlAI training30pending2026-08-14
You.comAI training22pending2026-08-17

Search engines

CrawlerTypeHitsVerifiedLast
BingbotSearch index1,1611153/11612026-08-18
GooglebotSearch index232199/2322026-08-18
YandexSearch index215210/2152026-08-18
Petal (Huawei)Search index175pending2026-08-18
ApplebotSearch index8076/802026-08-18
DuckDuckGoSearch index120/122026-08-18
SeznamSearch index11pending2026-08-17

Under attack: what scanners hunt for

29,854 requests probing for exposed files, admin panels, and known exploits, every one a 404 here. 780 forged a real crawler's user-agent to blend in.

Bot traffic reality

Every bot request in the window. Hostile scanning dwarfs the legitimate crawlers.

Of 34,628 bot requests: 29,854 scanner probes (86%), 2,888 AI, 1,886 search.

What they hunt for

Probes grouped by target. Mostly WordPress, on a site that runs none.

By target: 2,777 secrets & config, 5,584 wordpress, 419 other, 20,678 git exposure, 396 admin / rce.

Top probed paths

The most-hammered URLs. None of them exist here.

/wp-login.php187
/wp-content/plugins/hellopress/wp_filemanager.php112
/.git/config89
/.git/HEAD72
/wp-content/uploads/64
/.env64
/wp-json/wp/v2/users55
/wp-content/admin.php52
/wp-blog.php46
/wp-admin/46
/wp-json/gravitysmtp/v1/tests/mock-data46
/wp-content/index.php43
Full probed-path table
Probed pathHits
/wp-login.php187
/wp-content/plugins/hellopress/wp_filemanager.php112
/.git/config89
/.git/HEAD72
/wp-content/uploads/64
/.env64
/wp-json/wp/v2/users55
/wp-content/admin.php52
/wp-blog.php46
/wp-admin/46

Verified counts cover traffic since real-IP logging was enabled, filling in daily. Log retention is ~2 weeks, so "blind spots" means "not fetched recently." The playbook: GEO Field Manual, and the answers it produces: GEO answers.