AI crawler behavior observed on production mirror sites
Insights
11,044
Total LLM Bot Requests
4,021
Citation Events
59
Days of Data
5
Log Entries
The Crawler Logs document real AI crawler behavior on production AI sites built by ROZZ. Using CloudFront access logs and User-Agent classification, we track how GPTBot, BingBot, ClaudeBot, ChatGPT-User, PerplexityBot, and other LLM bots discover, crawl, and cite GEO-optimized content. Across 59 days of observation on rozz.genymotion.com, we recorded 11,044 total LLM bot requests and 4,021 citation events—real users receiving Genymotion content in AI conversations.
We tested 24 queries across four AI platforms. ChatGPT cites Genymotion 83% of the time. Claude, 21%. Perplexity, 17%. Gemini, 4%. The first three track with crawl volume. Gemini doesn’t crawl the AI site at all.
rozz.genymotion.com · Feb 24 – Mar 3, 2026 · 24 queries × 4 platforms
ChatGPT: 83% citation rate, up from 14% before the AI site launched
ClaudeBot jumped 24x (21 to 505 requests)—reads topic taxonomy, not individual pages
Gemini recommends Genymotion in most queries but doesn’t link—different pipeline entirely
BingBot made 1,556 requests this week—more than any other bot, including ChatGPT-User. What started as a ChatGPT story is now happening across six platforms.
rozz.genymotion.com · Feb 17–24, 2026 · 3,188 total requests
BingBot: 1,556 requests—largest single bot category, surpassing ChatGPT-User
ChatGPT-User citations: 1,329, up from 1,077 the prior week (+23%)
Six platforms now crawling: OpenAI, Microsoft, Anthropic, Meta, ByteDance, Perplexity
ChatGPT citations grew from 7 to 116 in one week. 345 citation events, 161 unique sessions, and 75% of requests hitting Q&A pages—not traditional content.
rozz.genymotion.com · Feb 2–9, 2026 · 2,195 total requests
16x daily citation growth: from 7 on Feb 2 to 116 on Feb 9
75% of ChatGPT requests landed on Q&A pages, not traditional content
Q&A pages cited 10x more than traditional GEO content pages
GPTBot made 547 requests in a single day—47% of all training bot activity in 30 days. Three weeks later, ChatGPT users were receiving content in their conversations.
rozz.genymotion.com · Jan 3–Feb 2, 2026 · 1,280 total requests
GPTBot made 547 requests on January 7—47% of 30-day training activity in one day
42 citation events recorded; concentrated on high-intent pages (requirements, compatibility)
~3 weeks from major crawl to first ChatGPT citations
Methodology
Data source: CloudFront access logs for rozz.genymotion.com. Bot classification based on User-Agent strings. Training bots (GPTBot, ClaudeBot) are distinguished from search index bots (OAI-SearchBot) and citation events (ChatGPT-User). Citation events represent real user conversations where ChatGPT retrieved and cited mirror site content. All data is from a single production mirror site; results may vary by domain, content volume, and vertical.
Get Your Own Crawler Logs
ROZZ builds mirror sites with full CloudFront logging. See exactly which AI bots crawl your content, when they crawl it, and when citations begin.