Pangram verdict · v3.3
We believe that this text is a mix of AI and human-written content.
AI likelihood · overall
MixedArticle text · 799 words · 3 segments analyzed
Live data · Updated 8 Oct 2026AI Crawler IndexWhich AI bots crawl a real website, and how oftenAI crawlers made 24% of our bot traffic in the last 30 days. We log every crawler that visits mojodojo.io and sort it into AI training bots, AI search bots, assistants reading a page for a user, and search engines like Google and Bing. Each visit is checked against the IP addresses the bot's owner publishes, so anything pretending to be Googlebot or GPTBot is left out.
We started checking IPs on 7 Oct 2026, so earlier visits are sorted by the name the bot gives itself.7 days30 days90 daysAI crawlers24.2%14,037 of 58,057 counted bot hits.Search engines25.9%AI bots made 0.93 hits for every search engine hit.Live AI fetches1,034Pages an assistant like ChatGPT read on the spot because someone asked it a question.Fake bots11.5%Of hits claiming to be a bot we can verify, the share that came from the wrong IP.TrendCrawler hits per day, fakes removed9 Sept 2026: 1,692 hits10 Sept 2026: 2,687 hits11 Sept 2026: 1,961 hits12 Sept 2026: 1,865 hits13 Sept 2026: 1,799 hits14 Sept 2026: 1,478 hits15 Sept 2026: 2,404 hits16 Sept 2026: 1,593 hits17 Sept 2026: 1,290 hits18 Sept 2026: 1,638 hits19 Sept 2026: 2,168 hits20 Sept 2026: 1,695 hits21 Sept 2026: 1,378 hits22 Sept 2026: 1,021 hits23 Sept 2026: 2,137 hits24 Sept 2026: 1,293 hits25 Sept 2026: 1,603 hits26 Sept 2026: 1,594 hits27 Sept 2026: 1,334 hits28 Sept 2026: 1,417 hits29 Sept 2026: 1,415 hits30 Sept 2026: 1,504 hits1 Oct 2026: 2,395 hits2 Oct 2026: 2,128 hits3 Oct 2026: 1,452 hits4 Oct 2026: 2,156 hits5 Oct 2026: 1,830 hits6 Oct 2026: 1,717 hits7 Oct 2026: 2,689 hits8 Oct 2026: 6,724 hits9 Sept 2026Peak day: 6,724 hits8 Oct 2026AI trainingAI searchAI user fetchSearch enginesSEO toolsSocial previewsArchiveOther botsSplitWho is crawlingCategoryHitsShareAI training9,88217.0%AI search3,1215.4%AI user fetch1,0341.8%Search engines15,04225.9%SEO tools13,49723.2%Social previews12,71721.9%Archive5380.9%Other bots2,2263.8%Spoofed hits are excluded from every share on this page. 535 were removed in this period.LeaderboardEvery bot, rankedBotTypeHitsPer dayPagesHits / pageVerifiedFakes blockedFacebookBotMetaSocial previews10,35034517559.1——AhrefsBotAhrefsSEO tools8,5192843,0182.8100%—BingbotMicrosoftSearch engines5,8601952,6402.2100%—GooglebotGoogleSearch engines4,9931661,3173.897%7ClaudeBotAnthropicAI training3,4791161,6382.183%37AmazonbotAmazonAI training2,969991,1532.683%37PerplexityBotPerplexityAI search2,378791,0762.284%58LinkedInBotLinkedInSocial previews2,231748925.1——OtherOther bots2,226747253.1——SemrushBotSemrushSEO tools2,154721,3061.697%4Meta-ExternalAgentMetaAI training1,981661,4961.3——DotBotMozSEO tools1,597531,4111.1——ApplebotAppleSearch engines1,546527152.273%38GPTBotOpenAIAI training1,376461,1631.26%46MJ12botMajesticSEO tools1,214417001.7——ChatGPT-UserOpenAIAI user fetch934312743.448%39PetalBotHuaweiSearch engines887307051.3100%—SogouSogouSearch engines874291765.0——OAI-SearchBotOpenAIAI search722244171.757%40YandexBotYandexSearch engines576192342.5100%—Internet ArchiveInternet ArchiveArchive538183441.6——DuckDuckBotDuckDuckGoSearch engines1977238.6100%—BaiduspiderBaiduSearch engines1094631.72%49TwitterbotXSocial previews1033691.5——DuckAssistBotDuckDuckGoAI user fetch502411.2——cohere-aiCohereAI training452351.3——BytespiderByteDanceAI training321291.1——Perplexity-UserPerplexityAI user fetch301261.20%37PinterestbotPinterestSocial previews221211.0——Claude-SearchBotAnthropicAI search211191.10%50Claude-UserAnthropicAI user fetch201171.213%49Screaming FrogScreaming FrogSEO tools13043.3——SlackbotSlackSocial previews7023.5——DiscordbotDiscordSocial previews3013.0——TelegramBotTelegramSocial previews1011.0——CCBotCommon CrawlAI training0000.00%44Bot awardsThe standouts of the last 30 daysMost aggressiveFacebookBot345 hits a day · Meta · Social previewsAIClaudeBot · 116 hits a dayMost hits per dayMost politeDotBot1.1 hits per page · Moz · SEO toolsAIGPTBot · 1.2 hits per pageFewest hits per page: visits once and moves onMost obsessiveFacebookBot59.1 hits per page · Meta · Social previewsAIChatGPT-User · 3.4 hits per pageMost hits per page: keeps fetching the same fewMost thoroughAhrefsBot3,018 pages · Ahrefs · SEO toolsAIClaudeBot · 1,638 pagesMost different pages visitedRarest visitorBytespider2 days, 32 hits · ByteDance · AI trainingFewest days seen (at least 10 hits)Most impersonatedPerplexityBot58 fake hits · Perplexity · AI searchMost fake hits caught by the IP checkA bot needs at least 100 hits in the period to win (10 for rarest visitor). Where an AI bot would win its own category, it is listed underneath.MethodologyHow the numbers are madeSource. Every page request to mojodojo.io whose user agent looks like a crawler, logged at the web server with the visitor's IP.
One site, so read the numbers as a case study rather than a census. Tracking since 6 June 2026. IPs were recorded from 7 Oct 2026; hits before that are classified by user agent only and counted as unverified.Categories. AI training bots collect pages for model training (GPTBot, ClaudeBot, CCBot). AI search bots build the index behind AI answers (OAI-SearchBot, Claude-SearchBot, PerplexityBot). AI user fetches are live reads on behalf of a person (ChatGPT-User, Claude-User, Perplexity-User).Verification. A hit counts as verified when its IP sits inside the ranges the operator publishes (OpenAI, Anthropic, Perplexity, Google, Bing, Apple, Common Crawl, DuckDuckGo, Ahrefs), or passes forward-confirmed reverse DNS. Ranges refresh daily. A hit that fails the check is marked spoofed and left out. Bots whose operator publishes no method are counted as unverifiable.Cite this. Mojo Dojo, “AI Crawler Index”, mojodojo.io/ai-crawler-index, accessed 8 Oct 2026. Free to reuse under CC BY 4.0 with a link back.BotTypeCheckChatGPT-UserAI user fetchPublished IP rangesClaude-UserAI user fetchPublished IP rangesPerplexity-UserAI user fetchPublished IP rangesMistralAI-UserAI user fetchNot verifiableDuckAssistBotAI user fetchNot verifiableMeta-ExternalFetcherAI user fetchNot verifiableOAI-SearchBotAI searchPublished IP rangesClaude-SearchBotAI searchPublished IP rangesPerplexityBotAI searchPublished IP rangesGPTBotAI trainingPublished IP rangesClaudeBotAI trainingPublished IP rangesCCBotAI trainingPublished IP rangesMeta-ExternalAgentAI trainingNot verifiableBytespiderAI trainingNot verifiableAmazonbotAI trainingReverse DNScohere-aiAI trainingNot verifiableDiffbotAI trainingNot verifiableGooglebotSearch enginesIP ranges + reverse DNSGoogleOtherSearch enginesIP ranges + reverse DNSBingbotSearch enginesIP ranges + reverse DNSDuckDuckBotSearch enginesPublished IP rangesApplebotSearch enginesIP ranges + reverse DNSYandexBotSearch enginesReverse DNSBaiduspiderSearch enginesReverse DNSPetalBotSearch enginesReverse DNSSogouSearch enginesNot verifiableAhrefsBotSEO toolsPublished IP rangesSemrushBotSEO toolsReverse DNSMJ12botSEO toolsNot verifiableDotBotSEO toolsNot verifiableScreaming FrogSEO toolsNot verifiableFacebookBotSocial previewsNot verifiableTwitterbotSocial previewsNot verifiableLinkedInBotSocial previewsNot verifiablePinterestbotSocial previewsReverse DNSSlackbotSocial previewsNot verifiableDiscordbotSocial previewsNot verifiableTelegramBotSocial previewsNot verifiableWhatsAppSocial previewsNot verifiableInternet ArchiveArchiveNot verifiable