AI Crawlers Account For 28% Of Googlebot’s Traffic, Study Finds
A report released by Vercel highlights the growing impact of AI bots in web crawling. OpenAI’s GPTBot and Anthropic’s Claude generate nearly 1 billion requests monthly across Vercel’s network. The data indicates that GPTBot made 569 million requests in the past month, while Claude accounted for 370 million. Additionally, PerplexityBot contributed 24.4 million fetches, and … Read more
