OpenAI’s automated web crawlers appear to have accelerated sharply after the launch of GPT-5 in August 2025, even as a separate measure suggests direct ChatGPT usage may be slipping. A new analysis by Chris Long, co-founder of Nectiv, working with Botify and based on more than 7 billion server log events, found that OpenAI’s crawl of the web has roughly tripled since the model was released. The study, published on 23 April 2026, covers log data from November 2024 through March 2026 and is one of the clearest looks yet at how OpenAI’s three crawlers behave across the open web.

The research separates ChatGPT-User, GPTBot and OAI-SearchBot, each of which serves a different role. OAI-SearchBot handles web retrieval for ChatGPT search-style responses, GPTBot is used for general model training, and ChatGPT-User is triggered when a person asks ChatGPT to fetch a page or interact with it directly. According to Botify’s analysis, the biggest change after GPT-5 was in OAI-SearchBot, which rose 3.5 times overall and by 2.2 billion events within the company’s dataset. GPTBot also climbed, by 2.9 times, or 1.8 billion events. No industry in Botify’s sample showed negative growth from OAI-SearchBot, with the steepest gains in healthcare and media and publishing.

The ratio between OpenAI’s search crawling and training crawling has also shifted. Before GPT-5, the balance slightly favoured training; afterwards, search overtook it, suggesting that OpenAI is leaning more heavily on live web retrieval than on static collection. That shift echoes comments circulating in the SEO world around GPT-5’s release, including the view that future AI systems would rely more on the web as a current knowledge source. The Botify study does not prove that theory, but it does show a clear change in crawling behaviour after August 2025.

At the same time, ChatGPT-User events fell 28% between 1 December 2025 and 14 March 2026 compared with the previous equivalent period. The researchers say that could reflect lower direct usage of ChatGPT, pointing to SimilarWeb data showing a fall in ChatGPT’s share of AI-platform traffic from 86.7% in January 2025 to 64.5% in January 2026, alongside Sistrix data suggesting usage flattened and then eased late last year. But they also argue the decline may be partly structural: if OpenAI is building a fresher web index through OAI-SearchBot, fewer page fetches may be needed when users ask ChatGPT to interact with a site. That interpretation is not exclusive of declining demand, and the log data alone cannot fully separate the two.

Even after the post-GPT-5 surge, OpenAI still trails far behind Google in crawl volume. In the final month covered by the study, Googlebot generated 18.2 billion events across desktop and smartphone, compared with 887 million for OpenAI’s combined crawlers. That means OpenAI accounted for about 4% of Google’s crawl volume, up from 1.38% in the comparable 30-day window a year earlier. The broader context matters for publishers and marketers: media and publishing sites are being searched especially aggressively, while healthcare and retail sites are more likely to be hit by GPTBot. The findings also sit against the backdrop of GPT-5’s rocky consumer launch in August 2025, when users complained about broken workflows and model removals, prompting OpenAI to restore older models, even as the company won broader adoption in enterprise tools and coding platforms.

Source Reference Map

Inspired by headline at: [1]

Sources by paragraph:

Source: Noah Wire Services