Screaming Frog SEO Spider Version 24.0 "Bolus" Released: A Paradigm Shift with Native AI Integration and Advanced Automation

Main Facts

Screaming Frog, a titan in the technical search engine optimization (SEO) tool space, has officially announced the launch of Screaming Frog SEO Spider version 24.0, internally codenamed “bolus.” This major update represents one of the most substantial leaps forward in the software’s history, bridging the gap between desktop technical crawling and modern generative artificial intelligence workflows.

At the center of version 24.0 is the introduction of the Screaming Frog SEO Spider MCP (Model Context Protocol), a development that allows users to operate crawls, analyze data, run pipelines, and export metrics directly through natural language prompts inside major AI assistants like Claude, LM Studio, and other compatible chat interfaces.

Screaming Frog SEO Spider Update – Version 24.0

Beyond AI connectivity, version 24.0 addresses long-standing user requests by introducing Auto Compare Crawls for scheduled tasks, enhanced email notifications featuring granular issue comparisons, automated export attachments delivered directly to stakeholders, and a dedicated diagnostic filter for Uncrawlable Internal Outlinks. The release cycle has also been swiftly followed by iterative patches—versions 24.1, 24.2, and 24.3—rolling out throughout June 2026 to ensure software stability and refined performance.


Chronology of the Release

The rollout of the "bolus" generation marks a rapid and aggressive deployment schedule by the Screaming Frog engineering team:

Screaming Frog SEO Spider Update – Version 24.0
  • May 2026: Screaming Frog officially drops version 24.0, introducing the MCP server architecture, automated crawl comparisons, and enhanced reporting features.
  • June 8, 2026: Version 24.1 is pushed live, focusing primarily on under-the-hood bug fixes and minor quality-of-life adjustments.
  • June 22, 2026: Version 24.2 follows closely behind, bringing further stability patches and refined parsing rules.
  • June 29, 2026: Version 24.3 is released, cementing the version 24 branch with final minor optimizations and code hardening.

Supporting Data and Deep Dive into New Features

Version 24.0 is packed with powerful additions designed to strip away manual friction from day-to-day technical SEO audits. Here is a detailed breakdown of the core updates:

1. Screaming Frog SEO Spider MCP

The crown jewel of version 24.0 is the MCP integration. Built to work alongside Node.js, the MCP server connects the SEO Spider directly to LLM chat assistants. Users can now type natural language queries—ranging from simple commands like "Run a crawl of example.com and summarize the critical issues" to highly complex data manipulations.

Screaming Frog SEO Spider Update – Version 24.0
  • Visualizations and Pipelines: The AI can orchestrate data pipelines, install scripts for interactive data visualization, and generate advanced assets like internal link equity flow diagrams using native integrations (such as Ahrefs data).
  • Limitations: Screaming Frog notes that while powerful, not every feature of the SEO Spider is natively mapped to the MCP yet. User feedback will dictate future capability expansions.

2. Auto Compare Crawls for Scheduled and CLI Tasks

Previously, comparing historical crawl data required manual selection and post-crawl execution steps. Version 24.0 introduces an "Auto Compare Crawls" toggle specifically designed for scheduled and Command Line Interface (CLI) tasks. When active, the software automatically pairs and contrasts the two most recent crawls within a project, highlighting shifts in architecture, new errors, and resolved issues right out of the box.

3. Actionable Email Notifications and Crawl Changes

Website monitoring just became more passive and efficient. Crawl completion emails no longer feature just a static summary. They now contain:

Screaming Frog SEO Spider Update – Version 24.0
  • A comprehensive table of all issues discovered during the crawl.
  • A comparative breakdown highlighting changes if "Auto Compare Crawls" is enabled.
  • Immediate alerts for spikes in non-indexable pages, missing page titles, or sudden mass deletions of URLs—all without needing to open the desktop application.

4. Automated Crawl Export Attachments

To bridge the communication gap between technical SEOs, developers, and stakeholders, version 24.0 allows automated emails containing zipped export attachments upon crawl completion. Whether it is a weekly broken-links report destined for a developer’s inbox or a summary table for an executive stakeholder, the SEO Spider handles the delivery pipeline automatically.

5. Uncrawlable Internal Outlinks Filter

Search engine crawlers are notoriously unpredictable, but SEO best practices dictate clear hyperlink structures (e.g., standard <a> tags with valid href attributes). Version 24.0 introduces the "Pages With Uncrawlable Internal Outlinks" filter within the Links tab.

Screaming Frog SEO Spider Update – Version 24.0
  • By enabling the "Store" configuration under Config > Spider > Crawl, the tool flags links built inside non-standard HTML elements, such as:
    <span href="https://example.com">
    <div href="https://example.com">
    <a onclick="goto('https://example.com')">
    <a href="javascript:goTo('products')">
  • Industry Context: While Google’s advanced parsers often attempt to discover links hidden inside unconventional elements, they do not guarantee reliable link equity passage or consistent indexing behavior. This filter helps teams clean up code to meet rigorous technical standards.

6. Local Usage Statistics

For the curious data enthusiast, a new Help > Usage Stats menu tracks local application usage metrics, giving users a tangible look at how many hours they spend auditing websites and extracting value from the software annually.


Official Responses and Philosophy

Screaming Frog has maintained a pragmatic, user-first stance regarding the integration of artificial intelligence into their traditionally deterministic software.

Screaming Frog SEO Spider Update – Version 24.0

Addressing the introduction of the MCP server, the company issued a clarifying statement:

"This is not a replacement for an experienced SEO professional, obviously. There are plenty of use cases, but ultimately the idea of the integration is to make daily tasks and workflows that much more efficient."

Screaming Frog SEO Spider Update – Version 24.0

By explicitly framing AI as a force multiplier rather than a human substitute, Screaming Frog reassures its core base of enterprise SEO consultants and technical specialists that the tool remains anchored in hard data and accurate crawling mechanics. Furthermore, the company has heavily emphasized its reliance on community feedback, encouraging users to submit feature requests for subsequent patches and future major versions.


Implications for the SEO Industry

The release of Screaming Frog v24.0 "bolus" signals a broader maturation in how technical SEO toolsets adapt to the artificial intelligence boom. Rather than building proprietary, walled-garden AI copilots that charge exorbitant token fees, Screaming Frog has chosen an open architecture approach via the Model Context Protocol. This allows practitioners to leverage their preferred AI environments—whether cloud-based like Claude or local-first like LM Studio—tied directly to raw, unfiltered crawl data.

Screaming Frog SEO Spider Update – Version 24.0

Additionally, the focus on automated reporting, auto-comparisons, and uncrawlable link auditing pushes enterprise technical SEO further toward continuous monitoring. Agencies and in-house teams can now automate the tedious loop of crawling, comparing, and reporting, shifting human capital away from data gathering and squarely toward strategic implementation and site architecture remediation. As minor iterations like v24.1, v24.2, and v24.3 demonstrate, Screaming Frog is heavily invested in keeping this new automated ecosystem stable and rock-solid for daily professional use.

Back To Top