Cloudflare restricts AI crawlers as AI reshapes web, journalism and SEO

Cloudflare announced a new default policy that will limit “mixed‑use” crawlers – bots that both index pages for search engines and harvest data for training AI models. Starting 15 September 2026, the settings will apply to new customers, existing sites and free accounts unless administrators opt out. The move aims to give website owners more control over how their content is used and to push AI developers to separate search‑engine bots from those that feed generative‑AI services, a step that directly targets practices attributed to large search providers.

At the same time, major search engines are overhauling how results are delivered. Google has expanded its AI Overviews feature to over a billion users, enabling natural‑language queries and synthesized answers that go beyond traditional keyword lists. These advances are prompting publishers to adapt SEO tactics, emphasizing content quality, site speed, user experience and authoritative backlinks to maintain visibility in an AI‑driven ranking environment.

The broader impact of AI on media is also being highlighted at SIPConnect 2026, a journalism conference in Miami that will explore AI‑powered content creation, audience engagement, new business models and ethical challenges. Speakers from leading news organisations will discuss how AI can both enhance reporting and raise concerns about data ownership and editorial independence.

Opinion‑driven pieces across the region – from a podcast on AI and personal freedom, to a Mexican cultural analysis of AI in cinema, and an Argentine essay on delegating decision‑making to machines – underscore the societal debate about the balance between efficiency and human accountability as AI becomes embedded in everyday digital tools.