logo.png

Cloudflare Blocks AI Crawlers by Default -- How to Fix It

Tuesday, March 10, 2026

Primary Blog/Cloudflare Blocks AI Crawlers by Default -- How to Fix It

Search engine optimization took years to figure out. Most of us are still figuring it out.

And now there's a new layer.. Answer Engine Optimization. Getting your content surfaced when someone asks ChatGPT, Perplexity, or Claude a question in your category.

The whole thing depends on one simple condition: the AI crawler has to have been allowed to read your content in the first place.

Here's the problem nobody's talking about yet..

Cloudflare quietly changed their domain setup wizard. AI crawler blocking is now the DEFAULT option. Pre-selected. You click Continue without reading it and you're blocked.

Most business owners and agency owners set this up months ago and have no idea.

Load up your domain in the main Cloudflare dashboard and on the right side you'll see - Control AI crawlers.

See what "Block AI training bots" is set to

If it says "Block on all pages".. change it to "Do not block" if you want AI to use your content for answers people ask IN AI.

Funnel Pulse monitors your AEO crawlability as one of its 12 health signals. Whether GPTBot, ClaudeBot, and Perplexity can actually access and index your funnel.

It checks your robots.txt directives, your llms.txt presence, your AI bot access status.. and flags anything that's blocking AI discovery.

It won't change a Cloudflare setting for you. But it will tell you the setting is wrong.

If you want to know what your funnel looks like to an AI crawler right now.. that's the place to start.

🚀

​- James

customer1 png

Hi, I Am Jane Doe

CEO Of Best Blog Ever

Lorem ipsum dolor sit amet, consectetur adipisicing elit. Autem dolore, alias,numquam enim ab voluptate id quam harum ducimus cupiditate similique quisquam et deserunt,recusandae.

1 png

Get Our Best Selling Product!

You just read about this...

Super excited about this product? We are, too! We just wrote this whole blog post that mentions it.

Ready to buy it? Get access to the Product here: