Cloudflare Helps End the Search-or-AI-Training Tradeoff
Cloudflare launched a Disallow AI Training setting and a new Accountable designation for AI crawling, letting websites refuse AI training while remaining fully listed in search results. Mixed-use crawlers that collect content for both search indexes and AI training now account for 36.6% of verified crawler traffic on Cloudflare's network -- the single largest category -- while 17% of site owners restrict AI training and fewer than 1% block search crawlers.
Key figures
- Accountable criteria count
- 4
- Sites restricting ai training
- 17%
- Sites blocking search crawlers
- <1%
- Mixed use crawler traffic share
- 36.6%
AI analysis
The rest of the AI analysis, red flags and sentiment are part of Signal8 Pro.
AI-generated analysis of a public disclosure. Not investment advice; verify against the original document.