Tweet by Cloudflare

April 17, 2026

Soft directives don’t stop crawlers from ingesting deprecated content. Redirects for AI Training allows anybody on Cloudflare to redirect verified crawlers to canonical pages with one toggle and no origin changes. https://t.co/e3ByECc01v

Author
Cloudflare
Date
April 17, 2026