Cloudflare Launches AI Redirects for Canonical Content
Cloudflare is introducing a new AI training feature that allows website owners to redirect verified web crawlers to canonical pages, preventing AI models from being trained on outdated or duplicate content.
Vad har hänt
Cloudflare has launched 'Redirects for AI Training', a feature that gives website owners the ability to control which versions of content are used for AI model training. With a simple toggle, verified crawlers can be redirected from outdated or duplicate content to the canonical, authoritative page. This reduces the risk of AI models training on incorrect or suboptimal data without requiring changes to origin servers.
Key facts
| Funktionens namn | Redirects for AI Training |
|---|---|
| Lanseringsdatum | Okänt (nyligen enligt källan) |
| Leverantör | Cloudflare |
”Soft directives don’t stop crawlers from ingesting deprecated content. Redirects for AI Training allows anybody on Cloudflare to redirect verified crawlers to canonical pages with one toggle and no origin changes.”
Varför det spelar roll
The problem of AI models training on non-canonical content, such as duplicate or outdated pages, can lead to poorer performance and inaccurate model results. Previous 'soft' directives, such as robots.txt, do not always stop crawlers from indexing such content. This new feature ensures that only the most relevant and accurate content is fed to AI models, improving their quality and reliability.
Vem påverkas
This feature primarily affects website owners and content creators using Cloudflare, as well as AI developers and companies training large language models and other AI systems. End users of AI applications also benefit indirectly through improved data quality and more accurate AI responses.
EU-status
Ej relevant för EU-status.
Mer att veta
Cloudflare emphasises that the feature is designed to be simple to implement and requires no changes to the web server, lowering the barrier for improving data sources for AI training.
Quick answers about this story
Vad har hänt?
När hände det?
Varför spelar det roll?
Påverkar det EU?
Länken öppnar i nytt fönster och leder till utgivarens egen sida.
Källan har spårats automatiskt från utgivaren via Aheadlines signalkedja.