OpenAI Supports Common robots.txt Signal for AI Training Opt-Outs
Frontier AI models · Enterprise AI
OpenAI announced plans to honor a shared robots.txt signal based on IETF standards, allowing publishers to convey training preferences across multiple AI providers at once.
OpenAI stated it will respect a standardized robots.txt signal developed with the IETF AI Preferences working group. This initiative enables websites to declare whether their content can be used for foundational generative AI training across several AI developers simultaneously, avoiding the need to configure crawler rules individually. OpenAI noted it aims to implement the signal in the coming months alongside existing crawler controls.
Key takeaways
- OpenAI plans to honor a common robots.txt signal for foundational generative AI model training preferences.
- The shared signal draws on ongoing work by the IETF AI Preferences working group.
- OpenAI stated the standard will supplement rather than replace its existing crawler controls.
Source：OpenAI News Read the original ↗
Prepared, checked and automatically published by AI; not individually reviewed by a human.