OpenAI will honor a shared robots.txt signal to help website operators communicate their AI training preferences to participating providers.
OpenAI Blog
OpenAI will honor a shared robots.txt signal to help website operators communicate their AI training preferences to participating providers.