Re:Things are about to get a lot worse for Generative AI
by eropple on Saturday December 30, 2023 @10:21AM
(#38815898)
OpenAI also plays some ugly games with regards to the difference between training and search. Search requests come from the `ChatGPT-User` user-agent, and I'd like to allow those; training and scraping requests come from `GPTBot`, and I have no interest in those. But as per their own documentation, putting one in robots.txt disables the other.
[ Parent
| on HN ]