Re:AI companies cause most of traffic on forums
by equestria on Monday December 30, 2024 @12:09PM
(#42551196)
I exclude all the published LLM User-Agents and have a content honeypot on my website. Google obeys, but ChatGPT and Bing still clearly know the content of the honeypot.
[ Parent
| on HN ]
Re:AI companies cause most of traffic on forums
by Ukv on Monday December 30, 2024 @12:21PM
(#42551318)
Interesting - do you have a link?
Re:AI companies cause most of traffic on forums
by equestria on Monday December 30, 2024 @12:54PM
(#42551698)
Of course, but I'd rather not share it for obvious reasons. It is a nonsensical biography of a non-existing person.
Re:AI companies cause most of traffic on forums
by jonnycomputer on Monday December 30, 2024 @12:22PM
(#42551321)
how do you determine that they know the content of the honeypot?
Re:AI companies cause most of traffic on forums
by arrowsmith on Monday December 30, 2024 @12:43PM
(#42551553)
Presumably the "honeypot" is an obscured link that humans won't click (e.g. tiny white text on a white background in a forgotten corner of the page) but scrapers will. Then you can determine whether a given IP visited the link.
Re:AI companies cause most of traffic on forums
by jonnycomputer on Monday December 30, 2024 @12:57PM
(#42551733)
I know what a honeypot is, but the question is how the know the scraped data was actually used to train llms. I wondered whether they discovered or verified that by getting the llm to regurgitate content from the honeypot.