News for hackers. Stuff that matters.
Re:Llms.txt by haswell on Tuesday September 03, 2024 @11:39PM (#41441681)
That’s really my primary issue. Google indexing my content and directing traffic to my site is one thing.

But unlike search indexing, there is no exchange of value when these LLMs are trained on my content. We all collectively get nothing for our work. It’s theft dressed up as business as usual. I’ll do whatever I reasonably can to avoid feeding the machine and hope some of the ongoing and inevitable legal fights will rein things in a bit.

Re:Llms.txt by krmboya on Wednesday September 04, 2024 @01:00AM (#41442065)
At least with the open source models we do get something back..
Re:Llms.txt by haswell on Wednesday September 04, 2024 @10:14AM (#41446099)
That’s debatable. The end result is still potentially making your own content obsolete/unnecessary and these “open weight” models are still trained without the permission of creators (there are no true open source models at this point).

The people receiving the most value from these models are almost universally not the original content creators. The fact that I can use the model for my own purposes is potentially nice? But I’m not really interested in that and this doesn’t represent what I’d consider a reasonable exchange for using my work. It still drives people away from the source material.

Re:Llms.txt by jph00 on Wednesday September 04, 2024 @02:58AM (#41442646)
This proposal isn’t really for training. It’s for end users who want to know what information to include when they’re using models.
Re:Llms.txt by haswell on Wednesday September 04, 2024 @10:20AM (#41446170)
I get that. My point is that I’m uninterested in making it easier for LLM products to interact with my sites.

I realize there may be products that may benefit from this. I was just agreeing with the sentiment that I want no part in it.

Re:Llms.txt by 0x1064 on Wednesday September 04, 2024 @09:43AM (#41445795)
This is only true when a site's information is its only utility, such as for blogs. This is untrue when the information relates to a tool that would be consumed outside of the use of the model.
Re:Llms.txt by haswell on Wednesday September 04, 2024 @10:17AM (#41446130)
I was primarily agreeing with the sentiment that making it easier for companies to consume my work is a hard sell.

I realize not all sites fall into this category.