News for hackers. Stuff that matters.
Re:Daniel Kahneman has died by cornel_io on Thursday March 28, 2024 @02:04AM (#39848192)
Most human authors are frankly far too stupid to be worth reading, even if they do put care into their work.

This, IMO, is the actual biggest problem with LLMs training on whatever the biggest text corpus us that's available: they don't account for the fact that not all text is equally worthy of next-token-predicting. This problem is completely solvable, almost trivially so, but I haven't seen anyone publicly describe a (scaled, in production) solution yet.

Re:Daniel Kahneman has died by Ma8ee on Thursday March 28, 2024 @02:22AM (#39848260)
It hardly matters what sources you are using if you filter it through something that has less understanding than a two year old, if any, no matter how eloquent it can express itself.
Re:Daniel Kahneman has died by mistermann on Thursday March 28, 2024 @10:54AM (#39852360)
> This problem is completely solvable, almost trivially so, but I haven't seen anyone publicly describe a (scaled, in production) solution yet.

Can you explain your solution?

Re:Daniel Kahneman has died by pcthrowaway on Friday March 29, 2024 @08:13AM (#39863089)
I imagine it looks something like "Censor all writing that contradicts my worldview"