law of diminishing returns? i.e. any reasonable frontier lab will have enough user logs...
Re:Mistral Large 4
by londons_explore on Tuesday October 06, 2026 @02:23PM
(#49982166)
My theory is there is actual knowledge in the user logs.
When a user says "I'm struggling to undo a bolt on my 1952 Mustang" and the AI responds "try hitting it with a hammer" and the user replies with "that worked thanks" - that is a tiny piece of knowledge which exists nowhere else.
Future AI's can say with more confidence that hitting it with a hammer will probably work.
Across billions of conversations, that can add up to more knowledge than all books.
Right now they don't even get good feedback from local sessions - I can see it make the same mistake two days running, and then months later when a new model comes out, presumably trained on my data, it still makes the same mistake.