News for hackers. Stuff that matters.
Re:LLM Inevitabilism by mbgerring on Tuesday July 15, 2025 @02:00AM (#44568258)
Also I’m going to go ahead and say that “it’s slightly better than classical NLP for grammar check but requires 10,000x as much compute resources” is not an improvement
Re:LLM Inevitabilism by bee_rider on Tuesday July 15, 2025 @01:05PM (#44573401)
The models are already trained… is inference so costly? It’s just a dot product or a matvec or something, right?