News for hackers. Stuff that matters.

A comment on The Bitter Lesson of LLM Extensions.

Re:The Bitter Lesson of LLM Extensions by Der_Einzige on Monday November 24, 2025 @06:06PM (#46040464)
Zero discussion around LLM sampling. How do you leave such a gaping hole in such a written piece? I know it's not AI cus AI wouldn't be that sloppy.
[ Parent | on HN ]
Re:The Bitter Lesson of LLM Extensions by ttkciar on Monday November 24, 2025 @08:47PM (#46041504)
Local inference users are all about sampling, but users addicted to commercial inference services are wary of sampling, because they have to pay by the token.
[ Parent | on HN ]