News for hackers. Stuff that matters.

A comment on The Bitter Lesson is coming for Tokenization. Parent comment

Re:The Bitter Lesson is coming for Tokenization by ijk on Tuesday June 24, 2025 @03:28PM (#44370022)
And even on open LLMs, GPU instability can cause non-determinism. For performance reasons, determinism is seldom guaranteed in LLMs in general.
[ Parent | on HN ]
Re:The Bitter Lesson is coming for Tokenization by rar00 on Wednesday June 25, 2025 @08:36AM (#44376582)
yep, even with greedy sampling and fixed system state, numerical instability is sufficient to make output sequences diverge when processing the same exact input
[ Parent | on HN ]