News for hackers. Stuff that matters.

A comment on Generative AI uses more energy on non-English text. Parent comment

Re:Generative AI uses more energy on non-English text by guipsp on Saturday November 14, 2026 @01:26PM (#50499435)
utf8 is just one of the encodings that exist, and is kind of irrelevant at the point it contacts the llm
[ Parent | on HN ]
Re:Generative AI uses more energy on non-English text by stephantul on Sunday November 15, 2026 @04:48AM (#50505504)
No, the model is trained on utf-8, so switching encodings entails a full retrain
[ Parent | on HN ]