News for hackers. Stuff that matters.

A comment on Mistral NeMo. Parent comment

Re:Mistral NeMo by fzzzy on Thursday July 18, 2024 @01:36PM (#40997949)
it's very common to run local models in 8 bit int.
[ Parent | on HN ]
Re:Mistral NeMo by qwertox on Thursday July 18, 2024 @02:50PM (#40998593)
Yes, but it's not common for the original model to be 8 bit int. The community can downgrade any model to 8 bit int, but it's always linked to quality loss.
[ Parent | on HN ]