News for hackers. Stuff that matters.
Re:Nvidia's Chat with RTX is a promising AI chatbot that run... by sillysaurusx on Tuesday February 13, 2024 @11:40PM (#39366555)
Four bits per parameter. (A parameter is what you call an integer here.)

I was skeptical of it for some time, but it seems to work because individual parameters don’t encode much information. The knowledge is embedded thanks to having a massive number of low bit parameters.

There are no comments on this comment yet.