Re:Open models by OpenAI
by NoDoo on Tuesday August 05, 2025 @07:17PM
(#44805704)
Do you think someone will distill this or quantize it further than the current 4-bit from OpenAI so it could run on less than 16gb RAM? (The 20b version). To me, something like 7-8B with 1-3B active would be nice as I'm new to local AI and don't have 16gb RAM.
[ Parent
| on HN ]
There are no comments on this comment yet.