Re:Mixtral 8x22B
by user_7832 on Wednesday April 17, 2024 @11:13AM
(#40065857)
Generally about ~1gb ram per billion parameters. I've run a 30b model (vicuna) on my 32gb laptop (but it was slow).
[ Parent
| on HN ]
There are no comments on this comment yet.