News for hackers. Stuff that matters.
Re:Meta Llama 3 by qeternity on Thursday April 18, 2024 @06:25PM (#40081393)
The original GPT4 may have been around that size (16x 110B).

But it's pretty clear GPT4 Turbo is a smaller and heavily quantized model.

Re:Meta Llama 3 by IceHegel on Thursday April 18, 2024 @11:05PM (#40083086)
Yeah, it’s not even close to doing inference on 1.8T weights for turbo queries.