News for hackers. Stuff that matters.

A comment on Llama 3-V: Matching GPT4-V with a 100x smaller model and 500 dollars. Parent comment

Re:Llama 3-V: Matching GPT4-V with a 100x smaller model and ... by nomel on Tuesday May 28, 2024 @06:50PM (#40506433)
It's llama 3 training cost + their cost. Meta "kindly" covered the first $700M.

> We add a vision encoder to Llama3 8B

[ Parent | on HN ]
Re:Llama 3-V: Matching GPT4-V with a 100x smaller model and ... by lanceflt on Tuesday May 28, 2024 @09:21PM (#40507284)
They didn't train the vision encoder either, it's unchanged SigLIP by Google.
[ Parent | on HN ]
Re:Llama 3-V: Matching GPT4-V with a 100x smaller model and ... by qeternity on Wednesday May 29, 2024 @07:55AM (#40510946)
“We finetuned billions of dollars of research by Google and Meta.”
[ Parent | on HN ]