News for hackers. Stuff that matters.
Re:Meta Llama 3 by gliched_robot on Friday April 19, 2024 @01:00AM (#40083570)
Disagree on Nvidia, most folks fine-tune model. Proof: there are about 20k models in huggingface derived from llama 2, all of them trained on Nvidia GPUs.
Re:Meta Llama 3 by eggdaft on Friday April 19, 2024 @01:48AM (#40083794)
Fine tuning can take a fraction of the resources required for training, so I think the original point stands.
Re:Meta Llama 3 by nightski on Friday April 19, 2024 @07:21AM (#40085407)
Maybe in isolation when only considering a single fine tune. But if you look at it in aggregate I am not so sure.