News for hackers. Stuff that matters.
Re:Run LLMs at home, BitTorrent‑style by YetAnotherNick on Monday September 18, 2023 @06:21AM (#37554330)
Finetuning in a distributed way with questionable network would be lot more energy/cost inefficient than doing it with a single node or a well connected cluster. Also, you can finetune 70b model for million tokens for $2 in lambda cloud or <$10 in replicate.

There are no comments on this comment yet.