Re:Run LLMs at home, BitTorrent‑style
by YetAnotherNick on Monday September 18, 2023 @06:21AM
(#37554330)
Finetuning in a distributed way with questionable network would be lot more energy/cost inefficient than doing it with a single node or a well connected cluster. Also, you can finetune 70b model for million tokens for $2 in lambda cloud or <$10 in replicate.
[ Parent
| on HN ]
There are no comments on this comment yet.