Re:Ask HN: Is distributed LLM training in browsers (WebRTC a...
by gtsop on Friday November 22, 2024 @05:33PM
(#42217892)
Possible? Yes. Practical? No
It is possible because training is already being done using distributed methods in the datacenter. It is not practical because of the sheer volume of network delay piled on top of the computation
It is possible because training is already being done using distributed methods in the datacenter. It is not practical because of the sheer volume of network delay piled on top of the computation