News for hackers. Stuff that matters.

A comment on Mesh LLM: distributed AI computing on iroh. Parent comment

Re:Mesh LLM: distributed AI computing on iroh by DerivativeBS on Saturday July 11, 2026 @10:15PM (#48877674)
Curious about: does it have fault tolerance if one of the machines goes down mid-inference? Can it dynamically reroute, or does it just retry?
[ Parent | on HN ]
Re:Mesh LLM: distributed AI computing on iroh by i386 on Saturday July 11, 2026 @10:39PM (#48877785)
It can dynamically route. If a machine drops out of split, the topology is recalculated and the request is automatically retried.
[ Parent | on HN ]