Mesh LLM: distributed AI computing on iroh

Re:Mesh LLM: distributed AI computing on iroh by ul5255 on Sunday July 12, 2026 @07:54AM (#48880418)

I’m staring at this comment for a while now: With 3ms latency combined per token, wouldn’t that mean (1 / latency) = 333 token/s for the theoretical upper bound? I’m not trying to nitpick, just curious if I misunderstand something.

[ Parent | on HN ]

Re:Mesh LLM: distributed AI computing on iroh by stymaar on Sunday July 12, 2026 @08:27AM (#48880633)

Indeed, I completely screwed my math up. Looks like 10am is too early in the morning for a Sunday.

33 tps max token generation speed would be for 10ms of network latency in the above example.

[ Parent | on HN ]