News for hackers. Stuff that matters.
Re:Mesh LLM: distributed AI computing on iroh by darkpicnic on Saturday July 11, 2026 @07:19PM (#48876768)
cocompute.ai is already doing this really well.
Re:Mesh LLM: distributed AI computing on iroh by SwellJoe on Saturday July 11, 2026 @07:22PM (#48876785)
Is it? I don't see anything on the website about splitting a model across multiple devices, only about putting local models on the internet, a wholly orthogonal problem (which is already easy with existing tools, since models use an http API).
Re:Mesh LLM: distributed AI computing on iroh by darkpicnic on Saturday July 11, 2026 @07:28PM (#48876824)
Good point. I know cocompute is working on splitting, but it’s not there yet; I was referring to the round-robin delegation within a trusted pool. Mesh LLM looks great too!
Re:Mesh LLM: distributed AI computing on iroh by dnoberon on Saturday July 11, 2026 @07:23PM (#48876791)
Cool, always good to have more in the ecosystem. I love Iroh and hope this continues to succeed.