News for hackers. Stuff that matters.

A comment on Mesh LLM: distributed AI computing on iroh. Parent comment

Re:Mesh LLM: distributed AI computing on iroh by darkpicnic on Saturday July 11, 2026 @09:25PM (#48877451)
If payloads to LLMs are being passed around to various nodes, even trusted ones (like friends and family), it gets awkward if you send something very personal. Think sending a medical question to medgemma:27b.
[ Parent | on HN ]
Re:Mesh LLM: distributed AI computing on iroh by oezi on Saturday July 11, 2026 @10:03PM (#48877628)
Even if transport is encrypted, the LLM computations will always be clear text, right?
[ Parent | on HN ]
Re:Mesh LLM: distributed AI computing on iroh by embedding-shape on Sunday July 12, 2026 @05:19AM (#48879635)
Indeed, it's in-transit-encrypted so snoopers won't be able to see it, but it's not E2E encrypted nor in-process encrypted, the one's doing the inference could obviously see the input/output.
[ Parent | on HN ]