News for hackers. Stuff that matters.
Re:Run 100B+ language models at home, BitTorrent‑style by rohfle on Monday March 20, 2023 @07:37PM (#35240453)
From https://github.com/bigscience-workshop/petals/wiki/Security,...

> Q: Does Petals guarantee that model outputs are correct?

> Not by default. A faulty or malicious server could give you incorrect outputs. There are two things you can do about this:

> - Verify outputs. Send some of your tensors to two or more peers and check that the answers match.

> - Set up a private swarm. You can launch your own swarm hosted by people and organization you trust, who are authorized to process your data.

> In future, we plan to implement an automatic verification and a reputation system, so that clients can select servers that they can trust.

Re:Run 100B+ language models at home, BitTorrent‑style by zekrioca on Tuesday March 21, 2023 @01:13AM (#35242784)
Byzantine problems allover again..