News for hackers. Stuff that matters.

A comment on Petals: Run 100B+ language models at home bit-torrent style. Parent comment

Re:Petals: Run 100B+ language models at home bit-torrent style by borzunov on Monday January 02, 2023 @01:38PM (#34221781)
There's a lightweight HTTP API for inference: https://github.com/borzunov/chat.petals.ml#http-api-methods
[ Parent | on HN ]

There are no comments on this comment yet.