News for hackers. Stuff that matters.

A comment on Petals: Run 100B+ language models at home bit-torrent style.

Re:Petals: Run 100B+ language models at home bit-torrent style by vegabook on Monday January 02, 2023 @08:54AM (#34217823)
Any plans for releasing an API spec that would allow for access from languages other than Python?
[ Parent | on HN ]
Re:Petals: Run 100B+ language models at home bit-torrent style by borzunov on Monday January 02, 2023 @01:38PM (#34221781)
There's a lightweight HTTP API for inference: https://github.com/borzunov/chat.petals.ml#http-api-methods
[ Parent | on HN ]