News for hackers. Stuff that matters.

A comment on Petals runs Llama 2 (70B) from Colab at 5 tokens/sec.

Re:Petals runs Llama 2 (70B) from Colab at 5 tokens/sec by borzunov on Wednesday July 19, 2023 @04:52PM (#36793161)
Chat web app: http://chat.petals.ml

Colab: https://colab.research.google.com/drive/1uCphNY7gfAUkdDrTx21...

Project description: https://github.com/bigscience-workshop/petals

[ Parent | on HN ]
Re:Petals runs Llama 2 (70B) from Colab at 5 tokens/sec by borzunov on Thursday July 20, 2023 @01:15PM (#36803586)
We've moved to a new domain, the chat is now at https://chat.petals.dev
[ Parent | on HN ]