Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Ask HN: Can we run ChatGPT/other large models on our devices?.
For Bloom 176B, an alternative to GPT3, you may need a cluster/machine with 512GB of GPU memory. That’s expensive.
On a more normal machine, you can run something like GPT J 6B, but it’s very limited in comparison to ChatGPT.
Maybe we will find a way to reduce the size of the models while keeping the capabilities.
There are no comments on this comment yet.
For Bloom 176B, an alternative to GPT3, you may need a cluster/machine with 512GB of GPU memory. That’s expensive.
On a more normal machine, you can run something like GPT J 6B, but it’s very limited in comparison to ChatGPT.
Maybe we will find a way to reduce the size of the models while keeping the capabilities.