News for hackers. Stuff that matters.
Re:Ask HN: Share Embedded GPT Model Without Going Broke? by MacsHeadroom on Saturday March 04, 2023 @10:38PM (#35026720)
Use GPT-NeoX-20B instead for 100x cheaper cost via https://nlpcloud.com/ or another provider. It's $0.00004 per token. They even let you fine tune your models and then charge $0.00007 per token for using a fine tuned model.

Basically anything is cheaper than using OpenAI, since their models are extremely inefficient. The latest Meta LLaMA-13B outperforms GPT-3 175B on a single 24GB video card. LLaMA-7B outperforms all other open source models and runs on a single 10GB video card. https://rentry.org/llama-tard

For more options check out the Chatbot General thread on /g/ https://boards.4channel.org/g/thread/91897528

There are no comments on this comment yet.