News for hackers. Stuff that matters.
Re:Use GPT-3 incorrectly: reduce costs 40x and increase spee... by nafizh on Wednesday February 08, 2023 @10:58AM (#34709874)
The medium article you posted does analysis on OpenAI's old embeddings. OpenAI has a single new embedding model [0] that replaces all the old models and it's also super cheap ($0.0004 / 1K tokens).

0. https://openai.com/blog/new-and-improved-embedding-model/

Re:Use GPT-3 incorrectly: reduce costs 40x and increase spee... by txtai on Wednesday February 08, 2023 @11:26AM (#34710387)
The first comment in that article has details on the new model. Not the original author but per their testing they said they paid $70 to encode 1M records. The embeddings are 1536 dimensions, which require a lot of vector storage. The HF hub has open models for 384 dimensions or 768 dimensions that work well for a lot of use cases.