News for hackers. Stuff that matters.

A comment on Custom Embeddings: Why going viral caused us to rip out everything in a weekend. Parent comment

Re:Custom Embeddings: Why going viral caused us to rip out e... by mdagostino on Friday February 24, 2023 @10:05AM (#34925153)
I wouldn’t say most—maybe a factor of 2. Getting the embedding is still an API call to an LLM.
[ Parent | on HN ]
Re:Custom Embeddings: Why going viral caused us to rip out e... by DanielVZ on Sunday February 26, 2023 @10:52PM (#34952744)
I’m pretty sure they were using a high cost LLM to summarize, and for embeddings you only need Ada, which is orders pf magnitude cheaper.
[ Parent | on HN ]