News for hackers. Stuff that matters.
Re:Embeddings: What they are and why they matter by simonw on Wednesday October 25, 2023 @09:47AM (#38012733)
I've been running these models on my own laptop without the GPU. They're generally a lot less resource demanding than full LLMs (though thanks to llama.cpp I've been able to run those on the CPU as well).

More about the tooling I use to run embedding models locally here: https://simonwillison.net/2023/Sep/4/llm-embeddings/

There are no comments on this comment yet.