News for hackers. Stuff that matters.
Re:GPU Embedding with GGML by aduffy on Monday October 16, 2023 @11:25AM (#37901146)
The model discussed in the article is MiniLM-L6-v2, which you can run via PyTorch from the sentence-transformers project[1].

That model is based on BERT and not LLaMa [2].

[1]: https://www.sbert.net/docs/pretrained_models.html

[2]: https://huggingface.co/microsoft/MiniLM-L12-H384-uncased

There are no comments on this comment yet.