News for hackers. Stuff that matters.
Re:Anthropic - Introducing 100K Token Context Windows, Aroun... by make3 on Thursday May 11, 2023 @07:48PM (#35909946)
open ai has an embeddings api that ppl use for that https://platform.openai.com/docs/guides/embeddings, though whether it's the best model to do that is congested.

Contriever is an example of a strong model to do that yourself. see their paper too to learn about the domain. https://github.com/facebookresearch/contriever

Re:Anthropic - Introducing 100K Token Context Windows, Aroun... by HarHarVeryFunny on Thursday May 11, 2023 @09:50PM (#35910906)
Thanks!