Re:Pinecone integrates AI inferencing with vector database
by mritchie712 on Wednesday December 04, 2024 @08:00AM
(#42317018)
The only reason I can see for this is to create lock-in. I'd be pretty surprised if anymore than 5% of their customers would want a model by pinecone.
Re:Pinecone integrates AI inferencing with vector database
by gdj0nes on Wednesday December 04, 2024 @03:33PM
(#42321745)
We trained a sparse embedding model because there is a lack of commercially licensed weights or APIs. For any proprietary model, particularly embeddings, there is a degree of lock-in.
> Astra DB seems to just be a tutorial showing how to generate embeddings using another service.
The link I shared showed how a single request to Astra DB's data API has Astra DB automatically create embeddings behind the scenes, integrating with an embedding service the user chooses when they set their database up. Indeed embeddings are generated by another service and not in-house, but from an end-user perspective, they don't need to generate embeddings themeselves as was the prior art and coordinate requests between:
- get text - generate embeddings - take embeddings and send to DB
As of May when they announced Vectorize, one request did all that. I believe from an end-user experience, this is really analogous to what Weaviate and Pinecone are offering unless I'm missing something.