Re:Splade outperforms BM25 and TF-IDF in search
by cschmidt on Thursday February 23, 2023 @08:18PM
(#34919376)
What are you saying is false? That they aren't using FAISS? Their whole startup is built around a proprietary ANN solution, which isn't using FAISS.
[ Parent
| on HN ]
Re:Splade outperforms BM25 and TF-IDF in search
by opisthenar84 on Thursday February 23, 2023 @08:24PM
(#34919424)
Just out of curiosity - how do you know this if you don't work there?
Re:Splade outperforms BM25 and TF-IDF in search
by cschmidt on Thursday February 23, 2023 @08:39PM
(#34919577)
I’m a paying customer. They have been building up a system with new features over time that Faiss doesn’t support. At least from a customer view I’d be very surprised if they were using it. I may be wrong but I thought it was originally started by some academics in Israel.
Re:Splade outperforms BM25 and TF-IDF in search
by opisthenar84 on Thursday February 23, 2023 @08:47PM
(#34919640)
FAISS is open source and highly extensible. I don't think it would be very difficult to build atop it.
Re:Splade outperforms BM25 and TF-IDF in search
by simonw on Thursday February 23, 2023 @08:27PM
(#34919456)
When a founder says "You might be surprised to learn there’s no Faiss inside Pinecone" I'm inclined to believe them. They seem like a good team. I don't think they would lie about this.
I also just had a browse through some of the employee profiles on LinkedIn and their team absolutely seems to have the background you would need to build something like this from scratch. https://www.linkedin.com/company/pinecone-io/people/
Re:Splade outperforms BM25 and TF-IDF in search
by opisthenar84 on Thursday February 23, 2023 @08:44PM
(#34919610)
If an engineer or product manager working there mentions it in a casual setting, I'm inclined to believe them. If an founder/executive says it, it's a tossup.
Why? Look at companies like FTX.
Re:Splade outperforms BM25 and TF-IDF in search
by gk1 on Thursday February 23, 2023 @08:45PM
(#34919622)
Correction: I'm not the Founder, but I've been at Pinecone for two years, from when we were ~10 people. Long enough to know what's under the hood.
I've also been on HN long enough to expect a few cynics and conspiracy theorists in the comments.
This reminds me... The creator of Faiss, Matthijs Douze, will speak at our NYC meetup on March 21st. Join up and ask him if he's aware of any sneaky business going on! https://www.pinecone.io/events/meetup-march-2023/