Re:Faiss: Facebook's open source vector search library
by jamesbriggs on Wednesday December 15, 2021 @04:31AM
(#29563742)
You can train a good sentence transformer on ~10K sentences using TSDAE (an unsupervised training approach), covered in Chapter 7 here: https://www.pinecone.io/learn/unsupervised-training-sentence...
So we've stuck with simple keyword search with filters to drill into specific categories within results, all pretty vanilla on a relational database structure.
Just wondering if there is a "volume" heuristic to this - I'd like to explore this more but realistically sometimes the academic user-base has big dreams with severe practical limitations.