News for hackers. Stuff that matters.
Re:Find anything fast with Google's vector search technology by mrg3_2013 on Tuesday December 14, 2021 @03:57PM (#29557595)
Thanks for the reference to haystack. I didn't know it existed! I was looking into huggingface that seems to allow to build your own language model and train (still learning - but thats what I've learnt so far). I don't know how expensive these get (for example, if you have 100K lines?). Any thoughts on how this compares to HuggingFace and any anecdotes on time it would take to custom train ?
Re:Find anything fast with Google's vector search technology by m3at on Tuesday December 14, 2021 @06:48PM (#29559820)
Not the author but I can answer that!

Haystack does not really compare to huggingface as they are directly using it as a library, it's more of a layer on top.

Serving a search system for 100K lines (short document?) is trivial on a single CPU machine, so the costs will be low.

For training if you stick to fine tuning and your dataset is relatively small (<10M) you could use collab with a free gpu. Training time really depends on your use case, the simplest classification may be handled in a couple of hours.

Re:Find anything fast with Google's vector search technology by mrg3_2013 on Thursday December 16, 2021 @12:21AM (#29575216)
Thank you @m3at!