News for hackers. Stuff that matters.
Re:Find anything fast with Google's vector search technology by m3at on Tuesday December 14, 2021 @06:48PM (#29559820)
Not the author but I can answer that!

Haystack does not really compare to huggingface as they are directly using it as a library, it's more of a layer on top.

Serving a search system for 100K lines (short document?) is trivial on a single CPU machine, so the costs will be low.

For training if you stick to fine tuning and your dataset is relatively small (<10M) you could use collab with a free gpu. Training time really depends on your use case, the simplest classification may be handled in a couple of hours.

Re:Find anything fast with Google's vector search technology by mrg3_2013 on Thursday December 16, 2021 @12:21AM (#29575216)
Thank you @m3at!