News for hackers. Stuff that matters.
Re:Vector indexing all of Wikipedia on a laptop by gfourfour on Wednesday May 29, 2024 @02:39PM (#40515262)
Ah didn’t realize it was every language. Yes I’m using a light weight open model - but also my use case doesn’t require anything super heavy weight. Wikipedia articles are very feature-dense and differentiable from one another. It doesn’t require a massive feature vector to create meaningful embeddings.
Re:Vector indexing all of Wikipedia on a laptop by tjake on Wednesday May 29, 2024 @02:52PM (#40515431)
it's 35M 1024 vectors Plus the text
Re:Vector indexing all of Wikipedia on a laptop by gfourfour on Wednesday May 29, 2024 @05:19PM (#40517145)
Still, $5000 is kind of insane. That makes no sense to me.