News for hackers. Stuff that matters.
Re:Ask HN: What is new in Algorithms / Data Structures these... by marginalia_nu on Wednesday May 10, 2023 @05:36PM (#35893862)
You don't typically use vector search for trade data though. It's already ridculously well structured. Assets have identifiers, parties and counterparties have IDs, etc. I'm not sure what nearest neighbors in a vector space would add.
Re:Ask HN: What is new in Algorithms / Data Structures these... by l33t233372 on Wednesday May 10, 2023 @06:24PM (#35894309)
Nonetheless it’s an example you asked for of a dataset with over a trillion entries.
Re:Ask HN: What is new in Algorithms / Data Structures these... by marginalia_nu on Wednesday May 10, 2023 @06:27PM (#35894331)
I asked which dataset they were indexing that was of this size, not whether any such dataset exists in other domains.
Re:Ask HN: What is new in Algorithms / Data Structures these... by captaincrowbar on Wednesday May 10, 2023 @09:17PM (#35896027)
I believe I hear the sound of a True Scotsman knocking at the door.
Re:Ask HN: What is new in Algorithms / Data Structures these... by marginalia_nu on Thursday May 11, 2023 @02:44AM (#35898601)
My exact words are still up there

> What sort of dataset are you indexing that has trillion entries?

It doesn't say

> What sort of dataset has a trillion entries?