News for hackers. Stuff that matters.
Re:Fast, Open Source Search by klaussilveira on Friday May 14, 2021 @10:58AM (#27154977)
Very interesting use of Google's sparse hash. This library is used throughout the codebase: https://github.com/greg7mdp/sparsepp

Also, after a quick look through the codebase, it really resembles how Algolia deals with indexes:

https://www.algolia.com/blog/engineering/inside-the-algolia-...

And distributed search:

http://highscalability.com/blog/2015/3/9/the-architecture-of...

Amazing project, hopefully gets a lot of traction.

Re:Fast, Open Source Search by karterk on Friday May 14, 2021 @12:03PM (#27155736)
Thanks. Typesense takes a different approach to indexing than Algolia.

a) While Algolia (from what is available publicly) has indices which are pre-sorted on a set of ranking factors, Typesense allows dynamic, on-the-fly sorting.

b) Also I believe Algolia memory maps their indices, but Typesense stores the raw JSON documents on-disk and constructs the index from scratch on start-up.

Re:Fast, Open Source Search by sreeramb93 on Friday May 14, 2021 @11:14AM (#27155137)
This seems to be a well thought out solution