Show HN: Instantly search 28M books from OpenLibrary

Re:Show HN: Instantly search 28M books from OpenLibrary by tmikaeld on Monday December 14, 2020 @03:41AM (#25414789)

The typesense performance is really impressive, seems at par with the (also) impressive meilisearch.

I'm going to try the free tier of typesense right now, perfect for my current use-case of site-search.

How large is the dataset for the books? How large nodes are needed?

[ Parent | on HN ]

Re:Show HN: Instantly search 28M books from OpenLibrary by jabo on Monday December 14, 2020 @03:47AM (#25414820)

Thank you!

The OpenLibrary dataset has ~28M records, takes up 6.8GB on disk and 14.3GB in RAM when indexed in Typesense. Each node has 4vCPUs. Took me ~3 hours to index these 28M records. Could have probably been done in ~1.5hrs - most of the indexing time was because of cross-region latency between the 3 geo-distributed nodes in Oregon, Mumbai and Frankfurt.

[ Parent | on HN ]

Re:Show HN: Instantly search 28M books from OpenLibrary by tmikaeld on Monday December 14, 2020 @07:04AM (#25416294)

That's a lot of text to index, impressive!

Is the indexed size 6.8GB or 14.3GB?

[ Parent | on HN ]

Re:Show HN: Instantly search 28M books from OpenLibrary by jabo on Monday December 14, 2020 @10:34AM (#25418677)

Thank you! The indexed size is 14.3GB.

[ Parent | on HN ]

Re:Show HN: Instantly search 28M books from OpenLibrary by binarymax on Monday December 14, 2020 @09:13AM (#25417716)

I'm curious, what do you feel meilisearch offers that is better than elasticsearch or solr?

[ Parent | on HN ]