News for hackers. Stuff that matters.
Re:Postgres as a Search Engine by philippemnoel on Sunday August 25, 2024 @07:55AM (#41346644)
This is partially true. You're right that the feature set is necessary, but it's now possible to do this in Postgres.

ParadeDB pg_search bundles Tantivy, a Lucene-inspired library inside Postgres, to give users the feature set (BM25 ranking, tokenizers, faceted search, etc.) while keeping the benefits of Postgres (keep your data normalized, avoid ETL, etc.)

Disclaimer: I work on ParadeDB

Re:Postgres as a Search Engine by williamcotton on Sunday August 25, 2024 @08:22AM (#41346796)
I’ve been using pg_search for a tranche of emails in 2+ GB PDFs converted to PDF-page-per-row. Along with some materialized views for regex extracted timestamps it has given us a means for data forensics that has been very fruitful.

Orchestrating this outside of a few Python scripts and a single instance of postgres would have taken much more work!

Re:Postgres as a Search Engine by philippemnoel on Sunday August 25, 2024 @11:40AM (#41348085)
So happy to hear you like it. We have a lot more coming up for it. Stay tuned!