Re:Postgres as a Search Engine
by williamcotton on Sunday August 25, 2024 @08:22AM
(#41346796)
I’ve been using pg_search for a tranche of emails in 2+ GB PDFs converted to PDF-page-per-row. Along with some materialized views for regex extracted timestamps it has given us a means for data forensics that has been very fruitful.
Orchestrating this outside of a few Python scripts and a single instance of postgres would have taken much more work!
Re:Postgres as a Search Engine
by philippemnoel on Sunday August 25, 2024 @11:40AM
(#41348085)
So happy to hear you like it. We have a lot more coming up for it. Stay tuned!
ParadeDB pg_search bundles Tantivy, a Lucene-inspired library inside Postgres, to give users the feature set (BM25 ranking, tokenizers, faceted search, etc.) while keeping the benefits of Postgres (keep your data normalized, avoid ETL, etc.)
Disclaimer: I work on ParadeDB