Re:Show HN: BemiDB – Postgres read replica optimized for ana...
by exAspArk on Thursday November 07, 2024 @09:56PM
(#42083661)
I'd say that querying data from S3 is not ideal when low-latency queries are required. Generally, there could be a few roundtrip requests to fetch metadata (JSON, Avro) and data (Parquet) files, which may lead to around 1s or so latency. However, we have caching on our roadmap (it could be just a simple TTL for the fetched data or some more sophisticated caching depending on the synced & queried data)
[ Parent
| on HN ]
Re:Show HN: BemiDB – Postgres read replica optimized for ana...
by anentropic on Friday November 08, 2024 @07:55AM
(#42086481)
How tied is it to S3?
Could I easily point it to Iceberg tables on another storage target?
Re:Show HN: BemiDB – Postgres read replica optimized for ana...
by exAspArk on Friday November 08, 2024 @09:54AM
(#42087287)
Yes!
BemiDB natively supports two storage layers, a local disk and S3 (we assumed that most people would choose this in production environments to simplify management).
When I query Iceberg tables stored on SSD, it works superfast.
Re:Show HN: BemiDB – Postgres read replica optimized for ana...
by anentropic on Saturday November 09, 2024 @04:27AM
(#42093437)
awesome, thanks