News for hackers. Stuff that matters.
Re:EdgeDB is now Gel and Postgres is the future by kelseydh on Tuesday February 25, 2025 @09:19PM (#43179910)
Postgres is great, but the level of work required to scale it on large workloads is really quite overwhelming. You really need expert-level knowledge to scale it. Just ask anybody who has had to shard their database.
Re:EdgeDB is now Gel and Postgres is the future by genewitch on Tuesday February 25, 2025 @09:50PM (#43180076)
I ran a 4000qps postgres database set to use no more than 640KB of RAM (its in the configs).

The DBA was having fun with my silly idea until Slow-Query takes 10 seconds and we flipped back over to the production systems with much more allowed memory for postgres.

My purpose was to show that Linux itself is pretty fast at caching and paging, even if Postgres was hamstrung. The db actually ran fine except for the slow queries, and we probably could have cleaned them up, too. But I proved my point.

DB was ~300GB, metal had 512GB RAM. This was in 2012.

Re:EdgeDB is now Gel and Postgres is the future by dano on Tuesday February 25, 2025 @10:55PM (#43180426)
Yep. I converted a business from to Postgres in 2004 and never looked back. Stable, reliable, no surprises. Postgres is the answer until proven otherwise.
Re:EdgeDB is now Gel and Postgres is the future by sgarland on Wednesday February 26, 2025 @10:17AM (#43184435)
No offense, but 4000 QPS is not large. I ran a 100K+ QPS MySQL instance with 384 GiB of RAM.

This is all subjective, of course, but I wouldn’t call 100K QPS large, either. It’s getting on the high end of what you might reasonably want to handle without horizontal scaling, but it’s still not “large.”

Re:EdgeDB is now Gel and Postgres is the future by genewitch on Thursday February 27, 2025 @03:29AM (#43192409)
postgres served 4000qps while restricted to 640 kilobytes of memory.
Re:EdgeDB is now Gel and Postgres is the future by sgarland on Friday February 28, 2025 @01:33PM (#43208836)
I am so sorry; I conflated your comment with the sibling from zeeg.
Re:EdgeDB is now Gel and Postgres is the future by genewitch on Sunday March 02, 2025 @07:34PM (#43236959)
you did say no offense, and i took none. Be well.
Re:EdgeDB is now Gel and Postgres is the future by zeeg on Wednesday February 26, 2025 @12:38PM (#43185992)
Define large workload.

Sentry runs large workloads and Postgres isn't a bottleneck. We have also never employed a DBA. Most users never need to shard their database, and at most can just partition datasets by tables for _extremely_ high volume workloads.

You just have to consider architecture and optimize things that are slow, just like any other software. Nothing is free at the end of the day, and nothing else gives you the flexibility that Postgres does, particularly these days with its growing high value extensions.