Just use Postgres for everything

Re:Just use Postgres for everything by madjam002 on Saturday December 10, 2022 @01:50PM (#33935508)

The issue isn't so much the speed as yes I use bulk SQL statements and can upsert like 4-5k rows per second, it's more the disk writes which I find unsettling as after a few months I've noticed several 10s of TBs of disk writes from Postgres onto the SSDs which seems like unnecessary wear.

[ Parent | on HN ]

Re:Just use Postgres for everything by crazygringo on Saturday December 10, 2022 @05:00PM (#33937324)

Then it seems your setup is totally fine. If you're upserting 10 million rows a day with lots of columns, then of course you're going to be seeing TB's of disk writes. And remember that SSD's can't even write individual bytes the way HDD's can, they necessarily write a whole page at a time, which might be 4K or 16K, even if you're just updating a single integer.

Your database and SSD are functioning totally normally, as designed.

[ Parent | on HN ]

Re:Just use Postgres for everything by qeternity on Saturday December 10, 2022 @04:36PM (#33937084)

Several 10s of TBs of writes over a few months is literally nothing to be concerned about for any recently modern enterprise ssd in a production setting.

This seems like a bizarre rationale to make a database choice.

[ Parent | on HN ]