News for hackers. Stuff that matters.
Re:OpenAI: Scaling PostgreSQL to the Next Level by vanviegen on Friday May 23, 2025 @10:24AM (#44073200)
The talk seems to be mostly about all the limitations and workarounds they've had to deal with, because they choose not to shard. Apparently, they have a policy of adding no new functionality to the database, which presumably means additional separate database services being setup for each new feature. That sounds a lot like accumulating tech debt very rapidly, just because sharding is not on the table, for whatever reason.
Re:OpenAI: Scaling PostgreSQL to the Next Level by bhouston on Friday May 23, 2025 @01:08PM (#44074565)
Yeah, when they mentioned that they couldn't put any more services on their main DB because of this issue I did a facepalm. They are building out explicit tech debt now because they are not sharding.