News for hackers. Stuff that matters.
Re:TiDB – cloud-native, distributed SQL database written in Go by sgarland on Monday January 06, 2025 @10:19PM (#42618804)
While you’re not wrong re: Postgres and MySQL not being necessarily designed for PB-scale, IME many shops with huge datasets are just doing it wrong. Storing numbers as strings, not using lookup tables for low-cardinality data, massive JSON blobs everywhere, etc.

I’m not saying it fixes everything, but knowing how a DB works, and applying proper data modeling and normalization could severely reduce the size of many datasets.

Re:TiDB – cloud-native, distributed SQL database written in Go by PeterCorless on Thursday January 09, 2025 @01:25PM (#42648426)
Yes. The chance to do wrong things with data increases with scale.