News for hackers. Stuff that matters.
Re:The problem with invariants is that they change over time by prometheus76 on Tuesday April 23, 2024 @08:55AM (#40131422)
We were pulling the entire list of tasks (around 80,000 tasks from various projects) from Microsoft Project 2012 (MSP) and dumping it into a database every day, so that we could track progress of projects daily. MSP uses GUIDs and they are great for uniqueness, but the memory footprint they caused when reporting using Power BI became untenable after about six months.

We ended up creating our own integer table tied to the GUIDs and replaced all the GUIDs with integers in our reporting database. Our memory footprint dropped by 10X and we were able to report on years worth of data, rather than months.

Re:The problem with invariants is that they change over time by CodesInChaos on Tuesday April 23, 2024 @12:13PM (#40133638)
> Our memory footprint dropped by 10X

How? A UUID is only 4x the size of a 32-bit integer.

Re:The problem with invariants is that they change over time by prometheus76 on Tuesday April 23, 2024 @01:03PM (#40134240)
We had multiple columns using UUID that we needed, and the Tabular memory model goes up exponentially for every column.