News for hackers. Stuff that matters.
Re:Big data is dead (2023) by qaq on Monday May 27, 2024 @08:01AM (#40489990)
You can have 8TB RAM in a 2U box for under 100K. grab a couple and it will save you millions a year compared to over-engineered bigdata setup.
Re:Big data is dead (2023) by apwell23 on Monday May 27, 2024 @08:53AM (#40490297)
Bigquery and snowflake are software. They come with a sql engine, data governance, integration with your ldap, auditing. Loading data into snowflake isn't overegineering. What you described is over-engineering.

No business is passing 6tb data around on their laptops.

Re:Big data is dead (2023) by qaq on Monday May 27, 2024 @10:51AM (#40491261)
So is ClickHouse your point being ? Please point out what a server being able to have 8TB of RAM has to do with laptops.
Re:Big data is dead (2023) by int_19h on Monday May 27, 2024 @06:16PM (#40495277)
I wonder how much this costs: https://www.ibm.com/products/power-e1080

And how that price would compare to the equivalent big data solution in the cloud.

Re:Big data is dead (2023) by chx on Tuesday May 28, 2024 @11:04AM (#40501407)
1U box too.