Re:Big data is dead (2023)
by qaq on Monday May 27, 2024 @08:01AM
(#40489990)
You can have 8TB RAM in a 2U box for under 100K. grab a couple and it will save you millions a year compared to over-engineered bigdata setup.
[ Parent
| on HN ]
Bigquery and snowflake are software. They come with a sql engine, data governance, integration with your ldap, auditing.
Loading data into snowflake isn't overegineering.
What you described is over-engineering.
No business is passing 6tb data around on their laptops.
So is ClickHouse your point being ? Please point out what a server being able to have 8TB of RAM has to do with laptops.
I wonder how much this costs: https://www.ibm.com/products/power-e1080
And how that price would compare to the equivalent big data solution in the cloud.