Re:Big data is dead (2023)
by maayank on Monday May 27, 2024 @07:12AM
(#40489678)
What do you mean by 'variety'?
[ Parent
| on HN ]
Data that isn't internally managed database exports.
One of the reasons big data systems took off was because enterprises had exports out of third party systems that they didn't want to model since they didn't own it. As well as a bunch of unstructured data e.g. floor plans, images, logs, telemetry etc.
not op, but I think they mean the data is complex, heterogeneous and noisy. You won't be able to extract meaning trivially from it, you need something to find the (hidden) meaning in the data.
So AI currently, probably ;)
the other comments get it.
It means that data comes in a ton of different shapes with poorly described schemas (technically and semantically).
From the typical CSV export out of an ERP system to a proprietary message format from your own custom embedded device software.