News for hackers. Stuff that matters.
Re:Big data is dead (2023) by maayank on Monday May 27, 2024 @07:12AM (#40489678)
What do you mean by 'variety'?
Re:Big data is dead (2023) by threeseed on Monday May 27, 2024 @07:33AM (#40489821)
Data that isn't internally managed database exports.

One of the reasons big data systems took off was because enterprises had exports out of third party systems that they didn't want to model since they didn't own it. As well as a bunch of unstructured data e.g. floor plans, images, logs, telemetry etc.

Re:Big data is dead (2023) by boesboes on Monday May 27, 2024 @07:23AM (#40489750)
not op, but I think they mean the data is complex, heterogeneous and noisy. You won't be able to extract meaning trivially from it, you need something to find the (hidden) meaning in the data.

So AI currently, probably ;)

Re:Big data is dead (2023) by zurfer on Monday May 27, 2024 @08:33AM (#40490168)
the other comments get it.

It means that data comes in a ton of different shapes with poorly described schemas (technically and semantically).

From the typical CSV export out of an ERP system to a proprietary message format from your own custom embedded device software.

Re:Big data is dead (2023) by nairboon on Monday May 27, 2024 @01:25PM (#40492791)
it doesn't fit the relational model, e.g. you have some tables, but also tons of different types of images, video, sounds, raw text, etc.