Ask HN: How would you store 10PB of data for your startup today?

Re:Ask HN: How would you store 10PB of data for your startup... by creiht on Saturday April 24, 2021 @12:22AM (#26922234)

Late to the party, but one does not simply store 10PB of data :)

The short story is, ignore most of the advice, poach^H^H^H^H^Hhire someone who has done this, and leverage their expertise. There is no armchair quarterbacking infrastructure at this scale.

[ Parent | on HN ]

Re:Ask HN: How would you store 10PB of data for your startup... by warrenm on Wednesday May 05, 2021 @04:34PM (#27055391)

Honestly, 10PB is small potatoes nowadays - and it's not "armchair quarterbacking" to think about storing it in a distributed environment

I work with one customer right now that's storing something like 27PB across ~100 systems for analysis on a rolling 90-to-365-day period (and they're a relatively small customer) with Splunk

If they were doing more storage than analysis, that storage cluster would be substantially smaller

[ Parent | on HN ]