Re:Ask HN: What problem in your industry is a potential star...
by kiyoto on Monday June 29, 2015 @05:50PM
(#9801397)
>Have a good way of querying, analyzing, processing, and securing all this time series data in a way that can handle literally getting >100TB per hour?
Is this data logging the changes or the states of your sensors? If it's the states, then I am guessing most of this is highly compressible. If it is actually 100TB of changes logged, then that's a pretty difficult problem.
Is this data logging the changes or the states of your sensors? If it's the states, then I am guessing most of this is highly compressible. If it is actually 100TB of changes logged, then that's a pretty difficult problem.