Re:Intel’s first Optane SSD: 375GB that you can also use as RAM
by digi_owl on Sunday March 19, 2017 @06:23PM
(#13910030)
"As above, so below" comes to mind.
Sometimes it seems that the diff between a CPU and a cluster is the suffix put on the latency times.
Re:Intel’s first Optane SSD: 375GB that you can also use as RAM
by cowardlydragon on Thursday March 30, 2017 @12:30AM
(#13992910)
I thought I read somewhere that the fastest networking technology actually gets close to a couple hundred instructions window of processing.
http://netoptimizer.blogspot.com/2014/05/the-calculations-10...
Hm, 67 ns per packet.
So even this local storage would be the drag in many scenarios...
Similarly, the difficulty in large data problems is often more of getting the data in the first place. This is often about coordinating the data creation of many machines and systems.
So, for most of us, this shift will not be huge. Because it is mostly irrelevant. Even systems that do have this much data often benefit from algorithms that don't rely on directly accessing and processing all of it in one shot. If only for resilience. (That is, if a system failing doesn't mean reprocessing all of the data, restarting and recovery is often faster and easier to deal with.)