Re:Crossing the 1 tb/s throughput threshold for object stora...
by the8472 on Sunday November 10, 2019 @04:46PM
(#21500374)
P2P-DMA is making inroads to the linux kernel. Which means software can limit itself to orchestrating transfers between storage, GPUs, accelerators and network cards and avoid having the data touch system RAM or the CPUs.
Re:Crossing the 1 tb/s throughput threshold for object stora...
by natmaka on Monday November 11, 2019 @09:13AM
(#21504928)
Confining the CPU to the most noble processing, and flanking him with highly-specialized units directly exchanging... isn't it the mainframe all over again?
Re:Crossing the 1 tb/s throughput threshold for object stora...
by Iwan-Zotow on Sunday November 10, 2019 @08:54PM
(#21501526)
> Once storage is as-fast as memory, things change.
"Money can buy bandwidth. Latency requires bribing God."
Re:Crossing the 1 tb/s throughput threshold for object stora...
by jamessb on Sunday November 10, 2019 @05:54PM
(#21500719)
For databases, there was a 2016 VLDB paper that suggested using 'write-behind logging' as an alternative to traditional 'write-ahead logging' that is "designed for a hybrid storage hierarchy with NVM and DRAM": http://www.vldb.org/pvldb/vol10/p337-arulraj.pdf
Re:Crossing the 1 tb/s throughput threshold for object stora...
by mjb on Sunday November 10, 2019 @06:13PM
(#21500807)
Lots of work, in both academia and industry. For example, check out Daniel Bittman's work at UCSC, and Tim Kraska's at MIT.
Two interesting things are happening here: memory becoming non volatile, and storage and network bandwidth catching up with memory bandwidth.
Re:Crossing the 1 tb/s throughput threshold for object stora...
by amarshall on Sunday November 10, 2019 @06:04PM
(#21500769)
> Once storage is as-fast as memory
Bandwidth is only one aspect, SSD latency (even Optane) is still quite slow compared to RAM.
Re:Crossing the 1 tb/s throughput threshold for object stora...
by JulianMorrison on Sunday November 10, 2019 @03:43PM
(#21500091)
There's a lot of programs of late, designed to run in pure RAM. I imagine it would be similar? Except perhaps with different retention-over-restart characteristics.
Once storage is as-fast as memory, things change.
Please note: i am NOT referring to cpu-on-the-memory-chip architectures