Re:AWS switch from gzip to zstd – about 30% reduction in com...
by londons_explore on Saturday August 20, 2022 @06:20PM
(#32535655)
But on an FPGA you can probably implement super fast and effective compression.
If it is far enough above the curve of speed Vs ratio, then it will pay for itself in saved storage.
Remember there is no need for said FPGA to be in every machine - in a data center with ten's of gigabits of bandwidth to every node, you can send data to another machine for compression and receive back the compressed data to store.
If it is far enough above the curve of speed Vs ratio, then it will pay for itself in saved storage.
Remember there is no need for said FPGA to be in every machine - in a data center with ten's of gigabits of bandwidth to every node, you can send data to another machine for compression and receive back the compressed data to store.