Re:Linode hacked, CCs and passwords leaked
by voidlogic on Monday April 15, 2013 @03:43PM
(#5553778)
That is one (good) way to handle the encryption.
You don't want to leave out the compression or block size however, so add those back in. Most WAN links are low bandwidth enough that compression will not slow things down (this is usually true even on 1 GBE LAN links for pigz) and in my experience the speed-up is substantial.
pigz is much faster than using ssh compression as it is multicore. apt-get it or http://zlib.net/pigz/
the compression is unnecessary here, you're moving a max of less than a couple of hundred GB of data.
Re:Linode hacked, CCs and passwords leaked
by cookiecaper on Tuesday April 16, 2013 @12:10PM
(#5558961)
It's pretty necessary if you aren't moving between colocated boxes. "less than a couple hundred GB of data" is still a lot of data to be moving around, even on a 100Mb/s link, which almost no one in America has residentially, and isn't even a guarantee for colo'd machines.
In most cases, compression at the raw block level will result in HUGE size savings, especially since a lot of that may be free space. It might even make this transfer tenable.
A few hundred GB here, a few hundred GB there, pretty soon you're talking real bandwidth.
Re:Linode hacked, CCs and passwords leaked
by BrandonM on Tuesday April 16, 2013 @01:14PM
(#5559408)
Just add -C to the ssh command to enable compression.
Re:Linode hacked, CCs and passwords leaked
by offmycloud on Monday April 15, 2013 @10:04PM
(#5555728)
That's a great way to screw up the filesystem on the destination. You'll get mounted fs write combined with low-level block writes, filesystem in a blender.
Re:Linode hacked, CCs and passwords leaked
by FireBeyond on Monday April 15, 2013 @10:39PM
(#5555880)
LVM snapshot, that's the way I'd go about it. Is how we do our backups, to maintain a good state. Mount the snapshot, and do the same with it.
let SSH handle compression for you instead.