Re:Announcing RDS/Aurora Snapshot Export to S3
by aquark on Friday January 24, 2020 @01:50PM
(#22141249)
Great, thanks -- will take a look at this.
The challenge with RDS in the past has always been getting the data easily and scriptable into an S3/etc bucket to start with. This might be a good enough solution.
Restore would be a pain, but at the point its needed the pain would be acceptable.
Re:Announcing RDS/Aurora Snapshot Export to S3
by rsync on Friday January 24, 2020 @01:54PM
(#22141285)
"Restore would be a pain, but at the point its needed the pain would be acceptable."
I can't speak specifically to this, but I will point out that you can just as easily run those 'rclone' commands in reverse, to move data from an rsync.net snapshot out to (insert cloud):
ssh [email protected] rclone .zfs/snapshot/1dayago/bucket s3:/some/bucket
Re:Announcing RDS/Aurora Snapshot Export to S3
by sandGorgon on Saturday January 25, 2020 @01:59AM
(#22145152)
AFAIK rsync.net doesnt work with RDS (which is a managed solution with no ssh access).
Re:Announcing RDS/Aurora Snapshot Export to S3
by rsync on Saturday January 25, 2020 @01:09PM
(#22147600)
I can't speak to RDS specifically, but if you can get RDS into either S3 or Glacier, then there is an easy path to rsync.net: rclone.
The ssh access is not to Amazon, or S3 or RDS, etc. - you run the rclone command at rsync.net, over ssh:
ssh [email protected] rclone s3:/some/bucket local/rsync.net/dir
rsync.net has 'rclone' built into the environment[1] so it is trivially easy to call rclone, over SSH:
... and perform arbitrary data movements into, out of, and between S3/glacier/nearline/gdrive resources. Your "out-of-aws solution" contains ZFS snapshots, on any schedule you like, so you can just do a "dumb" sync to rsync.net and handle the retention with the snapshot schedule.Also, the snapshots are immutable (read-only) so your data gains some protection against ransomware and other threats like accidental deletion.
You should trust us with your backups because we've been doing this since 2001.
[1] https://rsync.net/products/rclone.html