News for hackers. Stuff that matters.
Re:S3sync – Tool belt for managing your S3 buckets by mfonda on Thursday September 26, 2013 @01:06PM (#6452082)
How does this compare to the existing s3cmd [1] tool? One issue I've had with s3cmd is it tends to use a lot of memory when syncing two large buckets. I'd love to see a tool that was faster / more memory efficient than s3cmd. Would be awesome to see some benchmarks and feature comparison in the README!

[1] http://s3tools.org/s3cmd

Re:S3sync – Tool belt for managing your S3 buckets by rsync on Thursday September 26, 2013 @01:35PM (#6452295)
Agreed. We support s3cmd:

  ssh [email protected] s3cmd get s3://rsynctest/mscdex.exe
... and have for some time ... but we'd be happy to have some diversity there. One thing that sticks out immediately, of course, is that s3cmd is written in python and s3sync is a ruby gem. This makes things difficult since we insist on having no interpreters in our customer chroot...[1]

[1] We "freeze" things like s3cmd and rdiff-backup into binary executables so they don't require python in the environment

Re:S3sync – Tool belt for managing your S3 buckets by clarete on Thursday September 26, 2013 @01:58PM (#6452454)
So, basically, the main difference is the language they're implemented in. I started working on s3sync cause I found its code easier to read and I really needed to practice my ruby skills.

Although s3cmd is older and has more features, s3sync was designed to grow stable and well tested. I'm definitely planning to write benchmarks to s3sync and improve its performance as much as I can.

Re:S3sync – Tool belt for managing your S3 buckets by bender80 on Thursday September 26, 2013 @03:27PM (#6453037)
Thank you. Does this support IAM Roles?
Re:S3sync – Tool belt for managing your S3 buckets by clarete on Thursday September 26, 2013 @05:04PM (#6453642)
Not currently! Please feel free to open a ticket about that! Thank you! :)
Re:S3sync – Tool belt for managing your S3 buckets by bender80 on Thursday September 26, 2013 @10:52PM (#6454979)
Ok here you go.

https://github.com/clarete/s3sync/issues/15

Wish I could help, but I don't know ruby :)

Re:S3sync – Tool belt for managing your S3 buckets by eterps on Thursday September 26, 2013 @02:56PM (#6452831)
The speed of https://github.com/cobbzilla/s3s3mirror is quite impressive, I suggest you give it a try.