AWS Glue - Fully managed data catalog and ETL service

Posted by irs on Thursday December 01, 2016 @12:52PM
from the aws.amazon.com dept.

https://aws.amazon.com/glue/

( 5 comments | 35 points | on HN )

Re:AWS Glue - Fully managed data catalog and ETL service by sjellis on Friday December 02, 2016 @04:00AM (#13087164)

I'm surprised that there aren't more comments on this, because it seems like it could be enormously useful. My first thoughts are that it could simplify synchronizing data between environments, or coordinating backups where a system has data in both S3 and RDS or RedShift.

[ Parent | on HN ]

Re:AWS Glue - Fully managed data catalog and ETL service by ccannon on Thursday December 01, 2016 @04:02PM (#13083477)

Is it just me or does this look like AWS Data Pipeline with an actually feature-complete and usable user interface?

[ Parent | on HN ]

Re:AWS Glue - Fully managed data catalog and ETL service by shrikant on Thursday December 01, 2016 @04:55PM (#13083910)

I just spoke one of the folks here who's PM for Glue. He confirmed that Glue will be superseding Data Pipeline, and it's basically the same team working on it.

[ Parent | on HN ]

Re:AWS Glue - Fully managed data catalog and ETL service by ccannon on Friday December 02, 2016 @08:59PM (#13093811)

Data Pipeline was a great version 1 of this idea, but the lack of functionality in the UI really killed it for me. It seemed inevitable that I would end up just writing the JSON configuration by hand.

[ Parent | on HN ]

Re:AWS Glue - Fully managed data catalog and ETL service by scapecast on Saturday December 03, 2016 @01:31AM (#13094639)

I wonder how Segment, Fivetran, Stitch and all the other ETL vendors feel about this. I have a feeling that the ecosystem will flock towards Glue and leave everybody else in the dust...

[ Parent | on HN ]