Re:Building Analytics at 500px
by Wagthesam on Thursday October 01, 2015 @02:11AM
(#10309511)
That is all there is. s3, one amazon instance for luigi which holds the mysql read replica, and amazon redshfit. There wasn't any heavy ETL in Luigi. Luigi mostly just extracted/dumped data. All the heavy lifting was in EMR
[ Parent
| on HN ]
There are no comments on this comment yet.