jkm2155
Pulling Data from an API, Using AWS Lambda
Re:Show HN: Data Engineering Project for Beginners
on Sunday October 11, 2020 @10:36AM (#24746090)
I wrote a simple streaming data pipeline project post, using Apache Kafka, Apache Flink and PostgreSQL DB. Hope this helps someone. lmk if any questions/thoughts/concerns, etc
Show HN: Data Engineering Project for Beginners
Re:Show HN: Data Engineering Project for Beginners
on Thursday June 11, 2020 @12:49PM (#23490745)
@gifflar Glad you found it illuminating :). Yea moving spark script to S3 using a Airflow task is usually the easiest.
Show HN: Data Engineering Project for Beginners
Re:Show HN: Data Engineering Project for Beginners
on Sunday June 07, 2020 @09:47AM (#23447294)
Simple project to help beginners get started with data engineering. This is my fist post on HN, any feedback would be greatly appreciated.