Re:Go+: Go designed for data science
by fractionalhare on Saturday March 27, 2021 @11:47AM
(#26603127)
I can see a lot of potential in Go for data engineering specifically, yeah. Those would probably be some very stable and performant ETLs. And the concurrency and network primitives would make it easy to develop libraries like Prefect/Airflow.
[ Parent
| on HN ]
Yep, agreed. Go is a great language for AWS Lambda type workflows.
Python isn't as great (Python Lambda Layers built on Macs don't always work). AWS Data Wrangler (https://github.com/awslabs/aws-data-wrangler) provides pre-built layers, which is a work around, but something that's as portable as Go would be the best solution.
Re:Go+: Go designed for data science
by fractionalhare on Saturday March 27, 2021 @12:33PM
(#26603494)
Love awswrangler. I use that over boto whenever I have the opportunity.