News for hackers. Stuff that matters.

A comment on Data engineering and software engineering are converging. Parent comment

Re:Data engineering and software engineering are converging by rawgabbit on Friday August 29, 2025 @04:16PM (#45068906)
In Snowflake, I am now writing Python Stored Procedures that make REST API calls to things like Datadog REST API and dumping the JSON into a Snowflake table. I then unpack the JSON and transform it into a normalized table. So far it works reasonably well. This is possible using Snowflake's external access feature. https://docs.snowflake.com/en/developer-guide/external-netwo...
[ Parent | on HN ]
Re:Data engineering and software engineering are converging by hobs on Friday August 29, 2025 @09:47PM (#45071231)
Right, but isn't snowflake like the most expensive way to run python? why not just host the python outside of snowflake and store it there?
[ Parent | on HN ]
Re:Data engineering and software engineering are converging by rawgabbit on Friday August 29, 2025 @10:05PM (#45071307)
It is to take advantage of snowpark.
[ Parent | on HN ]