News for hackers. Stuff that matters.

A comment on Databricks is an RDBMS. Parent comment

Re:Databricks is an RDBMS by victor106 on Tuesday February 02, 2021 @12:33AM (#25997733)
> Calling UDFs from SQL means you can create great features for SQL analysts

You can do that in Spark, no?

[ Parent | on HN ]
Re:Databricks is an RDBMS by jpau on Tuesday February 02, 2021 @12:38AM (#25997769)
You sure can :)

I see it as why the article supports Databricks as an RDBMS; it offers something others do not.

You can't currently* do the same extensive UDFs in Snowflake or BQ and, sometimes, they are important. But with SnowPark coming, hopefully you won't have to make such a large sacrifice to SQL users' experience for it.

* Currently you can do JavaScript UDFs and external functions in Snowflake, and BigQuery ML is worth mentioning here too. Those cover some, but not all, of what you might use a Spark UDF for in SQL.

[ Parent | on HN ]