News for hackers. Stuff that matters.

A comment on Arquero – data tables wrangling in JavaScript.

Re:Arquero – data tables wrangling in JavaScript by gerad on Saturday July 23, 2022 @12:27PM (#32204803)
We explored Arquero a year or so ago. It’s pretty cool, can run against data in Apache Arrow format and even transform it to run against WebGPU I think. This makes things run super fast.

It didn’t work for our use case so we didn’t end up using it for long.

I also didn’t like that it parsed and transformed your JavaScript behind the scenes for various reasons. [1]

Honestly, this just leads to a lot of confusion and additional complexity for folks to reason about. I’d have preferred just a non-JavaScript DSL for the stuff they optimize and for things to work exactly the way you expect when you do use JavaScript.

[1] https://uwdata.github.io/arquero/api/expressions.html

[ Parent | on HN ]
Re:Arquero – data tables wrangling in JavaScript by pbowyer on Saturday July 23, 2022 @01:43PM (#32205625)
> I also didn’t like that it parsed and transformed your JavaScript behind the scenes for various reasons. [1]

If your data's smaller e.g. you do most of the filtering on the backend but want to transform it to display multiple ways on the frontend, I really enjoy using Tidy.js https://pbeshai.github.io/tidy/. Great API and makes massaging data pleasant.

[ Parent | on HN ]