Arquero – data tables wrangling in JavaScript

uwdata.github.io

We explored Arquero a year or so ago. It’s pretty cool, can run against data in Apache Arrow format and even transform it to run against WebGPU I think. This makes things run super fast.

It didn’t work for our use case so we didn’t end up using it for long.

I also didn’t like that it parsed and transformed your JavaScript behind the scenes for various reasons. [1]

Honestly, this just leads to a lot of confusion and additional complexity for folks to reason about. I’d have preferred just a non-JavaScript DSL for the stuff they optimize and for things to work exactly the way you expect when you do use JavaScript.

[1] https://uwdata.github.io/arquero/api/expressions.html

> I also didn’t like that it parsed and transformed your JavaScript behind the scenes for various reasons. [1]

If your data's smaller e.g. you do most of the filtering on the backend but want to transform it to display multiple ways on the frontend, I really enjoy using Tidy.js https://pbeshai.github.io/tidy/. Great API and makes massaging data pleasant.

Reply on news.ycombinator.com