Re:Perspective: Streaming pivot visualization via WebAssembly
by dman on Tuesday February 06, 2018 @12:08PM
(#16317611)
No, when I first prototyped it I had written a Python version initially. From memory the first C++ build was ~80x faster than the Python prototype.
[ Parent
| on HN ]
Re:Perspective: Streaming pivot visualization via WebAssembly
by goatlover on Tuesday February 06, 2018 @01:08PM
(#16318075)
80x faster than using Pandas? What if you just used the Numpy values array?
Re:Perspective: Streaming pivot visualization via WebAssembly
by dman on Tuesday February 06, 2018 @01:12PM
(#16318106)
You will get me into trouble! I said 80x faster than the Python prototype. I did benchmark this vs Pandas over the years and depending on the usecase the two codebases trade blows with each other for static data. However for streaming datasets Perspective has a large advantage over Pandas since pandas does a full group by on every update, while perspective does its work incrementally using deltas.
Re:Perspective: Streaming pivot visualization via WebAssembly
by carapace on Tuesday February 06, 2018 @12:15PM
(#16317661)
I'm curious if you did any profiling? If the intent was always to rewrite the whole prototype in C++ then it kinda wouldn't matter, eh?
Re:Perspective: Streaming pivot visualization via WebAssembly
by texodus on Tuesday February 06, 2018 @12:23PM
(#16317719)
We do some benchmarking just for catching performance regressions and validating assumptions against the non-WebAssembly version, but definitely need more in this regard.
[benchmark for wasm build](https://jpmorganchase.github.io/perspective/examples/benchma...)