News for hackers. Stuff that matters.

zerozerocool

Re:Bryan Cantrill interviews Arthur Whitney (2009) on Saturday December 07, 2019 @11:12PM (#21734286)
It wouldn't be a hacker news kdb thread without exaggerated claims about kdb's exaggerated performance.

When you say KDB is "amazingly slow" in real life, you're either talking about your own attempt at KDB, or make-believe KDB.

Expensive, terse, and 'amazingly slow' software would not be exist, let alone be competitive.

Re:Shakti, the new data platform from Arthur Whitney on Saturday December 07, 2019 @10:09PM (#21734127)
To give you an idea, here are some benchmarks comparing Python (with pandas/numpy) vs k (aka q/kdb+).

https://www.linkedin.com/pulse/data-analysis-example-python-...

https://www.linkedin.com/pulse/lists-python-q-side-by-side-f...

I think that software history page is meant to convey general workloads achievable, rather than performance.

-(not the author of the benchmarks nor an employee of shakti FWIW)

Re:Shakti, the new data platform from Arthur Whitney on Saturday December 07, 2019 @09:54PM (#21734098)
Here are some actual benchmarks comparing Python (with pandas/numpy) vs k (aka q/kdb+). It seems k is orders of magnitude more performant - without applying any no brainer optimizations/indexing:

https://www.linkedin.com/pulse/data-analysis-example-python-...

https://www.linkedin.com/pulse/lists-python-q-side-by-side-f...

Re:Shakti, the new data platform from Arthur Whitney on Saturday December 07, 2019 @09:42PM (#21734058)
Last I was told - removing the avx hard requirement is on the roadmap.

This Intel SDE emulator took care of issues I ran into on an older laptop running shakti release circa ~ September:

https://software.intel.com/en-us/articles/intel-software-dev...