News for hackers. Stuff that matters.

A comment on A Billion Rows per Second: Metaprogramming Python for Big Data [video].

Re:A Billion Rows per Second: Metaprogramming Python for Big... by pjvds on Friday September 27, 2013 @02:48PM (#6458762)
My takeaway is, that the reason that this is possible is that they care about data structure. A language can give you an order of magnitude performance, but - according to Ville - you can almost get infinitive improvement if you rethink the algorithms and data structure.
[ Parent | on HN ]
Re:A Billion Rows per Second: Metaprogramming Python for Big... by mathattack on Friday September 27, 2013 @03:47PM (#6459075)
Structure of the database matters a lot. Going column-oriented [1] will improve performance dramatically before you scale up the processing power.

[1] http://en.wikipedia.org/wiki/Column-oriented_DBMS

[ Parent | on HN ]