News for hackers. Stuff that matters.

rvilj

Re:Why Polars rewrote its Arrow string data type on Thursday August 08, 2024 @11:40AM (#41192717)
The length of the buffer for entire column in O(n * k). If you want to gather a subset of the strings in that buffer, you essentially need to scan across the buffer and copy out the subset you want. Because that buffer grows with string size k, it's linear wrt k. The new implementation doesn't have this problem - you only need to deal with views which are constant size.
Re:Octopuses caught on camera throwing things at each other on Friday November 11, 2022 @11:49AM (#33563168)
Since it seems to be extremely controversial, here's the most thorough argument for the plural of octopus I've ever seen:

https://nyctographa.substack.com/p/the-plural-of-octopus-20-...

Re:The Cognitive Style of PowerPoint (2003) [pdf] on Saturday May 29, 2021 @04:54PM (#27328161)
Even with that definition, you won't necessarily observe correlation between A and B.

See the example used in the twitter thread I linked:

> Imagine driving a car, reaching a hill and pumping the gas as you begin to go up so that your speed is constant. The correlation between pressing on the gas and the speed of the car is zero but they're obviously causally related, it's that the agent is optimizing speed!

Re:The Cognitive Style of PowerPoint (2003) [pdf] on Saturday May 29, 2021 @04:39PM (#27328090)
Interestingly, the example he uses about correlation isn't true:

> Probably the shortest true statement that can be made about causality and correlation is "Empirically observed covariation is a necessary but not sufficient condition for causality."

Correlation isn't necessary for causation, so ironically the supposed mutilation used to fit on a PP slide - "Correlation is not causation" - is actually far more correct.

The same mistake is also made in Kahneman, Sibony and Sunstein's new book [1].

[1] https://twitter.com/economeager/status/1395791301627596806