Scikit-Learn Version 1.0

Re:Scikit-Learn Version 1.0 by mrtranscendence on Tuesday September 14, 2021 @09:52AM (#28524794)

I'm more a dplyr man myself, but data.table is much faster than pandas, most noticeably IMO when reading large files. It's also extremely succinct if you're into that sort of thing (though I find it a bit obfuscated). pandas is a lot of things, but "fast" and "concise" are not two of them.

[ Parent | on HN ]

Re:Scikit-Learn Version 1.0 by MichaelRazum on Tuesday September 14, 2021 @11:12AM (#28526066)

Got it. Regarding fast you have something like Vaex on python side (but not sure how fast it realy is). For me I had with pandas the most issues using it's multiindex.

[ Parent | on HN ]

Re:Scikit-Learn Version 1.0 by mrtranscendence on Tuesday September 14, 2021 @12:01PM (#28526770)

> For me I had with pandas the most issues using it's multiindex.

Yessss. I loathe indices, and have never been in a situation where I was better off with them than without them.

> Regarding fast you have something like Vaex on python sid

I've never used Vaex, but I've used datatable (https://github.com/h2oai/datatable) and polars (https://github.com/pola-rs/polars). Polars is my favorite API, but datatable was faster at reading data (Polars was faster in execution). I'll have to give Vaex a try at some point.

[ Parent | on HN ]

Re:Scikit-Learn Version 1.0 by civilized on Tuesday September 14, 2021 @12:25PM (#28527116)

Pandas is the PHP of data science. Pretty badly designed, but immensely popular because it got there first and had no real competition (in Python) for years.

[ Parent | on HN ]