Scikit-Learn Version 1.0

Re:Scikit-Learn Version 1.0 by bllguo on Tuesday September 14, 2021 @09:09AM (#28524195)

maybe we are casualties of the vague definition of "data science," but in my experience numpy is too low-level for most of what I consider DS, and pandas/matplotlib are _much_ more central than sklearn or pytorch. Even if your definition only encompasses deep learning research, surely plotting is still indispensable?

I'll also add my vote for the superiority of data.table and ggplot2 to any Python alternatives. the bloat and verbosity of pandas is a daily struggle

[ Parent | on HN ]

Re:Scikit-Learn Version 1.0 by MichaelRazum on Tuesday September 14, 2021 @09:28AM (#28524469)

Just curious. In which way is data.table superior to pandas? Really interested about it! From my personal experience pandas is just sometimes a bit slow.

[ Parent | on HN ]

Re:Scikit-Learn Version 1.0 by mrtranscendence on Tuesday September 14, 2021 @09:52AM (#28524794)

I'm more a dplyr man myself, but data.table is much faster than pandas, most noticeably IMO when reading large files. It's also extremely succinct if you're into that sort of thing (though I find it a bit obfuscated). pandas is a lot of things, but "fast" and "concise" are not two of them.

[ Parent | on HN ]

Re:Scikit-Learn Version 1.0 by MichaelRazum on Tuesday September 14, 2021 @11:12AM (#28526066)

Got it. Regarding fast you have something like Vaex on python side (but not sure how fast it realy is). For me I had with pandas the most issues using it's multiindex.

[ Parent | on HN ]

Re:Scikit-Learn Version 1.0 by mrtranscendence on Tuesday September 14, 2021 @12:01PM (#28526770)

> For me I had with pandas the most issues using it's multiindex.

Yessss. I loathe indices, and have never been in a situation where I was better off with them than without them.

> Regarding fast you have something like Vaex on python sid

I've never used Vaex, but I've used datatable (https://github.com/h2oai/datatable) and polars (https://github.com/pola-rs/polars). Polars is my favorite API, but datatable was faster at reading data (Polars was faster in execution). I'll have to give Vaex a try at some point.

[ Parent | on HN ]

Re:Scikit-Learn Version 1.0 by civilized on Tuesday September 14, 2021 @12:25PM (#28527116)

Pandas is the PHP of data science. Pretty badly designed, but immensely popular because it got there first and had no real competition (in Python) for years.

[ Parent | on HN ]

Re:Scikit-Learn Version 1.0 by bllguo on Tuesday September 14, 2021 @03:11PM (#28529516)

I just love how much more terse and fast it is, someone else linked a benchmark below. There's definitely a learning curve though.

If you already think pandas is slow I think you'll be surprised how much more strongly you feel after using data.table!

[ Parent | on HN ]

Re:Scikit-Learn Version 1.0 by nojito on Tuesday September 14, 2021 @12:25PM (#28527126)

Data.table is Faster to write and faster to perform

https://h2oai.github.io/db-benchmark/

[ Parent | on HN ]