News for hackers. Stuff that matters.
Re:Python is not a great language for data science. Part 1: ... by npalli on Tuesday November 25, 2025 @05:26PM (#46051567)
Python is nothing without it’s batteries.
Re:Python is not a great language for data science. Part 1: ... by jskherman on Tuesday November 25, 2025 @05:31PM (#46051624)
Python is its batteries.
Re:Python is not a great language for data science. Part 1: ... by iLemming on Wednesday November 26, 2025 @03:58PM (#46062244)
But why whenever I try to use it, it tries to hurt me like it's kicking me right in my batteries?
Re:Python is not a great language for data science. Part 1: ... by 1vuio0pswjnm7 on Tuesday November 25, 2025 @06:23PM (#46052056)
What language is used to write the batteries
Re:Python is not a great language for data science. Part 1: ... by logicprog on Tuesday November 25, 2025 @06:28PM (#46052105)
C/C++, in large part
Re:Python is not a great language for data science. Part 1: ... by saboot on Tuesday November 25, 2025 @06:31PM (#46052134)
And below that, FORTRAN :)
Re:Python is not a great language for data science. Part 1: ... by JPKab on Tuesday November 25, 2025 @11:24PM (#46054190)
These days it's a whole lot of Rust.
Re:Python is not a great language for data science. Part 1: ... by volemo on Wednesday November 26, 2025 @12:46AM (#46054520)
These days it’s still a whole lot of Fortran, with some Rust sprinkled on top. (:
Re:Python is not a great language for data science. Part 1: ... by pjmlp on Wednesday November 26, 2025 @03:52AM (#46055510)
Which since Fortran 2003, or even Fortran 95, has gotten rather nice to use.
Re:Python is not a great language for data science. Part 1: ... by Koshkin on Wednesday November 26, 2025 @10:49AM (#46058607)
IDK it's become too verbose IMHO, looks almost like COBOL now. (I think it was Fortran 66 that was the last Fortran true to its nature as a "Formula Translator"...)
Re:Python is not a great language for data science. Part 1: ... by pjmlp on Wednesday November 26, 2025 @11:02AM (#46058754)
We are way beyond comparing languages to COBOL, now that plenty folks type whole book sized descriptions into tiny chat windows for their AI overloads.
Re:Python is not a great language for data science. Part 1: ... by pphysch on Tuesday November 25, 2025 @06:12PM (#46051967)
The design and success of e.g. Golang is pretty strong support for the idea that you can't and shouldn't separate a language from its broader ecosystem of tooling and packages.
Re:Python is not a great language for data science. Part 1: ... by LtWorf on Tuesday November 25, 2025 @06:28PM (#46052099)
The success of python is due to not needing a broader ecosystem for A LOT of things.

They are of course now abandoning this idea.

Re:Python is not a great language for data science. Part 1: ... by lmm on Tuesday November 25, 2025 @09:13PM (#46053434)
> The success of python is due to not needing a broader ecosystem for A LOT of things.

I honestly think that was a coincidence. Perl and Ruby had other disadvantages, Python won despite having bad package management and a bloated standard library, not because of it.

Re:Python is not a great language for data science. Part 1: ... by rjzzleep on Wednesday November 26, 2025 @01:48AM (#46054812)
It's because Ruby captured the web market and Python everything else, and I get everything is more timeless than a single segment.
Re:Python is not a great language for data science. Part 1: ... by vkazanov on Wednesday November 26, 2025 @04:58AM (#46055898)
Ruby was competing on the web market and lost to many others, including Python. In part, because python had a much broader ecosystem, and php had wide adoption through wordpress and others, and javascript was expanding from browsers.
Re:Python is not a great language for data science. Part 1: ... by procaryote on Wednesday November 26, 2025 @02:28AM (#46055017)
The bloated standard library is the only reason I kept using python in spite of the packaging nightmare. I can do most things with no dependencies, or with one dependency I need over and over like matplotlib

If python had been lean and needed packages to do anything useful, while still having a packaging nightmare, it would have been unusable

Re:Python is not a great language for data science. Part 1: ... by lmm on Wednesday November 26, 2025 @03:32AM (#46055383)
Well, sure, but equally I think there would have been a lot more effort to fix the packaging nightmare if it had been more urgent.
Re:Python is not a great language for data science. Part 1: ... by ModernMech on Wednesday November 26, 2025 @11:13AM (#46058916)
There was a massive effort though, the proliferation of several different package managers is evidence of that.
Re:Python is not a great language for data science. Part 1: ... by lmm on Wednesday November 26, 2025 @08:42PM (#46064512)
Maybe. A lot of them felt like one-person projects that not many people cared about. I think that on the contrary, part of the reason so many different package managers could coexist with no clear winner emerging was that the problem wasn't very serious for a lot of the community.
Re:Python is not a great language for data science. Part 1: ... by LtWorf on Wednesday November 26, 2025 @04:12AM (#46055637)
The bloated standard library is the reason why you can send around a single .py file to others and they can execute it instantly.

Most of the python users are not able nor aware of venv, uv, pip and all of that.

Re:Python is not a great language for data science. Part 1: ... by throwaway2037 on Tuesday November 25, 2025 @07:21PM (#46052593)
I hear this so much from Python people -- almost like they are paid by the word to say it. Is it different from Perl, Ruby, Java, or C# (DotNet)? Not in my experience, except people from those communities don't repeat that phrase so much.

The irony here: We are talking about data science. 98% of "data science" Python projects start by creating a virtual env and adding Pandas and NumPy which have numerous (really: squillions of) dependencies outside the foundation library.

Re:Python is not a great language for data science. Part 1: ... by m55au on Tuesday November 25, 2025 @07:55PM (#46052832)
Someone correct me if I'm completely wrong, but by default (i.e. precompiled wheels) numpy has 0 dependencies and pandas has 5, one of which is numpy. So not really "squillions" of dependencies.

pandas==2.3.3

├── numpy [required: >=1.22.4, installed: 2.2.6]

├── python-dateutil [required: >=2.8.2, installed: 2.9.0.post0]

│ └── six [required: >=1.5, installed: 1.17.0]

├── pytz [required: >=2020.1, installed: 2025.2]

└── tzdata [required: >=2022.7, installed: 2025.2]

Re:Python is not a great language for data science. Part 1: ... by noitpmeder on Wednesday November 26, 2025 @12:40AM (#46054498)
I don't know about _squillions_, but numpy definitely has _requirements_, even if they're not represented as such in the python graph.

e.g.

  https://github.com/numpy/numpy/blob/main/.gitmodules (some source code requirements)
  https://github.com/numpy/numpy/tree/main/requirements (mostly build/ci/... requirements)
  ...
Re:Python is not a great language for data science. Part 1: ... by m55au on Wednesday November 26, 2025 @01:02AM (#46054589)
They're not represented, because those are build-time dependencies. Most users when they do pip install numpy or equivalent, just get the precompiled binaries and none of those get installed. And even if you compile it yourself, you still don't need those for running numpy.
Re:Python is not a great language for data science. Part 1: ... by nonameiguess on Wednesday November 26, 2025 @05:41AM (#46056091)
Read https://numpy.org/devdocs/building/blas_lapack.html.

NumPy will fall back to internal and very slow BLAS and LAPACK implementations if your system does not have a better one, but assuming you're using NumPy for its performance and not just the convenience of adding array programming features to Python, you're really gonna want better ones, and what that is heavily depends on the computer you're using.

This isn't really a Python thing, though. It's a hard problem to solve with any kind of scientific computing. If you insist on using a dynamic interpreted language, which you probably have to do for exploratory interactive analysis, and you still need speed over large datasets, you're gonna need to have a native FFI and link against native libraries. Thanks to standardization, you'll have many choices and which is fastest depends heavily on your hardware setup.

Re:Python is not a great language for data science. Part 1: ... by aragilar on Wednesday November 26, 2025 @07:58AM (#46056957)
The wheels will most likely come with openblas, so while you can get the original blas (which is really only slow by comparison, for small tasks it's likely users won't notice), this is generally not an issue.