News for hackers. Stuff that matters.
Re:Go's Sweet 16 by Denzel on Friday November 14, 2025 @10:52PM (#45934922)
Did you try scipy/numpy or any python library with a compiled implementation before picking up Go?
Re:Go's Sweet 16 by synthetic-echo on Friday November 14, 2025 @11:44PM (#45935103)
Of course, but the dataset was mostly strings that needed to be cross-referenced with GIS data. Tried every library under the sun. The greatest speed up I got was using polars to process the mostly-string CSVs, but didn't help much. With that said, I think polars was also just released when we were working with that dataset and I'm sure there's been a lot of performance improvements since then.
Re:Go's Sweet 16 by rcxdude on Sunday November 16, 2025 @11:31AM (#45946321)
These only help if you can move the hot loop into some compiled code in those libraries. There's a lot of cases where this isn't possible and at that point there's just no way to make python fast (basically, as soon as you have a for loop in python that runs over every point in your dataset, you've lost).