News for hackers. Stuff that matters.
Re:Minimalism in programming language design by astrange on Tuesday May 24, 2022 @07:31AM (#31490667)
Hmm, every piece of web infrastructure I just thought of (every browser, nginx, FreeBSD, your HL language runtime, nghttp2, curl, SSL) is written in C.

Sure, you may not be touching those during your web development, but that’s because you don’t know how to have fun and outsourced it all.

Re:Minimalism in programming language design by weatherlite on Tuesday May 24, 2022 @07:48AM (#31490794)
web infrastructure is not the same as web development...infrastructure is what allows developers and users to build and use the apps. C does make sense for these things. Stuff like Curl I think is written in C more due to historical reasons (Unix is written in C so all of its apps are in C), I don't see any major con if it was written in Python (which is a big high level wrapper over C in the end...) - it would be a tad slower and a bit more memory yeah, but in todays world I don't know how much of a difference it makes.
Re:Minimalism in programming language design by _gabe_ on Tuesday May 24, 2022 @08:47AM (#31491288)
> I don't see any major con if it was written in Python

> it would be a tad slower

a tad? I'll use C++ as an example, but the last time I profiled a hash map in C++ vs C#, the C++ lookup took 1 nanosecond[0] and the C# version took 1ms (1000x slower) (I don't have these metrics anymore but I believe it was one ms or slower, and Google seems to confirm that).

Now, if the difference between C++, a machine compiled language, and C#, a runtime compiled language, is 1000x for a very common operation, how much slower will an interpreted language that is running at an even higher level be??

The reason 90% of our apps are such slow trash these days is because programmers think that there is no difference in a couple milliseconds when it is a huge difference if that couple milliseconds is being run thousands of times through hundreds of thousands of lines of code! Take a look at how fast the Jai compiler is compared to a modern C++ compiler. Or even a C compiler vs a C++ compiler. It's night and day because of how much cruft slowly gets added on.

So I find your claim that most of the Unix utilities are only written in C because that was mainstream in the day highly dubious. If anything, they would be written in something like Rust today, but definitely not JS or Python.

Edit: I would also like to point out how much of a pain it would be to write low level network code, like what's necessary in curl, in a language like Python. When you're writing low level net code you want as little interference between the bytes and the programming language. Because if your bytes have some hidden padding, or the endianess is swapped, or a data structure is aligned a byte off, it means the difference between between correct transfer over the net, and sending garbage over the net. Python is not conducive at all to understanding how an object will be transformed into q series of bytes, whereas C is almost a direct translation from a struct to a series of bytes.

[0]: https://gist.github.com/ambrosiogabe/66a6e2fdc77e6a600e570f4...

Re:Minimalism in programming language design by cpurdy on Tuesday May 24, 2022 @11:00AM (#31493008)
C# definitely does not take 1ms to look up something in a hash map. Perhaps 1us (microsecond) in a horrible example if the virtual hash code has a slow algorithm and doesn't cache the result.

Regardless, the benefit of not using C++ is and always has been: Not having to use C++.

Re:Minimalism in programming language design by _gabe_ on Tuesday May 24, 2022 @01:02PM (#31494688)
Yep you are correct, I was mis-remembering quite a bit. I just re-ran the tests using BenchmarkDotNet and C# takes 124 nanoseconds on average, which is still 100x slower and a considerable difference, but not orders of magnitude difference :)

C# benchmarks on my machine. FastFindRecipe just does a hash set lookup, it looks like this:

  private static readonly HashSet<CraftingRecipe> FastList = new HashSet<CraftingRecipe>(new CraftingComparer());
  public static CraftingRecipe? FastFind(CraftingRecipe r) => FastList.TryGetValue(r, out var res) ? res : null;

  |         Method |     Mean |   Error |  StdDev |      Min |      Max |
  |--------------- |---------:|--------:|--------:|---------:|---------:|
  |     FindRecipe | 315.2 ns | 1.17 ns | 1.09 ns | 313.6 ns | 317.4 ns |
  | FastFindRecipe | 124.5 ns | 0.23 ns | 0.21 ns | 124.1 ns | 124.9 ns |
Re:Minimalism in programming language design by avgcorrection on Tuesday May 24, 2022 @02:03PM (#31495437)
> , which is still 100x slower and a considerable difference, but not orders of magnitude difference :)

Two orders of magnitude.

Re:Minimalism in programming language design by weatherlite on Tuesday May 24, 2022 @08:58AM (#31491412)
I might be wrong about curl - I use it just as a tool to make http calls but it might be more complicated than that - but why can't you build curl with python's http libraries? I guess there are use cases where you have to manipulate responses on the byte level?
Re:Minimalism in programming language design by wing-_-nuts on Tuesday May 24, 2022 @11:43AM (#31493567)
I see this sort of argument for low level, system languages all the time. What you're not considering is that runtime isn't the constraint that we're hitting anymore, it's developer time. There's no doubt that a good python dev is much more productive than a good c dev, both in terms of raw output, and in terms of writing code with fewer bugs. 'Software is eating the world' is overused, but broadly true, and the reason we devs are so well paid is because the demand so vastly outstrips the supply of productive devs.
Re:Minimalism in programming language design by _gabe_ on Tuesday May 24, 2022 @12:41PM (#31494374)
My argument here is about developer time though. Python development for low level systems programs would be astronomically slower than using a language like C, C++ or Rust which are built for these things. Use the proper tool for the proper job.

If you have to have multiple structures that need to be precisely laid out in binary, python is the wrong tool for the job. Delivering content using Tcp or Udp packets requires very explicit binary definitions of the data your sending. Sure you can use a wrapper on top of a library that deals with the low level stuff, and that's what Python is all about.

Use the proper tools for the proper jobs. If you're using C to write one off scripts or simple data manipulation like analyzing csv contents or something, then you should probably use a higher level language instead. If though, like curl, you have to be very explicit about the binary description of objects to accurately send and receive those objects between a network, then use a low level language.

> runtime isn't the constraint that we're hitting anymore

If you're sending data over the network you're absolutely hitting this constraint. Reading some data from RAM is on the order of like nanoseconds, sending data over the network is on the order of hundreds of milliseconds depending on the size and location you're sending that data. When it comes to sending data over the network, literally every byte does matter.

Re:Minimalism in programming language design by wing-_-nuts on Tuesday May 24, 2022 @12:57PM (#31494594)
My point was more broad. We're not short on compute power in most cases, we're short on dev time. If you're talking low level microcontroller stuff, or bit banging, sure, do it in C if you like. In general though, I'd rather devs using a higher level language that gives them tools to deal with things like memory management and concurrency. The slowest code is the code that was never written, not the code that takes an extra 100ms because it was done in python instead of C.
Re:Minimalism in programming language design by _gabe_ on Tuesday May 24, 2022 @01:18PM (#31494890)
> I see this sort of argument for low level, system languages all the time.

It seems like you were advocating using a higher level language for low level, systems programs. If that's the case I disagree. My original argument was about Unix utilities. Unix utilities contain everything from "list the files in a directory" to "compile this C program". The original poster was talking about how Curl would probably be written in Python if it was written today. This is just incorrect. From the author of curl[0]:

>> If I would start the project today, would I’ve picked another language? Maybe. Maybe not. If memory safety and related issues was the primary concern I had, then sure. But as I’ve mentioned above there are several others concerns too so it would really depend on my priorities.

> If you're talking low level microcontroller stuff, or bit banging, sure, do it in C if you like.

This is the argument I'm making. Unix utilities are usually dealing with low level bit banging stuff. Unix utilities are also meant to be extremely portable. C is the glue that holds all programming languages together, whether we like that or not. So programming a library in C automatically ensures that the library can be used in practically any higher level language.

[0]: https://daniel.haxx.se/blog/2017/03/27/curl-is-c/

Re:Minimalism in programming language design by nayuki on Tuesday May 24, 2022 @09:39AM (#31491930)
> the C++ lookup took 1 nanosecond[0] and the C# version took 1ms (1000x slower)

The ratio between 1 ns and 1 ms is a million.

Re:Minimalism in programming language design by flohofwoe on Tuesday May 24, 2022 @09:47AM (#31492038)
The link talks about nano- vs micro-seconds, so probably just a typo.
Re:Minimalism in programming language design by _gabe_ on Tuesday May 24, 2022 @12:54PM (#31494558)
I just re-ran the benchmarks and I was mis-remembering those statistics quite a bit. It looks like C# takes 124.5 nanoseconds on average for a hash set lookup. This was benchmarked using BenchmarkDotNet :)