News for hackers. Stuff that matters.
Re:The rxv64 Operating System: MIT's xv6, in Rust, for SMP x... by phendrenad2 on Friday September 08, 2023 @09:46PM (#37441382)
Okay let's take your argument to the logical conclusion. If elegance is all that matters, let's write a kernel in Standard ML and run it on a virtual Turing machine. But even the v6 learning Unix targets 32-bit x86, which is NOT elegant in any way (love that bootstrap assembly that switches from 16-bit 8086 mode to 32-bit 386 mode, but it's not elegant).

What's missing from your theory is the ability to tinker. Nobody is going to try to improve upon an esoteric kernel that sacrifices all usability for theoretical purity. But a Rust kernel for x86-64 (which is not dying, BTW) is something students can run on real hardware, and that's cool and engaging in a way that is hard to put a value on.

Re:The rxv64 Operating System: MIT's xv6, in Rust, for SMP x... by kelas on Friday September 08, 2023 @10:33PM (#37441654)
> elegance matters

absolutely, but no need for strong violence. ANSI C and RISC-V are doing fine.

> x86-64 which is not dying

true. technically speaking, it is long gone - any Intel CPU since about Pentium Pro is actually a well-hidden RISC, because it is more efficient. Sure that requires a pretty beefy CISC decoder in front, but the sheer power of having a virtual 8086 mode next to amd64 must totally justify all that extra TDP.

> [x86 is] something students can run on real hardware, and that's cool and engaging

also true, but nothing compares to booting the real xv6 on a real RISC-V system for the first time, which is easy and fun (and cheap, if we’re talking value). i recommend.

Re:The rxv64 Operating System: MIT's xv6, in Rust, for SMP x... by nine_k on Friday September 08, 2023 @10:46PM (#37441725)
I'd say that C is not elegant as a language at all. It's a good (as in "working") solution of many problems that other system languages had in late 1960s, and I'd hazard to say that the highly economical ways that were used to solve them are elegant. E.g. using #include is terrible from many angles, but is elegant as a highly minimalist way to solve the modularity problem (reduce the problem to one already solved).
Re:The rxv64 Operating System: MIT's xv6, in Rust, for SMP x... by kelas on Saturday September 09, 2023 @02:39AM (#37442834)
> C is not elegant

okay, tastes differ, but it remains what it was in one of its original definitions: a sufficiently portable assembly.

> #include hell / modularity

okay, so rust has cargo, so we’re all better now, right? but what if someone will dare to argue that C has a whole bunch of cargos, some less terrible than others, if we reframe the problem like so:

$ [rpm|dpkg|dnf|yum|apt|brew|pkg-add] install libcurl libcurl-dev(el)

(this makes me wonder how any software even works anymore in absence of universal cargo cult, but hey)

Re:The rxv64 Operating System: MIT's xv6, in Rust, for SMP x... by viraptor on Saturday September 09, 2023 @04:47AM (#37443420)
Different things entirely. System-specific packages have no concept of C building or linking. Things work because of some agreement about paths + pkgconfig + others. This is very far from the idea of a dependency manager like cargo which is very much aware of project-specific and language features.
Re:The rxv64 Operating System: MIT's xv6, in Rust, for SMP x... by kelas on Saturday September 09, 2023 @02:51PM (#37448983)
> Different things entirely

yes, they are.

> System-specific packages have no concept of C building or linking.

every day i learn something new, but this time around I’m gonna go ahead a tell you that you are very mistaken.

> Things work because of some agreement about paths + pkgconfig + others.

True. By convention, we call it “convention”, or “standard” for short, e.g. POSIX or ISO C. Call us back once you have something like that in rustland.

> This is very far from the idea of a dependency manager like cargo which is very much aware of project-specific and language features.

All good and sound, and makes total sense for userland software. But what is being discussed here is an operating system and core userland. If you can imagine that to be your “project”, such as linux or OpenBSD, maybe my tongue-in-cheek comparison of a system-wide dependency manager suddenly looks less dissimilar to cargo.

needless to say, things like Linux and OpenBSD will stay written in C for a little while longer. In case of BSD specifically, you can go as crazy as to bump and rebuild your entire system from source in place, kernel and userland. BSD is one pretty old cargo cult in that sense, and pretty cool, i might add.

> language features

right… rust 2018 edition is not really rust as of 2023, or is it? This where those pesky standards come very handy.

Re:The rxv64 Operating System: MIT's xv6, in Rust, for SMP x... by viraptor on Saturday September 09, 2023 @06:13PM (#37450811)
> tell you that you are very mistaken.

Go on then. Beyond RPMs ability to depend on soname, what else is there on the structure/installation/usage side (not on the building side which can include whatever scripts you want). Where are they now aware of the libraries more than tar.gz is?

Re:The rxv64 Operating System: MIT's xv6, in Rust, for SMP x... by kelas on Saturday September 09, 2023 @07:20PM (#37451270)
I think I see your point. Thing is, a C program can be built and executed without that cargo dependency pyramid sandwiched into a gigantic runtime polyp. The whole operating system is your environment, and yes - if ‘man ldconfig’ is not your friend, then maybe pkg-config is, or, worse to worst, link against project-local structure, where you can indeed build the bejesus out of your imagination and ship it. That’s ok. It’s linux, after all.

That’s what we do for embedded systems, anyway. I haven’t seen much success for rust in this department, although people are clearly trying to make it work. It just keeps coming out fat and ugly. A few more decades of hard push, call me a maybe.

Do you know what riscv version of xv6 rev3 compiles to in terms of object size?

I will not spoil it for you, but it compiles to total shreds.

Re:The rxv64 Operating System: MIT's xv6, in Rust, for SMP x... by lproven on Saturday September 09, 2023 @08:19AM (#37444472)
> a sufficiently portable assembly.

No, it isn't, and it hasn't been for about 40 years.

« C Is Not a Low-level Language Your computer is not a fast PDP-11. »

https://queue.acm.org/detail.cfm?id=3212479

David Chisnall, ACM Queue, April 30, 2018

Re:The rxv64 Operating System: MIT's xv6, in Rust, for SMP x... by kelas on Saturday September 09, 2023 @02:30PM (#37448658)
Sounds expensive, thanks. So:

Preface to the Digital Edition of Kernighan and Ritchie's The C Programming Language Oct 31, 2012

“… Remarkably, in spite of all of this change, C retains a central position. It is still the core language for operating system implementation and tool building. It remains unequaled for portability, efficiency, and ability to get close to the hardware when necessary. C has sometimes been called a high-level assembler, and this is not a bad characterization of how well it spans the range from intricate data structure and control flow to the lowest level of external devices.”

(sorry, I messed up the lyrics a bit, but also I didn’t, really)

Also, my computer is a fast Turing machine. And so is yours.

Re:The rxv64 Operating System: MIT's xv6, in Rust, for SMP x... by lproven on Saturday September 09, 2023 @05:56PM (#37450697)
I can't make any sense of a single sentence of that.

> Sounds expensive, thanks

Huh? What does? The paper is entirely free. That's why I posted a link. Go read it. It's not very long, it's interesting, it's accessible, it's provocative and insightful and profound.

> Kernighan and Ritchie

Creator of C is biased about the language he created. Shock. Pictures at 11.

K&R was published in 1988. Then, your PC was to some degree a fast PDP-11. That was over 1/3 of a century ago and it is no longer even remotely true.

> Also, my computer is a fast Turing machine. And so is yours.

Reductio ad absurdam.

Here's a talk from the inventor of the Arm architecture. It's pretty good.

https://www.youtube.com/watch?v=6lOnpQgn-9s

She talks about her more recent baby, Firepath.

It can, for instance, in a single opcode and a single CPU cycle load 4 separate different 32 bit integers, multiply them by 4 other 32-bit ints and store the result.

(Around 25 min in but it's very worth watching the whole talk.)

Her point is that C can't express stuff like this well at all.

A modern CPU has dozens of execution units doing stuff in parallel, applying matrix operations and transformations to multiple different streams of data simultaneously: SIMD and MIMD combined. C has no way of even beginning to express any of this.

C is no more a high-level assembly language for any 21st century CPU than a Falcon-9 reusable orbital launch vehicle is a space-going version of the Wright Flyer.

Re:The rxv64 Operating System: MIT's xv6, in Rust, for SMP x... by kelas on Saturday September 09, 2023 @06:43PM (#37451047)
> The paper is entirely free. That's why I posted a link. Go read it. It's not very long, it's interesting, it's accessible, it's provocative and insightful and profound…

…and I already read it and you already have my reflections on this piece of work :)

> …SIMD and MIMD combined. C has no way of even beginning to express any of this.

Man, no hard feelings, but I suggest you start with K&R refresher and then work your way up to modern C. It is remarkably easy to learn, you’ll come around. What you deem impossible is very possible. Once you’re comfortable with basic C, I recommend cloning the repo of Lemire’s blog.

Just to see what’s available.

Re:The rxv64 Operating System: MIT's xv6, in Rust, for SMP x... by kelas on Saturday September 09, 2023 @06:16PM (#37450826)
> No, [C is not a high-level assembler], and it hasn't been for about 40 years. «C Is Not a Low-level Language Your computer is not a fast PDP-11.» some dude in ACM Queue

Please correct me if I’m wrong, but this ACM rant seems to amount to blaming C language for the most disastrous embarrassment in the history of Intel Corp, i.e. spectre/meltdown. Well, thank you very much, but that’s just deranged thinking, or someone was on INTL payroll in 2018.

but wow, thank you, what a gem. he then proceeds to elucidate how C is broken and again not low-level enough, because his 1337 skills require knowing the cache line size. well, this is absolutely true, captain Chisnall. but what is complete and utter nonsense is the conclusion that C is retarded by not letting the programmer manipulate the cache directly:

“The cache is, as its name implies, hidden from the programmer and so is not visible to C. Efficient use of the cache is one of the most important ways of making code run quickly on a modern processor, yet this is completely hidden by the abstract machine, and programmers must rely on knowing implementation details of the cache (for example, two values that are 64-byte-aligned may end up in the same cache line) to write efficient code.“

This deserves a WAT.

Re:The rxv64 Operating System: MIT's xv6, in Rust, for SMP x... by lproven on Monday September 11, 2023 @06:17AM (#37465147)
It seems to me that you take a fundamentalist view on this: anything which attempts to point out the problems, inadequacies, or failings of C and possibly of xNix in general is heresy, to be mocked rather than addressed.

I have often encountered this attitude in real life from fundie/evangelical christians, but in the tech world, it's also a thing among a certain hardcore xNix enthusiast.

I feel that I have encountered one here, and you are not willing or not able to engage in discussion. You merely want to proselytise at me.

I am not interested in that, so I won't comment further.

For me, as an xNix user for some 35Y and a full-time writer about xNix for a decade or more, it's just one of many interesting, significant or valuable OS ideas, and C is a rather poor and deeply flawed language which is a vastly expensive handicap on the computer industry.

Re:The rxv64 Operating System: MIT's xv6, in Rust, for SMP x... by phendrenad2 on Friday September 08, 2023 @11:06PM (#37441858)
> nothing compares to booting the real xv6 on a real RISC-V system for the first time

Why is that?

> any Intel CPU since about Pentium Pro is actually a well-hidden RISC

Well if it's well-hidden, it doesn't matter to the person learning to write an OS. ;)

Re:The rxv64 Operating System: MIT's xv6, in Rust, for SMP x... by kelas on Saturday September 09, 2023 @12:15AM (#37442232)
> Why is that?

you said it best - the “tinkering” part is a small thing that makes all the difference when one is first led up to a computer.

> if it's hidden, it doesn't matter

right… and if you ignore it, maybe it’ll go away, i guess. like Intel Management Engine, perhaps. Which OS does it run, if you know? :)

Re:The rxv64 Operating System: MIT's xv6, in Rust, for SMP x... by phendrenad2 on Saturday September 09, 2023 @12:20PM (#37447067)
> the “tinkering” part is a small thing that makes all the difference when one is first led up to a computer

True, but when making an OS, assembly code is an incredibly small part of it. You basically need to run a few instructions to put the processor in the right mode, and you need ONE line of assembly code (often inline C) to allow usermode to call supervisor mode. When choosing an architecture for a learning OS, I think other factors would dominate, like availability of hardware (many people have a PC already, saving them $100-$200 on RISC-V hardware).

> right… and if you ignore it, maybe it’ll go away. like Intel Management Engine, perhaps. Which OS does it run, if you know? :)

I'm not interested in gatekeeping tech to only those who care about personal privacy, so I consider this line of thought completely irrelevant to the discussion. But that's just me...

Re:The rxv64 Operating System: MIT's xv6, in Rust, for SMP x... by kelas on Saturday September 09, 2023 @03:14PM (#37449241)
> True, but when making an OS, assembly code is an incredibly small part of it.

A few comments up this thread i briefly mentioned r/xv6 entry.S, so here’s what i meant:

rv64:

https://github.com/mit-pdos/xv6-riscv/blob/riscv/kernel/entr...

amd64:

https://github.com/dancrossnyc/rxv64/blob/main/kernel/src/en...

> You basically need to run a few instructions to put the processor in the right mode, and you need ONE line of assembly code (often inline C) to allow usermode to call supervisor mode.

Right… Please see above. Also, in riscv land we have machine, supervisor and user modes, with hypervisor mode being in the works.

> When choosing an architecture for a learning OS, I think other factors would dominate, like availability of hardware (many people have a PC already, saving them $100-$200 on RISC-V hardware).

yet, MIT PDOS thinks Fabrice Bellard’s ubiquitous qemu is a better, cheaper and more forgiving starting point, although i personally prefer to spend a few bucks on something as absurdly cheap and cool as kendryte k210/k510 SoC and enjoy the real deal.

> Intel hate keeping tech is irrelevant [I don’t care]

Yes, it’s just you. Also, it runs Minix.

Re:The rxv64 Operating System: MIT's xv6, in Rust, for SMP x... by phendrenad2 on Sunday September 10, 2023 @02:09PM (#37458400)
Cool links and all, but can you express in words how the invalidate my point? And do you actually know how RISC-V machine/supervisor/user/hypervisor modes work? I assure you, it's just a few instructions to switch between them, so my point still stands, unless I'm wrong about that, which I am not. So let's move on.

> qemu

A poor substitute for running on real hardware, from a psychological perspective. Just look at how people nerd out on HN about porting Doom to a smartwatch. People like to run things on hardware: fact. PCs are more ubiquitous than RISC-V boards which you have to order online: fact.

> Intel hate keeping tech is irrelevant [I don’t care]

I didn't get it, can you explain?

> Also, it runs Minix

Everyone knows this already, it makes the front page of HN at least once per year.

Re:The rxv64 Operating System: MIT's xv6, in Rust, for SMP x... by astrange on Friday September 08, 2023 @11:42PM (#37442062)
> true. technically speaking, it is long gone - any Intel CPU since about Pentium Pro is actually a well-hidden RISC, because it is more efficient. Sure that requires a pretty beefy CISC decoder in front, but the sheer power of having a virtual 8086 mode next to amd64 must totally justify all that extra TDP.

It is not, the µcode on an x86 is still often "CISCy" and rightfully so - a complicated instruction like "lea" is still perfectly suited to hardware.

Re:The rxv64 Operating System: MIT's xv6, in Rust, for SMP x... by adgjlsfhk1 on Saturday September 09, 2023 @12:04AM (#37442186)
this is true, but modern RISC cpus are also pretty CISCy now. The risc-V vector extension has an vfwmacc.vf which is a broadcasted vectorized widening fused multiply accumulate instruction.