News for hackers. Stuff that matters.
Re:Thread-per-core by ori_b on Friday October 06, 2023 @10:33AM (#37791318)
> I like the thread per core design because kernel context switches are expensive

You can do a millions to tens of millions syscalls per second per core. They're on the same order of magnitude as a single digit number of full cache misses.

So, expensive, but a lot less expensive than many people assume.

Re:Thread-per-core by cmrdporcupine on Friday October 06, 2023 @10:50AM (#37791543)
And all our assumptions get blown up with every new hardware generation, too.

Hardware engineers are building systems for the applications of today. And the kernel developers are optimizing as well. It's all a moving target.

Dogma has no place here.

Re:Thread-per-core by kldx on Friday October 06, 2023 @10:51AM (#37791563)
That's an interesting view and one I agree with. Surely if context switch = expensive is common knowledge for a long time in computing, the kernel people and CPU companies would have tried optimizing it to the fullest, no?
Re:Thread-per-core by insanitybit on Friday October 06, 2023 @10:54AM (#37791596)
Syscalls have gotten quite a lot slower after Specter/Meltdown mitigations. Though I suspect that if you're writing a web service that wants TPC you should just disable these - I've told that to Scylla Cloud before, they have no reason to keep them enabled and plenty of reasons to disable them.

The other thing is 'io_uring', which is trying to come at the problem by removing context switching altogether by providing a cheap primitive for communicating with the kernel.

Re:Thread-per-core by kldx on Saturday October 07, 2023 @01:32PM (#37803684)
Sadly io_uring has its share of vulnerabilities as well
Re:Thread-per-core by insanitybit on Saturday October 07, 2023 @03:22PM (#37804676)
Of course, I'm very aware of that fact. But it is designed to minimize system calls exactly because they can add significant overhead.
Re:Thread-per-core by amluto on Friday October 06, 2023 @11:06AM (#37791766)
You’re replying to a comment about context switches, not syscalls. Linux on x86 cannot do tens of millions of context switches per second per core. (I expect that, at high clock speed, carefully tuned, under ideal and possibly unrealistic conditions, you might get 2M/s — it’s been a while since I benchmarked this.)

But this is silly — shared nothing will have no substantial difference in the rate of context switches (or of syscalls) compared to a thread-per-core-shared-everything architecture. The architecture that actually loses is many-threads-per-core if it ends up in a small-batch mode in which it context switches once per request or so.

Re:Thread-per-core by TexasMick on Friday October 06, 2023 @04:58PM (#37796344)
I have seen context switches be a killer in some embedded contexts. Especially on FPGA soft core applications where you often are dealing with heavy I/O, if you just naively spin up threads for I/O then you will suffer heavily.