News for hackers. Stuff that matters.
Re:96-core ARM supercomputer using the NanoPi-Fire3 by skissane on Thursday November 08, 2018 @09:28PM (#18411947)
> No. Containers on a single node are too fast.

You can add artificial delay to your local container network to better simulate a production environment.

For example using https://github.com/alexei-led/pumba and "pumba netem delay" you can add networking delay between Docker containers, and "pumba netem rate" can limit the bandwidth between them as well.

("pumba" is just using the underlying Linux networking traffic control technologies, such as the "tc" command from "iproute2", so you don't have to use "pumba", you can set this up manually, but a tool like "pumba" makes it a lot easier.)

Re:96-core ARM supercomputer using the NanoPi-Fire3 by dragontamer on Friday November 09, 2018 @09:23AM (#18414520)
I've used netem to emulate millisecond delays before. But I'm not sure if it has the granularity to emulate micro-second level delays.

Basically, netem is designed to provide milliseconds of delay, emulating a worldwide network. Supercomputers are thousands of times faster than that. I'd have to play with netem before I was certain that it could handle a sub ~10uS delay that supercomputers have node-to-node.

Considering that Linux task-switching is on the order of ~10mS or so, I have severe doubts that uS level delays will work with netem.

The NanoPi-Fire3 uses normal Gigabit Ethernet, which probably has latencies in the ~50uS region. Which is slower than a real supercomputer, but "proportionally" should be representative of supercomputers (since the tiny embedded ARM chips are around 50x slower than a real supercomputer node anyway).

A bunch of Rasp Pis on Gigabit Ethernet seems like a better overall "cheap supercomputer" architecture, for students of supercomputing. Better than containers or software-emulated network delays

Re:96-core ARM supercomputer using the NanoPi-Fire3 by geezerjay on Friday November 09, 2018 @03:45AM (#18413144)
Thank you for mentioning pumba. Sounds very interesting.