Re:96-core ARM supercomputer using the NanoPi-Fire3
by laumars on Friday November 09, 2018 @07:03AM
(#18413843)
> Had to read your answer twice... "High latency???" But I see you consider 1-2us high latency. :P
Relative to accessing the hardware resources on a host, it very much is. Just as accessing the RAM is slow relative to accessing the L2 cache on a CPU
It is an interesting question what people who don't have access to a supercomputer, but would like to learn and optimize for HPC-style distributed memory programming should use.
I've found AWS to be pretty nice, except there are no RDMA drivers for the elastic NIC and the BW is a bit low. (25Gbit vs. 100Gbit). For MPI bulk synchronous programs, it's probably a pretty close model, though.