Re:Oracle built a 1,060 node Raspberry Pi cluster
by _bxg1 on Thursday November 21, 2019 @03:08PM
(#21598940)
I wonder what the cost-effectiveness is in terms of compute power. I'd assume not great, but who knows? Raspberry PIs pack a lot of punch for their size and price.
[ Parent
| on HN ]
Re:Oracle built a 1,060 node Raspberry Pi cluster
by asdfasgasdgasdg on Thursday November 21, 2019 @03:32PM
(#21599260)
When it comes to cluster-scale computing, size is not the main issue. The main issues are: compute/$ and compute/watt.
There is also the matter of how much RAM and disk can be attached to each board, and the speed of the NIC. Gigabit ethernet is a little slow these days.
Re:Oracle built a 1,060 node Raspberry Pi cluster
by willis936 on Thursday November 21, 2019 @04:04PM
(#21599602)
GbE is slow, yes, but GbE for the amount of compute a raspi 4 can do is massive. Raspis don’t even have the oomph to max out GbE links. You hook 48 raspi 4 into a switch and using a 25 GbE link to a storage cluster.
Edit: It is conceivable that a raspi has the oomph to max out a GbE link but is limited to 300 Mbps due to the use of a USB 2.0 bridge in between the ethernet interface and the SoC. My mistake.
Re:Oracle built a 1,060 node Raspberry Pi cluster
by esotericn on Friday November 22, 2019 @05:30AM
(#21604411)
The RPi4 is capable of gigabit. I benchmarked mine at 900-950mbit via iperf yesterday. That was to a usb3 gigabit ethernet adapter on a laptop.
Re:Oracle built a 1,060 node Raspberry Pi cluster
by willis936 on Friday November 22, 2019 @07:31AM
(#21604958)
Ah thanks. My previous post is dated knowledge, applicable only to the raspi 3.
Re:Oracle built a 1,060 node Raspberry Pi cluster
by jandrese on Thursday November 21, 2019 @03:21PM
(#21599087)
If they can leverage the GPU on the Pis it could be quite a bit of compute power spread across that array. Even if they're purely CPU bound that is 4240 cores which is not nothing.
Power wise each Pi going flat out burns around 5W, so all told you're burning ~6kW, which is quite modest for a big computing setup.
Re:Oracle built a 1,060 node Raspberry Pi cluster
by willis936 on Thursday November 21, 2019 @04:16PM
(#21599708)
It looks like you can get 400 single precision MFLOPS for those 5W. So 80 MFLOPS/W +/- 20%. It isn’t the worst and it isn’t the best, but it is respectable. It would be a big hassle to make and maintain a cluster of thousands of these.
https://www.arnabkumardas.com/platforms/nvidia/nvidia-jetson...
https://raspi.tv/2019/how-much-power-does-the-pi4b-use-power...
Re:Oracle built a 1,060 node Raspberry Pi cluster
by willis936 on Friday November 22, 2019 @03:18PM
(#21609614)
Oh jeez. Out of curiosity I did a comparison against a gaming GPU. A GTX 1080 uses 200W of power for 9 TFLOPS, which is roughly 500x better performance per watt than a raspberry pi. Outside of the fun of it, and maybe a cheap way to prototype larger systems, I can't see a serious reason to make a raspi cluster.
Re:Oracle built a 1,060 node Raspberry Pi cluster
by ramses0 on Thursday November 21, 2019 @05:52PM
(#21600637)
...but you could experiment with "disposable computing" (ie: similar to original google datacenter racks: never replace a node, only replace a rack at a time if 51% is failing).