News for hackers. Stuff that matters.

A comment on Exo: Run your own AI cluster at home with everyday devices ⌚. Parent comment

Re:Exo: Run your own AI cluster at home with everyday devices ⌚ by alexandercheema on Tuesday July 16, 2024 @01:23PM (#40978436)
It *should* but I haven't tried it. I will try it. Updated in this issue:

We could also try raspberry pi + coral usb tpu (https://coral.ai/products/) - that might be a killer combo for super cheap home ai cluster.

[ Parent | on HN ]
Re:Exo: Run your own AI cluster at home with everyday devices ⌚ by alexandercheema on Tuesday July 16, 2024 @01:23PM (#40978439)
Issue link: https://github.com/exo-explore/exo/issues/11
[ Parent | on HN ]
Re:Exo: Run your own AI cluster at home with everyday devices ⌚ by yjftsjthsd-h on Wednesday July 17, 2024 @12:56AM (#40982689)
> coral usb tpu

I thought those were so memory limited that there was no useful way to run an LLM on them?

[ Parent | on HN ]