News for hackers. Stuff that matters.
Re:Exo: Run your own AI cluster at home with everyday devices ⌚ by ajnin on Tuesday July 16, 2024 @07:19AM (#40975469)
It requires mlx but it is an Apple silicon-only library as far as I can tell. How is it supposed to be (I quote) "iPhone, iPad, Android, Mac, Linux, pretty much any device" ? Has it been tested on anything else than the author's MacBook ?
Re:Exo: Run your own AI cluster at home with everyday devices ⌚ by orsorna on Tuesday July 16, 2024 @09:56AM (#40976660)
One of the maintainers has a video demo on his twitter claiming iOS, android and Linux. Some of the code is not released and I wish they were advertising that properly.
Re:Exo: Run your own AI cluster at home with everyday devices ⌚ by tama_sala on Wednesday July 17, 2024 @06:05AM (#40984200)
The library already has tinygrad support it seems, so it's not limited to Apple & MLX
Re:Exo: Run your own AI cluster at home with everyday devices ⌚ by orsorna on Wednesday July 17, 2024 @11:41AM (#40987078)
That is true. However (as of two days ago, it may have rapidly changed since then) the python program did not differentiate based on your architecture and would try to import mlx regardless if it's installable on your system or not, causing import errors.
Re:Exo: Run your own AI cluster at home with everyday devices ⌚ by alexandercheema on Wednesday July 17, 2024 @02:36PM (#40988909)
This is fixed now, with these commits: - https://github.com/exo-explore/exo/commit/dbbc7be57fb1871d2b... - https://github.com/exo-explore/exo/commit/ce46f000591d8d59c1...

Please keep the bug reports coming, we're moving fast to get this stable on all platforms.

Re:Exo: Run your own AI cluster at home with everyday devices ⌚ by lopuhin on Tuesday July 16, 2024 @12:07PM (#40977818)
The README says they plan to add llama.cpp support which should cover a lot of targets, also they have tinygrad already integrated I think.
Re:Exo: Run your own AI cluster at home with everyday devices ⌚ by alexandercheema on Tuesday July 16, 2024 @06:59PM (#40981110)
Repo maintainer here. It supports any device tinygrad does, which is a lot. We didn’t expect it to blow up so soon - the repo is still experimental. Internally we’ve mostly been testing on MacBooks and Mac Minis, and that’s where dev is happening. The swift implementation is outdated and currently broken, since Python has been changing so fast (over 20 commits in the last day). On my ToDo is CI/CD pipeline with integration tests for different device and network configurations, so we don’t randomly break stuff for certain devices.

We’re moving fast to get it stable and usable. The goal is for this to be as simple as running Dropbox. Bear with us :)

Re:Exo: Run your own AI cluster at home with everyday devices ⌚ by mikeqq2024 on Friday July 26, 2024 @03:15AM (#41076500)
why there is no intel cpu/gpu support? it seems intel cpu/gpu is dead in AI community.