News for hackers. Stuff that matters.
Re:Open Source AI Is the Path Forward by jcheng on Tuesday July 23, 2024 @09:49PM (#41052917)
A lot of libraries seem to be working on Apple Silicon GPUs but not on ANE. I found this discussion interesting, seems like the ANE has a lot of limitations, is not well documented, and can only be used indirectly through Core ML. https://github.com/ggerganov/llama.cpp/discussions/336

There are no comments on this comment yet.