News for hackers. Stuff that matters.
Re:Self-Hosting Open Source LLMs: Cross Devices and Local De... by Kubuxu on Tuesday November 21, 2023 @09:05AM (#38363731)
> you get true cross-platform support

wasi_nn is just an abstraction layers for wrappers around llama.cpp/gguf.cpp/onyx/others. It is not any more cross-platform than these libraries/apps deployed themselves, or rust apps using bindings for them.

There are no comments on this comment yet.