Re:Self-Hosting Open Source LLMs: Cross Devices and Local De...
by Kubuxu on Tuesday November 21, 2023 @09:05AM
(#38363731)
> you get true cross-platform support
wasi_nn is just an abstraction layers for wrappers around llama.cpp/gguf.cpp/onyx/others. It is not any more cross-platform than these libraries/apps deployed themselves, or rust apps using bindings for them.
wasi_nn is just an abstraction layers for wrappers around llama.cpp/gguf.cpp/onyx/others. It is not any more cross-platform than these libraries/apps deployed themselves, or rust apps using bindings for them.