I'm developing ggmlc, an ML compiler that automatically lowers any PyTorch/JAX/Flax/Keras model to high level GGML execution. Using that, I compiled laya to GGUF and developed a single executable. Laya is an open-source Jev-alternative system-1 model. The executable binary can be used for one-shot launch from the command line, with JSON-formatted lines over stdin/stdout communication (for agents and programmatic integrations), and through an http API. It also comes with a built-in web UI.

You can learn more and download the pre-built executables from the ggmlc repo and download the GGUF files on HF: I read a request for Jev-compatible endpoint, /v1/sysstemone, and I'll include it in the next release. If you have any other requests and/or feedback, please feel free to reach out to me in ggmlc issues.