News for hackers. Stuff that matters.
Re:Microsoft's ONNX Runtime has disappeared from GitHub by UncleOxidant on Tuesday November 17, 2026 @08:12PM (#50540605)
Aren't there other ONNX runtimes out there? A quick google search shows a few written in Rust: Tract, RTen, WONNX, Burn&Candle. Also, IIRC there's a Julia-based one as well.
Re:Microsoft's ONNX Runtime has disappeared from GitHub by antimora on Tuesday November 17, 2026 @08:20PM (#50540653)
https://github.com/tracel-ai/burn-onnx

I maintain this project at the moment.

It convert ONNX models into native, backend-agnostic Burn code for inference and fine-tuning.

Re:Microsoft's ONNX Runtime has disappeared from GitHub by ytxm on Tuesday November 17, 2026 @08:35PM (#50540756)
Have used it with wasm and it's lovely, but I was kindof disappointed to learn internally it's basically another serialisation format. I imagined gigabytes of generated Rust code hehe
Re:Microsoft's ONNX Runtime has disappeared from GitHub by antimora on Tuesday November 17, 2026 @09:05PM (#50540975)
The graph is converted into Rust code that calls Burn APIs but the weights are converted into Burn's format, called burnpack (similar to safetensors but instead of JSON we use CBOR for weights meta data).
Re:Microsoft's ONNX Runtime has disappeared from GitHub by citizenpaul on Wednesday November 18, 2026 @03:04AM (#50543228)
This looks awesome, i may be using this in prod very soon. Ive had some ONNX issues this looks to solve
Re:Microsoft's ONNX Runtime has disappeared from GitHub by robertknight on Wednesday November 18, 2026 @04:30AM (#50543994)
I maintain RTen (https://github.com/robertknight/rten). It is a good drop-in replacement for ONNX Runtime for many use cases where you are running inference on CPU (there is no GPU support yet). There is no Python or NodeJS API at present, though you could get an agent to build a small wrapper quite easily.
Re:Microsoft's ONNX Runtime has disappeared from GitHub by robjam on Wednesday November 18, 2026 @04:39AM (#50544082)
I've used your library ocr to read serial numbers on an IoT device on a mobile phone. It was really responsive and faster than tesseractjs in a web worker. Just wanted to say thanks for such well thought software!
Re:Microsoft's ONNX Runtime has disappeared from GitHub by coffee_am on Wednesday November 18, 2026 @10:45AM (#50547718)
Yet another alternative: convert your `.onnx` file to GoMLX [0] using onnx-gomlx [1].

For CPUs using SIMD it's significantly faster than ONNX. For NVidia GPUs, depending on the model, you can use an XLA backend. On Apple you can use an MLX backend (but it supports Neon/SME as well).

- [0] : https://github.com/gomlx/gomlx - [1] : https://github.com/gomlx/onnx-gomlx