News for hackers. Stuff that matters.
Re:Windows ML is generally available by sorenjan on Saturday September 27, 2025 @05:38PM (#45399544)
What's stopping you from using ONNX models on other platforms? A hardware agnostic abstraction to make it easier for consumers to actually use their inference capable hardware seems like a good idea, and exactly the kind of stuff I think an operating system should provide.

> Call the Windows ML APIs to initialize EPs [Execution Providers], and then load any ONNX model and start inferencing in just a few lines of code.

Re:Windows ML is generally available by electroglyph on Sunday September 28, 2025 @12:30AM (#45401772)
i exclusively use ONNX models across platforms for CPU inference. it's usually the fastest option on CPU. hacking on ONNX graphs is super easy, too...i make my own uint8 output ONNX embedding models