News for hackers. Stuff that matters.
Re:Serving ML at the Speed of Rust by minimaxir on Thursday June 23, 2022 @04:04PM (#31854472)
As the article notes, there isn't any official Rust-native support for any common frameworks, and using a C wrapper limits its advantages.

tract (https://github.com/sonos/tract) seems like the most mature for ONNX (for which TF/PT export is good nowadays), and recently it successfully implemented BERT via Hugging Face ONNX export.

There are no comments on this comment yet.