News for hackers. Stuff that matters.
Re:Show HN: I rewrote my Mac Electron app in Rust by binarymax on Wednesday May 28, 2025 @03:20PM (#44119704)
Looks awesome. I work closely with Multimodal search and have had trouble porting CLIP to ONNX and other formats due to the lack of multi-head attention operators. Are you using Python for the CLIP inference, or did you manage to port it to a format hostable in a Rust or C/C++ inference runtime?
Re:Show HN: I rewrote my Mac Electron app in Rust by katrinarodri on Wednesday May 28, 2025 @05:26PM (#44120817)
Yes, we were able to port the CLIP model to work with ONNX Runtime for inference
Re:Show HN: I rewrote my Mac Electron app in Rust by binarymax on Wednesday May 28, 2025 @06:03PM (#44121057)
May I ask, which version or ORT are you using? Were the outputs identical to PyTorch outputs for the same image?