News for hackers. Stuff that matters.
Re:OpenCV 5 Is Here: The Biggest Leap in Years for Computer ... by nnevatie on Tuesday June 09, 2026 @04:14AM (#48458162)
No one uses ONNXRuntime (nor the new engine in OpenCV 5) in production. For anything performance-sensitive, one would run models under TensorRT, as an example.
Re:OpenCV 5 Is Here: The Biggest Leap in Years for Computer ... by gunalx on Tuesday June 09, 2026 @04:36AM (#48458335)
Production dosent have to be performance sensitive, so devex may still outcompete the performance differences in some scenarios.
Re:OpenCV 5 Is Here: The Biggest Leap in Years for Computer ... by snovv_crash on Tuesday June 09, 2026 @04:48AM (#48458423)
Strong statement to make when I have at least 2 datapoints contradicting it, in SaaS and embedded/robotics.
Re:OpenCV 5 Is Here: The Biggest Leap in Years for Computer ... by amorroxic on Tuesday June 09, 2026 @05:04AM (#48458538)
Curious on what backs this assertion. As a counterpoint we’ve been running 200+ models in production for more than 5 years - language models, embedding, classifiers, low tens to hundred M params. Traffic in the order of 1-2M requests/day and everything is enabled by onnx with some cgo (or Rust) plumbing on top. What’s your SLA?
Re:OpenCV 5 Is Here: The Biggest Leap in Years for Computer ... by nnevatie on Tuesday June 09, 2026 @10:59AM (#48462038)
Ahh, I should have probably added some context around my hyperbole. I was referring to real-time computer vision - think of e.g. segmenting FHD/UHD video.
Re:OpenCV 5 Is Here: The Biggest Leap in Years for Computer ... by OvervCW on Tuesday June 09, 2026 @05:49AM (#48458885)
You can use ONNXRuntime with a TensorRT backend, so one does not exclude the other.
Re:OpenCV 5 Is Here: The Biggest Leap in Years for Computer ... by pzo on Tuesday June 09, 2026 @07:00AM (#48459396)
how are supposed to use TensorRT on iOS, iPadOS, Android or even Web? Production is not only cloud.
Re:OpenCV 5 Is Here: The Biggest Leap in Years for Computer ... by antonvs on Tuesday June 09, 2026 @08:02AM (#48459976)
We use this in production:

https://docs.rs/onnxruntime/latest/onnxruntime/

It’s a Rust wrapper around ONNX Runtime. We currently serve 5+ million inference requests per day for a highly performance-sensitive application, for a long list of major enterprise clients. We don’t use GPUs for inference, because it would be cost-prohibitive. We launch tens of thousands of VMs per day to run these workloads.

Re:OpenCV 5 Is Here: The Biggest Leap in Years for Computer ... by monster_truck on Tuesday June 09, 2026 @08:28AM (#48460228)
I've never understood how anyone comes into contact with it and thinks its anything more than an incredible inconvenience masked as the easy way of doing things. Given it a few good shakes for various uses and regretted the time spent each time
Re:OpenCV 5 Is Here: The Biggest Leap in Years for Computer ... by cik on Tuesday June 09, 2026 @09:16AM (#48460749)
Ummm embedded robotics is all about this. For years.
Re:OpenCV 5 Is Here: The Biggest Leap in Years for Computer ... by dTal on Tuesday June 09, 2026 @03:26PM (#48466375)
OpenTrack uses it for its AI headtracking, which works extremely well.