Thanks? I'm a ML researcher. I thought the comment about ViTs would have been a dead giveaway. Is this nerd-splaining? Because it is really demeaning and you're missing the entire point.

While you're right, inference is not training but accuracy and inference speed is still important and hardware dependent. YOLO still can be faster and more accurate. Everything I said still holds true. You want to do inference on larger images because larger images have more information. More information helps you get better accuracy. You want bigger networks because bigger networks correlate strongly with higher accuracy. If you read any object detection paper you will see different sized models showing these tradeoffs. You want faster hardware because you still want your algorithms to be fast. Inference is still done in the car. Better hardware still makes all that perform better.

> The really hard part of this project is on training, not inference.

If you pay attention to the YOLO series or other real time object detection you will know that inference is still something being worked on. Inference speed matters. Throughput (different metric) matters. Hardware helps with both even if we use the same pretrained network. A network will have faster inference and higher throughput on an Ampere card than on a Kepler. So I'm not sure what you're debating here, it really feels like you're just trying to tell me you know machine learning but missed strong clues that you're talking to someone else who is aware.

TLDR: hardware still matters.