News for hackers. Stuff that matters.
Re:How we used GPT-4o for image detection with 350 similar i... by isoprophlex on Tuesday January 14, 2025 @01:53PM (#42701977)
We got bboxes from yolo indeed to identify "here is a traffic sign", "here is a traffic light" etc. Then we cropped out these objects of interest and took the DINOv2 embeddings of them.

Not using it to create segmentations (there are YOLO models that do that, so if you need a segmentation you can get it in one pass), no, just to get a single vector representing each crop.

Our goal was not only to know "this is a traffic sign", but also do multilabel classification like "has graffiti", "has deformations", "shows decoloration" etc. If you store those it becomes pretty trivial (and hella fast) to pass these off to a bunch of data scientists so they can let loose all the classifiers in sklearn on that. See [1] for a substantially similar example.

[1] https://blog.roboflow.com/how-to-classify-images-with-dinov2

Re:How we used GPT-4o for image detection with 350 similar i... by ac2u on Tuesday January 14, 2025 @03:41PM (#42703549)
Understood. Thanks for taking the time to elaborate.