News for hackers. Stuff that matters.
Re:Cats, Rats, A.I., Oh My [video] by amelius on Sunday June 16, 2019 @02:51PM (#20197186)
He hand-labeled 23,000 images ...
Re:Cats, Rats, A.I., Oh My [video] by joshvm on Sunday June 16, 2019 @05:29PM (#20198015)
If you've only got a few classes it's faster to transfer learn a model from a few hundred examples, get that model to relabel your entire dataset and then fix any mistakes it's made. This is less than ten lines of python using fast ai.

If you've split your labelled data into folders then you can scan through several thumbnails at once to catch any misclassified pictures.

Rinse and repeat until the model is good enough.

Re:Cats, Rats, A.I., Oh My [video] by amelius on Sunday June 16, 2019 @05:39PM (#20198068)
> and then fix any mistakes it's made

This might be the most practical way to approach this, but it's not really a fundamental improvement since you still need to consider every image (also the correctly labeled ones).

Re:Cats, Rats, A.I., Oh My [video] by joshvm on Monday June 17, 2019 @08:20PM (#20208661)
True, although as the sibling suggested you can sort by confidence and weed out the edge cases. It's also quicker to go through mostly correct images as you need to make fewer (corrective) interactions/clicks. You can even view eg four thumbnails at once to spot outliers.
Re:Cats, Rats, A.I., Oh My [video] by pfundstein on Sunday June 16, 2019 @07:35PM (#20198629)
> you still need to consider every image

Not necessarily. The classifier will not only tell you whether it sees a rat, but also its confidence. So you can manually classify just the low confidence images, retrain, and repeat until there's none left or you're happy with its detection rate.

Re:Cats, Rats, A.I., Oh My [video] by Componica on Monday June 17, 2019 @10:33AM (#20203356)
Running a computer vision consulting shop, that's our way of life. For almost a decade we've developed semi-automated means to make the problem saner, but we have to maintain a network of people and software for labeling images.
Re:Cats, Rats, A.I., Oh My [video] by velcrovan on Sunday June 16, 2019 @04:50PM (#20197802)
Once you have each image in its own file, not hard to rig up a way to preview them one at a time and press a number key corresponding to the desired category (1–4 in this case) which will bin the image in that category and bring up the next image.
Re:Cats, Rats, A.I., Oh My [video] by Hello71 on Sunday June 16, 2019 @03:37PM (#20197448)
if you can do one per second that's just over 6 hours.
Re:Cats, Rats, A.I., Oh My [video] by gwern on Sunday June 16, 2019 @04:00PM (#20197568)
Faster if you can do them in a batch. If you have individual video segments, just label the whole segment. There isn't going to be no prey in one frame and then suddenly prey materializes from nowhere in the next frame.
Re:Cats, Rats, A.I., Oh My [video] by marvin on Sunday June 16, 2019 @03:09PM (#20197289)
Well, genius is 1% inspiration and 99% perspiration, in the immortal words of Thomas Alva Edison.
Re:Cats, Rats, A.I., Oh My [video] by amelius on Sunday June 16, 2019 @03:16PM (#20197326)
Yeah but it makes you wonder: is it genius, or is it just brute force pattern matching?

And what if he gets a new cat, or his cat switches to a different kind of prey?

From the outside, it might seem as if he is enslaved by his pet.

Re:Cats, Rats, A.I., Oh My [video] by keerthiko on Sunday June 16, 2019 @04:17PM (#20197654)
> From the outside, it might seem as if he is enslaved by his pet.

I don't see the issue, this is the explicit contract of having a cat for a pet.

Re:Cats, Rats, A.I., Oh My [video] by fisherjeff on Sunday June 16, 2019 @04:55PM (#20197833)
> explicit contract

I think many first-time cat slaves would disagree

Re:Cats, Rats, A.I., Oh My [video] by chris_st on Sunday June 16, 2019 @08:55PM (#20198948)
They'll learn.
Re:Cats, Rats, A.I., Oh My [video] by fisherjeff on Sunday June 16, 2019 @11:07PM (#20199513)
It took me all of maybe 20 minutes
Re:Cats, Rats, A.I., Oh My [video] by velcrovan on Sunday June 16, 2019 @04:54PM (#20197831)
Brute force pattern matching would be cataloguing all possible matching pixel patterns. The whole point of the ML approach is that with a comparatively few images (yes even 20k is comparatively few) the computer will correctly match pixel-sets it has never encountered before.
Re:Cats, Rats, A.I., Oh My [video] by amelius on Sunday June 16, 2019 @05:08PM (#20197905)
If your comparison function returns a float instead of a binary value, then you don't need to match against every possible image. Instead you just return how much each image is "similar" to the given image. A simple approach is to use cross correlation for the similarity.