You choose a category first, like "tree", "flower", "grass" or "fern" and it will guide you through the process, trying to identify the plant with as few photos as necessary. Common ones it will identify from a single image, for others, it will e.g. prompt to take a close-up photo of the bark, bloom or the complete plant in its environment. From what I understand, they are aiming for accuracy of the identification and will provide a description of possibly matching plants if there is still ambiguity. Very recommended!
Edit: here is a link if it sounds interesting: https://floraincognita.com
Upload a photo, tell the app which part of the plant is in the photo (leaf, flower, fruit, bark), and it'll tell you what the plant is.
Highly recommended as well, almost always identifies the plant with just one photo. I'll have to check out flora incognita sometime.
I have installed the app now for the next time I am gardening :)
Thanks
IMO this will just lead people to wrongly ID their plants more often than not, and that's a really bad thing.
You label geotagged images with the AIs suggestion if you agree with it and then other users can either confirm or suggest a different / more specific species.
Still, if you post the plants under a more general species other users can identify it mentally, adding to the data set.
As a bonus if the algorithm can tell it can't identify correctly you can use this feedback to teach the algorithm.
I will say though, most of the time I don't have service where I'm IDing plants, so it's not the most convenient tool.
There's no reason to think that needs to be done separately, and in fact that's the kind of things that you'd expect a good model to find on its own.
In general, we've already learned that while handcrafted features can help, they are often ultimately worse than learned ones as techniques get better.
Every plant has baked in restrictions on how it grows. If you can identify separate features of a leaf and how the leaf grows out of the stem you can basically look it up in a table and tell what kind of tree you are looking at, without need for guessing.
On the other hand AI will develop its own classification method but one that has unknown faults in it.
Maybe it has learned to look at the lighting direction because half of the data set was non-suculents with light from the left and half was succulents with light from the right, because it came from a different facility?
Or maybe different cameras were used to photograph different types of plants?
So now rather than looking at the leaves it uses light direction or photo grain to tell if it is succulent or not?
Face the reality, you are wrong.
The above algorithm returns completely nonsensical results for my searches, plants that have completely different structure and coloration and nobody would ever mistake them.
It relies at you looking at the suggested solution, and then, Hey!, here you have five more, maybe your plant is somewhere on the list?
This is only marginally useful but could have been so much better if it tried to identify structure of the plant.
So, basically do what a person would do -- identify simple features visually and then consult the book to go through decision tree to figure out what you are looking at based on these features.
As you go through decision tree, you keep excluding more and more possibilities until you are left with only one match.
You would never mistake oak with a cactus because there are so many occasions on this decision tree to go one or the other way that you would have to make multiple mistakes.
But that's exactly what the algorithm seems to be doing -- mistaking plants that are very far away from each other when it comes to their build.
Disagree - learning to classify morphological characteristics is learning the generalizable features. Especially given that some plants are going to have relatively few photos, knowing with high confidence some diagnostic factors and GPS could absolutely outperform the brute force approach.
This isn’t about hand tuned features, it’s about predicting the right thing.
Also, the approaches aren’t mutually exclusive.
Unfortunately, I have tried to identify some of my plants but it could not identify correctly a single one. Just an endless procession of at best similar plants, most of the time completely dissimilar.
I think this is another naive model that just tries to push entire problem to AI. That is unfortunately what I am seeing nowadays, very unimaginative. Just try to have fun with parameters of the network until you find some kind of configuration that seems to be working.
What it would benefit from would be some kind of analysis/classification of basic features of the plants like what's the basic shape of the leaf, trunk, how things are connected, etc.
The classification would benefit from AI (like identify where leaves are, where trunk is, etc.) but then that intel would be passed to a more classification-oriented algorithm.
(disclaimer, I am not an AI developer, it just seems to me like pretty rational way to approach the problem)