We don’t nail everything yet but we allow users to refine the predictions. So in your example we might predict bread and let the user pick the type.
> How does it handle a thick layer of butter or another fat put on the sandwich in the Avocado Toast example, which would presumably be below the visible avocado?
We don’t predict portion sizes yet. At the moment we give a sane default and ask the users to adjust it. The next time you eat the dish we bring back the past meal so you don't have to specify the details again. We’re hoping to start predicting some of those details once we get enough data from our users.
Thank you for trying it out and the feedback.
This is a serious problem. Research suggests that one of the main causes of obesity in children is lack of ability to identify portion sizes or understand how much to eat.
Obviously there is a market of people who understand this well and want to track what they eat, but you are very likely going to be misleading a very significant amount of your userbase into making worse decisions for themselves.
Would be cool if I could pull one out from my pocket, stick it under my plate, get a measurement then subtract whatever is left after I'm done.
this is one of those things that i believe you should have right from the beginning.
How does it handle differentiating different types of bread, which have differing carbs?
How does it handle a thick layer of butter or another fat put on the sandwich in the Avocado Toast example, which would presumably be below the visible avocado?
A long time ago my friends and I offered a manual version of this as a service via sending pics / emails to us and us then manually going through and guessing. It worked well enough, so I have high hopes for a ML version!
My biggest pain point doing it manually came from pics of things like pasta where I couldn't really guess how much oil was in the sauce.
You can definitely get far with just estimating the macronutrients from a photo, and the absolute accuracy matters less than consistency in measurements over time.