News for hackers. Stuff that matters.
Re:Fungi Foragers Freaked by neilv on Saturday October 15, 2022 @08:46PM (#33220064)
> When the app matched his photos of the backyard mushrooms with an edible species, [...] it almost killed him.

Now there's an app that'd have to be designed very conscientiously.

Re:Fungi Foragers Freaked by SpikeDad on Saturday October 15, 2022 @08:49PM (#33220073)
Wow. Who would take the liability of an app such as this? Regardless of how many disclaimers you'd have to agree to I could easily see a jury holding the creator of the app liable for a horrible death like that.
Re:Fungi Foragers Freaked by caust1c on Sunday October 16, 2022 @02:05AM (#33221411)
It's literally part of the iphone camera, if you weren't aware. Not disagreeing with you, but acknowledging that it's pretty hard to prevent these apps with how accessible machine learning is today, despite accuracy still being difficult for many things.
Re:Fungi Foragers Freaked by csydas on Sunday October 16, 2022 @06:32AM (#33222604)
I dunno, watching the video linked by this use [0], I think the apps (aside from Google Lens) do a fairly okay job of being clear that they aren't as sure on their identification and that they're about casualness, not "safe to eat or not safe to eat."

While the article cites some persons who ate poisonous mushrooms because an app said they weren't poisonous, ultimately it will come down to "Did the app sell itself as telling you what's safe to eat and what's not?"

From the video, I'm particularly harsh towards Google on this as it doesn't seem to include the confidence level or analysis process and instead focused on showing a result and even trying to sell you something based on the result. This does seem like it's the wrong approach that will get people killed, with thoughts like "well Google thinks it's this, and it's even trying to sell me some, so must be okay."

For the others, you can see warnings in the apps about eating identified stuff, you can see how confident it is in the analysis, and they at least appear to be considering things like the region you're in when making an analysis.

I think it would be fairly defensible based on the warnings and preparation that a reasonable person would not be expected to take the identification as a go-ahead to eat something. That unreasonable persons take unreasonable actions as a result of these apps wouldn't really change the legal interpretation, but of course maybe it can be persuasive in other directions.

At first I shared the same opinion as you that these are dangerous apps, but watching what the apps do in the linked video, the non-google ones are actually pretty acceptable in my opinion. I would prefer they include a few more warnings though when there is low confidence matching or when there is conflicting matching just to remind the person using the app "hey, btw, a lot of plants can kill you. Don't eat this, I'm just an app."

[0] - https://news.ycombinator.com/item?id=33220688

Re:Fungi Foragers Freaked by chernofool on Saturday October 15, 2022 @08:54PM (#33220111)
Most plant ID apps have a disclaimer saying that you should never eat anything that you use the app to identify. Seek reminds you every time you open the camera.

They're mostly intended as entertainment, but some of them use the data to analyze where species are growing in realtime.

Re:Fungi Foragers Freaked by colechristensen on Saturday October 15, 2022 @10:54PM (#33220673)
Honestly though there should be limits to the amount that a disclaimer should be able to protect you when your product advises people to do dangerous things you know (or have every responsibility to know) could be lethal.

There’s a lot of room between a one in a billion mistake that hurts somebody and a fifty fifty chance a mushroom is poisonous. There are plenty of edible vs deadly mushrooms that only have incredibly subtle differences that you should trust nobody but a human expert to identify.

Effectively what I’m saying is a disclaimer shouldn’t be able to get you out of murder charges for a game of Russian roulette.

Re:Fungi Foragers Freaked by Dylan16807 on Sunday October 16, 2022 @12:23AM (#33221004)
It identifies plants and animals. The main use is not for finding food. "advises people to do dangerous things" is a ridiculous way to describe it.
Re:Fungi Foragers Freaked by uwagar on Sunday October 16, 2022 @01:37AM (#33221296)
>Effectively what I’m saying is a disclaimer shouldn’t be able to get you out of murder charges for a game of Russian roulette.

By your logic knife makers will all be praying that their knives arent used for killing or harming people or they'd be charged for murder.

Re:Fungi Foragers Freaked by colechristensen on Sunday October 16, 2022 @05:27AM (#33222345)
This isn’t at all the case.

These identification apps are selling incomplete information where the need for full information about toxins is obvious.

Nobody was ever surprised that a knife hurt somebody or had cause to accuse a knife maker that their product could cut things in a way a consumer wouldn’t know about.

The issue isn’t that a tool can be harmful but that a danger to the producer of a product would be obligated to know and share isn’t obvious to the consumer without previous knowledge. If you’re selling information you must know your audience.

Any human teaching you to identify mushrooms will teach you about the risks of poison right away. “I didn’t tell you what you needed to know but you should have known better” only works when it’s reasonable for you to know better. General audience mushroom identifiers shouldn’t be expected to know how easily a misidentification could kill them, plus it’s just not difficult to do.

This doesn’t match the situation with knives unless you can find me someone who really does need to be warned about knives and isn’t, say, 4 years old.

Re:Fungi Foragers Freaked by cyphar on Saturday October 15, 2022 @11:13PM (#33220752)
Even if that does waive their legal liability (which I'm not sure it does), there is a moral obligation to try to not endanger the many people that the app developers know are going to disregard that warning. It would be intellectually dishonest for the developers of such apps to pretend that everyone who uses their app actually obeys that warning (there are plenty of YouTube videos instructing people to forage for things using these apps).
Re:Fungi Foragers Freaked by TheDong on Sunday October 16, 2022 @02:01AM (#33221398)
I feel like there's still some sort of line here. I'm sure the developers aren't surprised that some users ignore the warning... but does that mean they failed their moral obligation?

Did the developers of google maps fail their moral obligation if they know some users will follow google map's directions, despite their GPS being broken, and go down wrong streets, walk into walls, get lost without water, etc?

Did the developers of the bird scooter app, which tells you to wear a helmet (but developers know that warning will be ignored), fail their moral obligation since they know some scooter riders won't actually know how to ride and will fall and be injured?

Do the developers of competitive sport apps, like strava, fail a moral obligation since they know some people will injure themselves trying to get on a leaderboard?

Like, I agree that there's a moral obligation for developers. But on the other hand, I feel like you can expect some baseline of "bad users who misuse the app horribly", and it feels like if that's enough to obligate you to not build said app, you just can't build anything. Just about anything can be misused, and at the scale of most apps, it's reasonable to expect it will be.

Is there something about plant identification that makes it more special than the other apps above?

Re:Fungi Foragers Freaked by yieldcrv on Sunday October 16, 2022 @06:06AM (#33222507)
The apps aren't for eating.

I think you're missing how many steps are necessary.

Those apps for identifying your local poplars and evergreens.

This person pointed it at a mushroom, picked the mushroom, used it as a topping and digested it.

I would be for an additional warning label when mushrooms are identified. But we need more people on the same page about the apps themselves, if you haven't used them I think you might be out of the loop.

Re:Fungi Foragers Freaked by trhr on Sunday October 16, 2022 @06:18AM (#33222558)
We need to stop pretending that developers are liable for the idiocy of users.

There was a time when you could publish a book on how to make a pipe bomb and nothing would happen to you. Now the wrath of the government descends on you as if you broke the law by having knowledge and telling it to someone.

Re:Fungi Foragers Freaked by Normille on Sunday October 16, 2022 @07:59AM (#33222917)
The plant app I use [0] gives a percentage confidence rather than saying "this is definitely X or Y". I've found it pretty accurate on the various plants and trees I've used it to ID. But I limit my foraging to nuts and berries I already know and generally only use the app to increase my recognition factor of what else grows around me.

I do like mushrooms but I think it's just a step too far into 'Russian Roulette' territory to risk trying to forage for those. Eating something which might make you sick for a day or two is one thing. But risking eating something which might kill you or require a liver transplant, if you get it wrong, is a bit too scary for me. The only mushroom I'm confident in my ability to ID is psilocybin.

[0] https://play.google.com/store/apps/details?id=com.floraincog...

Re:Fungi Foragers Freaked by smegsicle on Saturday October 15, 2022 @09:04PM (#33220174)
a mushroom identification app that doesn't draw attention to toxic lookalikes sounds pretty close to criminally negligent
Re:Fungi Foragers Freaked by DangitBobby on Saturday October 15, 2022 @10:40PM (#33220597)
And this is why we can't have nice things. This opinion is wild to me. You do not trust a consumer app with life and death decisions, especially over something where the upside is not eating a mushroom you found and the downside is death.
Re:Fungi Foragers Freaked by colechristensen on Saturday October 15, 2022 @10:59PM (#33220694)
A very important fact you need when identifying mushrooms is the consequences of misidentifying them. You don’t have “nice things” when you fail to raise this crucially important point.

Every responsible resource will be full of this kind of caution and neglecting it should be criminal. It isn’t covering your ass or putting an obligatory warning label on everything, a primary point of interest in mushroom identification is toxicity. If you don’t do it you kill people, not like maybe but certainly.

Re:Fungi Foragers Freaked by DangitBobby on Saturday October 15, 2022 @11:13PM (#33220755)
Eh, no, you're inventing a narrative. The guy knew the downside actually or he wouldn't have bothered to use the app to identify it. He knew the downsides, he rolled the dice, he lost. His wife knew the downsides, didn't roll the dice, and he thankfully lived maybe because of that.

You also don't know that the app doesn't warn users that it shouldn't be used in life and death situations, but I'll maintain that it shouldn't have to. To avoid "criminal negligence" accusations.

If I have a rock identification app does it need to say not to eat rocks to avoid liability for dental damages? If I sell bicycles do I have to tell you that rolling downhill fast can cause death or injury?

Re:Fungi Foragers Freaked by SamoyedFurFluff on Sunday October 16, 2022 @12:16AM (#33220988)
I think you’re misunderstanding the point here. Mushroom identification isn’t the same as bike selling or rock identification because the purpose of those isn’t to avoid danger. Almost the entire purpose is to reduce the “rolling the dice” factor in mushroom eating. In fact, that is precisely why traditional mushroom identification has such a wealth of deep knowledge, such as noticing ecological location, weather patterns, neighboring plants, etc. to reduce this as much as possible.

It is more comparable if you built an app to identify cancerous moles, except it produced false negatives significantly more often than an actual doctor, leading to people dying. This isn’t a “roll the dice” thing.

Re:Fungi Foragers Freaked by DangitBobby on Sunday October 16, 2022 @12:44AM (#33221089)
I don't think the intended purpose of the app is to tell you whether a mushroom or plant is edible or not, I think it's merely meant to identify plants, fungi, and other things for a hobbyist who's into botany and the like. I could definitely see where you're coming from if the app advertised itself as a "a great wilderness survival companion app" or something like that... But we're pretty much speculating, here. This is specific as the story gets

> he used the plant identification app

Which I think is a different category of app altogether from a fungus/plant edibility app.

Re:Fungi Foragers Freaked by colechristensen on Sunday October 16, 2022 @03:58AM (#33221949)
It doesn’t matter what the app intends to do. You should not under any circumstances identify mushrooms without loudly and clearly spelling out specific dangers.
Re:Fungi Foragers Freaked by DangitBobby on Monday October 17, 2022 @01:08AM (#33229991)
It would probably be wise to do so, especially after you've learned that it could save lives. But to decide after the fact that it's criminal negligence is not a healthy outcome. I'm all for trying to make sure people don't hurt themselves, but the app makers should not be legally responsible for the decision that was made here, period.
Re:Fungi Foragers Freaked by hodgesrm on Sunday October 16, 2022 @12:36AM (#33221059)
> You do not trust a consumer app with life and death decisions, ...

What about an app that tells you how to pump gas while smoking a cigarette? That seems like pretty obvious negligent design. In California at least that opens you up to a lawsuit. [0]

[0] https://www.shouselaw.com/ca/personal-injury/product-liabili...

Re:Fungi Foragers Freaked by mtlmtlmtlmtl on Sunday October 16, 2022 @01:31AM (#33221277)
And yet clearly the existence of these apps has made the problem worse. People don't read disclaimers. And people do idiotic things. Now, for a mushroom identification app clearly the only functionality that actually matters is telling edible mushrooms from toxic ones.

How is it okay to make fundamentally broken software and then release/sell it as if it's functional? It shouldn't be, just like it isn't for architects, engineers(real ones) to design and build buildings that fall down and cars that explode.

Re:Fungi Foragers Freaked by vilhelm_s on Sunday October 16, 2022 @02:10AM (#33221430)
The article calls it a "plant identification app", I guess it's not specifically for mushrooms.
Re:Fungi Foragers Freaked by morsch on Sunday October 16, 2022 @02:24AM (#33221503)
We don't know if it made "the problem" worse. It certainly made it worse for the guy getting poisoned. But it's possible that for each person getting poisoned, there's a couple not getting poisoned because the app correctly ID'd a mushroom.

Or a hundred people who have their intellectual curiosity satisfied. I recently used Google Lens to ID (with like 75% confidence) a mushroom I had zero intention of eating either way.

Mushroom identifying books have all of the same issues. I guess one could make an argument that it's unconscionable to publish those, too.

Re:Fungi Foragers Freaked by AngryData on Sunday October 16, 2022 @03:18AM (#33221765)
Yeah that seems like a huge oversight. Every mushroom field guide book ive seen very specifically called out any potential look-a-likes for edible mushrooms and gave extra warning on mushrooms that are particularly difficult to positively identify.
Re:Fungi Foragers Freaked by cyphar on Saturday October 15, 2022 @10:57PM (#33220688)
Some time ago, I somehow ran into a YouTuber who talks about foraging in the UK talking about how effective these apps are[1]. Each one of them misidentified at least one plant, and two of three gave incorrect (or misleading) results for the deadly plant he tested.

However he made the very interesting point that having an app tell you if something is edible is a completely incorrect starting point for foraging because the main thing you get from using a reference book is that you are forced to notice that there are many plants that may look similar but are different (meaning you are more aware that your task is more about differentiation than identification, since botany is a bit fuzzy around the edges) and might seriously differ in their toxicity. None of these apps have a feature to say "it looks like this edible plant but if the angle you took the photo from was slightly off, it's definitely poisonous because the group of plants that look like this only only one or two edible members and everything else will definitely kill you". Some list confidence percentages but there were examples where the percentages were far too pessimistic or optimistic for a certain match, making them not particularly useful.

My impression is that these apps are developed using the same "move fast and break things" model as most other things these days, which definitely seems like the best model to use when making an app that may or may not lead to people's deaths (not your fault of course, because you waived all liability in your ToS). /s

[1]: https://youtu.be/sjS0PgC9KSc

Re:Fungi Foragers Freaked by WalterBright on Saturday October 15, 2022 @11:57PM (#33220918)
I've tried to identify hemlock from photos, without much success in distinguishing them from a carrot.

I'll just stick to distinguishing a '67 from a '68 Mustang.

Re:Fungi Foragers Freaked by creepycrawler on Sunday October 16, 2022 @05:14AM (#33222296)
Instead of a general mushroom identification app, it could be a poisonous mushroom identification app. The dataset would only include poisonous mushrooms, and it will be made clear that it is not exhaustive. This could be useful to rule out some mushrooms.