A perfect reminder of why ethics needs to be taken more seriously by Software "Engineers". I don't think we should throw around that title lightly when stuff like this is happening.

People won't die from what we build, but they can easily be denied medical insurance or get harsher sentences because an AI suggested it to a judge (especially those who aren't aware of the technology's limitations).

Building machines to make decisions should not be taken lightly. See: FAA(not N)G companies who ban people without human interaction.