I still remember sometime back Google's GNMT translate the Chinese text of 'I don't want to go to work' into English 'I want to go to work'. That example alone should be sufficient to showcase how most advanced machine learning model can fail at the simplest task.

It didn't understand the source material, it is just very good at memorizing and faking.