But still, this kind of analysis (part-of-speech, dependency parsing, etc.) was deemed useless with NN transformer models.

The solutions to these low-level problems seem to be unimportant for high level tasks. Not to mention that error propagates. Error on part-of-speech tagging will propagate to dependency parsing that uses that info, and eventually this error will affect NER or entity/relationship extraction and similar.