As for why people complain about vocab, it's probably because the dropout rate for language learning is huge (look at the completion rates on duolingo or popularity of beginner resources vs intermmediate vs advanced). By the numbers I suspect most learners are struggling with grammar, and most will drop out before "finishing" with grammar and being left with the long tail of vocab.
This is an incredibly insightful point.
For starters, there is hardly any bijective mapping between words. Translating 'run' to German could mean any of 'rennen, renne, rennst, rennt, renn, laufen, laeuft' and I am sure I am missing quite a bit.
And that only scratches the surface, let's not get started about Grammar or idioms, etc.
The word order really only adds negligible overhead.
Philosophers deny linguistic determinism(a notion that language sets the ceiling for thoughts) but that’s just talking Turing Completeness.
Conversely, you'll only use 'ballon' when you take about un ballon. I hope that's frequently enough for you to remember the word & its gender. At least it looks like the word 'ball', something you don't get with Vietnamese's 'bóng' or Chinese's '球[1]'
And you'll still get funny looks if you say you're getting ready to go to the New Year's ballon, because substitutions fail with homonyms in both directions. And you'll have to learn and relearn about ten thousand of these substitutions.
[1]maybe?
If you don't understand what a word means, can't you ask the other person?
I've never found this a convincing reason as to why a language is difficult to learn. Word order is learned once while vocabulary, speaking and listening need to be learned and refined consistently over many years. All of these become harder the further the target language is from the ones you already know. Would French really be significantly harder to learn if they said 'Je le ballon frappe'?.
I also think this applies to some other 'hard' qualities of languages, like pronouns and alphabets (i.e. not logograms). Conversely, freedom in how you approach grammar in a sentence makes it harder, not easier, because while you're able to structure a sentence how you like it makes it harder to know what sounds idiomatic and it increases the number of forms you need to listen and read for.
Tangential thought: one of the reasons that vocabulary is annoying can be presented in CS terms. Imagine reading a sentence like 'Do you want to foo the bar?'. From the context you can probably understand what kind of words foo and bar are but you don't know what they mean. Yet they're the most important words in the sentence. This isn't a coincidence: the least common words in a sentence tend to be those with the highest entropy. If there was another word that carried the same meaning but was more common, the author would be more likely to use it. So it's not enought to learn 90% of the words, you need the niche words too.