Yes, it's non-sensical, just like it's non-sensical to use a word that basically means "our language" when it's not actually a language that you speak. (Not a grammatical error though, but rather a semantic error, a dangling reference as it were!)

Let's say you don't speak German but keep hearing Germany referred to as "Vaterland" in the media. You might deduce that the word "Vaterland" is synonymous with Germany, and start using it yourself to refer to the country, but that would be wrong, because the word (without additional context) simply means "homeland", typically the speaker's homeland, whatever country that is.