I think that's a broad over simplification. You're a "user" of your compiler or interpreter. Is it the act of typing that makes it programming? We've had a definition and model for computation since Turing that is largely universal, so as long as the language and rules that you are following is Turing complete, I think it could be argued that using that language is by definition programming.

I'd also argue that a game like cargo-bot (which is effectively a game-ified assembly language) is very much programming, even though you do nothing but drag some boxes around.