Yes. But some languages get compiler before they get interpreted. For example Python (in the cPython version).
And there's a continuum between interpretation and compilation. Threaded interpreters like they are common for Forth are quite close to compilers.
I remember having a similar epiphany: that all languages are always interpreted. I believe my next thought was "so what?". I suppose it might be a good thing to remember if implementing a new language.