This is how it works in Plasma, you can use the app switcher key combo to switch between apps and then the app window switcher combo to switch between that app's windows. You can also go through every single window, if you want.