In Siri and a phone call, you're still adjusting the speaker volume. The current setting appears to be independent of random apps that make noise, but it's still speaker volume vs. ringer volume.