Seems that, since the right volume to adjust is dependent on so many contextual variables, the right thing to do is to display two sliders, one for app & one for the system volume, and let the user adjust the appropriate one.