The vapor barrier should be placed on the 'warm side', i.e. the side where the temperature is higher (as you say). So yes which side that is (what side of the insulation) depends on whether you're mostly cooling or mostly warming your house.