Not necessarily. Average income can be up substantially at the same time that median income remains flat or even declines. This means that it is possible for spending by wealthier Americans to make up for sales lost from the unemployed middle class and poor.