The relationship between the job market and employment is not so straightforward as you presume. After all, fewer people means less demand for labor as much as it means more supply. In general a falling population is considered an economic risk.