The president can veto any bill sent to him by congress, and that includes the budget

... which just shuts down the government altogether. That's why it essentially never happens.