> An outright ban on all work would certainly be unconstitutional (life liberty, pursuit of happiness etc).

One of those isn't in the Constitution, the other two are only protected against deprivation without due process.