We are starting to do that, and for very simple operations, it works (like scripts for maintenance that we deploy remotely, and run as cron jobs). So far no big surprises, but we were very careful.

The big minefield is that you do not really know which libraries will go boom and where, as any place could make use of class loading.