You can do this with Docker too without Dockerfile or rebuilding. You can treat the container as mutable and just start/stop it, doing changes manually, and make snapshots with docker commit.

You'll forfeit the benefits of reproducible scripted environment of course but Docker does let you do it.