This has been discussed a fair amount, as well as replaying session transcripts, persisting key data structures easily, some other things i can't remember.
http://groups.google.com/group/clojure/browse_thread/thread/...
http://groups.google.com/group/clojure/browse_frm/thread/473...
http://stackoverflow.com/questions/3480377/clojure-namespace...
If I wanted to use other versions of Lisp, I would be using them. For my environment (lots of legacy java code) clojure is the right language, and I can't reasonably change to Haskell or Scheme (or whatever) because working from files is a little bit inconvenient.
My point was I hear people gushing about the REPL, but I don't find it that useful because of this one deficiency. It makes me wonder if I'm missing something.
SLIME gives you some ability to save REPL state in that you can start a REPL with all of your code already loaded (check out the Clojure bulid tool Leiningen and the command 'lein swank'). If you want to save the complete state of a running application you could check out one of the versions of Lisp with image based persistence or Smalltalk.