I tried to address the "assuming you know Java" bit here http://copperthoughts.com/p/clojurists-guide-to-java/ – I think it about covers what you need to go to get started, and it's readable in just 5 minutes or so.

Let me know if it's missing anything! You don't need to worry about any sort of jvm ant wars, either. Use Leiningen.