Why would they need UK agreement to extradition if he's in Sweden???
Because European law says so.
Read the New Statesman article linked somewhere in this thread. You'll find that most of what people on the Internet say about the legal issues is factually wrong.
Re:Assange 'to leave' Ecuador embassy
by contingencies on Monday August 18, 2014 @09:27PM
(#8195636)
The New Statesman article and its author David Allen Green have been extensively debunked. If you do choose to read it, read it in conjunction with http://justice4assange.com/extraditing-assange.html to get the full picture.
Given that, I have the feeling that he was actually trying to avoid the trial and using the fear of extradition to the US as a convenient excuse. I may quite well be wrong on that, but that's how I currently feel.