Maybe something with the settings of your SSH client? The server only has an ssh-rsa key in it, so if your client is configured to not accept that, then that might be the source of the problem.

Sorry :-/. Wish I had a better idea. Would greatly appreciate any ideas.