Homebrew expects ruby to be installed at /usr/bin. RVM installs it in ~/.rvm/bin/ruby-$VERSION. Even if you symlink there are compatibility problems. I'm sure it's fixable, but non-trivially so.