fwiw, bash autocompletion does this automagically, too, but you might need to enable it. .ssh/config is definitely the canonical place to keep this stuff, but I like @haosdent's ranking concept. some of my boxes I rarely log into, and others I log into all the time.