ease/speed of prototyping: Ruby (or Python, even), Go, [Crystal]
pure performance: Go, Rust, C++, C, Scala, [Crystal]
a good concurrency model: Erlang, Go, [Crystal (similar to Go)]
A small note about why Crystal is in brackets: The language is very young compared to the rest, and it's currently very volatile in terms of syntax/API stability, or even compiler semantics, but it looks very promising and it's quite easy to get started with it or to become a contributor because the compiler is written in itself. http://crystal-lang.org/ (Sadly, /docs is a bit outdated and misses some crucial parts, but /api is very comprehensive).
I should do some real world benchmarks on Elixir vs Go for my own purposes.
But I'd imagine if you really care about microseconds, you should use a language without GC.
Rust would seem a good choice.
out of curiosity, which language + library/framework pairs do you think is a better tool than javascript + nodejs when evaluated along each of your 3 metrics?
I moved from python + flask to nodejs a while ago, I still thing nodejs is better than python + flask, but I'm trying to move away from javascript on the backend.