It depends on how much better you think C# is but I think of this the other way around. You don't have to use Java anymore to get cross platform support, good performance and a stable and statically typed language.

Regarding things that might be better I think the linq support in dotnets collections is better than the streams support in java since java has kept more old collection libraries.