I think C is the best option which is simple, fast and powerful. You need to introduce a separation layer to decouple your core implementation from the graphics, networking... libraries. This makes porting to other OSes or switching to the other libraries easy.