Optimization for latency is a completely different game than optimization for throughput. The flip side has similar but opposite hacks and you can get a lot of hints on what to do by looking at that polar opposite as things to avoid.