Your point is completely valid but physically there still is some room to improve. Hollow core fibers for instance allow light to move one third faster.

With 40 Mm circumference and 300 Mm/s light speed in vacuum you have as a physical limit latency below 70 ms from opposite places in the world.