High-speed rail can't stop too often, so all the towns in between stops and far from that line would have to be served by low speed rail, running a few times a day at most.

As everywhere - there's a tradeoff between efficiency and latency. Sometimes it's not worth going all in with efficiency.