I think one aspect you're missing is that infinity does not always mean everything. For example, there are infinite decimals between 1.0 and 2.0, and between 3.0 and 4.0 — however, there is no overlap at all between the sets.

That's how I imagined the busses to be; two non-overlapping infinite sets. No one from the first bus was also on the second.