The difference is that train tracks and high cliffs are not generally ubiquitous obstacles to get from A to B, whereas crossing the street is needed to get pretty much anywhere.

Pedestrians being restricted to curbs is a blip in the timeline of humanity, it's a very recent development.