It makes more sense if you know that there used to be multiple competing private passenger railroads. Penn Station was the station for the Pennsylvania Railroad. The Pennsylvania Railroad had stops in Newark and in New York. Other railroads had their own stations. Some railroads had shared stations, hence Grand Central, and all of the stations called Union Station.

Of course the PRR hasn't existed in 50 years so maybe it's time to change the name...