It's a Quality of Implementation issue.

The tape does this because it was mechanically simpler. But in other systems, where it may not be, this is still what you want. So, a good Implementation should do it anyway.

Portable minidisc players _could_ have been made slightly cheaper by removing the solid state storage, then they would have skipped if jogged like old portable CD players (and unlike a portable tape player). But all the official ones had solid state and so the experience for the end user was that they "didn't skip" even though of course in reality a spinning disc can't achieve that, the solid state storage hides it from you for long enough. Good Implementation. CD players copied this technology eventually as RAM got cheaper.

This is the same for TV channel up/down on most digital TVs. It's very slow. Why? Well, mechanically changing channel is more complicated, and so by default it will be slow. But that's not really _why_ the real answer is that consumers prefer a cheaper TV that has poor Quality of Implementation and so those have won. Vendors could spend $5 extra on the BOM (duplicate tuner and decoder circuitry following adjacent channels) and a few hours engineering to make it nice and fast, but why bother when customers won't pay a dime extra?

Yes, quality aside, the "stateful-ness" of tape is very useful. Using VHS is quicker to pick a show back up where you left off than DVD.

The SD Card full of MP3s in my van always starts back at the first alphabetical song in the first alphabetical folder every time you turn on the car, or switch to radio and back. It's infuriating.

That's just a reminder of how utterly awful OEM headunits are in vehicles. This was NEVER a problem for the $20 8gb MP3 player you could pick up in the walmart checkout aisle

Some people put a silent track called "A" on their media to make this less annoying.