I am not saying they should learn computer science, but it's one of the best ways to use computers, and having some basic skills with it is incredibly useful still.
The main problem is that basically everything a kid would want to do with computers is already done in neatly packaged binaries, so the reward for exploring is just the exploration itself. And preventing your kids from using those binaries wont make your kid excited to recreate programs from the 80's, it will make your kid resent you as a conservative parent who wants his kid to relive his own childhood.
You are right, however, that some parts are simply impossible to replicate: narratives, for instance, have to be experienced. Gameplay however, is where the fun is when it comes to games and game programming (this might be subjective), and is usually quite simple to replicate.