A big assumption here is that the throwback to these old mediums is quality or artefacts but, with vinyl at least, I think that's largely wrong. Most of the arguments I see for it is the packaging. The package a vinyl record comes in has multiple large pieces of artwork, liner notes, lyrics etc. The medium also encourages listening to music as a main activity when we're all now so used to it being background noise.

With VHS you get crappy quality, you need more physical storage space (but, unlike vinyl, you don't get better packaging in return), and seeking is much more difficult (with vinyl seeking is almost as easy as CD/digital). Nostalgia is probably the biggest driver when it comes to VHS (in the same way audio cassettes are gaining in popularity).