I'm definitely not disparaging it as a ton of work. But I think it also gives us some ideas about the limitations of our models of how sound is actually made. Along the way we've ended up producing some truly unique and interesting sound models which have given birth to any number of entire musical genres.
I think part of the problem is also build some kind of control interface which can even detect the elements of a nuanced performance. Take something as straightforward as an electronic drum head. You've got velocity, edge to middle playback area, different parts of the stick of hand, the side of the drum (not just the head). Different stick head materials. You can stop a ringing drum or cymbal, or disrupt the vibration in subtle ways. For something that just seems like it's "onImpactPlaybackSample()" it's not anywhere near that simple.
Since then most commercial synths have either been multipurpose sample subtractive, or virtual analog that simulate the old analog synths from the 70s.