There's more than wood in these casks. Aging in a sherry butt extracts sherry flavors, which are unmistakeable --- you don't need to be a whiskey nerd to notice them any more than you need to be a beer nerd to notice the difference between an APA and a porter. And sherry butts get used in cycles for multiple batches of scotch.