See, this is where data collection would actually come in useful.

Noscript can collect the information as to the most common settings for each website (say youtube) and apply them automatically.

Would save the whole "temp allow" -> "refresh" whack a mole game :)