I start by treating Javascript as whitelist only. If the site is blank without Javascript, I ask myself what is the chance its worth enabling scripts one by one. HTML CSS and reasonably sized images are quick, its videos, scripts, and calls to databases which are slow.