How exactly is it either faster or simpler...? Especially when any of the frameworks just come with it configured out of the box?

sure, if you're writing "Hello world", /index.php is great. For everything else? Not so much.

This reminds me of people saying "version control, that's too hard, I'll just make backups of the src dir regularly".