SponsorBlock has a lot of configurability: segments can be marked as various different things, so it's not all-or-nothing. You can set it to skip certain types of segments, and show other types. As for where things start and stop, it's crowdsourced, so you're relying on some volunteer to get those time points correct. I think it's possible to upload your own corrections, but I haven't played around with it much.