I recorded a video with advice about designing a webhooks system a couple of months ago: https://www.svix.com/blog/webhook-architecture-design/

It's high level, so it doesn't touch everything you mentioned, but it's a good primer.