I don't know what your monitoring setup is like, but I'd recommend something like Prometheus' blackbox-exporter to help alarm when your network "changes".

I setup alerting rules so that certain subnets or servers suddenly being exposed to certain instances of blackbox will wake people up!