I’ve work on similar sized systems that utilized a very large human workforce to verify models before release and to monitor/measure production models on a daily basis after release. There are ways to make it efficient.