I also had this a lot on a brand new Mac Mini + clean install of Catalina. There's a long thread about the issue on MR:

https://forums.macrumors.com/threads/constant-kernel-panics-...