Using a Gödel like encoding every program is also a number. So it seems that numbers that are complex enough that they are isomorphic to a copyrightable program should be copyrightable. I tend to think of the neural net weights as a different instruction set, just how Intel and ARM are also different instruction sets.

I fully well realize that lawmakers and the judiciary will be the final arbiter here (although I hope some logic will be part of the process).