In systems biology textbooks, these networks are typically described more as alike logic gates than as neural networks, although some similarities are there for sure.

The GRNs are a bit more dynamic than strictly on/off, but the fact they have multiple types of interaction, such as enhancers and inhibitors, means they can model logical gates better than I understand a typical neural network can.