It used to be a stupid question to me since how could rules have consciousness.

But most modern AI is learnt from data, not programmed, how will we know if our AI in conscious?

We're not there yet and may never be, but since we do not know what consciousness is or what leads to it, we may stumble into it...