> If that were the main reason, we would have stories about people clandestinely milling at home. I’m not aware of any.

https://en.wikipedia.org/wiki/Quern-stone#Laws_against_use

Laws against a thing often indicate that it was enough of a thing to be a problem, although there are exceptions.