People did clandestinely mill at home. It was treated as a serious crime. There are specific historical laws about this and the punishments were pretty severe. It was something the lords were quite concerned about.