https://arxiv.org/abs/1906.04721 is an example paper where they perform data-free quantization after training (using batchnorm parameters to get information about the data distribution) without large performance drops.