Why are you worried about distractions? Is the sole focus of your company that the people you pay are 100% focused on something? Obviously not. Pick a better metric, measure it, and see if it is performing worse than before remote work.

And if you don't have the metric to back it up, you can't claim remote work is bad.

If you think you can't measure something, read How to Measure Anything: Finding the Value of Intangibles in Business

https://www.amazon.com/How-Measure-Anything-Intangibles-Busi...