This “ban” would only apply if both the employer and employee agree to the terms.

Seems like a reasonable position.

This issue can be discussed at the time of recruiting / hiring. Reasonable working hours and “off limit” hours can be agreed upon and should be respected.