"societies and governments interfere all the time in activities that are legal"

Actually, societies and (especially) governments are the ones defining what is or isn't legal.