In a broad sense indirect harm is OK. There are many activities that result in indirect harm. The argument about which should be banned should focus on the amount of harm and the degree of restriction required to be placed upon people's freedoms to reduce the harm.