> You will absolutely get into some kind of trouble (social or legal) if you put a camera on a sidewalk and start filming whoever goes by.

In the US, you won't get in any legal trouble for doing this. You do have certain restrictions on what you can do with the images you capture, though.