Someone who is panhandling wants money and they get very angry when you interrupt that process. At least in the US, the panhandlers tend not to be the genuinely homeless--they mostly tend to be scummy people. It's a semi-regular news occurrence for someone to follow a panhandler with a camera to find out they really aren't homeless.
It really makes the political discussion about how to help the "homeless" a lot harder because now you have to deal with "How do we make sure that we help the "homeless" instead of these scummy jerks?" And it's impossible to make the separation--the scummy jerks will always work your system better than the genuinely homeless. It's one of the reasons why I'm generally for the basic income kind of approaches--the scummy jerks can't work your system to the detriment of those who genuinely need it.
In the US at least, the "genuinely homeless" that you could actually help tend to be nearly invisible because they don't want to be seen--getting seen gets you noticed and harrassed.
My belief is that this is a very small percentage of beggars and the videos are so widely shared not because they reflect a common situation but because they make the people share them feel better about walking on by. I don’t actually think that you can determine that someone isn’t homeless just because they don’t want to accept food from you.
Should we be helping these people? Yes.
Is panhandling money really helping these people? Not really.
This article tries to find some numbers and should probably cast doubt on the rich beggar narrative: https://invisiblepeople.tv/how-much-do-panhandlers-actually-...
For almost a half-dozen of my too sympathetic friends, I have introduced them to the local beggar population that they wanted to help by saying: "All right. I'll split it with you. Go there (whatever close food source), buy some form of sandwich and drink--no mayo, and come back and give it to him. He'll still be here; trust me on this."
They have quite the reaction when the cursing starts and the food gets thrown back in their face. It's been sadly invariant.