I'm not saying he's not a samurai, just that "holds a sword" does not a samurai make.
Retainers and bodyguards defend the title of their lord, and were essentially always of the samurai class. If you were recruited as a peasant for the job, then you became the class.
It’s not like medieval Europe where you have to be officially knighted to join the class. The equivalents of man at arms and mercenaries were also of the samurai class.
So as a cross poster said: the man was officially taken as a bodyguard to the daimyo, received a household, and was presented with a katana. Thus for all intents and purposes he’s a samurai. There’s just no other class permitted to do that job.
Edit: It would also be a grave insult for a samurai to be protected by a non samurai. To claim the lord, a noble warrior, requires a mere peasant to protect him… well that’s not permissible. So the daimyos bodyguard will be recognized as a samurai at least within his own lands.
Several of the key players during this time were themselves just peasants. Then after Tokugawa took over, he once again encouraged the hereditary samurai as a way to ensure stability.
Yasuke was under Nobunaga who was very much active when the definition of samurai was much more fluid than rigid.
Because as far as Edo society would be concerned, anyone who holds weapons would default to being a samurai if doing so legitimately or a peasant bandit if doing so illegitimately. So essentially he should be one, and seemingly was treated as one from reports of his fine clothing, social standing amongst other bodyguards, and land holding.