Yes, it is. Tax authorities don’t really care about petty versions of it (like your example of a gardener), but they do care if you’re effectively a FTE being paid under the table.

(The gardener might also be filing 1099s or the equivalent without you knowing, but that doesn’t seem likely.)