I think that may be a fair critique, as long as there's a better alternative to use. If the distinction is between someone that has done extensive training or preparation for a job, to the point that it requires months or years of experience doing that job or being trained specifically for it, and to a job that essentially anyone can do and they just need a day or so of on-the-job training (if that), what's the better terminology to use?

I acknowledge there's a full spectrum between they points (e.g. painting, where anyone can do it, but professional painters have many skills developed over years to make them both more efficient and with a better outcome).

Perhaps the problem with the label is that it's being attributed incorrectly? I don't think it's saying the person is unskilled in general, just that the person is unskilled in this job. There are plenty of instances where people that are skilled in one area but unable to find work in that area get a job in another area they are unskilled in to make ends meet, and I think those jobs are generally for unskilled labor. In those cases, they likely are unskilled in the job being done.