Society has implemented welfare safety nets and minimum wages for the express purpose of improving the lot of the poor, at a non-trivial cost to the rest (i.e. financial net-contributors) of society. The wages that the poor are able to command (above the proscribed price floor) are the result of market forces of supply and demand; the prevalence of unskilled labor results in low pay--not society or greedy business owners.
The fact that society doesn't do even more to put money in the pockets of the poor can't be 'exploitation', unless you're 'exploiting' a homeless man when you put a dollar in his cup, when you could've put two.
Unless you're talking about loansharks, pay-day-lenders, and that sort of thing, in which case you're right, screw those guys.