Legally, certain people were considered less equal than others. That doesn't make the law just in and of itself.

As for having a right to drugs, every man has a right to do what they please with their body.