Technically, they did pay tax as the owners of the slaves would have been obliged in some states to pay certain fees based on outputs. (And a lot of times even on the inputs.)

No one ever evades taxes. As horrible as this may sound, that kind of included blacks.