I never thought of "thug" as conveying an implication of the subject being black. "Thug" to me is more of a attitude / mindset / way of life, not something that corresponds to race. IOW, it's as easy to be a white "thug" as a black "thug". In fact, now that I think about it, the context in which I usually think of the word "thug" is the phrase "jack booted thug" which has connotations of Nazis, who were - as far as I know - mostly white. The other thing the word "thug" brings to mind for me, is the stereotyped image of a big white (Italian, probably) guy in an expensive suit, working as an "enforcer" for some mafioso type or something.
Maybe it varies by region, age or other factors, but I would not think of myself as being racist towards blacks by using the word "thug".
Um, the word thug is actually of Indian origin. It's borrowed into English. So based on this logic the original thugs who were Indian are now racist.
http://www.etymonline.com/index.php?term=thug