Yes! People in Bangladesh need money for development desperately. It would be better to just mail them checks, but if you aren't doing that then buying from their (crappy) factories is better than nothing. Even if you are mailing checks the extra that gets contributed from buying clothes made in Bangladesh helps.

It's certainly counterproductive to boycott them if you don't do anything else.