I hardly think it's unfair because suits cost money, and the more money you put into the suit the more people can tell. In many tech places people are okay with you wearing the free company t-shirt and khakis. You could look like $50 and be accepted.

That's widening the gate as far as you can.