I agree. T-shirt, shorts, and sandals would seem to be what I would want to wear, especially if this startup is in the Bay Area. (IDK if it is, just a thought.)

If you don't get the job because of wearing something like that, to an interview with a startup, you don't want to be working there anyways.