Because a lot of vegans are leftist nerds, who are often scrawny. Plenty of them are fat too though.

Source: I'm a leftist nerd, carrying a few too many pounds, who doesn't eat meat.