We generally don't eat the toughest parts of plants either. Seeds and fruits are not as hard to digest as many stems or plants like grass. Not to mention that we pre-process a lot of the vegetable matter we eat - either by grinding (e.g. flour) or cooking or both.