I was actually thinking of places like India in my original comment. Dairy is how those billion nourish themselves. Not just amino acids but important vitamins and minerals as well.

A world where "we have plenty for what we need with just plants" may be a possible world, but it's not the one we live in now. It seems like it would require immense effort to get there.