The point being that not all foods are ethically made. It's not as easy as meat == always the only immoral food choice and not-meat == always good. By reducing meat consumption, if you replace it with other non ethically sourced foods, are yo really helping? And if those new foods take advantage of human workers and slavery, is that better than an animal's suffering?
They aren't saying "Well plants can also be bad, so just stick with meat." It's "if you switch blindly without any research, you may actually ending causing more suffering for people and animals in the world than if you had stuck with meat."
Edit since I can't reply to posts below mine. It's not just about calories. I really think this sentence was overlooked from the parent post way up:
"What is more moral, eating a steak from a cow that was killed for its meat by decently paid, respected workers - or - eating a chocolate bar made with palm oil whose products were farmed using slave and child labor?"
Research conditions of cacao workers if you think this example is a joke or being made up.