I associate "localvore" with "farmer's market," not with "vegetable garden." Vegetable gardens sound unambiguously good to me, whereas 50 pickup trucks making 50mi trips to a farmer's market might be worse than 1 semi truck making a 500mi trip to the grocery store.
However, there's surely some benefit from growing food in your own backyard - you do cut down on the (admittedly minimal transport costs), and doing something physical outside has got to be good for you - even if it is a few pots outside if you live in a high-rise. Here's hoping you don't cut your finger off doing so.