There were lots of similar folk beliefs, such as diseases being related to the resemblance to the food you ate. E.g. potatoes looking like tumours therefore giving you tumours. In Germany they were popularised by Frederick the great putting a cursory guard around a field of them and then letting peasants steal them.

From memory tomatoes were for some time grown as ornament in Europe before they were commonly part of cuisine.