It's hard to do by hand, what a commercial grower does at enormous scale. Sure you can have (a few) tasty vegetables, but nothing like enough for your entire diet? It takes like 400 sq ft to grow enough vegetables for one person-year. That would be a lot of work.