I'm not sure I agree with this statement (though I like your first two paragraphs)...in the end, couldn't we replace most of our fossil fuel usage by just ramping up nuclear? I'm pretty sure there's enough supply there with breeder reactors to power our civilization long enough to invent something else.
We cannot continue to act on the hope that some future generation will fix our energy problems with a hypothetical technology. It is energy policy of the dot-com bubble. There is an outside possibility that technology might save us, but it is just that, a possibility. There is no roadmap, no plan, merely some things that might work, maybe, some day. Without such a hypothetical breakthrough, there is simply no possibility of continuing our current rate of energy production.
I highly recommend Dr David MacKay's book "Energy Without the Hot Air". In it, he surveys the production possibilities of all the currently viable technologies, gives current consumption levels of British people, and leaves the reader to decide how to make one number match the other. It is impeccably researched and available to read for free online - http://www.inference.phy.cam.ac.uk/withouthotair/
>The next generation of reactors in development are only around 15% more efficient than the best extant facilities.
I'm not sure what figure you're referring to, but breeder reactors with full reprocessing are 200 times more efficient than LWRs.
Breeders might hypothetically be very efficient indeed, but the plants we are actually building or have actual plans to build are PWRs and BWRs with only marginally better efficiency.
However, from a practical perspective, I do think that ideas such as vertical farming are a step in the right direction for a host of other reasons, assuming that the energy issue gets solved.
Vertical farming seems better for the environment since we're not taking down more forests to claim farm land. It also seems like a great idea for developing societies that can't meet base consumption levels. I'm sure there are other great reasons too, but my point is that this type of thinking certainly turns the wheel towards the direction you're pointing to.
Going vertical just spreads the same amount of light over a broader area. Your yield only increases if you use electric lighting, which is only economically viable if electricity gets very, very cheap. Using vertical sheds to farm cattle doesn't help, because the land use to house cattle is negligible compared to the land needed to grow their feed. Vertical farming doesn't help reduce soil depletion, because it depends on what we use now to amend poor soil - oil-based fertilisers. Vertical farming is a perfectly reasonable solution if we solve cold fusion, but there are a whole lot of other problems that magically disappear if we discover a limitless source of practically free energy.
Food is just a proxy for energy and any future food crisis is likewise a proxy for an energy crisis. Much as it'd be easy if we could solve it all, we can't. We've been living on millennia of stored energy and that store is coming to an end. We cannot escape the fact that we will have to dramatically reduce our energy use. Easy solutions to the problem of energy are tremendously appealing, but the laws of physics are a harsh mistress. The future of our species rests entirely upon joules, watts and kilocalories. Vertical farming is an appealing but irrational fantasy, rooted of the same fallacies as food pills and jetpacks.