Wow, you've described my situation almost exactly. Where my garden is now was nothing but hardpan and rocks. It's taken quite a bit of work over four years to "terraform" the area back to life.
I've done a mix of techniques, but at the end of the day I've just found that the more organic material you can bring in, the better. I'm still looking for that silver bullet, though-- Something that can be deployed inexpensively at scale. I'm particularly excited to experiment with fracking daikon this winter (https://www.restorationseeds.com/products/fracking-forage-ra...).
Anyway, it's validating to know that someone else has independently arrived at the same conclusions as me :)
First of all, after recycling and composting, I have very little trash waste - maybe a 10 gallon trash bag every couple weeks. Even junk mail and most packaging goes in the compost. Every so often driving by Starbucks I'll grab some of their giant "Grounds for Your Garden" bags and add that in too, and so the overall volume of compost is pretty high.
After digging into the rock-clay a foot or two, I add soil+compost+logs and line each bed with logs that hold its shape but also compost into the ground over time. As you say I've put in very little effort after the initial, but the improvement over a few years in the entire yard has been dramatic - it's basically been brought back to life.
The loop from garbage -> compost -> plant food -> my food is great, honestly makes me feel better about garbage. Highly recommended pandemic project.