Trees are heavy. Assuming a fairly mature tree with a 10-inch diameter trunk and around 20 feet of height, the wood alone weighs around 800 pounds, and that's before you consider the soil that the tree sits in (100 lbs per cubic foot, so at least a ton for the whole planter) or the water that it needs (100 gallons per week ~800 pounds)
I had some ideas in similar thrust to yours, I think it's worth following up on.
One of the cooler things you could do is space the floor plates so that you give people berths in a building. They then install walls and possibly a subfloor and run utilities. If they want to leave the space open they can, if they want to cut it up into rooms they can.
Not sure what the value to residents in shaded mid-floor outdoor space, vs having sun-filled decks in places that make structural sense. Mid floor parks are just an aesthetic embellishment for people outside the building.
Is it simply a cost issue? Everyone is just trying to maximize "livable area" at the expense of not making the structure itself more livable?