When you borrow, you borrow from someone else's past/present labor and obligate your future labor. (Where 'you' can be an individual, organization, or society.)
In my view, borrowing is always from the past. You cannot borrow that which has not yet been created.
For example, imagine I take a loan to buy a house. The people who built the house invested their labor with the expectation of future payment. Or if they spent their wages, then the firm that fronted their wages invested labor into building the firm with the expectation of future payment.
Generally, if one borrows, someone else must loan. This means that if you are consuming before producing, then at some point in the economic chain, there is someone who has produced but not yet consumed.
It is in this sense that I conceptualize borrowing as coming from the past.
This notion is reflected in the GDP equation of a closed economy: GDP = C + I. Any consumption over production must be balanced by investment, which is itself past production.
Of course, if we are to conceptualize literally, then borrowers do not borrow from either the future or the past. They borrow from banks.
Controlling assets is not the same thing as consuming, and money is designed to designate control rather than consumption. I can borrow money to buy stocks, which are nothing more than a promise of a corporate future. etc. People and entities do not have control because they have produced, but because they have controlled, or are part of the system that magnifies control to create more of it (through the banking system).
We elect to accept this system of the government determining who can control assets based on a vision of human society, or simply because we cannot object in a meaningful way. We borrow almost exclusively from money created by the government. In the end we borrow from nobody, but borrow by means of a de facto authority. The mutual agreement of human wills is more powerful than any sort of temporal precedence.
In that sense we borrow from neither the past nor the future. Of course you are correct that a large portion of borrowed funds are used to control tings that have already been produced. But the money is created at the same instant the loan is made. And it must be repaid by future labor or returns. Since it is not necessary for the money to be used to purchase something that already exists (and another large portion of borrowed funds are used for futures of myriad kinds), but it is always true that future results must be used for repayment, I think it is more accurate to say we borrow from the future.
Our debt is around 1x GDP and 1/5th American households' and non-profits nominal wealth [1]. (This excludes public sector assets, corporate assets, and foreigners' assets in the United States.) All of that is subject to future taxation.
I don't like big deficits. (They imply future taxation, service cuts or inflation.) But our debt burden is easily manageable, particularly considering our suboptimal inflation attainment.
[1] https://en.wikipedia.org/wiki/Wealth_in_the_United_States
The 3rd world will be more numerous, the current citizens of the first world will not. We're already seeing societal strains rising from the introduction of 3rd world peoples intended to make up for the missing offspring of existing 1st world peoples so I highly doubt things will work out as easily (and peacefully) as you assume they will.