Suppose we take the Phillipines and Malaysia, they (together) have about 6x the population of Australia. They have the capacity to train a lot of doctors - and a doctor can have a great life in either of those countries.
They can both also produce doctors more efficiently than Australia, partly due to living costs / ppp and population size, and partly due to Baumol's disease hitting education costs harder in AU.
But let's be honest, no country is talent-limited on doctor production. What's limited are training slots, and that is partly a practical concern... but also licensing restrictions - which tend to be regulated by doctors who have a strong interest in avoiding the oversupply of doctors.
What I am trying to say with all this is that there are many reasons someone might not be getting good medical care in say, the Phillipines but those reasons are not primarily due to doctors emigrating.
Skimming their best resources off the top can't be justified by some dry economic formula (if it happens to be correct) that just by pure coincidence results in a worse outcome for that poorer country and a better outcome for the wealthier one. Colonialists had all sorts of economic arguments too.
I would agree that the Phillipines are under-supplied according to OECD ratios but again, I don't think the problem is emigration.
Personally I think your mental model of these countries is out-of-date. They are sophisticated and industrialised but do have high inequality and some governance problems. As usual, it's a distribution problem. I think you are under-estimating their capacity and they are not at all lacking in talent, education or human resources. Australia is lucky to get skilled migrants but is by no means "draining" them. I think I'd want to see a more quantitative argument before I was willing to accept that.
It is neocolonialism because it is extracting the most valuable and profitable resources of less well off countries for your own benefit. Sure they can't compete with the massive incentives offered by the uber wealthy countries. Probably because those wealthy countries have been exploiting their resources including human capital in the past which keeps them poor and dependent.
But they should be thankful that their children get to sew shoes for us for a few cents a day.