I've always wondered this, as a non English native speaker. You could also say the "u" in unity is pronounced as "iu" which starts with a vowel and sounds the same as "you", so your reasoning sounds incorrect. Perhaps a better explanation is that the "iu" diphthong is already paired together, so attaching it to the "an" sound to form "aniu" doesn't roll off the tongue as well.