Funnily, I have the same reaction to whey protein, and also if I eat very (!) large amounts of swiss cheese or even joghurt. I anecdotally found out that drinking a small amount of apple cider vinegar mostly resolves my stuffy ears after that. Forgot to mention that I also had my adenoids removed as a kid.