Many influenza infections are asymptomatic. Unless you've been getting tested every week, it's entirely possible that you have had the flu more than twice.