I think it's a dangerous myth, and I also have plenty of anecdata that matches yours. I only switched to software engineering partway through college, worked hard, and had a great job 3 years later. And people can always start in a basic position and spend their career improving and moving up.