There are plenty of people doing "menial" work who have plenty of drive. The work is to earn a paycheck and their life isn't about that. The drive is centered on something that doesn't earn them a living (e.g. family, bird watching). Not everything in life is about work and money.
A driven person who's terrified of Maths and Sciences is unlikely to become a leading Physicist, but they might well power through enough basic sums to successfully establish businesses.
An intelligent person who's not driven might never achieve anything like fame, at least in their lifetime, but they still probably enjoy their free time and passions.