At least if your job depends on being physically fit, it seems rather risky. Could be that one would be more likely to keep working even if slightly ill, putting long term health at risk. Also, of course there would be a higher risk in general to be incapable of continuing to work due to health reasons (as more parts of the body would be involved in the work).
My grandfather worked as a forest ranger, and he seemed happy enough, although I'm not sure it was much of a geeky occupation (although he did know the common and latin names of a large variety of flora and fauna). My other grandfather, OTOH, worked on the instrumentation of early jet planes. Definitely geeky:-)