In any community there is likely to be someone with a passion for something. Whether that something is making bread, helping the sick, or teaching children.

It's true that there are some jobs which people aren't naturally inclined to do, but in the society being described I think that communities would become smaller, and more cohesive. Some the of the jobs required to maintain a large city no longer need to be done, and those that do still need doing become less of a strain and can be distributed amongst people.