Very few jobs in society are compatible with flexible time where people can work when it suits them. Any job which requires some kind of real time coordination with others will conflict, which is most jobs. That is not even counting parents with school age children.
Most tasks with real person in time coordination also have fixed locations, and optimal environmental work times. Roofers work early in the morning so they don't need to literally risk their necks to darkness while also avoiding scorching heat.
Lighting was also expensive and very inadequate compared to sunlight. This lead to convergence. Notice all of the old proverbs and parables speak in terms of light and not time on clocks?
In addition to the manual craftmanship, before standardized parts creation was done to fit by one person - something where you would prefer to do all of the relevant tasks with one person when possible. And manufactured goods were expensive precisely because most spent time on raw material related tasks.
Actual coordinated work has music associated with the proper rhythm. Sea shanties, and rowing drums for instance.