The direct answer is most managers have no experience managing remote workers. Certainly that's not the entire story but it's a new way of working and many organizations reject it for its novelty without understanding it's advantages or what investments have to be made to get them.