Well this sound very similar to PKI and domain registar so the issues with them are pretty same.

But like PKI, if we can have id providers delegated by high authorities, the roots could be governments which could delete to smaller entites and so on. Not to much diff from pasports or liscence