Seems like system administration stuff to add more keys, not yaml/devops engineering.

If you rephrase your question and what prevents you to just add keys after provisioning finishes, I'll try to help