You could mount the nginx.conf files into the container so they are editable. The “correct” way to run a Docker container is to supply the config at runtime, not at image build time.