We reload right after you make a change in the UI. Seems pretty hot ;-)

If you want automatic reloading when a file changes, feel free to contribute a watchdog component to Home Assistant so people can hook it up themselves.