LLMs are also capable of analyzing, describing, and debugging software. There have been several papers published on this. So I wouldn't worry too much about any new buggy software being produced. In a few years, LLMs will probably be issuing PRs on your repos to fix things you haven't gotten around to or noticed yet.