> The ML model would replicate anything with a modest bit of effort.

Yeah, by stealing it.

Last time someone wrote a comment on HN on this topic he insulted a library author and said something like "you are just bitter that eventually this AI software will be able to write your opensource library based on the GitHub description alone"

Well, of course it does, it can just literally search through GitHub and produce a verbatim copy.