It helps me to think about it like a different type of function call. We've got normal functions, async functions, there's a Go project that turns HTML templates into "templ" functions. JSX functions. LLMs are just a new `infer` function type.

A few years ago if I suggested that you should write a program to help you with time tracking, I imagine that might get a few responses with pointers to some existing open source projects. In a few years, someone might point to support for infer functions in nightly rust.

In other words, I think that we're dealing with really poor packaging right now and it's stressful, and that in the future this will all be normalized and integrated into our existing workflows.