Re:The architecture of today's LLM applications
by lamroger on Sunday November 19, 2023 @09:45PM
(#38341588)
Make me think that a push model would be awesome. Would that be an agent?
[ Parent
| on HN ]
Re:The architecture of today's LLM applications
by lmeyerov on Monday November 20, 2023 @03:52AM
(#38344994)
Interesting, curious what you mean by push model?
Ex: Outbound - Interactive chat sessions trigger outside push update, such as to a database for data to index, new findings & enrichments, etc
Ex: Inbound - API calls trigger internal runs... which in turn can also trigger external workflows
We're experimenting with APIs for embedding in your own apps, headless APIs for automations, and all sorts of integrations. Getting security and modular/compositional interfaces right has been a fascinating challenge!