Re:The architecture of today's LLM applications
by lmeyerov on Monday November 20, 2023 @03:52AM
(#38344994)
Interesting, curious what you mean by push model?
Ex: Outbound - Interactive chat sessions trigger outside push update, such as to a database for data to index, new findings & enrichments, etc
Ex: Inbound - API calls trigger internal runs... which in turn can also trigger external workflows
We're experimenting with APIs for embedding in your own apps, headless APIs for automations, and all sorts of integrations. Getting security and modular/compositional interfaces right has been a fascinating challenge!
Re:The architecture of today's LLM applications
by lamroger on Monday November 20, 2023 @01:00PM
(#38351647)
Automated alerts - SRE as a service. Anomaly detection with some good suggestions. SRE intern as a service? Something like that - notifying you of something vs human requesting.
Ex: Outbound - Interactive chat sessions trigger outside push update, such as to a database for data to index, new findings & enrichments, etc
Ex: Inbound - API calls trigger internal runs... which in turn can also trigger external workflows
We're experimenting with APIs for embedding in your own apps, headless APIs for automations, and all sorts of integrations. Getting security and modular/compositional interfaces right has been a fascinating challenge!