News for hackers. Stuff that matters.
Re:AISpec: Declarative config for LLM app patterns? by lewq on Friday July 05, 2024 @01:47AM (#40880099)
This spec is an attempt to will a sensible, infrastructure-independent, declarative abstraction for LLM application patterns into existence

I'd love critical feedback and for more folks to get involved

Re:AISpec: Declarative config for LLM app patterns? by drphilwinder on Friday July 05, 2024 @04:34AM (#40880884)
For me, one of the most important parts of the spec is formulation of the DAG of tasks. Whether that be calling other LLMs or some retrieval mechanism.

What does everyone think about the pros/cons of a formal DAG specification vs using natural language? E.g. defining the DAG in yaml vs. something more natural language like writing logic and making calls in the prompt text?

Re:AISpec: Declarative config for LLM app patterns? by technocat on Friday July 05, 2024 @05:39AM (#40881274)
Having a consistent, well-defined, coherent, human readable format for applications to interact with LLM's is quite critical. Having a way to specifiy data sources would be useful - RAG sources, S3 raw data files?. What about an evals section?