News for hackers. Stuff that matters.

A comment on Ask HN: Examples of Agentic LLM Systems in Production?. Parent comment

Re:Ask HN: Examples of Agentic LLM Systems in Production? by BrandiATMuhkuh on Tuesday December 17, 2024 @02:24AM (#42439140)
Do you have some advice on how to build the structure on how to move from one prompt to the next?

Are you using a separate state manager + function calling so the LLM knows where it is?

[ Parent | on HN ]
Re:Ask HN: Examples of Agentic LLM Systems in Production? by isoprophlex on Tuesday December 17, 2024 @03:48AM (#42439578)
You can model it as a state machine, where the LLM decides to what state it wants to advance. In terms of developer ergonomics, strongly typed outputs help. You can for example force a function call at each step, where one of the call arguments is an enum specifying the state to advance to.

Shoot me an email if you want to discuss specifics!

[ Parent | on HN ]