News for hackers. Stuff that matters.
Re:Your back end should probably be a state machine by datadr on Thursday September 21, 2023 @10:06AM (#37597831)
Really interesting framework for thinking about backend systems. I've been messing around with LLMs, and there's a real need to check and constrain outputs when building anything rigorous. I've only been working through static workflows, but can imagine it only gets more complex if the workflow changes dynamically based on the LLM output. I wonder if this state-machine-based back end is a good way to better manage that.
Re:Your back end should probably be a state machine by abrgr on Thursday September 21, 2023 @10:09AM (#37597855)
Great point! State machines are a really nice way to orchestrate multi-step LLM invocations.

They're also a great way for LLMs to produce code. It's human-readable so you can vet that it's doing what you want it to and it's high-level enough that the remaining bits to fill in tend to be small functions that AI can easily generate.