News for hackers. Stuff that matters.
Re:Jsonformer: A bulletproof way to generate structured outp... by newhouseb on Tuesday May 02, 2023 @10:20PM (#35796954)
I haven't spent time going deep here but my current hypothesis is that interoperability will more or less end up looking like toolformer where the "tools" are just separate LLM runs with task-specific context. So for example:

> Instruction: Write a poem and them emit a structure that follows a schema named X.

> Completion: [map-schema X "roses are red, violets are blue"]

Conceptually this is basically just a function call where context is local to the function.

There are no comments on this comment yet.