Re:Auto-Differentiating Any LLM Workflow: A Farewell to Manu...
by amelius on Saturday February 01, 2025 @08:02AM
(#42897987)
I think what they mean is intermediate prompts, i.e. the prompts that the system gives to itself when solving a problem that requires multiple stages.
[ Parent
| on HN ]
Re:Auto-Differentiating Any LLM Workflow: A Farewell to Manu...
by xg15 on Saturday February 01, 2025 @09:36AM
(#42898608)
Ah, that makes sense. So (very) basically, they're putting a number of regular LLMs into a sort of compute chain/graph, where one LLM feeds into the other, then doing gradient descent on the whole chain at once, essentialy treating the boundaries between LLM n and LLM n+1 as "hidden layers"?