News for hackers. Stuff that matters.
Re:Langchain Is Pointless by Der_Einzige on Saturday July 08, 2023 @06:09PM (#36649284)
Much of why this stuff is not reusable is that eventually someone in the NLP world is going to properly migrate the features for promopt engineering that the coomers over in stable-diffusion/automatic1111 land have "pioneered", such as token weighting, negative prompts, token averaging, or etc. Literally all of these techniques work with regular LLMs (if you don't believe me, see here: https://gist.github.com/Hellisotherpeople/45c619ee22aac6865c...). NLP folks just haven't built the right tooling for it. Particularly sad since there's supposed to be an "Automatic1111 for LLMs" project called "Oogabooga" but it doesn't have any of the good features.

The future of LLM prompting will involve highly specialized and engineered prompts, much as is the case with most images seen on civit.ai

We are all likely to eventually throw away a lot of our current prompts

Re:Langchain Is Pointless by sandGorgon on Sunday July 09, 2023 @03:14AM (#36652347)
Automatic111 is the domain of Jupyter - desktop experimentation. When you go into production, there are tons of additional pieces of complexity that start hitting you - like prompt routing. So the problem space is different.

We have a simple concept - Generative AI is config management. We model it on top of config management grammar that is proven to work in large production config - jsonnet.

A trivial example is this - https://github.com/arakoodev/EdgeChains/blob/main/Examples/r...

Do u think this is something that works for you ?