News for hackers. Stuff that matters.
Re:LLMs are not suitable for brainstorming by dragonwriter on Thursday May 16, 2024 @01:39AM (#40375529)
> However, all LLM’s do this.

LLM’s degree of adherence to training patterns can be directly tuned, per request (up to whatever the maximum it is capable of.)

Can this be leveraged to build a framework around an LLM for brainstorming usefully? I’m not sure. But “Nope, because LLMs just directly adhere to existing patterns” is definitely not a useful answer to that question. It is the kind of answer someone who just parrots common patterns with surface-level knowledge of the subject area would come up with. (Huh, did a default-settings LLM write this article?)

Re:LLMs are not suitable for brainstorming by little_name on Thursday May 16, 2024 @01:51AM (#40375589)
> LLM’s degree of adherence to training patterns can be directly tuned, per request (up to whatever the maximum it is capable of.)

I think people often forget the behavior of instruction following is still based on SFT training data. This is exactly "adherence to training patterns". Prompt engineering is not elixir, it's just a way to utilize the patterns seen in training data.

Re:LLMs are not suitable for brainstorming by dragonwriter on Thursday May 16, 2024 @02:03AM (#40375643)
> Prompt engineering is not elixir

I’m not talking about prompt engineering when I talk about per request tuning of how closely it follows established patterns, I’m talking about inference parameters (temperature, top_p, top_k, are common for most models and ways of calling them, some others may be available, too.)

Re:LLMs are not suitable for brainstorming by little_name on Thursday May 16, 2024 @02:15AM (#40375705)
There is a thread below discussing tuning temperature and why it's not tied to creativity. I think the point is temperature and other sampling parameters don't have any inherent mechanism to control the adherence to training pattern as a whole (all top-X candidates are all from training data). Deviating from the max probability in next token generation has no relation with thinking out of box. It does give more generation results that may be lucky to hit something, but I doubt the cost effectiveness
Re:LLMs are not suitable for brainstorming by imtringued on Thursday May 16, 2024 @02:16AM (#40375709)
How will increasing temperature improve the arithmetic performance of the model with numbers it has never seen? When prompted the right way, the model has trouble sticking to the answer that is implied by its chain of thought process. For some strange reason it knows how to perform the task, but when it is time to output the answer, it decides to recalculate it from scratch using attention. Before you complain about me benchmarking arithmetic performance. Consider that I could have defined any algebraic structure and I could have made the exact same complaint. It's just that arithmetic is very easy to verify using a calculator. Dismissing the easy arithmetic also dismisses all operations on any algebra.

The obvious problem is that these logic and arithmetic operations don't really need exhaustive training examples. Training the LLM is supposed to teach it a method or process by which it arrives at the answer, not just the question answer pair itself, which tends to only lead to very good approximate results. That is ok when using language, since your exact words don't really matter if you can express yourself in another way, but when it comes to algebras, accuracy is key.

It really is strange that when one wishes for a more capable LLM that one is told how stupid one is for wanting such a thing. What exactly is so wrong about giving the model a price list and an example of an order at a restaurant and then asking how much the whole order costs and expecting the correct total sum? For some strange reason I'm getting numbers that would make sense if I generated the text in a vacuum without the price list, as if they are following some existing pattern...

Re:LLMs are not suitable for brainstorming by dragonwriter on Thursday May 16, 2024 @02:30AM (#40375763)
> How will increasing temperature improve the arithmetic performance of the model with numbers it has never seen?

“Brainstorming” and “doing precise arithmetic” are wildly different tasks. It is a complete non-sequitur to ask how a suggestion about the former will help the latter.