News for hackers. Stuff that matters.
Re:Large Enough – Mistral AI by tcgv on Wednesday July 24, 2024 @01:34PM (#41059564)
Chain-of-Thought (CoT) prompting to the rescue!

We should always put some effort into prompt engineering before dismissing the potential of generative AI.

Re:Large Enough – Mistral AI by IncreasePosts on Wednesday July 24, 2024 @03:09PM (#41060686)
Why doesn't the model prompt engineer itself?
Re:Large Enough – Mistral AI by tcgv on Thursday July 25, 2024 @08:04AM (#41067618)
Because it is a challenging task, you would need to define a prompt (or a set of prompts) that can precisely generate chain-of-thought prompts for the various generic problems the model encounters.

And sometimes CoT may not be the best approach. Depending on the problem other prompt engineering techniques will perform better.

Re:Large Enough – Mistral AI by johntb86 on Wednesday July 24, 2024 @02:06PM (#41059895)
By this point, instruction tuning should include tuning the model to use chain of thought in the appropriate circumstances.