Alpaca- An Instruct Tuned Llama 7B. Responses on par with txt-DaVinci-3. Demo up

Re:Alpaca- An Instruct Tuned Llama 7B. Responses on par with... by bogwog on Monday March 13, 2023 @11:14PM (#35146939)

Not sure about this specific example, but the prompts used for training were generated by davinci. The researchers only used 175 human-written prompts, and these were fed into davinci to generate the other ~52k used for fine tuning LLaMA to make it follow instructions. They had humans review the generated prompts to eliminate bad ones before fine tuning, but humans mess up.

I wonder how davinci would respond if every single output was fed back into itself with a prompt like "does this contain any errors?". That probably wouldn't work very well.

[ Parent | on HN ]

Re:Alpaca- An Instruct Tuned Llama 7B. Responses on par with... by jimmyjack on Tuesday March 14, 2023 @03:23AM (#35148322)

Funny enough it would.

LLMs have proven to be quite good at evaluating their own output. Think of things like "Think step by step" and how that improves output.

[ Parent | on HN ]

Re:Alpaca- An Instruct Tuned Llama 7B. Responses on par with... by BoorishBears on Tuesday March 14, 2023 @03:49AM (#35148477)

A trick I've started to use with davinci is prompting it to use a calculator for all math

I preprompt it to believe it's math cannot be trusted (because it can't) and to instead output "!c <insert basic calculations>" any time it would otherwise try to solve something

The next step I'm working on this weekend is piping that to Wolfram Alpha and seeing if I can put together a wrapper to make it "seamless" in terms of responses

[ Parent | on HN ]