News for hackers. Stuff that matters.

A comment on Using ChatGPT Plugins with LLaMA. Parent comment

Re:Using ChatGPT Plugins with LLaMA by tyfon on Sunday March 26, 2023 @01:18PM (#35316924)
GPT-4 will also happily invent python libraries that doesn't exist to enable some functionality in the code it produces.

I don't think this is a Bard only feature.

It's not as bad as the 65B llama model I run on my (amd) PC though, especially with quantized weights it tends to stop coding at some point and repeat the last line over and over. The 30B unquantized model seems better in this particular thing.

[ Parent | on HN ]
Re:Using ChatGPT Plugins with LLaMA by AviationAtom on Sunday March 26, 2023 @04:21PM (#35319132)
With LLaMA it's all about the tuning. Using an Alpaca-tunes 7B yields pretty reasonable results, considering it's constraints.
[ Parent | on HN ]
Re:Using ChatGPT Plugins with LLaMA by BryceSchroeder on Tuesday March 28, 2023 @11:06AM (#35342257)
You might want to consider the sampler you're using. Consider using a repetition penalty.
[ Parent | on HN ]