News for hackers. Stuff that matters.

A comment on A look at Apple’s new Transformer-powered predictive text model. Parent comment

Re:A look at Apple’s new Transformer-powered predictive text... by dchest on Sunday September 17, 2023 @07:16AM (#37543789)
Try running llama.cpp with 0 temperature and without repetition penalty and you'll sometimes get caught in a loop.

Or, if you're okay with a smaller LLM, go here, set temperature to zero and enjoy repetition: https://transformer.huggingface.co/doc/distil-gpt2

https://imgur.com/a/hF1Ewk4

[ Parent | on HN ]

There are no comments on this comment yet.