News for hackers. Stuff that matters.
Re:Collapse of Self-Trained Language Models by astrange on Wednesday April 17, 2024 @05:40PM (#40070341)
Open source models have an explicit endoftext token, yes.

You can set llama.cpp to keep generating after that and it often instantly goes offtopic.

Re:Collapse of Self-Trained Language Models by llm_trw on Wednesday April 17, 2024 @09:44PM (#40072121)
Not only off topic but out of sample.

The old style LLM hallucinations where it starts spitting out random tokens like:

    nxrt$$.full #`,,, jump #43one daisy daisy give me your answer ###