News for hackers. Stuff that matters.

A comment on Gpt4all: A chatbot trained on ~800k GPT-3.5-Turbo Generations based on LLaMa. Parent comment

Re:Gpt4all: A chatbot trained on ~800k GPT-3.5-Turbo Generat... by stolsvik on Thursday March 30, 2023 @10:11AM (#35372964)
As I understand these models, that makes no sense whatsoever. Is it the tokenisation that takes this crazy amount of time? Because each additional token should take exactly the same amount of time as the first.
[ Parent | on HN ]

There are no comments on this comment yet.