News for hackers. Stuff that matters.
Re:GPT-3.5 crashes when it thinks about useRalativeImagePath... by SirSegWit on Monday January 22, 2024 @03:00AM (#39087364)
Not really, right? There are a ton of special tokens, like start of sequence etc., so what happens if there are two start of sequences predicted? It's a valid token but cannot really be turned into something sensible, so it throws an error when converting tokens to plain text?
Re:GPT-3.5 crashes when it thinks about useRalativeImagePath... by minimaxir on Monday January 22, 2024 @03:02AM (#39087377)
Special tokens are handled by the application, not the model. They are still output before then.