News for hackers. Stuff that matters.
Re:Understanding GPT Tokenizers by base698 on Thursday June 08, 2023 @07:16PM (#36250657)
I saw this when 3.5 came out: https://yaofu.notion.site/How-does-GPT-Obtain-its-Ability-Tr...

Haven't followed up on all the comments in it but speculates on why chain of thought improves when training on code.

Re:Understanding GPT Tokenizers by kordlessagain on Friday June 09, 2023 @08:56AM (#36257167)
> Yet whether such reasoning should be done by a language model or a symbolic system is up for discussion. For example, instead of trying hard to make GPT do three digits addition, one might simply call Python.