News for hackers. Stuff that matters.
Re:Weird GPT-4 behavior for the specific string “ davidjl” by bondarchuk on Thursday June 08, 2023 @12:07PM (#36244206)
Is this tokenization basically the same process as what was done in word2vec?
Re:Weird GPT-4 behavior for the specific string “ davidjl” by ftxbro on Thursday June 08, 2023 @02:27PM (#36246428)
No. This tokenization is huffman encoding and word2vec is embedding in cartesian space. They are very different.
Re:Weird GPT-4 behavior for the specific string “ davidjl” by bondarchuk on Thursday June 08, 2023 @08:11PM (#36251233)
Ahh. Thanks for the clarification!