Re:Weird GPT-4 behavior for the specific string “ davidjl”
by ftxbro on Thursday June 08, 2023 @02:27PM
(#36246428)
No. This tokenization is huffman encoding and word2vec is embedding in cartesian space. They are very different.
[ Parent
| on HN ]
Re:Weird GPT-4 behavior for the specific string “ davidjl”
by bondarchuk on Thursday June 08, 2023 @08:11PM
(#36251233)
Ahh. Thanks for the clarification!