Re:Translating Akkadian clay tablets with ChatGPT?
by Veen on Tuesday May 16, 2023 @03:19AM
(#35958652)
That’s more a problem of tokenisation. In many cases, it doesn’t see individual letters at all, so it can’t encode them one at a time.
[ Parent
| on HN ]
Re:Translating Akkadian clay tablets with ChatGPT?
by H8crilA on Tuesday May 16, 2023 @04:44AM
(#35959145)
I am quite sure GPT can undo tokenization if needed. It has no problem handling misspellings, plus you can just ask it to "spell things" L-I-K-E S-O.
Re:Translating Akkadian clay tablets with ChatGPT?
by RugnirViking on Tuesday May 16, 2023 @08:10AM
(#35960709)
I'm pretty sure there is a spellchecker ran before the tokenisation
also it is often wrong with spelling stuff out like that, especially with rarer or more interesting tokens