News for hackers. Stuff that matters.
Re:Gemini Ultra Released by ComputerGuru on Thursday February 08, 2024 @10:27AM (#39303010)
GPT-4 has a really good tokenizer that is able to retain and use more information about input tokens than one might naively think.
Re:Gemini Ultra Released by planb on Thursday February 08, 2024 @11:04AM (#39303550)
Interesting. Given the example with made up words someone posted here it really looks like I was wrong.