News for hackers. Stuff that matters.
Re:The Myth of AI Omniscience: AI's Epistemological Limits by dvt on Saturday August 05, 2023 @12:00PM (#37013309)
Most tokens are word or sub-word level. A token can be "find" or two tokens can be "find" and "ing." To argue that this isn't inherently using the underlying grammar rules is plainly wrong. To argue that an LLM trained on English text is capable of "making up words" (in any meaningful sense of that sentence) is even more wrong.
Re:The Myth of AI Omniscience: AI's Epistemological Limits by jsight on Saturday August 05, 2023 @12:03PM (#37013345)
You might think it is wrong, but I think it is a perfectly cromulent case of AI "making up words".
Re:The Myth of AI Omniscience: AI's Epistemological Limits by jstanley on Saturday August 05, 2023 @12:09PM (#37013421)
Does this satisfy you?

  Me: give me a random character sequence that is not a pronounceable word

  ChatGPT: Sure, here's a random character sequence that is not a pronounceable word:
  "Jkplqxzv"