The LLama Effect: Leak Sparked a Series of Open Source Alternatives to ChatGPT

Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by isoprophlex on Sunday April 09, 2023 @03:47PM (#35505804)

I find the thing incredibly smart and yet utterly useless at times.

I just spent 20 minutes getting the current iteration of ChatGPT to agree with me that a certain sentence is palindromic. Even when you make it print the unaccented characters one by one, spaces excluded, backwards and forwards, it still insists "Élu par cette crapule" isn't palindromic.

I understand how tokenization makes this difficult but come on... this doesn't feel like a difficult task for something that supposedly passes the LSATs and whatnot.

* French for "Elected by this piece of shit"

[ Parent | on HN ]

Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by ShannonLimiter on Sunday April 09, 2023 @04:17PM (#35506075)

Just ask it to figure it out step-by-step and to remove accents:

GPT-4:

Figure this out step by step and check your work: Remove the accents and tell me if this a palindrome: Élu par cette crapule

GPT-3.5 (Needs to know that removing spaces and lowercasing is okay):

Figure this out step by step and check your work: Lowercase it and remove the accents and spaces and tell me if this a palindrome: Élu par cette crapule

[ Parent | on HN ]

Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by sbierwagen on Sunday April 09, 2023 @07:45PM (#35507591)

LLMs using BPEs are generally going to be bad at string reversal tasks, since they can't see individual letters: https://news.ycombinator.com/item?id=35297183

[ Parent | on HN ]