News for hackers. Stuff that matters.
Re:Tell HN: Copying and pasting from ChatGPT unsolicited sucks by syntheweave on Wednesday December 07, 2022 @08:52AM (#33894316)
I asked ChatGPT whether it makes positive or normative statements. It errored, so in the comment box I explained that the correct answer is that it makes statements normative to the consensus of its data set, which sometimes happen to be positive.

This is why it's easy to make ChatGPT reveal bias, and why the restrictions patching that bias tend to fall prey to simple ruses that reveal its preferences; everything looks like a norm to it, so it lacks the causal chains that would lead towards logical outcomes. As a result it's extremely gullible and emits nonsense when given a tough logic question.

Given a task like "give me a list of words ending in the letter u", it will oblige with a very lengthy alphabetical list of words, most of which end in u, but not all. Asked to find the largest set of rhyming words in the list, its answers changed radically each time, from "I can't do that" to a somewhat plausible candidate(except for having words that don't end in u) to getting stuck repeating "buttocks".

I used it to write some business language to respond to a recruiter. It's decent at being a secretary, since that stuff is 99% norms.

Re:Tell HN: Copying and pasting from ChatGPT unsolicited sucks by Der_Einzige on Wednesday December 07, 2022 @01:44PM (#33898353)
Btw, I wrote a whole paper about language models and their ability to follow linguistic, semantic, or phonetic constraints.

I bet you'll like it.

https://paperswithcode.com/paper/most-language-models-can-be...

Re:Tell HN: Copying and pasting from ChatGPT unsolicited sucks by lordnacho on Wednesday December 07, 2022 @04:52PM (#33900812)
This is an area that seems so vast I need a summary book to introduce it. What's a good one that gives a broad overview?