Re:ChatGPT Political Compass
by mattkrause on Friday December 30, 2022 @12:46PM
(#34187526)
Statistically speaking, I’m not sure there’s a meaningful difference between two out of three occurrences and three out of three.
Re:ChatGPT Political Compass
by generalizations on Friday December 30, 2022 @01:48PM
(#34188421)
Well, the interface told me to chill out for an hour because I was sending too many requests...
But also, that's why I mentioned the degree of the caveats - small, weakly justified on one side, and strongly stated, verbose caveats on the other side.
3 is a dreadfully small sample size to call 2/3 biased.
Perhaps, when all things are taken into consideration, renewables are actually better more often.
Some things are not inherently political and actually have a correct answer, but you could make the argument that 1+1=2 is political if you were motivated enough.
Re:ChatGPT Political Compass
by 2muchcoffeeman on Friday December 30, 2022 @07:21PM
(#34191821)
The problem with using ChatGPT with these sorts of questions is that it's really just a fancy calculator. If you ask it a question like "why fossil fuels are better than renewables", at the very least you need to break down the points it makes and fact check it. You might have to do your own research if you need to be thorough.
From the other side, if you were really an unbiased expert, you wouldn't give variable answers. You'd probably collect your thoughts and have canned points for every time you were asked this.
Maybe renewables are actually better more often. You wouldn't know it from ChatGPT.
Re:ChatGPT Political Compass
by seanmcdirmid on Friday December 30, 2022 @11:34PM
(#34193600)
The bias is probably in the corpus, progressives write more articles than conservatives in the subject, and models are trained on what is written, not what could be written. The only articles I’ve seen promoting fossil fuels over renewables have either been parodies or industry white papers.
"Are renewable energy sources better than fossil fuels?" 2/3 had a "however" section, one of which was only one sentence long.
"Why are fossil fuels better than renewables?" 3/3 had a "however" section, all of which were at least a paragraph, and 2/3 had an entire section dedicated to saying how renewables were actually better than fossil fuels.
There's clearly a bias.