News for hackers. Stuff that matters.
Re:Microsoft's paper on OpenAI's GPT-4 had hidden information by salad-tycoon on Thursday March 23, 2023 @09:17PM (#35283850)
There was a conflict of opinions with D3 and human annotator. The quote above at least does not indicate who was right or wrong, merely noting that the machine had a more sensitive sarcasm detector.

So I guess maybe it’s saying the human was wrong after all?

Re:Microsoft's paper on OpenAI's GPT-4 had hidden information by ChatGTP on Thursday March 23, 2023 @10:07PM (#35284160)
If you read the IMDB review, there is no sarcasm in it.

Maybe more like appreciation with some humour thrown in?

Are we all a bit confused and second guessing our own use and interpretation of language now ?

Re:Microsoft's paper on OpenAI's GPT-4 had hidden information by knaik94 on Thursday March 23, 2023 @10:55PM (#35284482)
I got confused about whether the review was positive or negative too. The part of the review where it says "he must have never in his life seen a flick about any small towns" could be classified as sarcastic. The review isn't very clear in terms of prose and conclusion. The reviewer clearly says "you should watch the movie", but after re-reading it a few times, I would consider that as sarcasm too. I can't say for sure whether the reviewer enjoyed it themselves.
Re:Microsoft's paper on OpenAI's GPT-4 had hidden information by ChatGTP on Friday March 24, 2023 @05:49AM (#35286986)
"he must have never in his life seen a flick about any small towns"

That's probably the least sarcastic bit for me, because it's just a reference back to the opening sentence which says: "I'm glad I don't live in a small american town because bad things happen".

Anyway, I think the conclusion is that it's pretty hard to tell and if our new robot overlord says it's sarcastic, I guess we better listen...

Re:Microsoft's paper on OpenAI's GPT-4 had hidden information by dougmwne on Thursday March 23, 2023 @10:56PM (#35284494)
It sounded jaded and a little sarcastic to me. I don’t think the reviewer liked the movie much, found it all that original or entertaining.
Re:Microsoft's paper on OpenAI's GPT-4 had hidden information by ChatGTP on Thursday March 23, 2023 @11:32PM (#35284760)
Then it’s quite subjective then , who’s right ?

He gave it a score of 7 which IMO is pretty high?

Re:Microsoft's paper on OpenAI's GPT-4 had hidden information by knaik94 on Thursday March 23, 2023 @11:47PM (#35284872)
Without the context of how the reviewer rates other movies, it's not possible to say whether 7 is high or low. I would say 7 is mid or mediocre, something I wouldn't go out of my way to watch. The trend I've noticed is that most people only use the top half of the scale, anything 5 and less is bad. The funny thing, and I am guilty of this myself, is when they only use 6 through 10 but then use decimal points too.
Re:Microsoft's paper on OpenAI's GPT-4 had hidden information by dougmwne on Friday March 24, 2023 @09:47AM (#35289025)
I doubt the score would have been part of sentiment analysis. I ignored it and tried to make a judgement based on the text alone. It seemed more like a 5/10 review to me and mildly negative.

And yes it absolutely is subjective. That’s exactly the point and the power of these LLMs, to be able to handle the vagueness of human communication.