News for hackers. Stuff that matters.
Re:Behind the curtain: what it feels like to work in AI righ... by nazgul17 on Friday April 07, 2023 @01:18AM (#35478303)
I found ChatGPT helpful in a bunch of diverse situations. I'll go into detail below, but overall I think the most valuable thing it can do is understand questions that takes both knowledge (that I don't have and want to acquire) and understanding (that prior AI technologies did not have) and provide meaningful answers. I suppose I find it very useful for my own education - with the understanding that I should use 2 or 3 grains of salt when reading its answers.

For example, I am studying Japanese and often encounter expressions that seems to mean the same thing; I would ask my teacher, but her time is limited. I can instead ask ChatGPT and only bring to my teacher the questions whose ChatGPT answers did not convince me.

Another example: I like understanding why there are certain steps in a recipe. It would be hard to find someone with the knowledge and time to answer the question, never mind I should pay for their time. ChatGPT can explain what I want to know at the level of detail that I want.

I was also able to get a decent understanding of a mathematical question I had no business understanding by recursively asking questions until I was able to link its answers to my own knowledge.

It was also able to answer questions about the Spring framework that I had while reading the documentation itself. In that context, going in rabbit holes severely slows down learning and has the potential to just get me lost.

Re:Behind the curtain: what it feels like to work in AI righ... by glandium on Friday April 07, 2023 @01:38AM (#35478423)
Be wary with ChatGPT and Japanese. As someone fluent enough and using ChatGPT for inspiration in writing, as well as to find words that either I have "on the tip of my tongue" but fail to remember, or find idiomatic expressions that I may or may not have heard of, ChatGPT can come up with weird hallucinations.

I always double check with Google searches, but at least ChatGPT gets me somewhere where I can actually search for something useful.

Relatedly, sometimes, even with an initial prompt I've used in the past to make it do what I need to a text in Japanese, and despite everything I type being in Japanese, sometimes it decides to respond entirely in English.

Re:Behind the curtain: what it feels like to work in AI righ... by roer on Friday April 07, 2023 @02:56AM (#35478907)
Are you using GPT4 or 3?
Re:Behind the curtain: what it feels like to work in AI righ... by glandium on Friday April 07, 2023 @03:40AM (#35479169)
GPT-3. Is GPT-4 significantly better with Japanese?
Re:Behind the curtain: what it feels like to work in AI righ... by fomine3 on Friday April 07, 2023 @03:56AM (#35479282)
It's night and day in Japanese.
Re:Behind the curtain: what it feels like to work in AI righ... by glandium on Friday April 07, 2023 @03:58AM (#35479298)
I guess I should give it a spin then.
Re:Behind the curtain: what it feels like to work in AI righ... by glandium on Saturday April 08, 2023 @07:44PM (#35498736)
GPT-4 still unfortunately makes up words. Which is not totally surprising considering its tokenizer.
Re:Behind the curtain: what it feels like to work in AI righ... by literalAardvark on Friday April 07, 2023 @04:09AM (#35479384)
GPT-4 is dramatically better with everything except speed. The minutia most people in this thread are complaining about is almost completely solved by GPT-4.

For example I used it over like 30 minutes to conceptualize, solve, and write some code that draws a graphic for a simple physics problem (0-shot) that I could intuitively understand but had no (physics and math knowledge) tools to calculate properly and it was a great experience.

It let me pick and change how what properties i wanted represented on the graph, knew what center of mass means, how to calculate it for a weird object, got something that feels correct to me, drew it out with various representations where i used color, size, shape to represent the various distances, weights, clusters, etc.

My non programmer friends have used generative networks to make designs for prints, incredible and generally accurate folk art, full mobile games.

People are sleeping on this. Don't be them.

Re:Behind the curtain: what it feels like to work in AI righ... by glandium on Friday April 07, 2023 @04:15AM (#35479423)
Specific examples don't generalize though. My experience with ChatGPT (GPT-3) is that it is vastly better at dealing with English than Japanese. That is still probably true with GPT-4, but that doesn't mean there hasn't been progress in GPT-4 with Japanese, which a sibling comment says is the case. But it's not because it does better at $task that you can extrapolate to a different one. People have reported GPT-3.5 being better at some things, after all.
Re:Behind the curtain: what it feels like to work in AI righ... by literalAardvark on Friday April 07, 2023 @07:22AM (#35480457)
Yeah that's fair, it may be that Japanese ended up getting pruned out. I sincerely doubt that though, it seems very, very unlikely.
Re:Behind the curtain: what it feels like to work in AI righ... by int_19h on Friday April 07, 2023 @03:41PM (#35486090)
I cannot speak for Japanese, but I'd say that GPT-4 is better at Russian.

That the model is better in English is no surprise given that most of its training corpus is in English. In fact, based on the sentence structure of the output when it speaks in Russian, it's clear that what's happening there is some kind of real-time translation from English.

That aside, I have yet to see any task on which GPT-4 wasn't at least as good as, or better than, GPT-3.5. I'd love to experiment with that. Do you recall any specific examples?

Re:Behind the curtain: what it feels like to work in AI righ... by IanCal on Friday April 07, 2023 @04:20AM (#35479457)
ChatGPT is 3.5, and the one mostly used is 3.5-turbo, that's the only free one and it's the default if you pay (though you can pick the legacy 3.5, or 4).
Re:Behind the curtain: what it feels like to work in AI righ... by worrycue on Friday April 07, 2023 @02:45AM (#35478843)
A lot of your examples you can just google search for the answer - and at least google won’t hallucinate; worst case the websites are wrong but GPT’s training data can be wrong too.