News for hackers. Stuff that matters.
Re:I built a Plane Spotter in 120 secs with ChatGPT by noman-land on Monday September 04, 2023 @09:13AM (#37380153)
For me the main thing I've gained from ChatGPT (3.5) is I no longer dread that wall of lack of knowledge. Where you know so little you don't even know where to start and the task seems dreadful and insurmountable. Just a couple questions later you've got an intro, some jargon, some sample code. It makes it much easier to put the pieces together and ask followup questions.
Re:I built a Plane Spotter in 120 secs with ChatGPT by Cannabat on Monday September 04, 2023 @09:30AM (#37380276)
It's seriously empowering. I've found it to provide excellent broad strokes for topics where there are well-established best practices. In these cases, where the training data would have had numerous data that all said the same thing, you can be pretty darn sure it is not leading you astray.
Re:I built a Plane Spotter in 120 secs with ChatGPT by dleeftink on Monday September 04, 2023 @09:41AM (#37380379)
It would be nice, though, if we could actually observe the training data distributions, alternatively exploring it through the use of the chat interface itself.

Right now, without even being allowed that extra digging, it is darn difficult to be sure about its high-dimensional musings.

Re:I built a Plane Spotter in 120 secs with ChatGPT by kalleboo on Monday September 04, 2023 @09:55AM (#37380508)
Yeah this is why for the times when I know I'm going to want to double-check the sources, I use Bing's AI chat bot since that one will do a web search to find pages to summarize and then stick in the source URLs in to check
Re:I built a Plane Spotter in 120 secs with ChatGPT by dleeftink on Monday September 04, 2023 @10:16AM (#37380692)
No doubt double checking is good practice, but this still introduces some ranking artefacts, at least in my experience with Phind.

What I would like to see most is the actual word/phrase/source distributions for a given prompt, in order to judge the sparsity of the underlying training data and subsequently, 'crowd source' the remaining gaps.

Re:I built a Plane Spotter in 120 secs with ChatGPT by simias on Monday September 04, 2023 @10:06AM (#37380593)
I haven't tried ChatGPT for coding yet but I have used it to study human languages (I've been studying Japanese for a little while) and it's so easy to get it to spew complete nonsense with perfect aplomb that it makes me super wary of using it for any "serious" things. In particular anything you're not super familiar with where you can't easily evaluate if the output is correct or not.

The other day I was struggling to parse a Japanese sentence, a particular grammatical construction made no sense to me. I wrote the sentence in ChatGPT, asked it to break it down for me, and it came up with a plausible-sounding explanation. Problem was, I couldn't find any hit on google when I searched for the thing it was talking about. So I asked ChatGPT to give me more details, tell me what I could search for, and it would insist that its explanation was correct and then gaslight me by telling me that the reason I couldn't find anything on Google was because it was a niche subject not usually taught in grammar books.

After some more searching around and double-checking it turns out that I had misread a kanji and the sentence I typed into ChatGPT was complete gibberish as a result. ChatGPT's explanation, while sounding very plausible, was complete fabrication.

The idea that some inexperienced people are shipping software using this tool is insane to me.

Re:I built a Plane Spotter in 120 secs with ChatGPT by renonce on Monday September 04, 2023 @10:49AM (#37380995)
Just wondering, are you trying it with GPT-3.5 or GPT-4? Better to use GPT-4 API version since the web version’s quality was controversial. When you feel quality is subpar you should try to use the best one first.
Re:I built a Plane Spotter in 120 secs with ChatGPT by simias on Monday September 04, 2023 @11:28AM (#37381417)
I'm not sure but given that I haven't paid anything I believe it's 3.5.
Re:I built a Plane Spotter in 120 secs with ChatGPT by imposter on Monday September 04, 2023 @10:49AM (#37380998)
Maybe they didn't feed it enough linguistical data for japanese, but they surely did for code.
Re:I built a Plane Spotter in 120 secs with ChatGPT by simias on Monday September 04, 2023 @11:33AM (#37381480)
Perhaps, but I wouldn't mind if the models just answered "I'm sorry but I don't have an answer to your question at the time". In fact I think that would be a great answer that would increase the amount of trust I have in ChatGPT.

Instead the model decides to make stuff up and pretend that it knows. That's vastly worse.

It reminds me of the early days of DuckDuckGo, when if you searched for something obscure with no matches online it would still fuzzy match some garbage like a binary blob in a Chinese PDF while Google helpfully would just tell you that it couldn't find anything.

Re:I built a Plane Spotter in 120 secs with ChatGPT by Cannabat on Monday September 04, 2023 @05:57PM (#37385512)
> Instead the model decides to make stuff up and pretend that it knows. That's vastly worse.

Does the model know it doesn’t know though? Does “know” even make sense as a concept here? I don’t know if it can really introspect like that, but of course it would be so much better if it could can have some sort of confidence score with each answer.

Re:I built a Plane Spotter in 120 secs with ChatGPT by ed_elliott_asc on Monday September 04, 2023 @11:08AM (#37381196)
The thing that annoys me is that you can ask it to do something specific but it does what it wants.

For example I had a massive sql query that was loads of statements unioned together, I said “for each statement remove this filter and add this filter” and it would go “certainly, here are the first four, I have used an example table name feel free to change it” then I’d say “can you do it for all the statements, not just the first four” and it would say “of course here you go” and just give me the first four but also makes them useless by changing the table name!

I’ve got great hopes that one day I can get it to help me shape the code in a way that the jetbrains ide’s can’t today - for those I have to choose from a set of available operations - I want to talk to it and get it to change the code in a set of operations that I choose!

One day maybe :)

Re:I built a Plane Spotter in 120 secs with ChatGPT by gertlex on Monday September 04, 2023 @10:49AM (#37381005)
> The idea that some inexperienced people are shipping software using this tool is insane to me.

I really think you're trying to compare apples and oranges, in multiple ways. For one, we can test the software by running it, which is a pretty different problem from asking language questions, with a much slower ability to verify correctness (based on what you describe and what I imagine).

I'm not saying your experience is invalid. In my own adventures, the equivalent of what you did was my writing some incomplete bash in an existing script, wandered off to another part of the code. I then came back to that incomplete snippet, and though it was some unfamiliar syntax someone else had written (vim even highlighted it like it was special!). Naturally I went and asked ChatGPT what that snippet did, and wasted 15 minutes trying to corroborate it before checking the git history or something and realizing my own error.

Re:I built a Plane Spotter in 120 secs with ChatGPT by simias on Monday September 04, 2023 @11:28AM (#37381410)
>For one, we can test the software by running it

As long as the tests are not also written by ChatGPT...

Many critical security issues require a deep understanding or the code or some intense fuzzing to discover, it's not enough to ask ChatGPT "write me X" then superficially glance at the output to validate that it looks correct. That's the part that worries me. Completely broken code will be caught immediately, but subtly broken code may linger for a long time and make it to production.

And from my limited experience with ChatGPT, it seems very good at making up broken things that look superficially correct.

Re:I built a Plane Spotter in 120 secs with ChatGPT by d-lisp on Monday September 04, 2023 @09:25AM (#37380242)
I kind of enjoy it as a sort of interactive "learn x in y" to fast start some hobby project into some programming language I don't know yet. Its integration in emacs makes anything I may want to build (unprofessionally) trivial.
Re:I built a Plane Spotter in 120 secs with ChatGPT by Frummy on Monday September 04, 2023 @09:26AM (#37380254)
For sure! Now I got the courage to go back to studying, after dropping out. That was my achilles heel, I would freeze and waste two weeks on a single problem that was too abstract for me. This time, after reading a lot of mathematical philosophy, as well as having a private tutor so to speak, I don’t have that fear. Well worth it to spend some money on GPT4, like an extra textbook per period in terms of money, to crush through those abstraction walls.
Re:I built a Plane Spotter in 120 secs with ChatGPT by bergon on Monday September 04, 2023 @10:06AM (#37380592)
Do you double check everything? The hallucinations is what keeps holding me back from using it more as a private tutor.
Re:I built a Plane Spotter in 120 secs with ChatGPT by Frummy on Monday September 04, 2023 @10:15AM (#37380687)
I dont rely on it to do the work for me but to answer theoretical questions such as explaining theorems or what theorems could be applicable
Re:I built a Plane Spotter in 120 secs with ChatGPT by etrautmann on Monday September 04, 2023 @09:23AM (#37380233)
Yes, and across a virtually infinite range of disciplines. I love diving into esoteric topics like grades of tool steel, where asking follow up questions and following a thread is so much easier than looking up info from disparate sources.
Re:I built a Plane Spotter in 120 secs with ChatGPT by nerdponx on Monday September 04, 2023 @02:54PM (#37383659)
After seeing these LLMs produce a mix of correct, half-correct, and incorrect answers on subjects I'm familiar with, I am very hesitant to trust them with subjects I'm not familiar with. Let's not subject ourselves to the Gell-Mann amnesia effect here.

Credit to the creators of these systems for getting it even close, but until they can actually correctly cite their sources and provide followup references to real content instead of hallucinating titles and emitting hyperlinks to unrelated medical research papers, I'll stick to using it as a very rough overview of a subject, just to get the right collection of search terms for following up in traditional sources.

Re:I built a Plane Spotter in 120 secs with ChatGPT by neatze on Monday September 04, 2023 @09:18AM (#37380194)
Same, I just use in many places instead of first google searches, it is so easy to narrow search to a highly specific topic.
Re:I built a Plane Spotter in 120 secs with ChatGPT by andrei_says_ on Monday September 04, 2023 @09:45AM (#37380416)
How can you tell the difference between the parts of the hallucinated answer which coincide with reality and the parts of the hallucinated answer which do not - when you are entering an area you don’t have expertise in?
Re:I built a Plane Spotter in 120 secs with ChatGPT by sarchertech on Monday September 04, 2023 @10:05AM (#37380581)
You can’t. I know this because I’ve used it a lot, and it’s like a newspaper article. Anytime it’s the talking about something I’m an expert in, I spot tons of errors.

I don’t notice nearly as many errors when I’m asking it about things I’m not already an expert in. The most likely explanation is that it’s fooling me.

I pay for gpt4. People using chatgpt to “learn” are absolutely slurping up incorrect information without knowing it.

Imagine trying to teach yourself physics with textbook where 10% of it is completely but convincingly wrong.

Re:I built a Plane Spotter in 120 secs with ChatGPT by q87b on Monday September 04, 2023 @10:38AM (#37380888)
How is gpt4 different?
Re:I built a Plane Spotter in 120 secs with ChatGPT by capableweb on Monday September 04, 2023 @10:54AM (#37381054)
> Imagine trying to teach yourself physics with textbook where 10% of it is completely but convincingly wrong.

This is basically how many people already use the internet, read information on random blogposts, stack overflow and more, then take that it's true for granted. ChatGPT isn't really different than reading those things in the end.

What has to change is how people treat information that they read, no matter if it's from a blog post, ChatGPT or a friend. Verify everything, before you'd bet on that it's true.

I've used GPT4 to understand topics I've had no exposure to before, and it's true, a lot of the things GPT4 writes isn't accurate in the end, but lots of things are accurate too. That you can mold the information in a different way than static browsing, makes a lot of difference.

Overall, even with some false information, ChatGPT personally saves me a ton of times and I find myself only using Google for verifying information now, not for finding information.

Re:I built a Plane Spotter in 120 secs with ChatGPT by noman-land on Monday September 04, 2023 @10:08AM (#37380614)
It's honestly not different from coming across a blog post or a StackOverflow answer, which might be wrong or outdated. You just try it and see what works. If it doesn't work, you tinker with it, go to the documentation, etc. You can also tell ChatGPT it doesn't work and show it the error and it sometimes has ideas.
Re:I built a Plane Spotter in 120 secs with ChatGPT by TheRoque on Monday September 04, 2023 @10:49AM (#37380999)
StackOverflow is a bad example, because you see the context, and this is what is definitely missing from ChatGPT. On SO, you see the votes for this answer, you see the date, you see the comments, you see the user who posted it etc. etc. When I check answers on SO, I immediately check at the date, because sometimes it makes the answer invalid, which you can't do on ChatGPT since it's a complete black box. I prefer other tools like Phind or Bing that attempt to show the sources of what they're saying, but it's still a lot of things to process.
Re:I built a Plane Spotter in 120 secs with ChatGPT by noman-land on Monday September 04, 2023 @11:15AM (#37381276)
StackOverflow isn't the best example for the reasons you outlined. I was just trying to illustrate the trust but verify mindset. Any time you find an explanation or a solution or anything out in the world, you test it out, read about it, look up terms, etc, to get your head around what's being suggested. It's not blind copy pasting and it shouldn't be.
Re:I built a Plane Spotter in 120 secs with ChatGPT by matsemann on Monday September 04, 2023 @09:47AM (#37380437)
You can't, which is why I'm not too worried (at the moment at least) for my job. It's currently a boost to people already knowledgeable in the area, but people with a lack of understanding of the underlying principles quickly become stuck.
Re:I built a Plane Spotter in 120 secs with ChatGPT by konschubert on Monday September 04, 2023 @09:49AM (#37380456)
You’ll notice when the api call breaks or the google search comes up empty.
Re:I built a Plane Spotter in 120 secs with ChatGPT by sarchertech on Monday September 04, 2023 @10:07AM (#37380600)
In the simplest case sure. It’s just as likely to add subtle bugs that don’t immediately show up.
Re:I built a Plane Spotter in 120 secs with ChatGPT by rambambram on Monday September 04, 2023 @10:47AM (#37380973)
Search on Youtube for videos by Sam Vaknin. He explained this by what is called a 'zimbo'. An entity that looks like a human, walks like a human, talks like a human, but is essentially devoid of human-ness. The one and only way to determine the difference is trusting your gut, it 'feels' wrong. Sam Vaknin uses the term 'zimbo' (derived from zombie, I guess) to explain relationships with cluster B disordered people, but I think it can be used one-on-one on ChatGPT. Utter non-sense with a lot of conviction sometimes.

TLDR: trust your gut feeling.

Re:I built a Plane Spotter in 120 secs with ChatGPT by ta988 on Monday September 04, 2023 @11:15AM (#37381271)
Not sure that's a universal truth. I've worked with people whose gut feeling was so wrong and at the same time their overconfidence in it was so high that it was impossible to get anything done. Heuristics only work if they apply to reality, and they have intrinsic limits too.
Re:I built a Plane Spotter in 120 secs with ChatGPT by rambambram on Monday September 04, 2023 @12:27PM (#37382020)
I never said everybody's gut feeling works as it should be. That's definitely not the case. I'm only saying one's gut feeling is one's only chance at telling the difference between real and fake in the situation described by OP. After you pin pointed your gut feeling, your rational mind can take it into account. Watch out for rationalizing your gut feeling away though (HN crowd is especially prone to this, all logical thinkers). So listen to and develop your gut feeling. We're going to need it with all the AI output.
Re:I built a Plane Spotter in 120 secs with ChatGPT by yard2010 on Monday September 04, 2023 @10:35AM (#37380864)
Just make sure you cross validate the facts it gives! It might hallucinate
Re:I built a Plane Spotter in 120 secs with ChatGPT by noman-land on Monday September 04, 2023 @11:18AM (#37381317)
Definitely. I'm not really talking about facts here, as much as code snippets or questions about technologies or solutions. It's not something I would blindly copy and paste. Moreso use as a stepping stone to build understanding and solve the problem "myself" since I understand the context.