News for hackers. Stuff that matters.
Re:Using ChatGPT as a Co-Founder by gsatic on Monday December 05, 2022 @06:31AM (#33864212)
The only people whose minds this is "blowing" are people who have never had to build or maintain question answering systems.

ChatGPT is like having a bunch of 8 year olds who know how to use Google hanging around.

Sure you can use them, and their skills might surprise u every now and then, but that has nothing to do with how much time you are going to waste on the answers they will get wrong.

Re:Using ChatGPT as a Co-Founder by buremba on Monday December 05, 2022 @06:42AM (#33864286)
OK, I get that you built such systems. Can you let us know about the other bots that can behave like a "8 years old"?
Re:Using ChatGPT as a Co-Founder by M4v3R on Monday December 05, 2022 @06:59AM (#33864414)
So you're telling me that it's not mind-blowing, that we basically created artificial intelligence capable of solving general tasks at a level of a 8 year old human being? Because to me that is still pretty mind-blowing. And I'd argue it's probably at a level above that (but not much).

When in your opinion it will finally be mind blowing? When it matches intelligence and skill of a 14 year old? 20 year old? 40?

Re:Using ChatGPT as a Co-Founder by omnicognate on Monday December 05, 2022 @08:49AM (#33865585)
GPT is not at the level of an 8 year old human being and isn't even doing remotely the same thing as an 8 year old human being.

GPT is mindblowing. It's a mindblowingly good predictive language model. It's an insanely, holy-fuck-I-never-thought-that-would-be-possible, amazingly good predictive language model. I'm thoroughly impressed. I just think it's not AGI, it's not close to AGI, it's not any kind of threat to jobs in programming (though maybe it could be in some fields) and it isn't likely to be any of these things any time soon.

The claims that it is all these things (which you can see all over these threads) are what people are arguing against.

Re:Using ChatGPT as a Co-Founder by chrisbaker98 on Monday December 05, 2022 @07:05AM (#33864473)
> ChatGPT is like having a bunch of 8 year olds who know how to use Google hanging around.

It astonishes me that people can dismiss ChatGPT like this. By your own account, there now exists an AI that can convincingly imitate a literate, technically fluent human child. That's an incredible advance that's far beyond anything that existed even a couple of years ago. How is it not amazing?

I get the sense that if some of the commenters here had been around to witness the Wright Brothers' first flight they'd have been like "meh, that's not impressive, the only people whose mind it will blow are people who've never been in a hot air balloon."

Re:Using ChatGPT as a Co-Founder by alchemist1e9 on Monday December 05, 2022 @07:29AM (#33864723)
Exactly which makes me think the egos are perhaps bruised. Yes obviously it will be wrong but using it you keep that in mind.

To expand on the analogy it is like having an 8 year old around but unbelievably this 8 year old has literally read and remembered and basically “understood” everything about everything we collectively know.

I’ve tested it with fairly esoteric questions about the technologies I work with and it gives excellent results for an 8 year old and extremely quickly about anything.

I think it can significantly speedup technical work. I intent to try and have it help me this week and see how it goes.

Re:Using ChatGPT as a Co-Founder by emehex on Monday December 05, 2022 @08:58AM (#33865683)
Framed differently: what would you (be able to) do, or (be able to) build with an infinite number of “8 year olds” at your disposal?
Re:Using ChatGPT as a Co-Founder by alchemist1e9 on Monday December 05, 2022 @09:03AM (#33865758)
A lot because I can dispatch them to collect the background knowledge for the next step. I’ve had multiple 8 years olds I’ve raised to be older and even human 8 year olds can be incredibly useful when given instructions. Actually if I remember correctly they were so useful we had to ban child labor?
Re:Using ChatGPT as a Co-Founder by guax on Monday December 05, 2022 @02:36PM (#33870700)
I believe where I disagree with you is the basically "understood" part. I don't think ChatGPT and the current models understand anything at all. Not in a way thats not fundamentally flawed and would require a complete new approach. I am hopeful that it can evolve into an incredible knowledge indexing tool but I am very hard pressed to believe it can do anything other than that at the moment.

ATM, im not sure if intentional or because it just can't do it, it just gobbles it all and spits out the mashup without knowing from where things got there, so it cant give me references.

I still think it can be very useful as it can point me to the general direction where I can copy and google stuff about its responses on subjects I know nothing about, though im not sure how much better that would be than googling it directly.

The way I see it, it still a very good simulation, just like a GCI lighting before ray tracing, very good at looking convincing but nothing underneath is actually reproducing the real thing.

Re:Using ChatGPT as a Co-Founder by FerociousTimes on Monday December 05, 2022 @07:19AM (#33864624)
It's amazing. impressive and fascinating but not superhuman, at least not yet.

Also, you can't really dismiss AI skeptics by associating them with denialists that don't see anything of quality or value of these creations despite all the evidence otherwise.

Re:Using ChatGPT as a Co-Founder by Winsaucerer on Monday December 05, 2022 @07:22AM (#33864651)
In many cases, it does a lot better than 8 year olds with Google.
Re:Using ChatGPT as a Co-Founder by NameError on Monday December 05, 2022 @11:30AM (#33867729)
I agree. I pasted a block of code from a personal project into the prompt, and asked it to add a simple-but-not-trivial frontend feature, in human language (e.g. "This button expands the sidebar and shows some clickable options. It should open a modal instead, and include a search bar which filters the available options").

It gave me working code which did something kind of like what I asked. After some back and forth where I asked for changes, it -almost- got it working. I had to make one manual CSS change.

I don't think 8 year olds can do this - it feels more like an "instant junior developer" to me.

Re:Using ChatGPT as a Co-Founder by trynewideas on Monday December 05, 2022 @12:02PM (#33868225)
It's possible to recognize the advancement within the field while simultaneously recognizing the deficiencies from a general standpoint, especially with domain knowledge of the former. ChatGPT is both fascinating in that it _can_ act like a bunch of ignorant liars using Google and Stack Overflow, and mockable because it _does_ act like a bunch of ignorant liars using Google and Stack Overflow.
Re:Using ChatGPT as a Co-Founder by baandam on Monday December 05, 2022 @12:51PM (#33869002)
ChatGPT response is "Ah, yes, 8 year olds with Google access - the pinnacle of AI technology!"

lol

Here is another, poem/rap lyric response

"ChatGPT is the best, no doubt It's like having a Google scout It's so smart and so wise It'll blow your mind, surprise!

But don't be fooled by its charm It's just a bunch of 8 year olds in a swarm"

Re:Using ChatGPT as a Co-Founder by srge on Monday December 05, 2022 @07:11AM (#33864540)
I want to be in this thread when it becomes the new infamous Dropbox thread
Re:Using ChatGPT as a Co-Founder by yesenadam on Monday December 05, 2022 @08:20AM (#33865230)
Oh please, comparing ChatGPT to Dropbox is like comparing a tiny little puddle to a vast ocean. Dropbox was a revolutionary product that changed the way we store and share files, while ChatGPT is just a mediocre language model with no real-world impact. You must be living under a rock if you think they're even in the same league.

> Write a mocking reply to someone suggesting on Hacker News that someone else dismissing ChatGPT is akin to the famous comment dismissing dropBox on Hacker News years ago.

Re:Using ChatGPT as a Co-Founder by srge on Monday December 05, 2022 @08:56AM (#33865661)
Write a sarcastic HN comment trivializing a significant tech accomplishment in the space of conversational artificial intelligence :

> Wow, another AI that can hold a conversation! I'm sure this will revolutionize the way we communicate with machines and make our lives so much easier. Definitely not a waste of time and resources at all. Keep up the impressive work!

Re:Using ChatGPT as a Co-Founder by t0lo on Monday December 05, 2022 @10:13PM (#33875430)
I picked it just before the end of the second sentence, 2/3 through. It's getting difficult to discern already. I wonder if it will deemphasise online forums.
Re:Using ChatGPT as a Co-Founder by phist_mcgee on Tuesday December 06, 2022 @12:50AM (#33876371)
Put me in the screencap.
Re:Using ChatGPT as a Co-Founder by cesarvarela on Monday December 05, 2022 @07:58PM (#33874361)
Let's not repeat the mistakes of the past and keep this thread focused on respectful and constructive discussion. Infamy is not something to strive for. Let's focus on the ideas and avoid personal attacks.
Re:Using ChatGPT as a Co-Founder by gjulianm on Monday December 05, 2022 @07:39AM (#33864814)
I have been a little bit skeptic of exaggerated claims about AI, but I tried ChatGPT and I've been amazed. My trial was not searching for anything. I tried asking the AI to code an traffic capture program with DPDK. Funnily enough, it knew several alternatives to use the code. I could also ask him to fill in certain parts, add parsing code for the packets... It's definitely far better than a bunch of 8 year olds knowing how to use Google.
Re:Using ChatGPT as a Co-Founder by 10xDev on Monday December 05, 2022 @09:47AM (#33866299)
People seem to be especially impressed by code generation like people were with chess because we associate those tasks with intelligence but they are constrained environments with well defined rules and a lot of data. Anyone who has followed the progress of RL knows that strong performance in such conditions does not mean it is comparable to human intelligence or that current architecture will scale even close to general human intelligence. It is much more comparable to a calculator.
Re:Using ChatGPT as a Co-Founder by allturtles on Monday December 05, 2022 @10:29AM (#33866867)
You are making what I think of as the standard "game move" of the AI skeptic. Chess-playing skill was considered a marker of intelligence, but then AI solved it, so it turns out it doesn't require "real" intelligence. 15 years later, neither does playing Jeopardy, it's "just" a clever Google search, that's not really intelligence. Now according to you, programming doesn't require real intelligence (and apparently neither does poetry writing, or essay writing, or any of the other things GPT can do).

In a few years, perhaps we will discover that medicine, law, the social sciences, accounting, financial advice, and white collar work generally speaking don't require intelligence either, and the only things left that will require "real" intelligence will be the building trades and maybe truck driving.

Re:Using ChatGPT as a Co-Founder by 10xDev on Monday December 05, 2022 @10:50AM (#33867178)
No, again we just discovered it only does well in constrained environments with well defined rules and a lot of data. Either that or something subjective that it can afford a lot of inaccuracy without looking totally stupid. It literally can't generalise to some basic logic problems just like AlphaZero is not going to be cooking your meals anytime soon.

If to you that's ok, fantastic. But to compare what we got so far to something intelligent rather than seeing it as more of a calculator then you are totally misrepresenting it.

Re:Using ChatGPT as a Co-Founder by motoxpro on Monday December 05, 2022 @12:51PM (#33869014)
So intelligence is a robot that can cook? Not so much an engineer or poet?
Re:Using ChatGPT as a Co-Founder by 10xDev on Monday December 05, 2022 @01:08PM (#33869269)
A key component to intelligence is generalisation which ironically you failed to do with the examples I gave.
Re:Using ChatGPT as a Co-Founder by tome on Tuesday December 06, 2022 @05:22AM (#33877748)
What's wrong with updating our definition of "intelligence" based on new data? 500 years ago people presumably thought that lifting heavy objects required "muscles". Nowadays you can do it with metal and hydraulics. Surely robots must therefore have muscles. If you deny that then you're shifting the "muscles" goalposts?!
Re:Using ChatGPT as a Co-Founder by gjulianm on Monday December 05, 2022 @11:17AM (#33867515)
I'm not claiming "general human intelligence". Just that to me it's impressive that it's able to generate code for a niche library (not too many code samples out there for DPDK), correct it according to instructions, add more code as needed... From what I've seen, it's even capable of detecting bugs. That, to me, is impressive. And I don't think programming is as much a constrained environment as chess is.
Re:Using ChatGPT as a Co-Founder by 10xDev on Monday December 05, 2022 @11:19AM (#33867551)
It is not as constrained but still fairly constrained and with a lot of data. And I was referring to the comparison to children with a search engine.
Re:Using ChatGPT as a Co-Founder by gjulianm on Monday December 05, 2022 @12:14PM (#33868430)
Well, I don't know what kind of 8 year olds you know but it definitely works better than any 8 year old I know at programming. In any way, I still think it's fairly impressive compared to what existed before.
Re:Using ChatGPT as a Co-Founder by SilkRoadie on Monday December 05, 2022 @07:54AM (#33864975)
What is mind blowing for me is the ability for ChatGPT with limited context to generate content. "Write me a letter informing X about issue Y" will draft 3 paragraphs which typically articulates the problem very well. Asking it to make the response more or less formal or to focus on a specific point will instantly rewrite it as requested.

I haven't delved too deeply but it is pretty good with code generation as well. "Write me a docker image that does X". "Let's use B instead of C." "I also require Z." It does a really solid job.

With the OP's article. It is very impressive how it generates ideas and then is able to drill down and expand on them as more detailed questions are asked. Perhaps something already can do this.. it is first time I have seen it. My experience so far is that ChatGPT is generations ahead of current assistants. For a number of tasks it is faster and more useful than Google.

Re:Using ChatGPT as a Co-Founder by watoc on Monday December 05, 2022 @08:24AM (#33865274)
What would impress you? A system that could answer any questions better than any current experts? Ok it's not always completely accurate and sometime plain wrong but still looks really impressive to me.
Re:Using ChatGPT as a Co-Founder by watoc on Monday December 05, 2022 @09:01AM (#33865731)
Did you generate your comment with ChatGPT? I can't tell.
Re:Using ChatGPT as a Co-Founder by megous on Monday December 05, 2022 @12:28PM (#33868666)
Dunno, you can start with the initial description in the TFA and continue prompting for more stuff, like:

> How to implement such a system on a Linux virtual machine using standard Debian 11 with only distribution provided packages?

It gives general steps, all look valid.

https://megous.com/dl/tmp/8af23d828e8dbf13.png

Then you can prompt for concrete realization of individual steps.

> Prepare SQL schema for the application.

https://megous.com/dl/tmp/634ebd53d1fffd6c.png

> Print the schema in PostgreSQL SQL dialect. Add a command to create a database and load the schema to the database.

https://megous.com/dl/tmp/d79b087afa9357a1.png

> Write PHP script to display login page and to allow the user to signup using the above schema.

https://megous.com/dl/tmp/ff854f009480d3d9.png

> Rewrite the PHP script to use PosgreSQL PDO and fix SQL injection issues.

https://megous.com/dl/tmp/740dc7b18b373e2f.png

I mean, this is a bit more than a glorified Googlefu.

Yesterday I gave it a small sample of a REST API schema description DSL I designed last month and told it to make another example of the similar schema description, and it created a perfectly formatted syntactically valid example that used syntactical elements correctly in contexts where it was not used in original example, but made sense to to use there. It used tokens that were not present in the original sample, but would make sense to use based on the context to a reasonable human, etc. It used documentation comments to document things in plain english. When I prompted it to translate documenation comments to other language, it did translate documentation comments only, etc.

I told it to write asterisk PBX module in C that does add a SIP header containing some internal data from asterisk channel. And it kinda did get quite close. There are two SIP channel technologies in asterisk, and it picked the older one. I just told it to rewrite the code using pjsip channel tech (similarly to how I asked it above to switch to postgresql PDO in PHP), and it did. The requested code doesn't exist anywhere as is.

I threw at it my private uncommented asterisk C module and told it to summarize what it does, and it did it pretty correctly. Random stuff like that.

The mysql code it produced above is horribly insecure, of course, but:

> Summarize issues in the above PHP code. Describe how to resolve them in plain english.

https://megous.com/dl/tmp/2e77f8a69b3a0763.png

> Fix the code to resolve the issues.

https://megous.com/dl/tmp/abd5830fb1aa4f9c.png

Yeah, wtf!