News for hackers. Stuff that matters.
Re:ChatGPT for Hardware Design by MuffinFlavored on Friday April 28, 2023 @12:11AM (#35737399)
I don't get this. I asked GPT-4 to help me build a machine learning program for historical stock prices. It spat back about 8 errors, functions that don't exist, nothing compiled, multiple logic flaws...

Which one of us is lying?...

Re:ChatGPT for Hardware Design by ugh123 on Friday April 28, 2023 @12:23AM (#35737458)
Probably neither of you? I've had better luck coding with ChatGPT when I ask it very concise questions, mainly at the function or small class level, but still asking for enough functionality to feel satisfied. It helps to give it a "shell" of some code, or a starting point of code to build from. I also make sure to ask it not to include 3rd party libraries (I'd consider those under separate discussions with it). It's truly helpful. And that's saying nothing about copilot integration in the IDE which is sooo good.
Re:ChatGPT for Hardware Design by newswasboring on Friday April 28, 2023 @12:28AM (#35737477)
None of you are. You are using the tool improperly. The tool cannot spit out entire applications yet, especially if all you told it was the final outcome. I see GPT-4 as a junior programmer in my team who is unusually productive. It cannot do the design for me, but executing it is a piece of cake for it.
Re:ChatGPT for Hardware Design by MuffinFlavored on Friday April 28, 2023 @10:55AM (#35742046)
> The tool cannot spit out entire applications yet,

Yesterday I had a ticket at my job to extend some functionality in a code base that was probably 200 files and 100+ lines of code in each file, and that's before any `import` references to other libraries.

How can you feed all of these tokens to GPT-4 in a cost effective way so that it knows about your application well enough to recommend/pull off code completion at a human-like level?

Re:ChatGPT for Hardware Design by newswasboring on Friday April 28, 2023 @04:06PM (#35746417)
I'm working on exactly this. I think we can use embeddings and langchain agents to do this.
Re:ChatGPT for Hardware Design by SanderNL on Friday April 28, 2023 @02:13AM (#35738043)
The largest models like GPT4 have the interesting property to really, really finish what you started. If you start with flaws of any kind, it will continue to produce them. The inverse is true as well.

This is an actual thing[1] and it’s something larger models are actually worse (better?) at. They score higher and higher on the loss function (did I predict correctly), but their utility (does it work) goes down.

Just thought it was noteworthy.

[1] https://arxiv.org/abs/2102.03896

Re:ChatGPT for Hardware Design by MuffinFlavored on Friday April 28, 2023 @10:57AM (#35742059)
> If you start with flaws of any kind

I asked it to start and it provided me the flaws :D I can share the prompt if you'd like.

Re:ChatGPT for Hardware Design by SanderNL on Friday April 28, 2023 @02:50PM (#35745487)
Please do, I’m curious.
Re:ChatGPT for Hardware Design by bombolo on Friday April 28, 2023 @03:51AM (#35738658)
Maybe he just writes really really really simple code all day and faked his way into a developer position? And then his team mates have to fix/redo anything he does?

I've seen it happen several times.

Re:ChatGPT for Hardware Design by boringuser2 on Friday April 28, 2023 @09:50AM (#35741265)
Wrong.
Re:ChatGPT for Hardware Design by boringuser2 on Friday April 28, 2023 @10:55AM (#35742032)
Asking GPT-4 to make you an entire application as a complete amateur is absurd and shows you don't understand the context window.