News for hackers. Stuff that matters.
Re:AlphaCodium outperforms direct prompting of OpenAI's o1 o... by richardw on Monday October 14, 2024 @01:00PM (#41839429)
So much of my workflow has moved to Claude. I haven’t quite got into Cursor, and find CoPilot fine for simple autocomplete but I don’t want bigger changes until I’ve checked them. In fact I usually heavily slow down efforts by insisting on design discussions first, and either continue, abandon/restart chat and/or write code myself and come back when the I think the issue is LLM-friendly. But Claude works for me and edits multiple files at once, which I check. I use ChatGPT (o1 or 4o) when I don’t want to impact my Claude quota or when I think a single file change is tricky. It’s personality is now too annoying. So often it doesn’t even look at the code in multiple files I’ve uploaded, it just starts shooting off code and I have to say “look at the code”.

What improvements am I missing? Honest question.

Re:AlphaCodium outperforms direct prompting of OpenAI's o1 o... by sha16 on Monday October 14, 2024 @01:34PM (#41839775)
I think Claude trades quality for speed. From what I've seen it starts generating almost immediately even with a large token window. For smaller changes it is usually good enough, but larger changes are where I bump into issues as well. I'll stick to using change [somefunction] rather than change entire file.
Re:AlphaCodium outperforms direct prompting of OpenAI's o1 o... by richardw on Monday October 14, 2024 @04:33PM (#41841653)
I tend to iterate and limit the output by eg saying “make the smallest change possible, don’t rewrite the file, tell me what you want to do first” etc. It seems to respond well to change requests, with much apology. ChatGPT berates me about its own code and keeps saving shit I don’t want in memory, so I have to go back and clean up stuff like "Is testing Lambda functions directly in the AWS web console" and "Is working with testing and integration test fixtures in their software projects" when those are 2 of 100 things I'm doing. I'm using SAM for lambda, I might have run one in the console to bypass the API and now it's saved it as gospel. Half the benefit with LLM's is that they forget context when you start a new chat, so you can control what it focuses on.
Re:AlphaCodium outperforms direct prompting of OpenAI's o1 o... by dghlsakjg on Monday October 14, 2024 @02:01PM (#41840088)
What are you using to get your code into Claude. Continue, or something similar?
Re:AlphaCodium outperforms direct prompting of OpenAI's o1 o... by richardw on Monday October 14, 2024 @04:19PM (#41841487)
No I just drag files in, at least when I'm working with IntelliJ. Sluggish but works. With VSCode I've used Copilot but still break multi-file tasks out to Claude. I’m sure the eg Cursor workflow is better but it hasn’t bitten for me yet.

I also tried Replit and it felt amazing, but quickly got into a place it couldn't escape and it felt like it took too much effort to get it to change direction once it had committed to a plan. This was early, so it's almost definitely better by now.

Re:AlphaCodium outperforms direct prompting of OpenAI's o1 o... by smuser on Monday October 14, 2024 @02:21PM (#41840317)
I really like using aider (https://aider.chat) and heavily leverage the /ask command to have a quick chat on intent and context before prompting it for the code I need.
Re:AlphaCodium outperforms direct prompting of OpenAI's o1 o... by rmbyrro on Monday October 14, 2024 @03:07PM (#41840784)
Aider feels like magic
Re:AlphaCodium outperforms direct prompting of OpenAI's o1 o... by algo_trader on Monday October 14, 2024 @02:25PM (#41840362)
is copilot improving behind the scenes ?

I assume you get the latest model, plus some goodies that GH is working on

Re:AlphaCodium outperforms direct prompting of OpenAI's o1 o... by baudpunk on Monday October 14, 2024 @01:59PM (#41840062)
Cursor is so good.