News for hackers. Stuff that matters.
Re:GPT4 is up to 6 times more expensive than GPT3.5 by falcor84 on Tuesday March 14, 2023 @07:04PM (#35160577)
GPT4 supports 32k tokens, which I guesstimate would be ~25k code tokens and perhaps ~2.5k lines of code. So already enough to work on a whole module of code at the same time. If you're using small microservices, it might already be good enough.
Re:GPT4 is up to 6 times more expensive than GPT3.5 by IanCal on Tuesday March 14, 2023 @07:27PM (#35160987)
Also if you were doing it personally you'd probably not take the whole codebase, but look at function signatures/docs as you get further away from the code you care about. While there's probably benefits in clever systems for summarising and iteratively working on the code, you can get away with just cramming a load of context in.

I have been playing with GPT4 and it's good. It's easy to imagine a bunch of use cases where even the maximal cost of a few dollars ($1.80 ish for the context alone) for a single query is worth it. If it's good enough to save you time, it's very easy to cross the threshold where it's cheaper than a person.