Yup, GPT-4 is still likely too expensive for this application at a dollar or two per interaction with the huge context window (or 30 cents-ish with an 8k window). Especially with the tooling not proven for strong interactive use in big codebases.

But we don't need to make much improvement in tooling and economics for it to start to look pretty good.