Have you used Claude? I regularly use them instead of GPT4 because of the larger context window. 4 is still useful when I want to give instructions to the system (Claude will refuse to do a lot), but generally the responses seem on par with each other.