It's really not. The hardware to support anything even remotely practical starts in the tens of thousands of dollars. Quantized 40b param models are impressive, but are basically toys.

there are plenty of providers of open source models at lower prices than the frontier companies. you're just not well informed.