If your moat is "Our vendors aren't expanding fast enough to supply our competitors!", you don't have a moat.

It's already very practical lmao

It's really not. The hardware to support anything even remotely practical starts in the tens of thousands of dollars. Quantized 40b param models are impressive, but are basically toys.

there are plenty of providers of open source models at lower prices than the frontier companies. you're just not well informed.

It will be impractical to self host, but not to get one that's served from other providers (which won't have to recuperate loses from training).