The base config is $2500 to begin with. So not thousands plural, it is one grand more than the base config and a lot of devs/pros go for the 32GB anyhow.
Apple laptops also have atypically high resale value, I usually sell mine after a couple of years for 50%+ of what I paid for it. By the by, Apple have a two week return policy. ;)
I think only your first catch applies. But if you can come up with the right mvp even that might fall away.
You could spend $600 and build your own PC that rubs LLaMA 65b.
First of all it is $4,700 on Newegg and secondly it is out of stock. This also leaves me with the rest of the computer to put together which is not $0. And finally it would absolutely not be 10x faster for this use case than a 64GB MBP.
The advantage of going with Apple is that I can pick one up immediately, use it as a laptop (soon with Asahi linux when it matriculates fully) and if need be easily sell it. You might not see the value in that, that's alright, people have different use cases and needs.
The second catch is that you would get much higher quality out of the 65b model, but would need to lay out a few thousand for the hardware.
The third catch is that you need the fine tuning data, but that seems easier than ever to create out of more capable LMMs.