Those aren’t good analogies because it costs nearly nothing to make that availability tradeoff and run things on your computer for your own fun.
Raspberry pi was a huge step forward, the move to LLMs is two steps back.
Raspberry pi was a huge step forward, the move to LLMs is two steps back.
Self-hosting has always have a lot of drawbacks compared with commercial solutions. I bet my self-host file server has worse reliability than Google Drive, or my self-host git server has worse number of concurrent user than github.
It's one thing you must accept when self-host.
So when you self-host LLM, you must either accept a drop in output quality, or spend a small fortune on hardware