News for hackers. Stuff that matters.
Re:Everything around LLMs is still magical and wishful thinking by TeMPOraL on Saturday July 05, 2025 @03:02AM (#44470662)
For the purpose of keeping the costs of LLM-dependent services down, you don't need to run bleeding-edge models on single consumer GPUs. Even if it takes a hundred GPUs, it still means people can start businesses around hosting those models, and compete with the large vendors.

There are no comments on this comment yet.