News for hackers. Stuff that matters.
Re:Was my $48K GPU server worth it? by freediddy on Friday May 22, 2026 @10:34AM (#48236461)
The speed of results for an API call to ChatGPT is 10-100x faster than my local LLM. I haven't exactly quantified the results but I was getting results in a few seconds vs 10+ minutes for my local LLM. I'm going to do a deep dive this weekend and try to get better results, but it was staggering. I'll also do a deep dive on how to optimize my setup and see if I can get things to perform much quicker.

There are no comments on this comment yet.