News for hackers. Stuff that matters.
Re:Was my $48K GPU server worth it? by freediddy on Thursday May 21, 2026 @02:08PM (#48226761)
It's just a project I'm working on. I'm working on projects where AIs are processing and classifying large amounts of data that would be a lot of work for humans to do.
Re:Was my $48K GPU server worth it? by wutwutwat on Thursday May 21, 2026 @03:08PM (#48227546)
I think of LLMs as being well equipped for handling dynamic data or adapting to unforeseen circumstances well (random code requests, website's ever changing layouts, typos, non-standard formatting in docs, groking out important info, etc), but math problems are be definition a very specific set of instructions to run, so is the overhead and "thinking" aspect of a LLM/AI even needed here? I'm genuinely curious, btw, I'm not asking sarcastically. Can't these math problems just be yanked from some test file and rapid fired directly at a gpu/compute unit?
Re:Was my $48K GPU server worth it? by freediddy on Thursday May 21, 2026 @03:22PM (#48227719)
> Can't these math problems just be yanked from some test file and rapid fired directly at a gpu/compute unit?

Yes this is exactly what I'm doing. I isolated the actual math question, and then sent it to my two servers to process and that's what's taking 10m+ to return. I'm asking them to solve the question and return the full answer along with their steps. I care about correctness so taking time is okay but I can't use 10m per solution.

Re:Was my $48K GPU server worth it? by jachee on Thursday May 21, 2026 @04:18PM (#48228355)
Nono, parent was asking “They’re bad and inefficient at that, so why have an LLM do math? Why not just use some code and the CPU/GPU that’s already good and efficient at basic math?”