News for hackers. Stuff that matters.

A comment on Show HN: sllm – Split a GPU node with other developers, unlimited tokens. Parent comment

Re:Show HN: sllm – Split a GPU node with other developers, u... by pokstad on Saturday April 04, 2026 @02:55PM (#47642083)
This problem sounds like an excellent opportunity. We need a race to the bottom for hosting LLMs to democratize the tech and lower costs. I cheer on anyone who figures this out.
[ Parent | on HN ]
Re:Show HN: sllm – Split a GPU node with other developers, u... by mememememememo on Saturday April 04, 2026 @10:16PM (#47645540)
This is classic queuing theory, rate limits etc. I don't have an answer but I would look there.
[ Parent | on HN ]
Re:Show HN: sllm – Split a GPU node with other developers, u... by taraindara on Sunday April 05, 2026 @02:57AM (#47646846)
What if you could group multiple of them. Long queries run on the group that’s commonly doing those. Shorter queries que faster because they’ll execute faster.
[ Parent | on HN ]