News for hackers. Stuff that matters.
Re:Show HN: sllm – Split a GPU node with other developers, u... by vova_hn2 on Saturday April 04, 2026 @01:00PM (#47640910)
1. Is the given tok/s estimate for the total node throughput, or is it what you can realistically expect to get? Or is it the worst case scenario throughput if everyone starts to use it simultaneously?

2. What if I try to hog all resources of a node by running some large data processing and making multiple queries in parallel? What if I try to resell the access by charging per token?

Edit: sorry if this comment sounds overly critical. I think that pooling money with other developers to collectively rent a server for LLM inference is a really cool idea. I also thought about it, but haven't found a satisfactory answer to my question number 2, so I decided that it is infeasible in practice.

Re:Show HN: sllm – Split a GPU node with other developers, u... by jrandolf on Saturday April 04, 2026 @01:12PM (#47641045)
1. It's an average. 2. We have sophisticated rate limiter.
Re:Show HN: sllm – Split a GPU node with other developers, u... by poly2it on Saturday April 04, 2026 @02:35PM (#47641918)
Does it take user time zones into account?
Re:Show HN: sllm – Split a GPU node with other developers, u... by jrandolf on Saturday April 04, 2026 @02:44PM (#47641990)
Yes