Re:Show HN: sllm – Split a GPU node with other developers, u...
by mogili1 on Saturday April 04, 2026 @02:19PM
(#47641732)
Rate limit essentially is a token limit
[ Parent
| on HN ]
Re:Show HN: sllm – Split a GPU node with other developers, u...
by ibejoeb on Saturday April 04, 2026 @03:28PM
(#47642442)
It depends on how it's implemented. If it's a fixed window, then your absolute ceiling is tokens/windows in a month. If it's a function of other usage, like a timeshare, you're still paying for some price for a month and you get what you get without paying more per token. There's an intrinsic limit based on how many tokens the model can process on that gpu in a month anyway, even if it's only you.
Re:Show HN: sllm – Split a GPU node with other developers, u...
by delusional on Saturday April 04, 2026 @06:51PM
(#47644364)
Time x capacity is also a limit. There's always a limit.