Show HN: Find and serve fast LLM config for your GPU
I was having a hard time finding settings that can let me utilise the models to maxium throughput without quality compromise so I built rigtune which helps me find the settings for my hardware and model I'm using, will love your feedback and the results if you can share for this.
(
no comments
| on HN
)
There are no comments yet.