Show HN: Find and serve fast LLM config for your GPU
https://github.com/Aagam-Bothara/rigtune
I was having a hard time finding settings that can let me utilise the models to maxium throughput without quality compromise so I built rigtune which helps me find the settings for my hardware and model I'm using, will love your feedback and the results if you can share for this.