News for hackers. Stuff that matters.
Re:Towards Optimal LLM Quantization by eonlav on Thursday May 30, 2024 @01:59PM (#40526724)
Decent platform support - any plans for a Rust SDK?
Re:Towards Optimal LLM Quantization by bejager on Thursday May 30, 2024 @02:08PM (#40526851)
We continuously work on expanding SDK support, Rust is also on the list.