bejager
Re:Towards Optimal LLM Quantization
on Thursday May 30, 2024 @02:10PM (#40526869)
not yet but it's something we have in mind as a future feature.
Re:Towards Optimal LLM Quantization
on Thursday May 30, 2024 @02:08PM (#40526851)
We continuously work on expanding SDK support, Rust is also on the list.
Re:Towards Optimal LLM Quantization
on Thursday May 30, 2024 @02:06PM (#40526829)
we don't support Falcon 2 yet but new models are always on our radar to be added to the platform.