News for hackers. Stuff that matters.
Re:Databricks Strikes $1.3B Deal for Generative AI Startup M... by ml_hardware on Monday June 26, 2023 @01:09PM (#36482614)
Mosaic's MPT models are already supported in GGML: https://github.com/ggerganov/ggml

Here's MPT-30B running in 4-bit precision on CPU :) https://twitter.com/abacaj/status/1673133443339763712?s=20

Re:Databricks Strikes $1.3B Deal for Generative AI Startup M... by brucethemoose2 on Monday June 26, 2023 @01:48PM (#36483171)
Oh I didn't realize this. Everything is moving so fast that I can't even keep up with the features.