News for hackers. Stuff that matters.

A comment on French AI startup Mistral releases ‘unmoderated’ chatbot via torrent. Parent comment

Re:French AI startup Mistral releases ‘unmoderated’ chatbot ... by objektif on Saturday September 30, 2023 @09:17AM (#37715148)
Do you have any resources to read on how to host LLMs in general? I am looking for scaleable ways to host our own models. Thanks.
[ Parent | on HN ]
Re:French AI startup Mistral releases ‘unmoderated’ chatbot ... by speedgoose on Sunday October 01, 2023 @04:41AM (#37723993)
Sorry I haven’t followed the latest developments to run at scale since the summer. I don’t have concurrent users so llama.cpp or diffusers are good enough for me.
[ Parent | on HN ]