News for hackers. Stuff that matters.
Re:Microsoft strikes deal with Mistral in push beyond OpenAI by loceng on Monday February 26, 2024 @06:54PM (#39518345)
Thanks for the clarification.

The CSAM bit seems to then be propaganda from at least one AI company putting out PR to falsely quell people's concerns about their LLMs being able to generate content involving children that's sexualized.

I've yet to see details of how much compute-minimum server requirements are necessary to run LLMs. Maybe you know a source who's compiling a list in a feature matrix that includes such details?

Re:Microsoft strikes deal with Mistral in push beyond OpenAI by dwaltrip on Monday February 26, 2024 @09:11PM (#39519273)
Large LLMs like gpt-3 and gpt-4 need very serious hardware. They have hundreds of billions of parameters (or more) which need to be loaded in memory all at once.