News for hackers. Stuff that matters.
Re:Introducing DBRX: A New State-of-the-Art Open LLM by Data... by XCSme on Wednesday March 27, 2024 @11:06AM (#39840250)
I have 128GB, but something is weird with Ollama. Even though for the Ollama Docker I only allow 90GB, it ends up using 128GB/128GB, so the system because very slow (mouse freezes).
Re:Introducing DBRX: A New State-of-the-Art Open LLM by Data... by InitEnabler on Wednesday March 27, 2024 @04:34PM (#39844257)
What docker flags are you running?
Re:Introducing DBRX: A New State-of-the-Art Open LLM by Data... by XCSme on Wednesday March 27, 2024 @07:30PM (#39845903)
None? The default ones from their docs.

The Docker also shows minimal usage for the ollama server which is also strange.