Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Codestral: Mistral's Code Model. Parent comment
By default only 75% of unified memory is available to GPU if you have >36GB. So with 48 total only 36 is available for GPU with is lower than 44.
tldr; without quantization you will not be able to run it.
There are no comments on this comment yet.
By default only 75% of unified memory is available to GPU if you have >36GB. So with 48 total only 36 is available for GPU with is lower than 44.
tldr; without quantization you will not be able to run it.