Re:The Llama 4 herd
by dormando on Saturday April 05, 2025 @06:48PM
(#43597445)
Does anyone run these "at home" with small clusters? I've been googling unsuccessfully and this thread doesn't refer to anything.
So a non-quantized scout won't fit in a machine with 128GB of RAM (like framework or mac studio M4). Maverick is maybe a 512GB M3 Max mac studio. Is it possible (and if so what're the tradeoffs for) running like one instance of Scout on three 128GB frameworks?
So a non-quantized scout won't fit in a machine with 128GB of RAM (like framework or mac studio M4). Maverick is maybe a 512GB M3 Max mac studio. Is it possible (and if so what're the tradeoffs for) running like one instance of Scout on three 128GB frameworks?