ashenWon
Re:Deploy dedicated DeepSeek 32B on L40 GPUs ($8/hour)
on Saturday February 01, 2025 @08:47PM (#42904786)
Is this running ollama, vllm or sglang under the hood? Curious about these performance numbers.