Where are you seeing Hyperbolic offering DeepSeek V3 API? I'm only seeing DeepSeek V2.5.
Thanks for mentioning that, I didn't realize they had DeepSeek v3.
If anyone sees this please upvoted the DeepSeek R1 model request https://together-ai.canny.io/model-requests/p/deepseek-ai-de...
I've done some testing and if you're inferencing on your own system (2xH100 node, 1xH200 node, or 1xMI300X node) sglang performs significantly better than vLLM on deepseek-v3 (also vLLM had an stop token issue for me, not sure if that's been fixed, sglang did not have output oddities).