News for hackers. Stuff that matters.
Re:DeepSeek-R1 by lhl on Monday January 20, 2025 @09:15AM (#42768940)
Fireworks, Together, and Hyperbolic all offer DeepSeek V3 API access at reasonable prices (and full 128K output) and none of them will retain/train on user submitted data. Hyperbolic's pricing is $0.25/M tokens, which is actually pretty competitive to even DeepSeek's "discount" API pricing.

I've done some testing and if you're inferencing on your own system (2xH100 node, 1xH200 node, or 1xMI300X node) sglang performs significantly better than vLLM on deepseek-v3 (also vLLM had an stop token issue for me, not sure if that's been fixed, sglang did not have output oddities).

Re:DeepSeek-R1 by gliptic on Monday January 20, 2025 @09:33AM (#42769105)
Where are you seeing Hyperbolic offering DeepSeek V3 API? I'm only seeing DeepSeek V2.5.
Re:DeepSeek-R1 by l33tc0de on Monday January 20, 2025 @10:55AM (#42769882)
Re:DeepSeek-R1 by ilaksh on Tuesday January 21, 2025 @03:13AM (#42777646)
Thanks for mentioning that, I didn't realize they had DeepSeek v3.

If anyone sees this please upvoted the DeepSeek R1 model request https://together-ai.canny.io/model-requests/p/deepseek-ai-de...