Interesting Interview with DeepSeek's CEO

Re:Interesting Interview with DeepSeek's CEO by eldenring on Tuesday December 31, 2024 @09:58AM (#42559050)

This comment is misleading. There is a "free lunch" here in the sense that serving this model is far cheaper than worse, open source models at scale.

Yes they probably are more willing to go down in price due to this, but the architecture is open, and they are charging similarly to a 30B-50B dense model, which is about how many active params deepseek-v3 has.

[ Parent | on HN ]

Re:Interesting Interview with DeepSeek's CEO by sanjams on Wednesday January 01, 2025 @11:00AM (#42566806)

So then OP is correct? Your comment confirms the same sentiment about the tradeoff API users make: cheaper inference means you pay with your data.

Sure Deepseek may publish their weights so you dont have to use the API, but the point still stands for the API.

[ Parent | on HN ]

Re:Interesting Interview with DeepSeek's CEO by eldenring on Thursday January 02, 2025 @05:17PM (#42579556)

Its a matter of degree. If 90% of the cost savings are from a new, smarter architecture, it doesn't make sense to point to the API terms as the reason for it being so cheap.

[ Parent | on HN ]