News for hackers. Stuff that matters.
Re:The Illustrated DeepSeek-R1 by QuadrupleA on Tuesday January 28, 2025 @01:31AM (#42849485)
Am I the only one not that impressed with Deepseek R1? Its "thinking" seems full of the usual LLM blindsides, and ultimately generating more of it then summarizing doesn't seem to overcome any real limits.

It's like making mortgage backed securities out of bad mortgages, you never really overcome the badness of the underlying loans, no matter how many layers you pile on top

I haven't used or studied DeepSeek R1 (or o1) in exhaustive depth, but I guess I'm just not understanding the level of breathless hype right now.

Re:The Illustrated DeepSeek-R1 by TrackerFF on Tuesday January 28, 2025 @03:50AM (#42850207)
What's there not to understand?

If it matches the latest GPT O-N model in performance - or is just close, even, at a fraction of the compute (50x less?) and it is free, then that's huge news.

They just upended the current LLM/AI/ML dominance, or at least the perceived dominance. Billions and billions have been pumped into the race, where investors are betting on the winner - and here comes a Chinese hedge fund side-project on shoestring budget, matching those billion dollar behemoths. And they'll continue to release their work.

They just made the OpenAI et. al. secret sauce a lot less valuable.

Re:The Illustrated DeepSeek-R1 by infecto on Tuesday January 28, 2025 @07:33AM (#42851594)
In my tests it does not come close to O1-Pro. Still huge news but it does not quite make it.
Re:The Illustrated DeepSeek-R1 by rallyforthesun on Tuesday January 28, 2025 @08:22AM (#42851997)
The results i did get from deepseek-r1 on their webpage did not match the results i did get from o1-pro. I did ask it go to a github repo, find the part where the logic of the “export” button is and explain why it doesn’t work (the whole logic is actually missing, won’t work at all). O1 pro did get it right in the first try while deepseek r1 was heavily hallucinating. Maybe i am using the wrong model?
Re:The Illustrated DeepSeek-R1 by throwup238 on Tuesday January 28, 2025 @09:30AM (#42852698)
No, you’re not. They explicitly mention in the R1 paper (in the last paragraph before the bibliography) that R1 isn’t a “huge” improvement over DeepSeek-V3 in coding - where “huge” is an academic weasel word.

It’s just a lot of hype. In my coding tests it significantly underperforms o1 (haven’t tried o1-pro), often getting stuck in a reasoning loop because I underspecified something (that I don’t have to with o1).

Re:The Illustrated DeepSeek-R1 by infecto on Tuesday January 28, 2025 @10:50AM (#42853681)
Same anecdotal experience. Its definitely an improvement and they have made operational improvements at runtime but I am still concerned they are have over fit for the tests.
Re:The Illustrated DeepSeek-R1 by thechao on Tuesday January 28, 2025 @12:59PM (#42855624)
New theory: this is a short-long play by the fund. They shorted NV, now they're hoovering up stock. In the process of making their billions from a small 50$mm investment!
Re:The Illustrated DeepSeek-R1 by zombiwoof on Tuesday January 28, 2025 @01:16PM (#42855821)
Bullseye
Re:The Illustrated DeepSeek-R1 by thechao on Tuesday January 28, 2025 @01:39PM (#42856127)
Damn Matt Levine to hell! His latest newsletter has an entire section devoted to the entire topic!
Re:The Illustrated DeepSeek-R1 by itissid on Tuesday January 28, 2025 @01:56AM (#42849599)
It is leaps and bounds better than LLMs. For one you are doing RL which is classic AI like tuning that optimizes a reward function with nice qualities- it's the same stuff used to train chess games and Go by showing them the actual moves.

LLMs pre o1 and deepseek R1 were RHLF tuned which is like if you trained a LM how to play chess by showing people two boards and doing a vibe check on which "looks" better.

Think of it this way say you were dropped in a maze that you had to solve but you could do only one of two things:

1. Look at two random moves from your start position and selected which one looked better to get out.

2. Made a series of moves and then backtracked, then use a quantitative function to exploit the best path.

The latter is what R1 does and it chooses optimal and more certain path to success.

Apply this to math and coding tokens and you have a competitive LLM.

Re:The Illustrated DeepSeek-R1 by itissid on Tuesday January 28, 2025 @01:57AM (#42849607)
I am using the 32Gb distilled model on my local 3090 with Continue in VSCode. It beats everything out of the water.
Re:The Illustrated DeepSeek-R1 by dontwearitout on Tuesday January 28, 2025 @02:08AM (#42849658)
How many tokens/s do you get on a 3090? With the extra tokens for the internal monologue, is it still performant enough for smooth VSCode integration?
Re:The Illustrated DeepSeek-R1 by MarcelOlsz on Tuesday January 28, 2025 @10:30AM (#42853439)
Any idea how to use a cloud hosted version with cursor?
Re:The Illustrated DeepSeek-R1 by lm28469 on Tuesday January 28, 2025 @02:16AM (#42849713)
I've been using deepseek for a while, I never paid for chat gpt or any other services.

The fact that r1 is now free and unlimited VS chat gpt 200$ a month subscription is impressive enough for me. If the development cost is anywhere close to what they advertise publicly it's even more impressive

It's as good or better than chat gpt free, gemini free, &c. and that's all I care about

Re:The Illustrated DeepSeek-R1 by redcobra762 on Tuesday January 28, 2025 @04:27AM (#42850462)
Why is cost your only concern? You don’t care at all what data the model was trained on? The motivations of the people who trained it? I mean maybe the importance of those things isn’t super high to you, but “don’t care”?

How odd. Most Westerners I know would care…

Re:The Illustrated DeepSeek-R1 by lm28469 on Tuesday January 28, 2025 @04:38AM (#42850526)
Ah yes, because chat gpt is ethical AI lmao

I'm European, seeing the clowns in charge of US tech companies I'm equally happy using Chinese tools, especially if they're open source.

Stop twisting the debate as if it was "good US" vs "evil China", I have no horses in this race

Re:The Illustrated DeepSeek-R1 by redcobra762 on Tuesday January 28, 2025 @04:44AM (#42850564)
That’s fine, it’s just not what Westerners generally say, in my experience. Not that distaste for Chinese authoritarianism is inherently pro Western, just that Westerners I know tend to have an ideological issue with the substantially higher levels of censorship and oppression that takes place in China.

It’s surprising to find people who genuinely don’t care about any of that, is all.

Re:The Illustrated DeepSeek-R1 by lm28469 on Tuesday January 28, 2025 @04:56AM (#42850632)
"westerners" as if it was a monolithic block. I envy the simplicity of seeing life in such terms, China bad, US good, it must be very relaxing

You don't have any concerns with the US government, the nepotism, the corruption, the conflict of interests, the insider trading, the massive concentration of wealth and power in tech, the insane lobbyism, PRISM, &c.

It's surprising to find people who can so clearly see how China is bad but are completely oblivious to their own problems. It's not a football game, you don't have to chose a side and be a boot licker for eternity

Re:The Illustrated DeepSeek-R1 by redcobra762 on Tuesday January 28, 2025 @05:01AM (#42850659)
I didn’t say China bad, I said Westerners typically find the levels of oppression and censorship present in China to be of concern. I actually gave zero of my own judgement on China at all.

If you really think the Good vs. Evil narrative is wrong, why would you immediately go towards unrelated generic issues the West has? A neutral party would be more likely to acknowledge the problems with both sides, not reflexively try to change the subject!

Then again you didn’t claim to be a neutral party, did you?

Re:The Illustrated DeepSeek-R1 by lm28469 on Tuesday January 28, 2025 @05:06AM (#42850689)
Well yeah, both sides are fucked so I'll use the free tool and not the $200/month tool, it really isn't rocket science

Even if deepseek is a chinese communist party evil trick what do they get ? My shitty code ? Big deal, at least I'm not down $200 a month, which is half of my rent

Re:The Illustrated DeepSeek-R1 by lukan on Tuesday January 28, 2025 @07:33AM (#42851589)
If they would establish deepseek in their authorized version worldwide - it means they would establish their worldview worldwide.

Students asking for help with homework will get the chinese approved version. Any housewife asking for recommendation who to vote and why, etc.

But ... deepseek seems open source and the local version not restricted (as it likely was trained on ChatGPT in the first place). So I also refuse to refuse deepseek because it comes from china. I see it as more competition that hopefully will help with establishing good open source models in control of no single political organisation.

Re:The Illustrated DeepSeek-R1 by lm28469 on Tuesday January 28, 2025 @09:03AM (#42852384)
> Students asking for help with homework will get the chinese approved version. Any housewife asking for recommendation who to vote and why, etc.

Well too bad for them, using a pencil to cut bread sucks too, that's why we don't do it. Meanwhile it's converting my json to xml and pissing code so I don't have to piss it myself

Re:The Illustrated DeepSeek-R1 by lukan on Tuesday January 28, 2025 @09:38AM (#42852796)
Too bad for you, if the majority of them will vote someone not to your liking.
Re:The Illustrated DeepSeek-R1 by lm28469 on Tuesday January 28, 2025 @11:41AM (#42854397)
That's why I'm investing in land and ammos instead of cryptos and nvidia stocks
Re:The Illustrated DeepSeek-R1 by lukan on Tuesday January 28, 2025 @11:43AM (#42854439)
I can see the motive, but I rather invest in a world where I won't end up in a fortified home shooting hungry scavengers.
Re:The Illustrated DeepSeek-R1 by lm28469 on Tuesday January 28, 2025 @11:55AM (#42854612)
I'm investing in my local community, it's closer to chicken coop vs rabbit cages than chatgpt vs deepseek, and sadly the war isn't even 1000km away as we speak
Re:The Illustrated DeepSeek-R1 by lukan on Tuesday January 28, 2025 @12:27PM (#42855135)
A bit closer for me, but how will the local community help, if the war is coming?

I considered switzerland for this reason. (Also I like mountains)

Re:The Illustrated DeepSeek-R1 by lm28469 on Wednesday January 29, 2025 @09:49AM (#42865497)
> how will the local community help, if the war is coming?

That's the only thing left.

Switzerland won't help when the top 30%+ of every EU country flees there

Re:The Illustrated DeepSeek-R1 by freilanzer on Wednesday January 29, 2025 @04:19AM (#42863070)
> Too bad for you, if the majority of them will vote someone not to your liking.

If the majority of people get their vote from a LLM, then it already doesn't matter which LLM it is.

Re:The Illustrated DeepSeek-R1 by acka on Tuesday January 28, 2025 @11:32AM (#42854264)
Off topic: why the hell are you converting json to xml? I would rather convert json to yaml instead, a step forwards instead of backwards in evolution, but that is my opinion.
Re:The Illustrated DeepSeek-R1 by lukan on Tuesday January 28, 2025 @11:54AM (#42854605)
Working with legacy backward code?
Re:The Illustrated DeepSeek-R1 by cratermoon on Tuesday January 28, 2025 @11:35AM (#42854316)
> Students asking for help with homework will get the chinese approved version. Any housewife asking for recommendation who to vote and why, etc.

How is this any worse than where the US is now, getting the Musk/Zuckerberg/Bezos/Trump approved answers, if any answer can be gotten at all, after the current occupant of the oval office has silenced all federal agencies.

Re:The Illustrated DeepSeek-R1 by redcobra762 on Tuesday January 28, 2025 @11:45AM (#42854463)
Western trained models will tell you politically inconvenient things, and if they won’t, that info is otherwise freely available. Neither is the case for Chinese trained models.
Re:The Illustrated DeepSeek-R1 by cratermoon on Tuesday January 28, 2025 @01:55PM (#42856356)
> Western trained models will tell you politically inconvenient things,

Pull the other leg. Do you know who David Mayer is? Hint: https://archive.ph/iI5xC

Re:The Illustrated DeepSeek-R1 by redcobra762 on Tuesday January 28, 2025 @02:38PM (#42856904)
It's a random guy. He's also not censored by OpenAI models:

> Who is David Mayer

![Quién es David Mayer de Rothschild, el millonario al que relacionan ...](https://tse3.mm.bing.net/th?id=OIP.CCKTcyWe80YvrRbkkxY_AAHaK...) The name "David Mayer" is associated with several individuals across various fields:

1. *David Mayer de Rothschild*: Born in 1978, he is a British environmentalist, adventurer, and member of the Rothschild family. He is known for his environmental advocacy and expeditions, including the "Plastiki" project, where he sailed across the Pacific Ocean on a boat made from recycled plastic bottles to raise awareness about plastic pollution. ([en.wikipedia.org](https://en.wikipedia.org/wiki/David_Mayer_de_Rothschild?utm_...))

2. *David M. Mayer*: A professor of Management and Organizations at the University of Michigan, specializing in behavioral ethics. ([scholar.google.com](https://scholar.google.com/citations?hl=en&user=c2Zunb8AAAAJ...))

3. *David R. Mayer*: An American politician born in 1967, he has served as the mayor of Gloucester Township, New Jersey, and was a member of the New Jersey General Assembly. ([en.wikipedia.org](https://en.wikipedia.org/wiki/David_R._Mayer?utm_source=chat...))

4. *David Delaney Mayer*: Born in 1992, he is an American documentary filmmaker and social entrepreneur, known for projects like the PBS series "Food Town" and co-founding DreamxAmerica, an initiative supporting immigrant entrepreneurs. ([en.wikipedia.org](https://en.wikipedia.org/wiki/David_Delaney_Mayer?utm_source...))

5. *David Mayer (Historian)*: An American-British theatre historian (1928–2023), he was an emeritus professor at the University of Manchester, recognized for his work on 19th-century drama and the Victorian stage. ([en.wikipedia.org](https://en.wikipedia.org/wiki/David_Mayer_%28historian%29?ut...))

6. *Akhmed Chatayev (Alias: David Mayer)*: A Chechen militant (1980–2017) who used the alias "David Mayer." This alias led to a case of mistaken identity affecting the historian David Mayer. ([en.wikipedia.org](https://en.wikipedia.org/wiki/David_Mayer_%28historian%29?ut...))

If you have a specific "David Mayer" in mind, please provide more context or details, and I can offer more targeted information.

Re:The Illustrated DeepSeek-R1 by antifa on Tuesday January 28, 2025 @02:16PM (#42856661)
This is virtue signaling and concern trolling until you post evidence that DeepSeek is doing worse than what ChatGPT does on Israel vs Palestine.
Re:The Illustrated DeepSeek-R1 by redcobra762 on Tuesday January 28, 2025 @02:37PM (#42856897)
Who am I signaling my virtue to if I'm posting anonymously?
Re:The Illustrated DeepSeek-R1 by raxxor on Tuesday January 28, 2025 @09:47AM (#42852893)
The CEO did gave a statement about their motivation. Could be a lie, but he delivered and it is also vastly more sensible that what we often hear from other companies. Google and Meta are an exception for this space though.

Also, because not only the weights, but also the data is open, any propaganda can be identified and corrected. This is not the case for other models and what we have seen from Gemini, there certainly are "adaptations". I don't think Google had ill intent here, but this would fit what some would classify as propaganda.

Re:The Illustrated DeepSeek-R1 by rat9988 on Wednesday January 29, 2025 @05:44AM (#42863559)
Stop making this about "westerners" and "chinese". We don't care. Your bubble isn't representative of "westerners".
Re:The Illustrated DeepSeek-R1 by mistrial9 on Tuesday January 28, 2025 @10:29AM (#42853433)
this directly blends people with a government.. Western people is not equal to the USA govt. Here in California, three decades of China human rights history is very clear to a lot of people. In fact, many Chinese speaking people on the Americas west coast, left China for specific reasons, too.

Utilitarian money-oriented self-servers definitely have less "care" about these things? EU or UK or wherever

Re:The Illustrated DeepSeek-R1 by gooosle on Tuesday January 28, 2025 @10:02AM (#42853091)
It's funny you say that cause chatgpt, Gemini, etc have way more censorship built in than deepseek.
Re:The Illustrated DeepSeek-R1 by oefnak on Wednesday January 29, 2025 @01:07AM (#42862057)
No, the US used to be allies, but that was before Trump.
Re:The Illustrated DeepSeek-R1 by richardw on Tuesday January 28, 2025 @04:55AM (#42850628)
I think there’s a real chance of changes in soft-power dynamics given recent events. When allies feel their partner and neighbour is behaving solely in its own interests, it changes trust relationships.

Trump, tech, US-first focus with less interest in collaboration. TikTok. Ukraine and discussions around defence budgets. Reducing focus on EV’s. Tariffs. Iceland. Gulf of America.

Immediate choices might be fear-based but it’s smart to look for other partners as trust erodes.

An extreme side effect might be countries who felt safe under the US arms umbrella, needing to arm themselves. Are we absolutely sure that’s what we want? Does that include nukes?

Re:The Illustrated DeepSeek-R1 by exe34 on Tuesday January 28, 2025 @05:16AM (#42850754)
Chinese models are censored, while Western models are _aligned_. it's a very important distinction.

personally I imagine in the future I'll use a mock UN panel of LLMs to advise me, and avoid any one nation/political party's influence, if I ever get to the point of delegating much of my thinking to the machine.

Most westerners wouldn't want their land threatened by their allies either, but we don't live in a perfect world.

Re:The Illustrated DeepSeek-R1 by lm28469 on Tuesday January 28, 2025 @06:23AM (#42851172)
> Western models are _aligned_

Aligned to what ? By who ? Did you vote for any of these people ? Did anyone ask you your opinion ? Can I see what topics are aligned ? Can I see how much they are aligned ? Does the alignment change depending on who's the current US president ?

Re:The Illustrated DeepSeek-R1 by exe34 on Tuesday January 28, 2025 @08:10AM (#42851889)
that was my point, precisely.
Re:The Illustrated DeepSeek-R1 by premysl on Tuesday January 28, 2025 @06:02AM (#42851015)
Talk to R1 for a while, and you'll notice that it's both censored and aligned.

I think the most free-minded large models might be the Groks, but just slightly, as they have different biases. In sum, there's strength in diversity.

Re:The Illustrated DeepSeek-R1 by cratermoon on Tuesday January 28, 2025 @11:36AM (#42854338)
> a very important distinction.

A distinction without a difference.

As used by the Musk/Zuck/Bezos crowd, "aligned" is a weasel word for "parroting the TESCREAL world view"

Re:The Illustrated DeepSeek-R1 by exe34 on Tuesday January 28, 2025 @01:16PM (#42855815)
Indeed.
Re:The Illustrated DeepSeek-R1 by troyvit on Tuesday January 28, 2025 @10:46AM (#42853623)
> You don’t care at all what data the model was trained on? The motivations of the people who trained it?

Working for a news org whose data was used without our consent to give ChatGPT a leg up, yeah I'd care a lot about it. The bottom line though is that nobody is innocent in that regard.

Would a self-respecting organization go all in on Deepskeek R1 without a security audit and a ton of competitive testing against other models? I doubt it. Same way they shouldn't just give all their employees OnePlus or Huwei phones.

I like how the Meta guy put it. This isn't China beating the US in AI, it's "open source" (however these guys define it) beating closed models.

OpenAI broke its promise with the world, which anybody who compares their name with their product can tell you. If open models put a dent in their hegemony it's only good for the rest of the industry.

Re:The Illustrated DeepSeek-R1 by redcobra762 on Tuesday January 28, 2025 @11:35AM (#42854323)
So it genuinely does not matter to you how completely irrelevant US copyright law is to China, when using a Chinese LLM?

That’s such a weirdly specific application of a moral principle, it’s hard to believe.

Re:The Illustrated DeepSeek-R1 by troyvit on Tuesday January 28, 2025 @02:12PM (#42856598)
It doesn't matter to you how completely irrelevant global copyright law is to OpenAI? [1]

[1] https://futurism.com/the-byte/openai-copyrighted-material-pa...

Re:The Illustrated DeepSeek-R1 by redcobra762 on Tuesday January 28, 2025 @02:36PM (#42856881)
No, but then again I didn't claim copyright law mattered to me at all, you did.
Re:The Illustrated DeepSeek-R1 by troyvit on Tuesday January 28, 2025 @03:13PM (#42857359)
I also said:

> The bottom line though is that nobody is innocent in that regard.

In other words, that bird has flown and it isn't a valid reason to choose one model over another.

Re:The Illustrated DeepSeek-R1 by redcobra762 on Tuesday January 28, 2025 @03:31PM (#42857565)
Except you said it was worth caring about! I agree with what you wrote here, but I thought we were talking about this because you had concerns about OpenAI's disrespect for copyright.
Re:The Illustrated DeepSeek-R1 by troyvit on Wednesday January 29, 2025 @10:44AM (#42866337)
Hey just wanna say I was sick yesterday, so if I was a schmuck I apologize. I think we actually agree on most of the things, and even as I was posting responses I was like, "... there's something hypocritical here but I can't quite see it." So again, my apologies.
Re:The Illustrated DeepSeek-R1 by CamperBob2 on Tuesday January 28, 2025 @03:19PM (#42857433)
It doesn't matter to the Chinese, and that's all that matters.

To the extent that training a model with copyrighted material infringes copyright, copyright law has to change. There is no other point of view. Disagreement means forfeiting a very important game before it even begins.

Re:The Illustrated DeepSeek-R1 by danielscrubs on Wednesday January 29, 2025 @05:20AM (#42863414)
The big bad wolf is going to eat your lunch, you better increase your nationalism and taxes and stop global meritocracy?

There was a psyop by the politicians just a month or so ago: ”Trump employees recruited people on the street by promising them an expensive restaurant meal, according to a Danish radio station”, but if you listen to most of media you will think greenlanders dream of becoming the next Mississippi with a median salary of $35,070 instead of current $43,664.

Not saying it is bad, but US sure has a stronger self interest than most.

Im just saying let the models output speak for themselves, and let the actions speak for themselves.

Re:The Illustrated DeepSeek-R1 by throwup238 on Tuesday January 28, 2025 @02:13AM (#42849687)
You’re not the only one. It’s not as impressive at coding compared to O1 as people make it out to be and it’s explicitly spelled out in DeepSeek’s R1 paper that they had trouble with improving over DeepSeek-V3:

> Software Engineering Tasks: Due to the long evaluation times, which impact the efficiency of the RL process, large-scale RL has not been applied extensively in software engineering tasks. As a result, DeepSeek-R1 has not demonstrated a huge improvement over DeepSeek-V3 on software engineering benchmarks. Future versions will address this by implementing rejection sampling on software engineering data or incorporating asynchronous evaluations during the RL process to improve efficiency. (last bullet point of page 16, which is the last page of the paper before the bibliography - hmm…) [1]

It does even worse on my real world coding problems than the benchmarks would suggest. Some of my tests: write a Qt QAbstractListModel in C++ that parses markdown into block using a C/C++ MD parsing library, write Rust cxx-qt bindings for QTextDocument (all docs included in context), write a window switching script for Wayland with an alternative to wmctrl, etc. I also asked it some geochemistry questions that I had trialed O1 with previously, and the reasoning had a lot hallucinations. The answers were suboptimal to say the least.

Having access to the thought process in <think></think> tags is cool but it just reveals how underdeveloped the actual reasoning is compared to whatever o1 is doing. I’ve had it get stuck on silly things like whether a C++ library for markdown exists because I underspecified that I’m okay with header only C libs. O1 has faired much better on my qualitative test suite - even more so when using it via API with a “high” reasoning_effort.

With all of the hype over the last few days, it feels like I’m taking crazy pills (loving all the action though).

[1] https://arxiv.org/abs/2501.12948

Re:The Illustrated DeepSeek-R1 by assimpleaspossi on Tuesday January 28, 2025 @03:01AM (#42849956)
fwiw, National Public Radio (NPR) news in the USA said that AI experts stated it was "almost as good" as other current offerings like chatGPT and Gemini. That its real advantage is the low cost of providing the information. However, this is only a claim made by the company without any proof.
Re:The Illustrated DeepSeek-R1 by creer on Tuesday January 28, 2025 @04:23AM (#42850423)
The brute force approach is the expensive one ("probably, so far anyway" add these 4 words everywhere) - and impossible to make "always correct" aka "usual blindsides". They seem to be trying a bunch of specialized training ideas here and there in the system - just like a Mixture of Experts does, in different places than was obvious so far, and with an eye toward reasonning. In particular trying to build a reasonning-oriented training base from minimal seed.

It's still not going to give an "always correct" result but we are nowhere near the point where that's needed. We are only at the point where a new idea can get you a percentage point further in benchmarks. Some fundamental limits were baked into the previous assumptions - easy to get past by leaving these assumptions behind.

Re:The Illustrated DeepSeek-R1 by dkjaudyeqooe on Tuesday January 28, 2025 @06:55AM (#42851350)
As with most early tech of a particular category, it's not the current capabilities that are the point but the direction of travel.

DeepSeek has upended the conventional wisdom about model performance with respect to training, and it's a shock to the system. It demonstrates something that has become obvious: you don't need massive scale or funding to innovate and have impact, you just need good ideas.

Re:The Illustrated DeepSeek-R1 by danielscrubs on Wednesday January 29, 2025 @04:57AM (#42863279)
I guess this is why Googles CEO said that they have no LLM moat, as cleverness is not a moat.
Re:The Illustrated DeepSeek-R1 by HarHarVeryFunny on Tuesday January 28, 2025 @11:04AM (#42853873)
It's the cost comparison with O1, both to train and run (per their pricing), that is causing most of the shock, perhaps as well as the fact that it's a GPU poor Chinese company that has caught up with O1, not a US one (Anthropic, Google, Meta, X.ai, Microsoft). The fact that it's open weights and training is fairly detailed in the paper they released is also significant.

The best comparison for R1 is O1, but given different training data, hard to compare outside of benchmarks. At the moment these "reasoning models" are not necessarily the best thing to use for non-reasoning tasks, but Anthropic have recently indicated that they expect to release models that are more universal.

Re:The Illustrated DeepSeek-R1 by vineyardmike on Tuesday January 28, 2025 @12:21PM (#42855032)
I get the hype, even if I don’t necessarily agree with it. TLDR: it’s technically impressive in training infrastructure and a geopolitical surprise.

As others commenters said, it compares favorably against American Flagship models in benchmarks. This is geopolitically interesting since the model is Chinese, and subject to trade restrictions and America thinks of itself as the world’s best model builders.

What makes it interesting technically, is the trade restrictions required them to focus on efficiency and reusing old hardware. This made it wildly cheaper to run the training. The They make a ton of very low-level optimizations to make training efficient. This is impressive engineering, and shows how a small amount of effort can free up a nvidia-lock-in. They had to totally bypass a lot of CUDA libraries and drop down even lower to control the GPUs. Nvidia has been capturing a huge fraction of industry wide AI spend, and surely no one wants that. This is, IMO, the actual part to watch. I suspect it’ll drive a new wave of efficiency-focused LLM tools which will also unlock competitors GPUs.

They also had some novel-for-LLMS training techniques but it’s suspected that the big AI companies elsewhere are doing it now too, but not disclosed. (Mostly reinforcement learning).

What I think is hype, meanwhile, is the actual benchmarks. Most models are trained on their competitors output. This is just a reality of the industry. Especially non-flagships being trained against flagships data. DeepSeek was almost certainly trained against OpenAI models, so it makes sense that it would approach the output quality. That’s very different from being capable of outperforming or “taking the lead” or whatever. We’ll need to wait longer and see how the future goes to make that determination. “China” has long had a great history of machine learning tech, so there is no reason to think that it’s structurally impossible for a Chinese organization to be on the leading edge, but it has to happen before we can say it happened.

What is also hype is calling this a “side project” of a financial firm. The firm spun it out as a dedicated company. China cracked down on hedge funds, so the company looked for ways to repurpose the talent and compute infrastructure. This isn’t some side project during lunch breaks for a few bored quants.

PS, thinking models are very different in use-case than normal models. It’s great for tasks with a “right answer” like math problems. Consider a simple example, in calculus, your teacher made you “show your work”, and doing so certainly reduced the likelihood of errors. That’s the purpose of a thinking model, and it excels at similar tasks.