News for hackers. Stuff that matters.
Re:OpenAI co-founder John Schulman says he will leave and jo... by aleph_minus_one on Tuesday August 06, 2024 @11:52AM (#41172073)
> So if LLMs weren't surprising to you, it would imply you expected this.

I do claim that I have a tendency to be quite right about the "technological side" of such topics when I'm interested in them. On the other hand, events turn out to be different because of "psychological effects" (let me put it this way: I have a quite different "technology taste" than the market average).

In the concrete case of LLMs: the psychological effect why the market behaved so much differently is that I believed that people wouldn't fall for the marketing and hype of LLMs and would consider the excessive marketing to be simply dupery. The surprise to me was that this wasn't what happened.

Concerning NVidia: I believed that - considering the insane amount of money involved - people/companies would write new languages and compilers to run AI code on GPUs (or other ICs) of various different suppliers (in particular AMD and Intel) because it is a dangerous business practice to make yourself dependent on a single (GPU) supplier. Even serious reverse-engineering endeavours for doing this should have paid off considering the money involved. I was again wrong about this. So here the surprise was that lots of AI companies made themselves so dependent on NVidia.

Seeing lots of "unconventional" things is very helpful for doing math (often the observations that you see are the start of completely new theorems). Being good at stock trading and investing in my opinion on the other hand requires a lot of "street smartness".

Re:OpenAI co-founder John Schulman says he will leave and jo... by sanxiyn on Tuesday August 06, 2024 @04:08PM (#41174793)
Re: NVIDIA. I wholeheartedly agree. Google/TPU is an existence proof that it is entirely possible and rational to do so. My surprise was that everyone except Google missed.
Re:OpenAI co-founder John Schulman says he will leave and jo... by snapcaster on Wednesday August 07, 2024 @07:59AM (#41180470)
Okay so $0 it sounds like, you should figure out a way to monetize your future sight otherwise it comes off as cynicism masquerading as intelligence
Re:OpenAI co-founder John Schulman says he will leave and jo... by aleph_minus_one on Wednesday August 07, 2024 @12:02PM (#41182700)
> cynicism masquerading as intelligence

Rather: cynicism and a form of intelligence that is better suited to abstract math than investing. :-)