News for hackers. Stuff that matters.
Re:Nvidia Announces Financial Results for Fourth Quarter and... by inadilemma on Wednesday February 21, 2024 @05:45PM (#39460661)
Random, but a serious question. I've just received an offer from Nvidia as a Senior SWE, and another from [insert FAANG].

Should I be scared of the bubble-ness of Nvidia? I have a lot of faith in the company and its vision, but reading about the bubble always scares me.

Re:Nvidia Announces Financial Results for Fourth Quarter and... by HPMOR on Wednesday February 21, 2024 @05:54PM (#39460764)
You should ABSOLUTELY take the Nvidia offer over other FAANG. The share price of Nvidia is not speculative hype. It's very reasonable given their growth. This is not some random crypto coin. Nvidia's share price really does reflect economic reality and their position in the market. As an employee there, you'll have the opportunity to purchase shares at a reduced price through their Employee Purchasing Program. Also, any RSUs or options you get will appreciate tremendously. Financially, the best decision here is to work at Nvidia.
Re:Nvidia Announces Financial Results for Fourth Quarter and... by HDThoreaun on Wednesday February 21, 2024 @07:30PM (#39461576)
> The share price of Nvidia is not speculative hype.

The share price of nvidia will collapse as soon as anyone else releases a competitive datacenter gpu. End of the day GPU compute is fully commoditized. Massive margins in commodity markets dont exist because competition leads to a race to the bottom in pricing. Hard for me to imagine that doesnt happen eventually, but wouldnt be surprised if it took 5 years.

Re:Nvidia Announces Financial Results for Fourth Quarter and... by sgillen on Wednesday February 21, 2024 @08:24PM (#39461945)
What makes you think GPU compute is acting like a commodity right now? AMD has comparable hardware but nowhere near the same margins or demand for their chips.
Re:Nvidia Announces Financial Results for Fourth Quarter and... by HDThoreaun on Wednesday February 21, 2024 @09:06PM (#39462254)
CUDA is stopping GPUs from being commoditized today. But how can that last when every big tech company can save billions of dollars by propping up a competitor? Sure intel is incompetent and AMD might not have the software know how but they can work on their open source offering with armies of developers from other companies at their sides.
Re:Nvidia Announces Financial Results for Fourth Quarter and... by seec on Thursday February 22, 2024 @10:02AM (#39468085)
AMD really isn’t as good at the high end (by quite a decent percentage depending on the tasks) and in perf per watt term they are far ahead. Even on the gaming side the only thing somewhat saving AMD is their lower prices for traditional game rendering (without the AI utilities on top) ; they don’t even have competitive ray tracing yet.

I don’t what are you on about…

Re:Nvidia Announces Financial Results for Fourth Quarter and... by lm28469 on Wednesday February 21, 2024 @06:11PM (#39460950)
I don't know what the future will bring but the entire rally around AI and especially nvidia is the purest definition of speculation...
Re:Nvidia Announces Financial Results for Fourth Quarter and... by godelski on Wednesday February 21, 2024 @07:06PM (#39461397)
I'm highly critical of AI, even being a ML researcher myself. I'm happy to criticize GPT, explain, and collect many downvotes for these views. I say this not to act victim, but to give context for what I'm about to say. AI isn't going away. The hype is likely to die and I think we're seeing the cracks that come from over promising. But just because people are putting a polished turd on top of something doesn't mean that something isn't a golden nugget. Actually, that's my main complaint at what's going on. We got something special and very powerful. It is weird to cover it in shit and try to convince everyone it's a fancy polish.

If scale is all you need, then we'll get there. But I'm not remotely convinced and see this as the bitter lesson's bitter lesson (a misinterpretation of the bitter lesson). But if we fund alternative pathways and hedge our bets, it's possible we get there without missing a step. But imo it looks like we've created a railroad and are just going all in on laying more tracks. Doesn't seem like the right move to me, but hey, I don't know the future any more than anyone else.

Re:Nvidia Announces Financial Results for Fourth Quarter and... by godelski on Wednesday February 21, 2024 @06:59PM (#39461353)
Jensen also seems to be playing the long game and not letting go of that focus. This seems unique to me given that so many companies are hyper focused on the next quarter. I think Nvidia recognizes that there are more things than money (which was one of the things that set Google apart in the early days). Things like free days go a long way (company wide long weekend per quarter). To me the growth is more Nvidia being in the right place at the right time and taking full advantage of every leg up that they have. I don't think speculation because they aren't just celebrating the luck, but rather acting like they are seizing a lucky opportunity are are aware that it requires a lot of work to maintain.
Re:Nvidia Announces Financial Results for Fourth Quarter and... by TheAlchemist on Wednesday February 21, 2024 @07:45PM (#39461667)
I'm sorry but this must be one of the worst advice imaginable.

The company itself is great, and is making a ton of money. But the share price of Nvidia is absolutely pure speculative hype !

The math - in the past year, during which Nvidia suddenly found itself in a monopoly situation during a huge spike in AI interest (or / and hype), they made 60B$ in revenue (x2 from 2023), and 30B$ in net profit (x10 ! from 2023). Both numbers are huge. But ... the company is valued at 1800 B$ currently. There is this pesky little ratio that is sometimes useful, called price / earning ratio, and it gives a number around 60 here.

So in short - great company, perfect positioning, but way overpriced.

Re:Nvidia Announces Financial Results for Fourth Quarter and... by karmasimida on Wednesday February 21, 2024 @05:48PM (#39460707)
It is already a highly speculated bubble, the share price is swinging drastically within the same day.

That being said, Nvidia will have a good 2-3 years in the future, until the cloud providers start mass replace their chips with in-house ones.

For money, unfortunately, it is as good as anyone's guess, but if you join now, double your share, it will be close to 4T. I personally didn't think that is sustainable amount of money if market/competition does their duty.

Re:Nvidia Announces Financial Results for Fourth Quarter and... by chatmasta on Wednesday February 21, 2024 @07:02PM (#39461373)
> Nvidia will have a good 2-3 years in the future, until the cloud providers start mass replace their chips with in-house ones

How do you imagine that happening on such a rapid timeline?

IMO, the biggest threat to Nvidia is radical innovation on the software side of AI that allows common use cases (training and inference) to run on clusters of commodity non-GPU hardware for cheaper price than GPU.

A similar threat is posed from ASIC chips that are dedicated to LLM tasks, but at least in that case Nvidia can still compete for a specific hardware design rather than overcoming an entire category of commodity hardware.

Re:Nvidia Announces Financial Results for Fourth Quarter and... by godelski on Wednesday February 21, 2024 @07:16PM (#39461476)
> A similar threat is posed from ASIC chips that are dedicated to LLM tasks, but at least in that case Nvidia can still compete for a specific hardware design rather than overcoming an entire category of commodity hardware.

But also consider the reason Nvidia is doing so well in the first place. The reason is because they were already developing hardware that specialized at performing tensor operations. Maybe not at the size or always the same types we see in ML, but not very far either. There's reasons why they aren't filling cards with tensor cores. But they are clearly developing specialized hardware for ML tasks. I'm not sure betting on LLMs sticking around is the best bet though. I'll be very impressed if scale is all you need.

Re:Nvidia Announces Financial Results for Fourth Quarter and... by karmasimida on Wednesday February 21, 2024 @07:11PM (#39461435)
Simply because of there is too much money on the table, news from today:

https://qz.com/intel-microsoft-new-chip-semiconductor-nvidia...

NVDA's margin is too high, it attracts competitors to eat into that.

Re:Nvidia Announces Financial Results for Fourth Quarter and... by chatmasta on Wednesday February 21, 2024 @07:13PM (#39461449)
But how are competitors going to magically start creating market leading specialized hardware in 2-3 years? Manufacturing chips is not a core competency of any of the cloud providers, and to the extent they've been trying to make it one, they're focused on CPU.
Re:Nvidia Announces Financial Results for Fourth Quarter and... by karmasimida on Wednesday February 21, 2024 @07:17PM (#39461491)
Well there is TPU, and it is at least as good as GPU for training, all Google's models are trained TPU, it is the best class of training chips in industry.

Second, there is no need to be market leading, it just needs to be cost efficiently to be successful, even if it is slower, as long as it is cheaper. All cloud providers have huge chip design/manufacturing history, AWS/Azure and Google.

I would argue it IS indeed the core competency for those cloud providers, because of price. The inhouse chips exist because they can reduce the cost.

I know for a fact, there is huge momentum in some big clouds to replace Nvidia GPUs with their own chips, at least for their internal compute needs at first.

Re:Nvidia Announces Financial Results for Fourth Quarter and... by HDThoreaun on Wednesday February 21, 2024 @07:33PM (#39461592)
All the cloud megasclaers already have in house chip design teams that have released successful products. Designing a GPU is easier than a cpu, they just need to figure out CUDA.
Re:Nvidia Announces Financial Results for Fourth Quarter and... by chatmasta on Wednesday February 21, 2024 @08:53PM (#39462164)
They have some small manufacturing operations that are producing a minority of the chips they actually use in their servers. Maybe they'll be able to produce enough GPUs for their use cases eventually, but there is no way they'll get there in "2-3 years" as OP suggests.

Also, if GPUs are easier to make than CPUs, then why isn't Intel leading the market in GPUs by now? Surely it's been clear they should compete with Nvidia there for at least the past half a decade. Or do they need more than 2-3 years to catch up?

Re:Nvidia Announces Financial Results for Fourth Quarter and... by HDThoreaun on Wednesday February 21, 2024 @09:03PM (#39462225)
They dont manufacture themselves so ramping up is as simple as "here's another billion build 10 times as many." If they design GPUs that they think have significant cost advantages without downsides they will absolutely make that call.
Re:Nvidia Announces Financial Results for Fourth Quarter and... by chatmasta on Wednesday February 21, 2024 @09:07PM (#39462258)
I think you're making a lot of assumptions about specialist employees and hardware suddenly materializing in the place where they're needed to manufacture the stuff.

I'm not disagreeing they can catch up within 10 years. But 2-3 years is an insane estimate IMO.

Re:Nvidia Announces Financial Results for Fourth Quarter and... by HDThoreaun on Wednesday February 21, 2024 @09:15PM (#39462317)
> specialist employees and hardware suddenly materializing in the place where they're needed to manufacture the stuff.

The beauty of being fabless is that they dont need to worry about that. When theyve got a design they like they just call TSMC and buy out all their capacity, they could pay double what nvidia does and still save a boatload. I agree that 2 years seems impossible and 3 a stretch, but I do think its possible for at least one cloud company to have something by then.

Re:Nvidia Announces Financial Results for Fourth Quarter and... by seec on Thursday February 22, 2024 @10:05AM (#39468140)
Considering how long it took apple to design a competent chip I think Nvidia will be fine for quite a while. Really their current hardware design is unparalleled and they even have some software lock-in with CUDA…
Re:Nvidia Announces Financial Results for Fourth Quarter and... by cavisne on Wednesday February 21, 2024 @05:57PM (#39460801)
My impression is they still have a fairly efficient culture, the main problem with joining a bubble company would be if they are overhiring/losing focus.

Just sell shares when they vest to reduce your risk.

Re:Nvidia Announces Financial Results for Fourth Quarter and... by sfmz on Wednesday February 21, 2024 @05:56PM (#39460797)
Think of Sam Altman's ask: $7T. 7 trillion dollars is going to flow into a company that looks a lot like Nvidia whether its directed by Sam or not.

https://www.astralcodexten.com/p/sam-altman-wants-7-trillion

Re:Nvidia Announces Financial Results for Fourth Quarter and... by saintradon on Wednesday February 21, 2024 @05:57PM (#39460809)
Take it and RUN with it.
Re:Nvidia Announces Financial Results for Fourth Quarter and... by 01100011 on Wednesday February 21, 2024 @08:52PM (#39462152)
Don't think of it like that. Go where you think you'll be the most productive and learn the most. Nvidia could grow substantially from here(probably less than 50% chance of that) or they might not, but your RSUs are going to be based on the current stock price so you'll be getting less of them. The ESPP is capped so it's not like you can dump 100% of your salary into it and use a free money glitch.

If NVDA has a position that fits you and you like the team, go for it! If you're just chasing money.. please don't.

Re:Nvidia Announces Financial Results for Fourth Quarter and... by sherincall on Thursday February 22, 2024 @05:27AM (#39465281)
For whatever it's worth it to you, I've been with NVIDIA for over 10 years and I wouldn't switch to F,A,A,N nor G for even 2x my total comp. Feel free to shoot any questions to [email protected] if it'll help you decide.

Or, just talk to your hiring manager(s) about the dilemma. For both companies, it'd be better to talk through any concerns before joining. If you accept one offer and then regret it a few months later, everyone loses: you, NVIDIA and [FAANG].