News for hackers. Stuff that matters.
Re:Nvidia to Acquire Arm for $40B by gautamcgoel on Sunday September 13, 2020 @07:50PM (#24464953)
This is awful. Out of all the big tech companies, Nvidia is probably least friendly to open source and cross-platform comparability. It seems to me that their goal is to monopolize AI hardware over the next 20 years, the same way Intel effectively monopolized cloud hardware over the last 20. Expect to see less choice in the chip market and more and more propietary software frameworks like CUDA. A sad day for CS and for AI.
Re:Nvidia to Acquire Arm for $40B by tony on Sunday September 13, 2020 @09:32PM (#24465761)
Surprisingly - they have a working driver for FreeBSD. Never had an issue with it - and the performance is fantastic. As far back as early 2000's I remember installing proprietary nvidia drivers on Linux and playing UT2004.

Maybe Nintendo/Sony uses Nvidia cards on their developer machines? I imagine FreeBSD drivers aren't simply altruism on their part.

On the other hand, stagnation on other fronts:

- Nouveau (tried recently) is basically unusable on Ubuntu. As in the mouse/keyboard locks every 6 seconds.

- Proprietary drivers won't work with wayland

And since their stuff isn't open, the community can't do much to push Nouveau forward.

Re:Nvidia to Acquire Arm for $40B by phire on Sunday September 13, 2020 @09:50PM (#24465918)
Nvidia's "Blob" approach does have an advantage when it comes to supporting random OSes.

It's less of a driver and more of an operating system. Basically self-contained with all the support libraries it needs. Super easy to port to a new operating system and any driver improvement work on all OSes.

But the approach also has many downsides. It's big. It ignores all the native stuff (like linux's GEM interface).

It also has random issues with locking up the entire system. Like if you are debugging a process with the linux drivers, a breakpoint or a pause in the wrong place can deadlock the system.

Re:Nvidia to Acquire Arm for $40B by loeg on Sunday September 13, 2020 @10:42PM (#24466227)
You say that, but: Nvidia's "blob" driver doesn't have CUDA, NVENC/NVDEC, nor DDC I2C support on FreeBSD — despite all of this functionality being specific to Nvidia's own hardware, and the support being present in the Linux blob, which runs on a relatively similar platform.

If the only differing bits were the portability framework, this would just be a matter of adding missing support. But it isn't — the FreeBSD object file Nvidia publishes lacks the internal symbols used by the Linux driver.

Re:Nvidia to Acquire Arm for $40B by magic_quotes on Sunday September 13, 2020 @10:55PM (#24466289)
> If the only differing bits were the portability framework, this would just be a matter of adding missing support. But it isn't — the FreeBSD object file Nvidia publishes lacks the internal symbols used by the Linux driver.

In fact it is. For Linux and FreeBSD Nvidia distributes exactly the same blob for compilation into nvidia.ko; the blobs for nvidia-modeset.ko are slightly different. (Don't take my word for it, download both drivers and compare kernel/nvidia/nv-kernel.o_binary with src/nvidia/nv-kernel.o.) Nothing is locked in the closed source part.

Re:Nvidia to Acquire Arm for $40B by loeg on Saturday September 19, 2020 @01:51PM (#24529225)
The userspace CUDA/NVENC libraries are distributed as pre-compiled artifacts in the Linux driver, and no such FreeBSD library is distributed in the FreeBSD driver package.
Re:Nvidia to Acquire Arm for $40B by magic_quotes on Sunday September 13, 2020 @10:25PM (#24466136)
Native Linux stuff is not at all native for FreeBSD. If Nvidia suddenly decides to open their driver (to merge it into Linux), FreeBSD and Solaris support will be the first thing thrown out.
Re:Nvidia to Acquire Arm for $40B by zamadatix on Sunday September 13, 2020 @10:00PM (#24466000)
Not just developer machines e.g. the Nintendo Switch uses an Nvidia Tegra X1 and run FreeBSD. Lots of game consoles do, you don't have to worry about the GPL.
Re:Nvidia to Acquire Arm for $40B by Shared404 on Sunday September 13, 2020 @10:22PM (#24466115)
I thought the switch ran a modified form of android, but just looked it up and found this on the Switch Wikipedia page:

> Despite popular misconceptions to the contrary, Horizon [The switch software's codename] is not largely derived from FreeBSD code, nor from Android, although the software licence[7] and reverse engineering efforts[8][9] have revealed that Nintendo does use some code from both in some system services and drivers.

That being said, at least one of the Playstation's runs a modified form of FreeBSD.

Edit: add [The ... codename]

Re:Nvidia to Acquire Arm for $40B by zamadatix on Monday September 14, 2020 @10:27AM (#24470533)
Very interesting, thanks!
Re:Nvidia to Acquire Arm for $40B by loeg on Sunday September 13, 2020 @10:39PM (#24466213)
The FreeBSD blob driver will drive a monitor, but it lacks a bunch of GPU hardware support the Linux one has: all of CUDA, NVENC/NVDEC, I²C DDC, and certainly more.
Re:Nvidia to Acquire Arm for $40B by non-entity on Sunday September 13, 2020 @10:41PM (#24466223)
I knew it was too good to be true.
Re:Nvidia to Acquire Arm for $40B by gautamcgoel on Sunday September 13, 2020 @09:34PM (#24465779)
Is the FreeBDD driver open source? Also, somehow I was under the impression they stopped maintaining the FreeBSD driver. Is that correct?
Re:Nvidia to Acquire Arm for $40B by magic_quotes on Sunday September 13, 2020 @10:22PM (#24466114)
> impression they stopped maintaining the FreeBSD driver.

It's maintained while simultaneously not receiving any new features.

Re:Nvidia to Acquire Arm for $40B by throwaway2048 on Sunday September 13, 2020 @10:35PM (#24466194)
Note this includes support for newer cards, so its only a matter of time before FreeBSD support is EOL'd
Re:Nvidia to Acquire Arm for $40B by loeg on Sunday September 13, 2020 @10:45PM (#24466242)
https://www.nvidia.com/Download/driverResults.aspx/163239/en...

The latest FreeBSD driver is 450.66, published 2020-8-18. Supports RTX 20xx, GTX 16xx, GTX 10xx, and older.

Re:Nvidia to Acquire Arm for $40B by magic_quotes on Sunday September 13, 2020 @10:39PM (#24466217)
New cards are fully supported. Why do you think they aren't?
Re:Nvidia to Acquire Arm for $40B by Conan_Kudo on Sunday September 13, 2020 @09:46PM (#24465883)
They did. The proprietary NVIDIA driver is required on FreeBSD as well. The FreeBSD community just doesn't care about this.
Re:Nvidia to Acquire Arm for $40B by dheera on Sunday September 13, 2020 @09:56PM (#24465960)
The proprietary driver also doesn't support fractional scaling on 20.04 and I've been waiting ages for that.
Re:Nvidia to Acquire Arm for $40B by therealmarv on Sunday September 13, 2020 @08:08PM (#24465104)
The problem is more that AMD is sleeping in regard of GPU AI and good software interfaces.
Re:Nvidia to Acquire Arm for $40B by burnte on Sunday September 13, 2020 @08:21PM (#24465220)
Hardly sleeping, they have a fraction of the revenue and profit of NVidia and Intel. Revenue was half of Nvidia, profit was 5% of NVidia. Intel is even bigger. They only have so much in the way of R&D money.
Re:Nvidia to Acquire Arm for $40B by adventured on Sunday September 13, 2020 @09:09PM (#24465577)
> Revenue was half of Nvidia, profit was 5% of NVidia.

For operating income it's 25%, for net income it's 18%; not 5%.

Last four quarters operating income for AMD: $884 million

Last four quarters operating income for Nvidia: $3.5 billion

This speaks to the dramatic improvement in AMD's operating condition over the last several years. For contrast, in fiscal 2016 AMD's operating income was negative $382 million. Op income has increased by over 300% in just ~2 1/2 years. Increasingly AMD is no longer a profit lightweight.

Re:Nvidia to Acquire Arm for $40B by burnte on Sunday September 13, 2020 @09:47PM (#24465896)
I was using 2019 numbers rather than last 4 quarters. I also talked about revenue and profit, not operating anything.

AMD 2019 Revenue: $6.73b [1] NVIDIA 2019 Revenue: $11.72b [2]

Roughly half, as I said.

AMD 2019 Profit (as earnings per share): $0.30 [1] NVIDIA 2019 Profit (as earnings per share): $6.63 [2]

4.52%, rounds to 5%, as I said.

However, you still proved my point. Lightweight or not, they do not, and have not had the amount of money available compared to NVidia and Intel. It's growing, they'll be able to continue to invest, and they have an advantage in the CPU space that should last for another year or two, giving them a great influx of cash, and their focus on Zen 2 really paid off allowing them greater cash flow to focus on GPUs as well.

[1] https://ir.amd.com/news-events/press-releases/detail/930/amd... [2] https://nvidianews.nvidia.com/news/nvidia-announces-financia...

Re:Nvidia to Acquire Arm for $40B by nerderloo on Sunday September 13, 2020 @11:58PM (#24466622)
Earnings per share is only useful when you look at the stock price. Since number of outstanding shares are different between two companies, it's incorrect to measure company's profit based on EPS.
Re:Nvidia to Acquire Arm for $40B by adventured on Sunday September 13, 2020 @10:22PM (#24466119)
> AMD 2019 Profit (as earnings per share): $0.30 [1] NVIDIA 2019 Profit (as earnings per share): $6.63 [2]

> 4.52%, rounds to 5%, as I said.

You're misunderstanding how to properly compare profitability between two companies.

If Company A has 1 billion shares outstanding and earns $0.10 per share, that's $100m in profit.

If Company B has 10 billion shares outstanding and earns $0.05 per share, that's $500m in profit.

Company A is not 100% larger on profit just because they earned more per share. It depends on how many shares you have outstanding, which is what you failed to account for.

AMD's profit was not close to 5% of Nvidia's in 2019. That is what you directly claimed (as you're saying you went by the last full fiscal year).

AMD had $341m in net income in their last full fiscal year. Nvidia had $2.8 billion in net income for their last full fiscal year. That's 12%, not 5%. And AMD's operating income was 22% of Nvidia for the last fiscal year.

The trailing four quarters and operating income, is the superior way to judge the present condition of the two companies, rather than using the prior fiscal year. Especially given the rapid ongoing improvement in AMD's business. Regardless, even going by the last full fiscal year, your 5% figure is still wrong by a large amount.

Operating income is a key measure of profitability and it's a far better manner of gauging business profitability than net income at this point. That's because the modern net income numbers are partially useless as they will include such things as asset gains/losses during the quarter. If you want to read up more on it, Warren Buffett has pointed out the absurdity of this approach on numerous occasions (if Berkshire's portfolio goes up a lot, they have to report that as net income, even though it wasn't a real profit generation event).

I didn't say anything refuting your revenue figures, because I wasn't refuting them. I'm not sure why you mention that.

Re:Nvidia to Acquire Arm for $40B by Polylactic_acid on Sunday September 13, 2020 @08:32PM (#24465300)
ROCm is their product for compute and it still can't run on their latest NAVI cards which have been out for over a year while CUDA works on every nvidia card on day one.
Re:Nvidia to Acquire Arm for $40B by reader_mode on Sunday September 13, 2020 @08:31PM (#24465294)
Seeing their market performance I have no doubt they could get capital for R&D
Re:Nvidia to Acquire Arm for $40B by zrm on Sunday September 13, 2020 @09:09PM (#24465581)
Their market performance is a relatively recent development. R&D has a lead time.
Re:Nvidia to Acquire Arm for $40B by Aeolun on Sunday September 13, 2020 @08:27PM (#24465264)
It is frankly amazing AMD can keep up at all.
Re:Nvidia to Acquire Arm for $40B by RantyDave on Sunday September 13, 2020 @09:29PM (#24465732)
They are doing something very right over there.
Re:Nvidia to Acquire Arm for $40B by slavik81 on Sunday September 13, 2020 @10:49PM (#24466266)
Aside from Navi support, which has already been mentioned, what would you like to see?
Re:Nvidia to Acquire Arm for $40B by twblalock on Sunday September 13, 2020 @09:45PM (#24465872)
On the other hand, if Nvidia wants ARM to succeed (and why else would they acquire it?), they can be a source of more competition in the CPU market.

I don't really see how this deal makes the CPU market worse -- wasn't the ARM market for mobile devices basically dominated by Qualcomm for years? Plus, the other existing ARM licensees don't seem to be impacted. On the other hand, I do see a lot of potential if Nvidia is serious about innovating in the CPU space.

Re:Nvidia to Acquire Arm for $40B by QuixoticQuibit on Sunday September 13, 2020 @08:40PM (#24465353)
NVIDIA’s hardware works on x86, PowerPC, and ARM platforms.

Many of their AI libraries/tools are in fact open source.

They stand to be a force that could propel ARM’s strength in data center and desktop computing. For some reason you’re okay with the current x86 duopoly held by AMD and Intel, both who have their own destiny over CPUs and GPUs.

The HN crowd is incredibly biased against certain companies. Why not look at some of the potential bright sides to this for a more nuanced and balanced opinion?

Re:Nvidia to Acquire Arm for $40B by LanternLight83 on Sunday September 13, 2020 @08:46PM (#24465411)
There are good points on both sides; as a Linux user, I feel the effects of their proprietary drivers and uncooperative approach, while I can also appreciate that they've managed to work with the Gnome and KDE project to have some support under Wayland, and the contributions they've made to the machine learning communities. Ad a whole, I do think that the former outweighs the latter, and loath the acquisition, but do think that the resources they're packing will bring ARM to new heights for the majority users.
Re:Nvidia to Acquire Arm for $40B by endgame on Sunday September 13, 2020 @09:15PM (#24465624)
Re:Nvidia to Acquire Arm for $40B by selectodude on Sunday September 13, 2020 @10:00PM (#24466003)
"October 26, 2017"

I'm not coming out and saying it's gotten significantly better, but that is a three year old article and Nvidia-wayland does work on KDE and Gnome.

Re:Nvidia to Acquire Arm for $40B by timidger on Sunday September 13, 2020 @10:24PM (#24466131)
That's because they implemented egl streams, nothing has changed majorly since then. There's been a lot of talk, but no action towards unification. The ball is entirely in Nvidia's court and they continue to work together on this.
Re:Nvidia to Acquire Arm for $40B by CountSessine on Sunday September 13, 2020 @10:32PM (#24466181)
The funny thing about GBM vs EGLStreams, though, based on everything I’ve read online, is that there’s broad agreement that EGLStreams is the technically superior approach - and that the reason it’s been rejected by the Linux graphics devs is GBM, while inferior, has broad hardware vendor support. Apparently very few GPU vendors outside the big 3 had decent EGl implementations.
Re:Nvidia to Acquire Arm for $40B by ddevault on Sunday September 13, 2020 @11:08PM (#24466367)
That's not true. EGLStreams would be better suited to Nvidia's proprietary driver design, but it's technically inferior. This is the "broad agreement". No one but Nvidia wants EGLStreams, or we would have implemented it in other drivers.
Re:Nvidia to Acquire Arm for $40B by CountSessine on Monday September 14, 2020 @01:21AM (#24467034)
You know I did a bit more reading about this, and it sounds like you’re right. There’s a great discussion about it here:

https://mesa-dev.freedesktop.narkive.com/qq4iQ7RR/egl-stream...

Re:Nvidia to Acquire Arm for $40B by arp242 on Sunday September 13, 2020 @10:26PM (#24466143)
I don't really have an opinion on nVidia, as I haven't dealt with any of their products for over a decade; my own problem with this is somewhat more abstract: I'm not a big fan of this constant drive towards merging all these tech companies (or indeed, any company really). Perhaps there are some short-term advantages for the ARM platform, but on the long term it means a few small tech companies will have all the power, which doesn't strike me as a good thing.
Re:Nvidia to Acquire Arm for $40B by QuixoticQuibit on Sunday September 13, 2020 @10:55PM (#24466291)
I don’t disagree with you, but I see it two ways:

1. The continued conglomeratization in the tech sector is a worrying trend as we see fewer and fewer small players.

2. Only a large-ish company could provide effective competition in the CPU/ISA/architecture space against the current x86 duopoly.

Re:Nvidia to Acquire Arm for $40B by arp242 on Sunday September 13, 2020 @11:56PM (#24466611)
I'm not so sure about that second point; I don't see why an independent ARM couldn't provide an effective competition? Server ARMs have been a thing for a while, and Apple has been working on ARM macbooks for a while. I believe the goal is even to completely displace Intel macBooks in favour of the ARM ones eventually.

The big practical issue is probably software compatibility and the like, and it seems to me that the Apple/macOS adoption will do more for that than nVidia ownership.

Re:Nvidia to Acquire Arm for $40B by dis-sys on Sunday September 13, 2020 @10:24PM (#24466132)
> Why not look at some of the potential bright sides to this for a more nuanced and balanced opinion?

because as a NVIDIA user of the last 20 years, I never saw such bright side when it comes to open source.

Re:Nvidia to Acquire Arm for $40B by ianai on Sunday September 13, 2020 @08:48PM (#24465422)
Yes I wonder the same thing about the sentiment against nvidia. It’s be helpful if there were some wiki about things they’ve killed or instances they’ve acted against foss systems.
Re:Nvidia to Acquire Arm for $40B by mixmastamyk on Sunday September 13, 2020 @09:03PM (#24465540)
Linus famously gave them the middle-finger.
Re:Nvidia to Acquire Arm for $40B by paulmd on Sunday September 13, 2020 @09:47PM (#24465889)
"linus went on a hyperbolic rant" isn't sufficient evidence for anything.

linus is a hyperbolic jerk (as he admitted himself for a few months before resuming his hyperbolic ways) who is increasingly out of touch with anything outside the direct sphere of his projects. Like his misguided and completely unnecessary rants about ZFS or AVX.

if there are technical merits to discuss you can post those instead of just appealing to linus' hyperbole.

(I won't even say "appeal to authority" because that's not what you're appealing to. You're literally appealing to his middle finger.)

Re:Nvidia to Acquire Arm for $40B by arp242 on Sunday September 13, 2020 @10:36PM (#24466201)
He just responded to a complaint that nVidia hardware wasn't working with "nVidia is the worst company we've dealt with". I don't think that's "out of touch", it's pretty much the kind of stuff his job description entails. If you don't like his style, fair enough, but if the leader of a project says "company X is the worst company we deal with" then that doesn't inspire a whole lot of confidence.
Re:Nvidia to Acquire Arm for $40B by paulmd on Monday September 14, 2020 @01:06PM (#24472494)
AFAIK the debate was mostly settled by NVIDIA submitting their own EGLStreams backend for Wayland (that promptly exposed a bunch of Wayland bugs). So difficult to work with, that NVIDIA, asking to do something different and then submitting their own code to implement it!

https://www.phoronix.com/scan.php?page=news_item&px=EGLStrea...

AFAIK it also ended up being literally a couple thousand lines of code, not some massive endeavor, so the Wayland guys don’t come off looking real great, looks like they have their own Not Invented Here syndrome and certainly a lot of generalized hostility towards NVIDIA. Like Torvalds, I'll be blunt, my experience is that a lot of people just know NVIDIA is evil because of these dozens of little scandals they’ve drummed up, and they almost all fall apart when you look into them, but people just fall back on asserting that NVIDIA must be up to something because of these 27 other things (that also fall apart when you poke them a bit). It is super trendy to hate on NVIDIA in the same way it’s super trendy to hate on Apple or Intel.

Example: everyone used to bitch and moan about G-Sync, the biggest innovation in gaming in 10 years. Oh, it's this proprietary standard, it's using a proprietary module, why are they doing this, why don't they support the Adaptive Sync standard? Well, at the time they started doing it, Adaptive Sync was a draft standard for power-saving in laptops that had languished for years, there was no impetus to push the standard through, there were no monitors that supported it, and no real push to implement monitors either. Why take 10 years to get things through a standards group when you can just take a FPGA and do it yourself? And once you've done all that engineering work, are you going to give it away for free? Back in 2016 I outright said that sooner or later NVIDIA would have to support Adaptive Sync or else lose the home theater market/etc as consoles gained support. People told me I was loony, "NVIDIA'S just not that kind of company", etc. Well, turns out they were that kind of company, weren't they? Turns out people were mostly mad that... NVIDIA didn't immediately give all their engineering work away for free.

The GPP is the only thing I’ve seen that really stank and they backed off that when they saw the reaction. Other than that they are mostly guilty of... using a software license you don’t like. It says a lot about the success of copyleft that anyone developing software with a proprietary license is automatically suspect.

The truth is that NVIDIA, while proprietary, does a huge amount of really great engineering in novel areas that HNers would really applaud if it were any other company. Going and making your own monitor from scratch with a FPGA so you can implement a game-changing technology is exactly the kind of go-getter attitude that this site is supposed to embody.

Variable refresh rate/GSync is a game changer. DLSS 2.0 is a game changer. Raytracing is a game changer. And you have NVIDIA to thank for all of those, "proprietary" and all. They would not exist today without NVIDIA, AMD or Intel would not have independently pushed to develop those, even though they do have open-source drivers. What a conundrum.

Re:Nvidia to Acquire Arm for $40B by arp242 on Monday September 14, 2020 @06:19PM (#24475804)
I'm not sure if Linus was talking about the Wayland stuff specifically; the answer was in response to a complaint that the nvidia/Intel graphics card switching didn't work on Linux.

I haven't used nvidia products for about 10 years and I' m not really in to gaming or graphics, so I don't really have an opinion on them either way, either business or technical. I used their FreeBSD drivers back in the day and was pretty happy it allowed me to play Unreal Tournament on my FreeBSD machine :-)

Linus is not always right, but a lot of what he says is often considerably more nuanced and balanced than his "worst-of" highlight reel suggests. There are plenty of examples of that in the presentation/Q&A he did from which this excerpt comes, for example (but of course, most people only see the "fuck you" part).

So if Linus – the person responsible for writing operating systems with their hardware – says they're the "worst company we deal with" then this strikes me as a good reason to at least do your research if you plan to buy hardware from them, if you intend to use it with Linux anyway. I'll take your word for it that they're doing great stuff, but if it outright refuses to work on my Linux box then that's kinda useless to me.

This was also 6 or 7 years ago I think, so perhaps things are better now too.

Re:Nvidia to Acquire Arm for $40B by ianai on Monday September 14, 2020 @08:51PM (#24476811)
Thank you for this comment. I learned quite a bit! As an investor it makes sense to go with a company that takes the profit for a renovation for a while.
Re:Nvidia to Acquire Arm for $40B by andrewprock on Sunday September 13, 2020 @10:04PM (#24466023)
The notion that the maintainer if Linux has a narrow focus role that isn't capable of advocating and serving the broader community is belied by the fact that Linux has grown from being a niche hobbyist platform to the de facto cloud standard OS.
Re:Nvidia to Acquire Arm for $40B by paulmd on Monday September 14, 2020 @12:36PM (#24472133)
https://arstechnica.com/gadgets/2020/01/linus-torvalds-zfs-s...

https://www.zdnet.com/article/linus-torvalds-i-hope-intels-a...

/shrug. The guy can't keep from popping off with obviously false statements about things he knows nothing about. What exactly do you want me to say? Yes, he's been a good manager for the linux kernel, but he is self-admittedly hyperbolic and statements like these show that he really doesn't have an issue running his mouth about things that he really doesn't understand.

It is the old problem with software engineers: they think expertise in one field or one area makes them a certified supergenius with relevant input in completely unrelated areas. I can't count how many times I've seen someone on HN suggest One Weird Trick To Solve Hard Problems in [aerospace/materials sciences/etc]. Linus suffers from the same thing.

His experiences with NVIDIA are probably relevant, and if so we can discuss that, but the fact that he gave someone the middle finger in a Q+A session is not. That's just Linus being an asshole.

(and him being a long-term successful project manager doesn't make him not an asshole either. Jensen's an asshole and he's one of the most successful tech CEOs of all time. Linus doesn't mince words and we should do the same - he's an asshole on a professional level, the "I'm just being blunt!" schtick is just a nice dressing for what would in any other setting be described as a textbook toxic work environment, and his defenses are textbook "haha it's just locker room talk/we're all friends here" excuses that people causing toxic work environment are wont to make. He knows it, he said he'd tone it down, that lasted about a month and he's back to hyperbolic rants about things he doesn't really understand... like ZFS and AVX. But hey I guess they're not directed at people this time.)

Again, if he's got relevant technical input we can discuss that but "linus gives the middle finger!!!!" is not the last word on the topic.

Re:Nvidia to Acquire Arm for $40B by andrewprock on Monday September 14, 2020 @01:13PM (#24472581)
I don't take issue with the fact that Linus' behavior is problematic.
Re:Nvidia to Acquire Arm for $40B by mixmastamyk on Sunday September 13, 2020 @10:17PM (#24466089)
A little defensive, no? I trust his judgement more than Mr. Random on the internets.
Re:Nvidia to Acquire Arm for $40B by WrtCdEvrydy on Sunday September 13, 2020 @09:18PM (#24465640)
Nvidia does not publish drivers, only binary blobs.

You generally have to wrap those and use them while not being foss-compatible.

[dead]
Re:Nvidia to Acquire Arm for $40B by dang on Sunday September 13, 2020 @10:51PM (#24466275)
This is off topic and breaks the site guidelines. Would you please review them and stick to the rules?

This sort of $BigCo metaflamewar in which each side accuses HN of being shills for the opposite side is incredibly repetitive and tedious. It's also a cognitive bias; everyone feels like the community (and the moderators for that matter) is biased against whatever view they favor.

https://hn.algolia.com/?dateRange=all&page=0&prefix=false&qu...

https://hn.algolia.com/?dateRange=all&page=0&prefix=true&sor...

https://news.ycombinator.com/newsguidelines.html

Re:Nvidia to Acquire Arm for $40B by Shared404 on Sunday September 13, 2020 @10:12PM (#24466072)
Haven't looked at the rest of your posts, but if this gets flagged, it's probably from this:

[Edit: I disagree with my past self of having put this comment here. This is something that if one feels that they notice, they should probably comment on. Leaving it here for clarity's sake]

> The HN algorithm basically encourages an echo chamber of people who gang up and downvote/flag others who don't agree with the gang opinion.

or this:

> (Psst ... If you see this comment disappear after a while, it's probably because the same Apple fanboys found this comment and decided to hammer it down again.)

than this:

> criticizing Apple's monopoly and policies

Source: Have criticized Apple without having been downvoted and flagged.

[dead]
Re:Nvidia to Acquire Arm for $40B by Shared404 on Sunday September 13, 2020 @10:38PM (#24466212)
> I've been downvoted to hell for speaking the above.

Fair enough. I don't think I've ever mentioned Apple by name, just participated in threads about them and commented on how I disagree about how they do some things.

I also went and reread some of my comments, and realized I haven't criticized Apple as much here as I'd originally thought. Apparently I mostly stick to that in meatspace.

> There are a bunch of brainwashed Apple worshippers lurking around here who don't accept any criticism of the holy.

As there are everywhere unfortunately. I haven't run into many here personally, but have no difficulty believing they are here.

> Also, I don't think criticizing HN's algorithm or design should warrant being flagged or downvoted, either. Downvoting should be reserved for trolling, not intelligent protest. I'm also of the opinion that downvotes shouldn't be used for well-written disagreement, as that creates an echo chamber and suppresses non-majority opinions.

I agree here as well. I was more trying to point out the combative tone then the content of the text. There was also some content that could be interpreted as accusations of shilling, which is technically against the guidelines.

To be clear -- I don't think your comment was accusing people of shilling, just that I can see how people could interpret it that way.

Edit: The first quote I took from your comment really shouldn't have been there. Sorry about that. I still think if you get flagged it's because of the "(Psst..." part though. That one does come off as a bit aggressive.

Re:Nvidia to Acquire Arm for $40B by barbecue_sauce on Sunday September 13, 2020 @10:11PM (#24466063)
What's the point of pretending that people don't know you will get downvoted for holding an unpopular opinion? It's tautological.
Re:Nvidia to Acquire Arm for $40B by throwaway2048 on Sunday September 13, 2020 @08:51PM (#24465450)
The OP said nothing about being ok with the x86 duopoly.

Its possible to dislike two things at once, its also possible to be wary of new developments that give much more market power to a notoriously uncooperative and closed company.

Re:Nvidia to Acquire Arm for $40B by sillysaurusx on Sunday September 13, 2020 @07:57PM (#24465013)
AI training is moving away from CUDA and toward TPUs anyway. DGX clusters can't keep up.
Re:Nvidia to Acquire Arm for $40B by ladberg on Sunday September 13, 2020 @08:00PM (#24465030)
And Nvidia's GPUs now include the same type of hardware that TPUs have, so there's no reason to believe that TPUs will win out over GPUs.
Re:Nvidia to Acquire Arm for $40B by sillysaurusx on Sunday September 13, 2020 @08:08PM (#24465099)
The key difference between a TPU and a GPU is that a TPU has a CPU. It's an entire computer, not just a piece of hardware. Is nVidia moving in that direction?
Re:Nvidia to Acquire Arm for $40B by newsclues on Sunday September 13, 2020 @08:13PM (#24465148)
They just bought ARM for 40$billion. I think they want to integrate CPU,GPU and high speed networks
Re:Nvidia to Acquire Arm for $40B by dikei on Sunday September 13, 2020 @08:53PM (#24465466)
In term of cutting edge tech, They have their own GPUs, CPUs from ARM, Networking from Mellanox, so I'd say they're pretty much set to build a kick ass TPU.
Re:Nvidia to Acquire Arm for $40B by shaklee3 on Sunday September 13, 2020 @09:07PM (#24465558)
A TPU is a chip you cannot program. It's purpose built and can't run the fraction of the type of workloads that a GPU can.
Re:Nvidia to Acquire Arm for $40B by sillysaurusx on Sunday September 13, 2020 @09:21PM (#24465661)
I don't know where all of this misinformation is coming from or why, but, as someone who has spent the last year programming TPUs to do all kinds of things that a GPU can't do, this isn't true.

Are we going to simply say "Nu uh" at each other, or do you want to throw down some specific examples so I can show you how mistaken they are?

Re:Nvidia to Acquire Arm for $40B by sorenbouma on Sunday September 13, 2020 @10:09PM (#24466055)
I'm a TPU user and I'd be interested to see a specific example of something that can be done on TPU but not GPU.

Perhaps I'm just not experienced enough with the programming model, but I've found them to be strictly less flexible/more tricky than GPUs, especially for things like conditional execution, multiple graphs, variable size inputs and custom ops.

Re:Nvidia to Acquire Arm for $40B by sillysaurusx on Sunday September 13, 2020 @10:30PM (#24466175)
Sure! I'd love to chat TPUs. There's a #tpu discord channel on the MLPerf discord: https://github.com/shawwn/tpunicorn#ml-community

The central reason that TPUs feel less flexible is Google's awful mistake in encouraging everyone to use TPUEstimator as the One True API For Doing TPU Programming. Getting off that API was the single biggest boost to my TPU skills.

You can see an example of how to do that here: https://github.com/shawwn/ml-notes/blob/master/train_runner.... This is a repo that can train GPT-2 1.5B at 10 examples/sec on a TPUv3-8 (aka around 10k tokens/sec).

Happy to answer any specific questions or peek at codebases you're hoping to run on TPUs.

Re:Nvidia to Acquire Arm for $40B by slaymaker1907 on Sunday September 13, 2020 @10:52PM (#24466282)
That doesn't answer the question of what a TPU can do that a GPU can't. I think the OP means impossible for the GPU, not just slower.
Re:Nvidia to Acquire Arm for $40B by slaymaker1907 on Sunday September 13, 2020 @10:50PM (#24466272)
You can run basically any C program on a CUDA core even those requiring malloc. It may not be efficient but you can do it. Google themselves call GPUs general purpose and TPUs domain specific. https://cloud.google.com/blog/products/ai-machine-learning/w...
Re:Nvidia to Acquire Arm for $40B by shaklee3 on Sunday September 13, 2020 @09:30PM (#24465741)
Please show me the API where I can write a generic function on a TPU. I'm talking about writing something like a custom reduction or a peak search, not offloading a tensor flow model.

I'll make it easier for you, directly from Google's website:

TPUs Cloud TPUs are optimized for specific workloads. In some situations, you might want to use GPUs or CPUs on Compute Engine instances to run your machine learning workloads.

Please tell me a workload a gpu can't do that a TPU can.

Re:Nvidia to Acquire Arm for $40B by sillysaurusx on Sunday September 13, 2020 @09:57PM (#24465969)
Sure, here you go: https://www.tensorflow.org/api_docs/python/tf/raw_ops

In my experience, well over 80% of these operations are implemented on TPU CPUs, and at least 60% are implemented on TPU cores.

Again, if you give a specific example, I can simply write a program demonstrating that it works. What kind of custom reduction do you want? What's a peak search?

As for workloads that GPUs can't do, we regularly train GANs at 500+ examples/sec across a total dataset size of >3M photos. Rather hard to do that with GPUs.

Re:Nvidia to Acquire Arm for $40B by shaklee3 on Sunday September 13, 2020 @10:08PM (#24466045)
Well, there you go. For one TensorFlow is not a generic framework like cuda is, so you lose a whole bunch of the configurability you have with cuda. So, for example, even though there is an FFT raw function, there doesn't appear to be a way to do more complicated FFTs, such as an overlap-save. This is trivial to do on a GPU, and is built into the library. The raw functions it provides is not direct access to the hardware and memory subsystem. It's a set of raw functions that is a small subset of the total problem space. And certainly if you are saying that running something on a TPU's CPU cores are in any way going to compete with a gpu, then I don't know what to tell you.

You did not give an example of something GPUs can't do. all you said was that TPUs are faster for a specific function in your case.

Re:Nvidia to Acquire Arm for $40B by sillysaurusx on Sunday September 13, 2020 @10:27PM (#24466149)
For one TensorFlow is not a generic framework like cuda is, so you lose a whole bunch of the configurability you have with cuda

Why make generalizations like this? It's not true, and we've devolved back into the "nu uh" we originally started with.

This is trivial to do on a GPU, and is built into the library

Yes, I'm sure there are hardwired operations that are trivial to do on GPUs. That's not exactly a +1 in favor of generic programmability. There are also operations that are trivial to do on TPUs, such as CrossReplicaSum across a massive cluster of cores, or the various special-case Adam operations. This doesn't seem related to the claim that TPUs are less flexible.

The raw functions it provides is not direct access to the hardware and memory subsystem.

Not true. https://www.tensorflow.org/api_docs/python/tf/raw_ops/Inplac...

Jax is also going to be giving even lower-level access than TF, which may interest you.

You did not give an example of something GPUs can't do. all you said was that TPUs are faster for a specific function in your case.

Well yeah, I care about achieving goals in my specific case, as you do yours. And simply getting together a VM that can feed 500 examples/sec to a set of GPUs is a massive undertaking in and of itself. TPUs make it more or less "easy" in comparison. (I won't say effortless, since it does take some effort to get yourself into the TPU programming mindset.)

Re:Nvidia to Acquire Arm for $40B by shaklee3 on Sunday September 13, 2020 @10:41PM (#24466221)
I gave you an example of something you can't do, which is an overlap-save FFT, and you ignored that completely. Please implement it, or show me any example of someone implementing any custom FFT that's not a simple, standard, batched FFT. I'll take any example of implementing any type of signal processing pipeline on TPU, such as a 5G radio.

Your last sentence is pretty funny: a GPU can't do certain workloads because one it can do is too slow for you. Yet it remains a fact that TPU cannot do certain workloads without offloading to the CPU (making it orders of magnitude slower), and that's somehow okay? It seems where this discussion is going is you pointed to a TensorFlow library that may or may not offload to a TPU, and it probably doesn't. But even that library is incomplete to implement things like a 5G LDPC decoder.

Re:Nvidia to Acquire Arm for $40B by sillysaurusx on Sunday September 13, 2020 @11:19PM (#24466418)
Which part of this can't be done on TPUs? https://en.wikipedia.org/wiki/Overlap%E2%80%93save_method#Ps... As far as I can tell, all of those operations can be done on TPUs. In fact, I linked to the operation list that shows they can be.

You'll need to link me to some specific implementation that you want me to port over, not just namedrop some random algorithm. Got a link to a github?

If your point is "There isn't a preexisting operation for overlap-save FFT" then... yes, sure, that's true. There's also not a preexisting operation for any of the hundreds of other algorithms that you'd like to do with signal processing. But they can all be implemented efficiently.

Yet it remains a fact that TPU cannot do certain workloads without offloading to the CPU (making it orders of magnitude slower), and that's somehow okay?

I think this is the crux of the issue: you're saying X can't be done, I'm saying X can be done, so please link to a specific code example. Emphasis on "specific" and "code".

Re:Nvidia to Acquire Arm for $40B by shaklee3 on Monday September 14, 2020 @12:10AM (#24466672)
Let's just leave this one alone then. I can't argue with someone who claims anything is possible, yet absolutely nobody seems to be doing what you're referring to (except you). A100 now tops all MLPerf benchmarks, and the unavailable TPUv4 may not even keep up.

Trust me, I would love if TPUs could do what you're saying, but they simply can't. There's no direct DMA from the NIC to where I can do a streaming application at 40+Gbps to it. Even if TPU could do all the things you claim, if it's not as fast as the A100, what's the point? To go through undocumented pain to prove something?

Re:Nvidia to Acquire Arm for $40B by sillysaurusx on Monday September 14, 2020 @12:18AM (#24466702)
FWIW, you can stream at 10Gbps to TPUs. (I've done it.)

10Gbps isn't quite 40Gbps, but I think you can get there by streaming to a few different TPUs on different VPC networks. Or to the same TPU from different VMs, possibly.

The point is that there's a realistic alternative to nVidia's monopoly.

Re:Nvidia to Acquire Arm for $40B by shaklee3 on Monday September 14, 2020 @12:24AM (#24466729)
When I can run a TPU in my own data center, there is. Until then it precludes a lot of applications.
Re:Nvidia to Acquire Arm for $40B by lostmsu on Sunday September 13, 2020 @08:01PM (#24465038)
Where did you get this from? AFAIK GPT-3 (for example) was trained on a GPU cluster, not TPUs.
Re:Nvidia to Acquire Arm for $40B by sillysaurusx on Sunday September 13, 2020 @08:07PM (#24465087)
Experience, for one. TPUs are dominating MLPerf benchmarks. That kind of performance can't be dismissed so easily.

GPT-2 was trained on TPUs. (There are explicit references to TPUs in the source code: https://github.com/openai/gpt-2/blob/0574c5708b094bfa0b0f6df...)

GPT-3 was trained on a GPU cluster probably because of Microsoft's billion-dollar Azure cloud credit investment, not because it was the best choice.

Re:Nvidia to Acquire Arm for $40B by lostmsu on Sunday September 13, 2020 @09:44PM (#24465868)
I checked MLPerf website, and it looks like A100 is outperforming TPUv3, and is also more capable (there does not seem to be a working implementation of RL for Go on TPU).

To be fair, TPUv4 is not out yet, and it might catch up using the latest processes (7nm TSMC or 8nm Samsung).

https://mlperf.org/training-results-0-7

Re:Nvidia to Acquire Arm for $40B by option on Sunday September 13, 2020 @08:29PM (#24465282)
no they are not. Go read recent MLPerf results more carefully and not Google’s blogpost. NVIDIA won 8/8 benchmarks for publicly available SW/HW combo. Also 8/8 on per chip performance. Google did show better results with some “research” system which is not available to anyone other then them yet.
Re:Nvidia to Acquire Arm for $40B by sillysaurusx on Sunday September 13, 2020 @08:37PM (#24465338)
This is a weirdly aggressive reply. I don't "read Google's blogpost," I use TPUs daily. As for MLPerf benchmarks, you can see for yourself here: https://mlperf.org/training-results-0-6 TPUs are far ahead of competitors. All of these training results are openly available, and you can run them yourself. (I did.)

For MLPerf 0.7, it's true that Google's software isn't available to the public yet. That's because they're in the middle of transitioning to Jax (and by extension, Pytorch). Once that transition is complete, and available to the public, you'll probably be learning TPU programming one way or another, since there's no other practical way to e.g. train a GAN on millions of photos.

You'd think people would be happy that there are realistic alternatives to nVidia's monopoly for AI training, rather than rushing to defend them...

Re:Nvidia to Acquire Arm for $40B by p1esk on Monday September 14, 2020 @06:03AM (#24468483)
transitioning to Jax (and by extension, Pytorch)

Wait, what? Why would transition to Jax imply transition to Pytorch?

Re:Nvidia to Acquire Arm for $40B by llukas on Sunday September 13, 2020 @09:59PM (#24465994)
You are basing your opinion on last year MLPerf and some stuff that may or may not be available in the future. MLPerf 0.7 "available" category has been ghosted by google.

Pointing this out is not aggressive.

Re:Nvidia to Acquire Arm for $40B by make3 on Sunday September 13, 2020 @08:54PM (#24465476)
this is just false