News for hackers. Stuff that matters.
Re:Nvidia pursues $30B custom chip opportunity with new unit by dotnet00 on Saturday February 10, 2024 @02:42PM (#39329522)
A modern graphics card already is a parallel compute card. A modern graphics pipeline is mostly compute with only very specific stuff using fixed function functionality.
Re:Nvidia pursues $30B custom chip opportunity with new unit by amelius on Saturday February 10, 2024 @02:50PM (#39329580)
Yes, but that was not the point. The point is that they are sold as graphics cards, not compute cards. Therefore, expect these cards to be good at (and have the memory for) typical graphics operations.
Re:Nvidia pursues $30B custom chip opportunity with new unit by dotnet00 on Saturday February 10, 2024 @11:46PM (#39332721)
I don't entirely agree, especially with the popularity of LLMs nowadays. While graphics are still a big portion of the pitch, compute oriented features are increasingly expected as part of the offering, especially at the higher end of the lineup. If you've bought a 3090/4090, you likely had in mind more computationally oriented tasks compared to if you've bought a 1660 or AMD card.
Re:Nvidia pursues $30B custom chip opportunity with new unit by justinclift on Saturday February 10, 2024 @06:22PM (#39331212)
Are the ray tracing cores in Nvidia cards used for compute?
Re:Nvidia pursues $30B custom chip opportunity with new unit by dotnet00 on Saturday February 10, 2024 @06:34PM (#39331292)
All that the ray tracing cores do is accelerate calculation of BVH intersections. The rest of the tracing (ie the part that gives meaning to the BVH intersection result) is done via compute, with the RT cores being able to be 'invoked' essentially arbitrarily. This is in contrast to the way graphics cards used to be, where you had certain stages for certain things, designed specifically around producing graphics, making the 'graphics' part of the name hold more weight than nowadays.

I'm not sure if you're asking if they're used for a compute application or if you're asking if they can be used from the same execution path as 'compute' code.

Re:Nvidia pursues $30B custom chip opportunity with new unit by zozbot234 on Saturday February 10, 2024 @10:09PM (#39332352)
Seen from first principles, BVH is quite close to some kinds of hierarchical clustering. The ray intersection part can be understood in turn as a kind of normalization, or projection to the unit sphere. So depending on how much hardware is actually reserved to this task on-chip, there might be ways of making it somewhat useful in the ML context.
Re:Nvidia pursues $30B custom chip opportunity with new unit by justinclift on Sunday February 11, 2024 @02:38AM (#39333259)
Just asking if those cores tend to sit unused when "standard" compute jobs are run on the cards. :)