Apple collaborates with Nvidia to research faster LLM performance

Re:Apple collaborates with Nvidia to research faster LLM per... by UncleOxidant on Wednesday December 18, 2024 @07:13PM (#42456947)

But Apple seems to have gone all in on their own GPU/NPUs, why would they collaborate with Nvidia on this?

[ Parent | on HN ]

Re:Apple collaborates with Nvidia to research faster LLM per... by username4567 on Wednesday December 18, 2024 @07:56PM (#42457227)

Complete speculation but could be that Apple supports these operators on their GPUs and they need end-user models optimized to use them. Apple makes their money on consumer devices and need them to be performant for inference on the edge. Getting NVIDIA to integrate the operators may result in more models optimized for operators Apple's devices can leverage to stay ahead of other edge GPUs.

[ Parent | on HN ]

Re:Apple collaborates with Nvidia to research faster LLM per... by threeseed on Wednesday December 18, 2024 @07:46PM (#42457165)

Apple inference is on their own GPU. Apple training is on the cloud with Nvidia.

There are plenty of use cases e.g. Apple Maps, News etc which are public and don’t need their Private Compute Cloud.

[ Parent | on HN ]

Re:Apple collaborates with Nvidia to research faster LLM per... by CharlesW on Wednesday December 18, 2024 @07:37PM (#42457113)

Personal speculation here: https://news.ycombinator.com/item?id=42456965

[ Parent | on HN ]

Re:Apple collaborates with Nvidia to research faster LLM per... by comboy on Wednesday December 18, 2024 @07:37PM (#42457109)

patents?

[ Parent | on HN ]