OpenAI models are coming to Google Cloud

Re:OpenAI models are coming to Google Cloud by aviinuo on Wednesday October 21, 2026 @01:22PM (#50184492)

Nvidia GPUs let you load encrypted weights onto them and to decrypt on chip so Google would need to have some sort of Nvidia management firmware attack to read from HBM while the GPU is live

[ Parent | on HN ]

Re:OpenAI models are coming to Google Cloud by zeroxfe on Wednesday October 21, 2026 @02:50PM (#50185720)

Distillation does not require access to weights.

[ Parent | on HN ]

Re:OpenAI models are coming to Google Cloud by jayd16 on Wednesday October 21, 2026 @02:25PM (#50185372)

Isn't distillation more of a black box type affair?

[ Parent | on HN ]

Re:OpenAI models are coming to Google Cloud by binlog on Wednesday October 21, 2026 @01:41PM (#50184757)

Doesn’t really matter what happens at the GPU level when Google can see all API traffic.

[ Parent | on HN ]

Re:OpenAI models are coming to Google Cloud by worldsavior on Wednesday October 21, 2026 @01:42PM (#50184761)

Except google cloud doesn't use Nvidia GPUs but TPUs.

[ Parent | on HN ]

Re:OpenAI models are coming to Google Cloud by Mond_ on Wednesday October 21, 2026 @02:53PM (#50185763)

Google has both. Afaik we don't know whether OpenAI models will run on TPUs or GPUs here.

[ Parent | on HN ]

Re:OpenAI models are coming to Google Cloud by tgma on Wednesday October 21, 2026 @03:35PM (#50186378)

I bet it would be the NVIDIA, at least initially, not for the encryption capability per se, but for simple fact that adapting to TPU at high performance is non-trivial.

[ Parent | on HN ]