News for hackers. Stuff that matters.
Re:GPUHammer by privatelypublic on Tuesday July 15, 2025 @08:47PM (#44577552)
This seems predicated on there being significant workloads that split gpu's between tenants for compute purposes.

Anybody have sizable examples? Everything I can think of results in dedicated gpus.

Re:GPUHammer by huntaub on Tuesday July 15, 2025 @11:50PM (#44578514)
My (limited) understanding was that the industry previously knew that it was unsafe to share GPUs between tenants, which is why the major cloud providers only sell dedicated GPUs.
Re:GPUHammer by vlovich123 on Tuesday July 15, 2025 @08:54PM (#44577597)
Many of the GPU rental companies charge less for shared GPU workloads. So it's a cost/compute tradeoff. It's usually not about the workload itself needing the full GPU unless you really need all the RAM on a single instance.
Re:GPUHammer by privatelypublic on Tuesday July 15, 2025 @10:52PM (#44578225)
Any examples to check out? The only one i know of is vastai... and there's already a list of security issues a mile long there.
Re:GPUHammer by diggan on Wednesday July 16, 2025 @08:34AM (#44581563)
I don't think Vast.ai does "shared GPUs", you can only rent full rigs, at least there is no indication the hardware is shared between multiple users at the same time.

But I think services like Runpod and similar lets you rent "1/6 of a GPU per hour" for example, which would be "shared hosting" basically, as there would be multiple users using the same hardware at the same time.

Re:GPUHammer by bluedino on Tuesday July 15, 2025 @09:06PM (#44577681)
NVIDIA GPU's can run in MIG (Multi-Instance GPU), allowing you to pack more jobs on than you have GPUs. Very common in HPC but I don't about in the cloud.
Re:GPUHammer by privatelypublic on Tuesday July 15, 2025 @10:42PM (#44578165)
I thought about splitting the GPU between workloads, as well terminal server/virtualized desktop situations.

I'd expect all code to be strongly controlled in the former, and reasonably secured in the latter with software/driver level mitigations possible and the fact that corrupting somebody else's desktop with row-hammer doesn't seem like good investment.

As another person mentioned- and maybe it is a wider usage than I thought- cloud gpu compute running custom code seems to be the only useful item. But, I'm having a hard time coming up with a useful scenario. Maybe corrupting a SIEM's analysis & alerting of an ongoing attack?

Re:GPUHammer by cyberax on Wednesday July 16, 2025 @02:52AM (#44579445)
No large cloud hoster (AWS, Google, Azure) shares GPUs between tenants.
Re:GPUHammer by shakna on Wednesday July 16, 2025 @05:25PM (#44586951)
Is that not what AWS is offering here? [0]

"In multi-tenant environments where the goal is to ensure strict isolation."

[0] https://aws.amazon.com/blogs/containers/gpu-sharing-on-amazo...

Re:GPUHammer by cyberax on Wednesday July 16, 2025 @07:55PM (#44588171)
This is for customers. AWS can use virtualization to slice their GPUs across multiple workloads (in their K8s), but AWS itself doesn't share GPUs.
Re:GPUHammer by privatelypublic on Tuesday July 15, 2025 @11:02PM (#44578274)
Update: I thought for a second I had one: Jupyter notebook services with GPUs- but looking at google colab^* even there its a dedicated GPU for that session.

* random aside: how is colab compute credits having a 90 day expiration legal? I thought california outlawed company-currency expiring? (A la gift cards)

Re:GPUHammer by dogma1138 on Wednesday July 16, 2025 @04:27AM (#44579963)
Colab credits aren’t likely a currency equivalent but a service equivalent which is still legal to expire afaik.

Basically Google Colab credits is like buying a seasonal bus pass with X trips or a monthly parking pass with X amount of hours. Rather than getting store cash which can be used for anything.

Re:GPUHammer by SnowflakeOnIce on Tuesday July 15, 2025 @10:50PM (#44578211)
Example: A workstation or consumer GPU used both for rendering the desktop and running some GPGPU thing (like a deep neural network)
Re:GPUHammer by privatelypublic on Tuesday July 15, 2025 @10:54PM (#44578242)
Not an issue- thats a single Tennant.

Which is my point.

Re:GPUHammer by spockz on Wednesday July 16, 2025 @12:19AM (#44578635)
Until the GPU is accessible by the browser and any website can execute code on it. Or the attack can come from a different piece of software on your machine.
Re:GPUHammer by haiku2077 on Tuesday July 15, 2025 @08:58PM (#44577626)
GKE can share a single GPU between multiple containers in a partitioned or timeshared scheme: https://cloud.google.com/kubernetes-engine/docs/concepts/tim...
Re:GPUHammer by privatelypublic on Tuesday July 15, 2025 @10:48PM (#44578196)
Thats the thing... they're all the same tennant. A GKE node is a VM instance, and GCE doesn't have shared GPUs that I can see.
Re:GPUHammer by im3w1l on Tuesday July 15, 2025 @08:50PM (#44577571)
Webgpu api taking screenshot of full desktop maybe?
Re:GPUHammer by privatelypublic on Tuesday July 15, 2025 @10:33PM (#44578124)
Rowhammer itself is a write-only attack vector. It can, however, potentially be chained to change the write address to an incorrect region. Haven't dived into details.
Re:GPUHammer by SnowflakeOnIce on Tuesday July 15, 2025 @10:48PM (#44578197)
How is it a write-only attack vector?
Re:GPUHammer by privatelypublic on Tuesday July 15, 2025 @11:14PM (#44578332)
Rowhammer allows you to corrupt/alter memory physically adjacent to memory you have access to. It doesn't let you read the memory you're attacking.

There's PoC's of corrupting memory _that the kernel uses to decide what that process can access_ but the process can't read that memory. It only knows that the kernel says yes where it used to say no. (Assuming it doesn't crash the whole machine first)

Re:GPUHammer by SnowflakeOnIce on Wednesday July 16, 2025 @07:36AM (#44581055)
Suppose you have access to certain memory. If you repeatedly read from that memory, can't you still corrupt/alter the physically adjacent memory you don't have access to? Does it really need to be a write operation you repeatedly perform?
Re:GPUHammer by privatelypublic on Wednesday July 16, 2025 @10:32AM (#44582792)
I probably should have called it "blind" instead.
Re:GPUHammer by extraduder_ire on Wednesday July 16, 2025 @05:57PM (#44587242)
> Does it really need to be a write operation you repeatedly perform?

Yes. The core of rowhammer attacks is in changing the values in RAM repeatedly, creating a magnetic field, which induces a change in the state of nearby cells of memory. Reading memory doesn't do that as far as I know.

Re:GPUHammer by Buttons840 on Tuesday July 15, 2025 @09:48PM (#44577907)
Do you think WebGPU would be any more of an attack vector than WebGL?