News for hackers. Stuff that matters.

A comment on Google's Gemini AI caught scanning Google Drive PDF files without permission. Parent comment

Re:Google's Gemini AI caught scanning Google Drive PDF files... by nickstinemates on Monday July 15, 2024 @09:03AM (#40967516)
This goes for every SaaS / cloud native company

I think there will be a real shift back on prem with software delivered traditionally due to increased in shit like this (and also due to cost)

[ Parent | on HN ]
Re:Google's Gemini AI caught scanning Google Drive PDF files... by JumpCrisscross on Monday July 15, 2024 @09:13AM (#40967600)
> there will be a real shift back on prem with software

Not while we’re production constrained on the bleeding edge of GPUs.

[ Parent | on HN ]
Re:Google's Gemini AI caught scanning Google Drive PDF files... by OtherShrezzing on Monday July 15, 2024 @10:31AM (#40968207)
How many SaaS / Cloud Native companies are really GPU constrained? The overwhelming majority of SaaS is a relatively trivial CRUD web-app interfacing with a database, performing some niche business automation, all of which would fit comfortably on a couple of physical servers.
[ Parent | on HN ]
Re:Google's Gemini AI caught scanning Google Drive PDF files... by ttul on Monday July 15, 2024 @09:53AM (#40967920)
… and that situation will persist until other vendors release consumer GPUs with significant VRAM. Nvidia craftily hamstrings the top consumer GPUs by restricting VRAM to 24GB. To get a bit more costs 3-5x. Only competition will fix this.
[ Parent | on HN ]
Re:Google's Gemini AI caught scanning Google Drive PDF files... by rtkwe on Monday July 15, 2024 @10:14AM (#40968085)
Even then NVIDIA has a pretty significant technology moat because most of the tools are built around and deeply integrate CUDA so moving off NVIDIA is a costly rewrite.
[ Parent | on HN ]