Re:Google Will Turn Off Search for Schools That Reject A.I
by whimsicalism on Tuesday November 03, 2026 @05:27PM
(#50359137)
Model size, definitely. Not so sure about the discriminative vs. generative distinction (technically 'generative' models are discriminators as well) - I suspect the data is extractable if you have access to the weights, although easier to extract from inferencing in a decoder model.
My guess is that the pairing of all of these things is due to the fact that Google has likely consolidated everything under the same style of decoder model.
The model size also plays a role, since they've become bigger since 2022 (let's use chatgpt as the cutoff date, but it could be around 2020/2021). Modern BERT trained nowadays will keep their lossy compression nature? Or could there be a privacy risk such as it's clear with generative model?
Thus, what are the characteristics of privacy-friendly models? So far, I listed discriminative vs. generative, size, and a lossy transforms (related to size).