News for hackers. Stuff that matters.

A comment on Hacker plants false memories in ChatGPT to steal user data in perpetuity. Parent comment

Re:Hacker plants false memories in ChatGPT to steal user dat... by oneshtein on Thursday September 26, 2024 @01:11AM (#41654727)
I have no idea what "reasonably fast" means for you. It good for performance when model fit inside memory of a graphic card. Nvidia 4090 with 24Gb will be more than enough to start learning. I use gaming notebook with Nvidia 3080Ti equipped with 16Gb of videomemory.
[ Parent | on HN ]
Re:Hacker plants false memories in ChatGPT to steal user dat... by ranger_danger on Saturday September 28, 2024 @02:35PM (#41682110)
I have no issues with using just the CPU on smaller (<= 13b) models and it's quite fast enough for me. Even 70b models still work if you have the RAM, they're just much slower.
[ Parent | on HN ]