News for hackers. Stuff that matters.
Re:Migrating a 40TB SQL Server Database by j88439h84 on Thursday July 30, 2020 @04:50PM (#24002706)
May I ask what kind of production environments you have in mind? Are these large-scale FAANG-style deployments or something else?
Re:Migrating a 40TB SQL Server Database by jeffbee on Thursday July 30, 2020 @06:38PM (#24003605)
Well, only to the extent that the management of small amounts of logs is not very interesting. There is not an ACM SIG for very small databases.

Anyway, GPDR requires you to have a purpose for any log that contains any IP address. Keeping logs for undefined purposes and unlimited time frames is not ok any more.

Re:Migrating a 40TB SQL Server Database by elorant on Thursday July 30, 2020 @05:25PM (#24003014)
It could be an e-commerce site, which depending on the case can produce a shitload of logs. Imagine having a few hundred of thousands of users daily and you record every page they view, along with heatmaps, and whatnot. In most cases those logs should never be touched by a human in raw format. You feed them in your analytics engine, and start making decisions about your conversion. And then you delete them because the goalpost is constantly moving.