News for hackers. Stuff that matters.

A comment on Shreddit is a Python program to remove all your Reddit comments. Parent comment

Re:Shreddit is a Python program to remove all your Reddit co... by antisthenes on Friday June 09, 2023 @10:21AM (#36258206)
There are public data dumps of Reddit comments available all the way up to December 2022. And they're only roughly ~2TB all together.

There's nothing stopping AI companies from just using those instead of paying Reddit $50 million to scrape all of them using the API. It would also be 10x-100x quicker to do that rather than hammer their API for the comments (the API sucks for mass data retrieval)

[ Parent | on HN ]
Re:Shreddit is a Python program to remove all your Reddit co... by mynameisvlad on Friday June 09, 2023 @10:52AM (#36258714)
Sure, but companies doing that also wouldn’t be paying Reddit for that data.

The point of shredding comments isn’t to hurt the companies scraping the data (although that might be a nice side effect). Ultimately it’s to hurt Reddit.

[ Parent | on HN ]
Re:Shreddit is a Python program to remove all your Reddit co... by realce on Friday June 09, 2023 @10:58AM (#36258803)
Where would someone find these?
[ Parent | on HN ]
Re:Shreddit is a Python program to remove all your Reddit co... by dontupvoteme on Friday June 09, 2023 @11:14AM (#36259057)
https://academictorrents.com/browse.php?search=reddit&sort_f...
[ Parent | on HN ]
Re:Shreddit is a Python program to remove all your Reddit co... by realce on Friday June 09, 2023 @11:29AM (#36259315)
merci good fellow :)
[ Parent | on HN ]
Re:Shreddit is a Python program to remove all your Reddit co... by dontupvoteme on Friday June 09, 2023 @06:20PM (#36265030)
lieto di aiutare l'amico
[ Parent | on HN ]