Re:Reddit’s plan to kill third-party apps sparks widespread ...
by rightbyte on Tuesday June 06, 2023 @08:48AM
(#36211814)
Why would you train with the API? Just render the site to scrape it.
[ Parent
| on HN ]
Re:Reddit’s plan to kill third-party apps sparks widespread ...
by Ekaros on Tuesday June 06, 2023 @09:00AM
(#36211969)
After killing the old reddit. I don't think scrapping is very effective, at least for the comments. Visibility of comments on web site is pretty horrid.
Re:Reddit’s plan to kill third-party apps sparks widespread ...
by _-____-_ on Tuesday June 06, 2023 @10:18AM
(#36213193)
The API is still there, and it must still be usable without paying, since the mobile app is using it. So setup mitmproxy on your iPhone and sniff the traffic to figure out how it gets its key, and then replicate that in your scraper.
Re:Reddit’s plan to kill third-party apps sparks widespread ...
by moffkalast on Tuesday June 06, 2023 @02:32PM
(#36217142)
No need, there are already several projects that have been scraping and downloading posts and comments for archival reasons for years. It's just a one click download.