Re:Show HN: I got tired of reading "This posting has been de...
by tivert on Friday October 13, 2023 @12:06AM
(#37866531)
> It probably nudges the crawler to come rather than sending the page. If it's private, the crawler won't be able to see it.
I'm sure that's exactly what it does. It is definitely not archiving some Facebook pages I've been browsing (that I would actually like to archive). It's only been capturing the login screen or an error about abusing the site.
I'm sure that's exactly what it does. It is definitely not archiving some Facebook pages I've been browsing (that I would actually like to archive). It's only been capturing the login screen or an error about abusing the site.