Re:Rdrview – Firefox Reader View as a Linux command line tool
by danpeddle on Monday October 19, 2020 @06:19PM
(#24831657)
I took a very quick look at the source code, and seems you’re using the curl default options for things like the user agent. Please correct me if wrong!
Did you try pretending to be a search engine crawler, for an idea..?
It won't do anything for the TechCrunch case you describe, because it only fetches the one webpage you point it to (and any redirections).