Re:More notes on writing web scrapers
by sockopen on Friday February 25, 2022 @12:51PM
(#30469979)
Copying a request as cURL, PowerShell, fetch etc… right from inside the DevTools is a blessing.
[ Parent
| on HN ]
Re:More notes on writing web scrapers
by cushychicken on Friday February 25, 2022 @01:00PM
(#30470103)
Isn't it though?
Does create a bit of work when you have to figure out which parts of cURL need to be ported to Python, and which can be safely omitted. Copying a cURL request adds in a lot of headers - many of which I still don't properly know the purpose of.
I'll get there eventually. : ) In the meantime - thank god for whoever wrote "Copy as cURL request"!