News for hackers. Stuff that matters.

A comment on How to crawl a quarter billion webpages in 40 hours (2012). Parent comment

Re:How to crawl a quarter billion webpages in 40 hours (2012) by delfinom on Thursday June 15, 2023 @01:16PM (#36343690)
>(even though the claim is that your IP is dynamic, in practice it hardly ever changes)

Every ISP just uses DHCP for router IPs. It's dynamic, you just have to let the lease time expire to renew it.

Or, have your own configurable router instead of the ISPs so that you can actually send a dhcp release command though they don't all support this part. Changing MAC Address will work otherwise.

[ Parent | on HN ]
Re:How to crawl a quarter billion webpages in 40 hours (2012) by cand0r on Thursday June 15, 2023 @01:42PM (#36344040)
When the lease expires, the same IP is prioritized for renewal. Leases are generally for a week or two, but I've noticed dynamic IPs staying for 3 months or more. Swapping modems is really the best way to get a new external IP.
[ Parent | on HN ]