News for hackers. Stuff that matters.
Re:uBlock 1.48.0 Adds Readiness Status, Code Viewer, and Oth... by 1vuio0pswjnm7 on Tuesday March 21, 2023 @11:12PM (#35256351)
I rarely have problems with IP addresses that stop working for a given domain name. And when these changes occur I want to know. Refresh interval is at least once daily. The format for the file that stores the data is simple

  domainname IP-address # timestamp
The file is sorted by timestamp. The proxy will use the first occurrence, and therefore the most recent data.

The source of domains is usually HTML, XML sitemaps or proxy log but it can be anything. I have small utilties I wrote to extract URLs and domains from any input. For example, I retrieve data for all the domains that appear on HN, excluding the ones in comments. I see there are close to 68K domains from the past 6-9 months.

There are no comments on this comment yet.