News for hackers. Stuff that matters.

A comment on Show HN: WarcDB: Web crawl data as SQLite databases. Parent comment

Re:Show HN: WarcDB: Web crawl data as SQLite databases by rengler33 on Sunday June 19, 2022 @04:16PM (#31803018)
Is there a forum or somewhere web crawlers hang out online? I'd love the learn about more sophisticated projects like this.
[ Parent | on HN ]
Re:Show HN: WarcDB: Web crawl data as SQLite databases by uniqueuid on Sunday June 19, 2022 @04:58PM (#31803434)
In github issues of said projects, and at scientific web archival conferences.

Although I'd absolutely welcome some sort of channel!

[ Parent | on HN ]
Re:Show HN: WarcDB: Web crawl data as SQLite databases by smcnally on Sunday June 19, 2022 @05:34PM (#31803748)
Topics include Issues and activities across projects. These topics are quite active, e.g.

https://github.com/topics/crawling https://github.com/topics/web-scraping https://github.com/topics/web-archiving

[ Parent | on HN ]