Re:Blocked by Cloudflare
by computerfriend on Thursday August 10, 2023 @07:01AM
(#37074487)
Interesting! Firefox history is just SQLite. I might do something like, take all non-search URLs and archive them once a month or so. Thanks for the inspiration.
For the archival process I use ArchiveBox[1] running as a container on my NAS; I just grep through the note for `http|https` and feed the resulting list to the archiver. For everything not-hackernews I set the depth to 1, but for HN threads I do 2 so I grab whatever people may have linked in the comments.
I think there's ways to hook into like, ALL Firefox history or saved posts on reddit, but that's way heavier than what I care for.
[1]: https://archivebox.io/