19-84

19-84 on Hacker News

Re:Show HN: Self-host Reddit – 2.38B posts, works offline, yours forever on Wednesday January 14, 2026 @01:16AM (#46612933)

there is nearly 10TB of youtube metadata available on archive.org https://archive.org/details/youtube-metadata

Re:Show HN: Self-host Reddit – 2.38B posts, works offline, yours forever on Tuesday January 13, 2026 @06:54PM (#46610304)

redd-archiver uses postgres full text search. for static search you could use lunr.js

Re:Show HN: Self-host Reddit – 2.38B posts, works offline, yours forever on Tuesday January 13, 2026 @06:52PM (#46610276)

the torrent has data for the top 40,000 subs on reddit. thanks to watchful1 splitting the data by subreddit, you can download only the subreddit you want from the torrent

Re:Show HN: Self-host Reddit – 2.38B posts, works offline, yours forever on Tuesday January 13, 2026 @06:51PM (#46610263)

the data from 2025-12 has been released already, it is usually released every month, it just needs to be split and reprocessed for 2025 by watchful1. i will probably eventually add support for importing data from the monthly arctic shift dumps so that archives can be updated monthly.

https://github.com/ArthurHeitmann/arctic_shift/releases

Arctic Shift https://academictorrents.com/browse.php?search=RaiderBDev

Watchful1 https://academictorrents.com/browse.php?search=Watchful1

Re:Show HN: Self-host Reddit – 2.38B posts, works offline, yours forever on Tuesday January 13, 2026 @05:52PM (#46609530)

I included a metadata dump of every subreddit found in the torrent. it includes a status field which will show of a subreddit is private along with a much more details

data catalog readme: https://github.com/19-84/redd-archiver/blob/main/tools/READM...

reddit data: https://github.com/19-84/redd-archiver/blob/main/tools/subre...

Re:Show HN: Self-host Reddit – 2.38B posts, works offline, yours forever on Tuesday January 13, 2026 @05:44PM (#46609444)

ive created tooling for an instance registry and team based leaderboard. the API has function to support this as well, so that we can collectively host archives in a decentralized and distributed manner

registry readme: https://github.com/19-84/redd-archiver/blob/main/docs/REGIST...

Re:Show HN: Self-host Reddit – 2.38B posts, works offline, yours forever on Tuesday January 13, 2026 @05:21PM (#46609149)

I've updated the workflow and added a placeholder page that will serve before archives are created. thanks again! https://github.com/19-84/redd-archiver/commit/0dfd505ca81cb2...

Re:Show HN: Self-host Reddit – 2.38B posts, works offline, yours forever on Tuesday January 13, 2026 @04:09PM (#46608057)

thank you for your comment, some example dot files were not copied in my original repo, they have now been added.

https://github.com/19-84/redd-archiver/commit/0bb103952195ae...

i will look into updating the local deployment instructions

Re:Show HN: Self-host Reddit – 2.38B posts, works offline, yours forever on Tuesday January 13, 2026 @02:52PM (#46606832)

thank you for your comment, I will support any platform that has complete dataset available. I will take submissions for any complete datasets through github issues. https://github.com/19-84/redd-archiver/blob/main/.github/ISS...

Re:Show HN: Self-host Reddit – 2.38B posts, works offline, yours forever on Tuesday January 13, 2026 @02:43PM (#46606697)

the API and MCP server is very powerful ;)

Re:Show HN: Self-host Reddit – 2.38B posts, works offline, yours forever on Tuesday January 13, 2026 @02:26PM (#46606404)

I have also published sub statistics and profiling for each platform. these can be used to help identify which subs to prioritize for archiving.

reddit: https://github.com/19-84/redd-archiver/blob/main/tools/subre...

voat: https://github.com/19-84/redd-archiver/blob/main/tools/subve...

ruqqus: https://github.com/19-84/redd-archiver/blob/main/tools/guild...

Re:Show HN: Self-host Reddit – 2.38B posts, works offline, yours forever on Tuesday January 13, 2026 @02:07PM (#46606111)

the API should allow for a lot of different integrations

Show HN: Self-host Reddit – 2.38B posts, works offline, yours forever

Posted by 19-84 on Tuesday January 13, 2026 @10:35AM
from the show-hn dept.

https://github.com/19-84/redd-archiver

Reddit's API is effectively dead for archival. Third-party apps are gone. Reddit has threatened to cut off access to the Pushshift dataset multiple times. But 3.28TB of Reddit history exists as a torrent right now, and I built a tool to turn it into something you can browse on your own hardware.The key point: This doesn't touch Reddit's servers. Ever. Download the Pushshift dataset, run my tool...

( Read More... | 66 comments | 3 points | on HN )