News for hackers. Stuff that matters.
Re:Show HN: Kage – Shadow any website to a single binary for... by tamnd on Sunday June 14, 2026 @02:12PM (#48530624)
I tried to follow well-known formats first, such as WARC and ZIM from Kiwix, so we could benefit from existing tooling support.

For my own custom data format, I have a lot of private code that I plan to release soon. It is optimized for compression, fast lookups, and more. I have been working on it for two years. This is part of a larger, ambitious umbrella project: I am building Google from scratch (all open source), something that anyone can host, including the crawler, indexer, storage, and serving layers. Stay tuned!

Re:Show HN: Kage – Shadow any website to a single binary for... by sanqui on Sunday June 14, 2026 @02:19PM (#48530708)
I'm a fan of compatibility with established formats!

Sounds awesome. There is a lot of untapped potential with respect to efficiently archiving and indexing websites. I saw the impressive things Marginalia Search is doing in this area (the blog is great when it gets technical). There is also a lot of very complete archives of websites out there which are not being indexed at all, and I would love to make them available for researchers. In any case, I'm interested in your project!

Re:Show HN: Kage – Shadow any website to a single binary for... by Prime_Axiom on Sunday June 14, 2026 @03:05PM (#48531300)
Looking forward to the next project! I love these kinds of archiving tools.
Re:Show HN: Kage – Shadow any website to a single binary for... by threecheese on Sunday June 14, 2026 @06:10PM (#48533367)
OK, sounds fascinating; following! (your GH)
Re:Show HN: Kage – Shadow any website to a single binary for... by tamnd on Sunday June 14, 2026 @07:05PM (#48533955)
Thanks ;)