Re:An Introduction to the WARC File
by SnowflakeOnIce on Monday January 29, 2024 @06:09PM
(#39184046)
As to the your second question: WARC is based on an older format that was started in the 1990s, before SQLite existed.
[ Parent
| on HN ]
Thanks for that info! Didn't realize WARC predated SQLite. Makes me wonder, are there any modern updates that could enhance WARC, or is it only format for archiving?
The main update to WARC now is WACZ.
Re:An Introduction to the WARC File
by TheTechRobo on Wednesday January 31, 2024 @03:58PM
(#39209319)
Yeah, the format really needs an update. For starters, WARC only officially supports HTTP/1.1. Webrecorder has started faking HTTP/1.1 data in WARC files in order to save other versions, but I don't think faking data is great for an archival format, especially if it isn't standardized.