News for hackers. Stuff that matters.
Re:An Introduction to the WARC File by abracadaniel on Monday January 29, 2024 @06:51PM (#39184416)
To add to this, WARC.gz files are also concatenated gzip records, so you can read any record by starting a decompression at a known offset. This gives you the access time of a file with the efficiency of having many many records only taking up one file.
Re:An Introduction to the WARC File by nikisweeting on Tuesday January 30, 2024 @03:27AM (#39187656)
WACZ also extends this functionality to allow streaming archives off a server without having to request the whole file to get one page. https://replayweb.page/docs/wacz-format