Anna’s Archive approaching 1 petabyte

Re:Anna’s Archive approaching 1 petabyte by carlosjobim on Tuesday July 16, 2024 @08:52PM (#40981665)

Other interesting news from the link: They expect improvements in OCR to make it possible for them in the coming years to apply it to their entire library. This would liberate an enormous amount of knowledge for easier access.

[ Parent | on HN ]

Re:Anna’s Archive approaching 1 petabyte by moonchild on Saturday July 20, 2024 @04:25AM (#41014996)

they are talking about treating ocr as lossy. i wonder about making a lossless compression algorithm for text scans based on an ocr; in effect, use the ocr to predict which text will show up and how, and then encode the pixel-level differences on top of that

[ Parent | on HN ]

Re:Anna’s Archive approaching 1 petabyte by eulgro on Saturday July 20, 2024 @06:15AM (#41015397)

DjVu does this to some extent, identifying identifical glyph bitmaps and reusing them for compression. See https://en.m.wikipedia.org/wiki/DjVu#Compression

[ Parent | on HN ]

Re:Anna’s Archive approaching 1 petabyte by benxh on Saturday July 20, 2024 @06:25AM (#41015429)

I am assuming this will be solved this year.

[ Parent | on HN ]