Who is we?
> then store the pages in a sealed plastic bag which goes in the archives; they're stored there indefinitely
Is that the best thing for archival storage? Like could things like chemical breakdown increase the humidity in the sealed bag or concentrate corrosive chemical vapors? I was under the impression the best environment was an actively climate-controlled environment.
Most books have some mold by the time they're ~100 years old, it's just not enough to cause a serious problem. Sealed enclosures (wrappings, bags, tubs) are a nightmare situation. Even packing books too tighly on shelves accelerates mold growth to problematic levels.
Archivists recommend standard ambient conditions or a little drier for long term storage. As you've said, too dry and the pages fall apart; permanent damage.
I suppose the fancy silica gels that maintain specific humidities would work in bags.
> I would think this totally dries the pages out and then they just turn to dust, from experience.
They used to sell Boveda two-way humidity control packs that would keep a bag at a constant low-ish 32% humidity, but last I looked those were discontinued (it looks like they've pivoted pretty heavily to marijuana storage and higher-humidity products).
The value of most very old books for AI training is very low. You don’t really want your AI training data to start biasing toward outdated writing styles. Most of the valuable knowledge has been covered again in modern texts in more depth and detail.
There is interesting value in old texts and it’s important to have them archived. It’s less valuable for stirring into the giant pot of AI training data, though.
I have a hard time believing that text valuable to humans would not be valuable to AI.
Yet
As for consumer-grade solutions, look for the Fujitsu SV600.
I have done it at home for my books since the mid-00s.
You've trashed the book (and its lifespan) but some books are for using, not keeping.
I have books but would have 5x as many if I could not capture them digitally. (When I go to move or go through a purge, some of the books I scanned do go to a used book store.)
So I scan in part to keep my physical book-footprint smaller, but also my scans all get cleaned up and uploaded to archive.org. Mainly I scan young-adult science books from the 50's and 60's (since they were so influential and have all but disappeared except on eBay and the like).
Most books I would rather have a digital copy. I had four or five book cases full of stuff and it makes moving difficult.
I originally started scanning 20 years ago when it was more difficult to find PDFs of basically whatever you want. Now it is only random old books I find at the used shop or online for cheap and somehow cannot get from archive.org or elsewhere.
We use a special guillotine type cutter to cut off the binding and then store the pages in a sealed plastic bag which goes in the archives; they're stored there indefinitely in case the book needs rescanned for some reason. We also keep the original, uncompressed copies of the books on magnetic disks.
We also go out of our way to try to find rare books published in 1931, 1932, etc. so they are ready to go once the copyright expires.
And no, no AI company has ever come to us and asked to run training on all of our scanned copies.