News for hackers. Stuff that matters.
Re:The Internet Archive Wants to Digitize 40,000 VHS and Bet... by caseysoftware on Monday August 03, 2015 @10:56PM (#10001382)
I worked on the digital archiving project at the Library of Congress. In that case, it was mostly wire spool recordings, wax cylinders, and LPs, but many of the same principles apply:

- This media can be fragile. Less so with VHS or Betamax, but it's something to keep in mind.

- It's not usually just a single copy and drop it into an archive. Most of the time, they'll want a super high quality, uncompressed master for long term preservation. This is with the hope that they never have to go back to the physical media.

- Once they have that copy, they create lower quality versions for day to day display, usage, study, etc.

- When you consider the "work" (in the artistic/archival sense, not the effort sense), it's not just the video. Quite often they'll want image scans of the media itself, container, etc. This is because the video itself may have been suffered damage due to physical damage.

- Next, you need to document the whole process down to the brand and settings of every single device. If it's known (or discovered later), that a particular piece of equipment distorts media (plays faster/slower, changes color palettes, etc), you need to know that and potentially correct for it at a later time.

- And finally, don't forget the metadata! A collection isn't useful if someone doesn't capture the who, what, and when. This is often the most painful part because the settings above are often set once and forgotten. This requires manually transcribing information written on the media, watching it, or a variety of other methods. Most libraries farm this out to interns. My new company - Clarify.io - hopes to help with this aspect.

If you're interested more in the mechanics, please feel free to let me know.

Re:The Internet Archive Wants to Digitize 40,000 VHS and Bet... by pavel_lishin on Monday August 03, 2015 @11:07PM (#10001409)
Would you consider doing a reddit AMA? HN doesn't quite seem like the right place/format for it.

Although, I'm gonna cut right in line and ask: what's the most interesting thing you've archived? If you're not sure what we'd find interesting, some suggestions are - content, medium and difficulty.

Re:The Internet Archive Wants to Digitize 40,000 VHS and Bet... by caseysoftware on Tuesday August 04, 2015 @12:43AM (#10001698)
I've considered it before but wasn't sure anyone would care. Now as I'm seeing more of these archiving efforts discussed, I'll consider it. :)

For the most interesting thing, I'll share two answers:

- First, there were the truly historic pieces of media. Things like Thomas Edison's first motion pictures and reporters' wire spool recordings of D-Day hours after the invasion "ended" were always the most amazing. You read about this stuff, but hearing it is something else entirely.

- On the other end of the spectrum, you have to remember that everything that has a registered copyright has been sent to the Library of Congress. That includes porn. My group didn't archive it but the group down the hall had to catalogue it. No, they didn't have private offices. ;)

Re:The Internet Archive Wants to Digitize 40,000 VHS and Bet... by weisser on Tuesday August 04, 2015 @03:06AM (#10002062)
Wow what an interesting coincidence...I just moved to Austin and am working on preserving some extremely historic recordings. Emailing you now!
Re:The Internet Archive Wants to Digitize 40,000 VHS and Bet... by pavel_lishin on Tuesday August 04, 2015 @09:39AM (#10003283)
Could y'all try to find a way of getting an AMA link back to HN if you end up doing one? This is fascinating stuff.
Re:The Internet Archive Wants to Digitize 40,000 VHS and Bet... by weisser on Tuesday August 04, 2015 @01:38PM (#10004903)
I'll definitely be doing an AMA about my specific project. I'm not at all an expert in the field but I'll share the story and my experiences.
Re:The Internet Archive Wants to Digitize 40,000 VHS and Bet... by caseysoftware on Tuesday August 04, 2015 @09:42AM (#10003307)
If/When it happens, I'll make sure to publicize it via our Twitter account - @ClarifyIO. I can't promise more atm.
Re:The Internet Archive Wants to Digitize 40,000 VHS and Bet... by TazeTSchnitzel on Tuesday August 04, 2015 @06:33AM (#10002535)
> - Once they have that copy, they create lower quality versions for day to day display, usage, study, etc.

I think the Internet Archive's systems do that automatically.

Re:The Internet Archive Wants to Digitize 40,000 VHS and Bet... by ris on Tuesday August 04, 2015 @08:05AM (#10002818)
"Most of the time, they'll want a super high quality, uncompressed master for long term preservation."

Is this really practical for video?

Re:The Internet Archive Wants to Digitize 40,000 VHS and Bet... by caseysoftware on Tuesday August 04, 2015 @10:19AM (#10003503)
If the alternative is going back to a known-to-be degrading physical copy, it doesn't matter how practical it is. They'll work to figure out how to do it.
Re:The Internet Archive Wants to Digitize 40,000 VHS and Bet... by pbreit on Monday August 03, 2015 @10:06PM (#10001243)
Hmmm, I thought there might be more information on what programs are included. And was also expecting some sort of probably sad discussion on content ownership.

On a side note, the Internet Archive HQ building is pretty cool: https://www.google.com/maps/place/300+Funston+Ave,+San+Franc...

Re:The Internet Archive Wants to Digitize 40,000 VHS and Bet... by WalterBright on Monday August 03, 2015 @08:25PM (#10000882)
Why does it cost $12 per tape to digitize it? I recently digitized a giant pile of old home movies, and all it took was an $80 usb video capture device, $20 thrift store VCR, and a few minutes each. About every dozen tapes I had to take the cover off and clean the heads, but that was no big deal.

Some older tapes will need a time base corrector to rebuild the sync signals, but they aren't that expensive.

Re:The Internet Archive Wants to Digitize 40,000 VHS and Bet... by deftnerd on Monday August 03, 2015 @09:00PM (#10000989)
If I remember correctly, the IA also likes to encode the video several times in different qualities and formats and that results in large archives. A 1 hour TV show might end up taking 100 gigs of space. With RAID and replication, an enterprise 4tb drive that costs $200 might end only holding 2tb of data, or 20 TV shows. That ends up being $10 in equipment just by itself for storage. Then add on the costs of power and equipment to encode it and the labor, I can see things costing $13 per tape.
Re:The Internet Archive Wants to Digitize 40,000 VHS and Bet... by sp332 on Monday August 03, 2015 @09:00PM (#10000991)
Pay someone $15/hr to babysit the player, type in the episode and guest names.
Re:The Internet Archive Wants to Digitize 40,000 VHS and Bet... by ytdht on Monday August 03, 2015 @10:43PM (#10001349)
$12 per tape is cheap to make it available to everyone...
Re:The Internet Archive Wants to Digitize 40,000 VHS and Bet... by WalterBright on Wednesday August 05, 2015 @04:17PM (#10012529)
Despite my message, I am very happy that these tapes are being made available.
Re:The Internet Archive Wants to Digitize 40,000 VHS and Bet... by userbinator on Monday August 03, 2015 @11:08PM (#10001417)
This seems like a trivially parallelisable problem. You can buy used VCRs by the pallet cheaply[1], although servicing and possibly retrofitting them into good condition is probably the major bottleneck here.

[1] https://govdeals.com/index.cfm?fa=Main.Item&itemid=1045&acct...

Re:The Internet Archive Wants to Digitize 40,000 VHS and Bet... by jdboyd on Monday August 03, 2015 @11:19PM (#10001457)
Many of the tapes are BetaMAX.
Re:The Internet Archive Wants to Digitize 40,000 VHS and Bet... by johansch on Monday August 03, 2015 @11:43PM (#10001521)
There are maybe about 100 betamax VCRs for sale on ebay at the moment.

http://www.ebay.com/sch/VCRs-/15088/i.html?_nkw=betamax

Re:The Internet Archive Wants to Digitize 40,000 VHS and Bet... by redcalx on Monday August 03, 2015 @06:52PM (#10000437)
I envisage much grainy audio of intellectual (or pseudo intellectual?) discussions featuring on soundcloud sad-core and post rock accounts.