I started wondering how one would reliably store a bit in about a microsecond of audio in the 1960s in a device that doesn't require continuous tuning.

Google led me to http://en.m.wikipedia.org/wiki/Delay_line_memory#Magnetostri.... It isn't audio, but a torsional wave, and Wikipedia claims a delay in the order of half a millisecond.