How about a picture of the inside of a magnetic media hard drive, complete with platters and heads. Or maybe just an icon of a bare 3.5" drive unit.

http://www.ubuntu.com/tour/img/librewriter.jpg

Everyone should be able to relate to that, right? :-)