Have you considered using something like MogileFS? It'd be perfect for this sort of situation.

Let me know if you're interested in this or have any questions -- I've dealt a good bit with systems like this in the past, and would love to give you a hand.