Those people that hold gold as a hedge don't hold gold. They hold a database entry on a computer somewhere that assigns them ownership of some gold (supposedly) in a vault somewhere.

This requires global stability, and a great deal of blind trust in multiple third-parties.