If they really wanted to prevent theft, the builders could alloy the metals with something poisonous or radioactive. But that's harder than it sounds. Not much stuff stays dangerous for 10,000 years. If I were in charge, I'd build some cool Indiana Jones-esque traps. :)
I'd also point out that such a technique would run opposite Long Now's goal of having visitors - I mean, it's hard to build a clock that lasts 10k years, hard to contain radioactive materials in casks buried underground in salt flats for 10k years, how much harder would it be to do both simultaneously?
Actually, you know what? Forget about clocks. I want to know how we can make elaborate dungeon traps last thousands of years.
Point being that over 10.000 years (heck, let's just say over 100 years), someone is going to tear that thing apart and use the components for some thing else.