How about we link them to modules downloaded onto local file system instead, just in case of network issues.

How about a cli tool to cache and build those modules/native extensions all at once? We could call that Deno Package Manager.