You're completely right; my thought experiment was half-baked. A challenge to an agency's use of delegated power is necessarily a constitutional challenge. So, unless Marbury were overturned, this wouldn't fly.