Yes, although usually when people are making these arguments they're imagining optimization across different entities and through time (relative to foreseeable events / probabilities). It then becomes much easier to write off conflicting higher-level subjective goals as not being actually valued in some imagined universal sense. The fallacy is rejecting the stickiness of human-made structure, even though that structure is all around us.