If we're the only intelligent beings in the Universe, then I argue that intelligence is overrated, thus our significance (except to ourselves) is negligible. Unless you go the route of arguing that without intelligence, there is no significance, and thus our self-significance is all the significance there is, in which case you're right - it's huge.