Thermos has two mechanisms blocking heat transfer. A vacuum to stop conduction/convection and a mirror to reflect IR. If you look into your thermos you'd see its inner reflective surface. Space is not a mirror, it is pitch black, it just absorbs all IR that you emit.
Had you thought that your face probably could feel the heat of the Earth being in space? Suppose your skin is resistant to vaccum, suppose you are on some low orbit (so the Earth would have really big angular size), and suppose that you look at the Earth and then turn to look into a deep space so you have no "nearby" objects in your field of view. I believe, that you can feel the difference with your skin's thermal receptors. Even if you are about the night side of the Earth.
I'm not entirely sure about it, maybe I missed something when doing math, but I'm still pretty sure. How can you talk about space not being cold with all this?
Now put freshly boiled water in a Thermos, or your preferred brand of vacuum insulated flask.
Notice how the water stays hot for, what, I don’t know, 24hrs or so.
That’s how ”cold” space is.
Incidentally, did you now it is estimated that the Sun, or star Sol, is anticipated to take trillions of years to cool via radiative dissipation after nuclear fusion stops in the core.