The James Webb space telescope cools it's observing side instruments to 10s of degrees above absolute zero, using active cooling. I wonder how hard it would be to detect from it's cool side, at a space combat distance?
Asteroids in the near solar system are normally 100-150 kelvin, apparently, and don't seem trivial to spot.
All that still seems to allow room for stealth in a hard sci-fi setting.
This and other points are discussed here: https://tvtropes.org/pmwiki/pmwiki.php/Analysis/StealthInSpa...
There are a number of methods one could theoretically use to minimize these factors. As an example, imagine the detectability of a small angle coherent neutron beam or the IR exhaust of a black hole starship.
Its still more fantasy than science, but hey, so are warp drive, hyperspace, and all that jazz :)
If heat signatures are a sure way to identify space ships, then the value of stealth comes in at the limit of detection range. If an enemy can only detect me at X units away, but I can detect him at X+1 units, I have an advantage.
If I'm spouting nonsense, I'd be legitimately delighted to hear why it can't work.
X+1 detection range isn't much of an advantage if X already includes most of the places you can actually be and/or X is already an order of magnitude past effective weapons range.
Some Sci-Fi has tried addressing it with plausible ideas - like for instance dumping all heat into shielded internal tanks, which have to eventually be vented(so that stealth cannot be infinite because you run out of heat storage capacity on board).