For them to actually work the energy needs to be replaced, flowing from the hot areas to the (relatively) cold areas, mostly coming from the sun.

If you have a small area and continually pump the heat out then you end up with the inside of a freezer, which uses the same tech for exactly that purpose, but also intentionally insulates to prevent the heat getting back in.