but, if anything, the opposite is true. If I keep dumping a constant amount of heat onto a material it will get hot enough to cool itself.

So a piece of aluminum will be cooler than a piece of iron. The Al might transfer more heat to my fingers than the steel... or it might not (that depends on many more factors than just the conductivity).