Even more so if you wonder if it couldn't be a way to dispose of waste. Also, if corrosion was an issue, perhaps they could coat it with something?
But you have it right: The decay power density of nuclear waste is quite soon not enough for such a probe.
With a good amount kilometers of rock between the surface and the waste, the danger is already gone. Furthermore, melting the waste and have it move thorugh the mantle will lower its concentration and will over time have the heavy materials fall into the core.
My guess is that the point at which the nuclear waste becomes less problematic than current methods will probably occur quite quickly, just a few kilometers if that. The point at which the tungsten corodes and the waste can be swept away doesn't seem to be that deep either.
Tungsten oxidizes in air beginning around 600°C and as the temperature increases, the tungsten oxide layer scales off, exposing underlying metal to further oxidation. (see, for example, http://labfus.ciemat.es/AR/2011/C_004/AM_4x.pdf)
Tungsten is great for high temperature use in vacuum, neutral (the inert gases) or reducing environments (hydrogen, for example). You can use it nearly up to its melting point in those conditions if you aren't too dependent on structural integrity.
In oxidizing environments (air, oxygen, water, halogens, silicates, etc.) it fails quite rapidly. Molten rock is replete with chemical species that react with tungsten at elevated temperatures.
At 2000°C, the tungsten blanket covering the Co60 heat source would be corroded away, I'll guess, within a week of launch on its journey to the center of the earth.
Although it would be incredibly costly, they might have better luck with iridium or rhenium.
Nevertheless, a fun mission to think about.