Memory palace works essentially by storing arbitrary things in your spatial memory. Most people have well developed spatial memory, as there is no practical method that could replace it. It's much better long term if you actually push yourself and train to use your textual or whatever memory properly, instead of using your spatial memory for storing things that don't belong there.