> The only way I can think of fixing this is to use something like audacity's pitch changer that doesn't affect the speed of the sample

Check out Ableton Live’s “Simpler”