Even if you use fusion power you need to use some mass that you can accelerate and then expel opposite to your direction of motion. So while you would need less fuel, this is only really true if you also have what would amount to a miniaturized particle accelerator beyond anything we are able to build so far. Or put other words simply producing lots of energy is not enough.