If you're drawing something you can see, I don't see why you would need visual imagination.

Even if you're not drawing from something you can see, you can have a procedural memory of how to draw the thing, and you can see what you've already put on the page, and experiment if necessary using an eraser.

I don't have complete aphantasia, but my visual imagination is pretty weak, and I can still draw.

I didn't mean to say you have aphantasia, sorry. I was just trying to give an FYI. The story I linked was an eye opener the way he explained how it works in his head was amazing.