I feel the same and am also an improviser on multiple instruments but a few times I regretted not being able to cursively read sheet music. However, all that effort and energy it would take, I’d rather spend creatively and enjoying myself just improvising.