Oh yeah - the tracker itself wasn't the sampler, but one would often import sampled waveforms (or borrrrrow 'em from other tracks). I seem to remember fasttracker ][ (which i spent a ridiculous amount of time with as a teenager) had some 'draw a waveform' functionality which is possibly the worst sound interface imaginable.
It was kind of like writing music in hexadecimal.
I wasn’t particularly good at it though. I much preferred the workflow of a sequencer to a tracker.