But, it's sad that any MIDI device can possibly have problems anywhere so long after its invention. I have a MIDI interface on a Commodore 64 that works reliably! Likewise, I used to do sequencing on an Amiga...worked fine for MIDI. Multi-track 16 bit audio was more of a challenge on such a small machine (started doing digital multitrack work with an Amiga 2000 with a 7.14Mhz CPU).
Boots Riley of the Coup talked about using an ST for many, many years after it was out of date. I think he was using it up until Party Music (released in 2001, but it might have been the prior record. Atari Teenage Riot also keep pounding away on their STs well past their prime.
I use a C64 and a Game Boy for music production these days; but I mostly play the 64 live (using the keyboard...not even a MIDI keyboard of piano overlay) and the Game Boy just exists as an independent music device. I've never tried combining its output with anything else. But, probably will eventually. If I were to find an Amiga 1200 or one of the latter day STs, in really good shape for not a lot of money, I'd probably pick it up. But, there are so many collectors of the old machines now, and so few remain in working condition, that it's not common to find them. I need to acquire a backup C64, though, for sure. I don't think there's good resources for repairing them the way there were when I was a kid.
Latency and glitching can become an issue when you're trying to record and monitor in real time while also operating plugins and multiple tracks. That's not the case here.
In passing, I'll tell you what is really a problem on current iterations of Windows: MIDI over USB. Audio is OK, MIDI is atrocious.