This story would be completely different if the old silicon computers were replaced with neo-computers.
Also for anything that uses a standard floppy drive there are cheap and plentiful adapters to use flash storage instead of disks.
The problem with those are that not all equipment that uses floppy drives conforms to standards. If you have a 50 year old embroidery machine from a company that no longer even exists you'd need someone pretty fucking technical to pull that shit apart and figure out if any of those drive replacements will even work in your weirdass machine. If you are lucky your machine used some off the shelf drive from a reputable company (I've seen some old weird drum machines machines that had Apple Disk ][ drives hanging off them) but otherwise...
Sometimes someone manages to spin up new manufacturing of retro components or things to replace the retro components (there are a few pcbs running around that can replace floppy drives that conform to certain interfaces with usb sticks or sd cards or even a network): Vacuum tubes, parts for vintage cars, parts for vintage watches, vinyl records, etc. but often before that happens the entire known supply needs to be scavenged.
So I can imagine a world where we manage to start doing the things we are doing with some new technology that is not digital silicon based computers that run on electricity. But there will be edges where the new technology is not compatible with some system, and in that edge lives this kind of speculation.