We rarely eat fast-casual nowadays despite being voracious consumers when we were in our early 30s. Our kids don't eat it (so we need to cook separate meals for them), and there's less infrastructure built up around making sure parents never need to go into the restaurant.
I feel like McDonald's has always served the families-with-small-kids demographic - it started in the baby boom and then massively expanded as the baby boomers were themselves having kids. To the extent that the fast food industry is seeing its customer base decline, it's probably because fewer people are having kids. It's likely that childless couples didn't eat at McDonalds in the 80s and 90s either, but being kids then, our only experience tended to be with other families that had kids.