People want to install a single “Lemmy” app on their phone that shows them all Lemmy content and lets them post to all instances, using a single account and a *simple* user interface. If Lemmy cannot provide that user experience (abstracting away the federation), then yes it is doomed.
Federation just means multiple independent servers/domains can talk to each other, such as with email or Matrix, without the need for central authority (other than for discovering each other).
To answer the question, and I have just a superficial understanding of the concept, the main issue with decentralized vs. federated protocols is that you have to store the whole (or quite a large chunk of the) social tree locally on your device. That's a lot of data that you don't really care about. It might be fine if you access the network from a computer with plenty of space, but a mobile device might be more problematic.
I have had a number of actually average users asking me about the Reddit blackouts recently. Most of them don't know of Reddit beyond the first party app. 3 or 4 didn't even know Reddit had a website. None of them could even comprehend how you could use a third party app to access Reddit and their minds were blown when I told them that Reddit didn't have an app at all originally and the Reddit app today was originally Alien Blue.
For most people, the word "service" doesn't even enter into their minds. It's an app. It either does what they want or it doesn't. The inability for many in our group, including myself, to comprehend and understand this is why the fediverse, Linux, crypto for non-investment/gambling purposes, etc. continue to fail to gain much popularity. For most people, they don't care how it works... they only care that "it just works".
Like with email, you have to think about it in terms of "service".
The "gravitate to one provider" problem is there (as with gmail), but those who care can still have their own email services or use reasonable third parties.
The tragedy of course is that very few people care.