In a world without clocks, no electric lights are needed. The safest and highest quality drinking water comes from springs and streams, still today. Flush toilets aren't needed if you live rurally. And so on.
Not to forget, that the less you are used to comforts, the more physically and mentally fit you will be as a person.
But we have abundant evidence in art, architecture, inventions, and every fruit of human creativity, showing that people weren't in a constant struggle.
Especially, we have evidence in literature from the past, giving a more nuanced picture than that of constant struggle for everyone everywhere.
Many would say life is a constant struggle. However few have any clue what others experience is like. Even the filthy rich consider life a struggle.
How far are you going back now? I'm not for groping in the mists of pre-history, when we can read literary descriptions from the last 500 years. That is a more relatable past than the little we can know from ancient days.
> If you were the elite in any time your life is much better than typical.
Yes, and that is just as true today.
In general I think that nobody would be willing to go far back in time. You don't need YouTube, but would you want to live without it? How about electric lights? Safe drinking water? Flush toilets?