Exactly. The historical remains that we have are all very biased compared with how people lived.

Even from a few hundred years ago, there's not much record of how the average person lived. Most things that survived are stone castles, and other remnants of noble life.