Actually in low-tech societies it was the other way around. Rich people had servants who lived in their houses and knew every detail of their lives. If you were rich back then, the servants knew where you ate, what you ate, where you slept, who you met, basically every detail of your life. If you had an argument with your spouse over money the servants could hear every word.

Meanwhile poor people were known to their immediate neighbourhood, but at a much lower level of detail. Yes, local businesses might know customers, but the knowledge was atomic and disconnected: nobody was integrating the information held by the barman and the storekeeper and the newsagent and the neighbours.