I do want to mention that larger social organizations were quite widespread in the Americas, despite the existence of hunter-gatherer tribes. The new world certainly wasn't an uncivilized wasteland when Europeans arrived.
Epigenetic factors can be triggered buy group size (domestication) as well. So those hunter-gatherer tribes might share the same genetic traits but express them differently based on their environment.
I don’t recall the study, it was either men in the US or Britton. But, income was positively correlated with number of children. Income and intelligence are also linked so that's evidence that right now intelligence is positively correlated with number of children. This may be strongly linked with prison time but again that links with intelligence.
The important thing to note is men often have children with more than one person and can have children vary late in life.
"Farming actually lowered many heath indicators ..."
Indeed, it's uncontroversial that farming degrades the heath.
Just 500 years ago lots of people in North America where living nomadic hunter gather lifestyles. Even just 100 years ago you could find tribes in many parts of the world still living hunter gather lifestyles little changed over the last 15,000+ years and probably similar to how people lived 100,000+ thousand years ago.
As to epigenetic factors, the classic hunter gather lifestyle could be very healthy as long as population numbers stayed low. Farming actually lowered many heath indicators even as it allowed for massive increases in population sizes.
PS: Anyway, evolution is only 'fast' when there are significant benefits or harms. If a single mutation or environment change increases survival chances by say +/- 1% it takes exponentially longer to spread than a +/- 10% change.