It was the weirdly sexualized race and gender based cannibalism that I think puts it over the line, not the actions of Joe, except in the context of the former.
I mean I see what he was trying to do, but rather than basing his African elites on anthropological evidence, or on real white cultures that were horrible to other races, (which would have gotten his point across better, I think,) he based them on the most disturbing (and to me, last believable or sympathetic) racial fears of the time, and because of that, it is kinda uncomfortable.
1964 was the same year the Civil Rights Act was passed. I imagine ideas of baser racial instincts were different when there were still lynchings and fear of sexual racial mixing. :(
As someone born in the very early 90's, it's weird seeing evidence of people taking seriously these thoughts I've only seen caricatured.
Of course, it's done with the subtlety of a sledgehammer, but somehow it's far more forgivable in its consistently tone deaf naivety than if it appeared Henlein actually had a decent understanding of race relations. (like the District 9 filmmakers ruining their perfect race-relations satire with comedy savage Nigerians...)
The daddy who's such an ubermensch even his own daughter wants to sleep with him, whilst he's actually busy screwing her best friend is much harder to accept, of course.
However.
Farnham's Freehold was just ubermensch porn coupled with some really weird racism. He used more hackneyed "I can do everything" stereotypes than an Ayn Rand novel, which is something he was always guilty of but it really came to a head here. The multiculturalism and openness that was so explicitly prevalent in Starship Troopers, Stranger, and Harsh Mistress (the main character of Starship Troopers is a bisexual South American) vanishes, replaced with this weird fear of black people - "they seem nice, but they'll turn on you when they get the chance" is the message the Joe character imparts.
Just a very weird book.