"You had some very bad people in that group, but you also had people that were very fine people, on both sides. You had people in that group …".

Do you mean this quote?

He meant the silent white supremacists, who protested quietly (with long guns, and who afterwards were pretty proud of themselves that they haven't mowed people down despite having been hit by bricks).

There's a 207 page long review assembled by a commission about the events, and it found no peaceful pro-statue protesters.