I always wondered who he had in mind when he said that. My guess would be Johannes Kepler and Tycho Brahe. But while both Kepler and Brahe qualify as giants without question, there's still a world of difference between them and Newton.