Yes. He had read a significant amount of English literature by age 15, including the complete works of Shakespeare.
But a fair number of people had similar upbringings without that kind of fluency. Plus, English was slightly passé to that cohort.
Nabokov wrote and read English before Russian.
The Russian aristocracy was extremely multilingual.