Agreed. What I think most people mean is that they can't recall events from those ages at will. Neither can I, but certain triggers can bring back a handful of vivid memories of events from when I was between 3-4 years old. For example seeing a house with the same architectural style as the one I grew up in.