Jaynes usually tries to move away from an interpretation of probability distributions being "correct" as in representing a fact about the world, and towards a definition that is more about a state of knowledge and uncertainty about the world. Distributions are a property of a model or of a knowledgeable agent, not of an object or situation. See Chapter 10: "Physics of 'Random Experiments'". However the two definitions sorta become indistinguishable when you are dealing with experiments that are repeated enough times.