I've asked this question before, and though I haven't gotten to the point where I could direct you to the best place to start, it would probably be in one of these books:

E.T. Jaynes, "Probability Theory: The Logic of Science"

Judea Pearl, "Probabilistic Reasoning in Intelligent Systems"

Bayesian Data Analysis, 2nd ed by Gelman et. al