Trying to fit your preconception into a mathematically convenient conjugate distribution is not as far afield from making stuff up as people want to believe. Maybe it is better with numerical approaches.

But yes, you usually do have some information and it is net better to encode when possible.