It depends on the effect you want. Since I usually want the details to be highly visible, I usually go for a background the same color but a shade lighter than the major color in the photo. That minimizes the contrast between the photo and its background, bringing out the details within the photo.