Use a neutral gray (this could be black or white). What you want to avoid is framing the image with any "color". Context affects what colors are seen. Knowing a little about something called simultaneous contrast is helpful: http://www.apple.com/pro/color/tools/caponigro/contrast.html