It's not obvious, but once you click to select a color, you can click the arrow at the bottom and manually insert hex / RGB / HSL, etc. to manually define your base color.