I'm no expert but asphalt is bitumen for a reason, and bitumen is blacker than black.

If you were to mix in something in sufficient proportion to lighten the color of the asphalt, it seems likely you'd change more properties than just its appearance, like its durability and water resistance.