Yes, there's a museum across the plaza from Notre Dame that showcases the subterranean Roman ruins.

http://www.crypte.paris.fr/en/crypt