There are processes that do the latter, such as fluorescence. There are features of the two processes that let you figure out which is which. In fluorescence, there is a time delay that might be long enough to observe. Also, the generated photons will come out with energies characteristic of the material, rather than of the incoming photon. And there are differences related to polarization and the angular distributions of the photons.