You still need timing logic, you have to extract the clock signal from the SPDIF signal as well.