It would be a LOT more seamless if the output didn't have any HDCP to re-synchronize. Though the different frame timings (gen-lock is a term you want to search for) between the inputs and outputs so such a system might introduce presentation latency which would have to be accounted for in the audio streams.