I think we're saying the same thing. Training pair at t0 is video_t0, sensor_t30. So we have shifted sensor data back 30 seconds, or put your way, we look to sensor data 30 seconds in the future.
Re:Robot Learns to See in 30 Minutes
by stormfather on Monday March 27, 2023 @08:03AM
(#35325571)
Oh yeah you're right, thank you. I think the way you phrased it makes the most sense now.
Do you mean forward time shifted sensor data? I.e. using sensor data 30 seconds from the future as a label, and real time video as input?