That would mean most likely that the video is the result of a prompt without any example.

Illustrated examples from how Google does it here: https://blog.research.google/2023/11/zero-shot-adaptive-prom...

EDIT: corrected answer factuality.

I wonder why "zero-shot" rather than "one-shot".

I was wrong indeed, this is technically called zero-shot prompting.

Zero-shot prompting here means without an example, i.e. "show me a panda on a skate". The opposite would be few-shot prompting, "write me a limerick like these 5 examples".

In addition, there are some tasks that the model can do and was never trained on, see the newly added paper link in the website.

i interpret it that the VideoPoet has not seen the things prompted. One shot means you show it one example of something and it generates equivalents.

However i find it very misleading, as the training data is most likely gigantic. So it is not very accurate calling it zero shot

Ah, thanks, that makes sense.

Author here. We demonstrate zero-shot capability on a few tasks by chaining smaller tasks together. For example, the model was never trained on text-to-audio but we can do it by generating text-to-video followed by video-to-audio.

We just added a link to the paper in the website, you can read more about it.