Re:Lumiere: A Space-Time Diffusion Model for Realistic Video...
by sjwhevvvvvsj on Wednesday January 24, 2024 @11:07AM
(#39118999)
“PoC or GTFO” as they say.
[ Parent
| on HN ]
Re:Lumiere: A Space-Time Diffusion Model for Realistic Video...
by addandsubtract on Wednesday January 24, 2024 @11:35AM
(#39119341)
PapersWithCode or GTFO.
Re:Lumiere: A Space-Time Diffusion Model for Realistic Video...
by baldgeek on Wednesday January 24, 2024 @12:05PM
(#39119727)
2 clicks from the Posted Link: "Read Paper", then "Code, Data and Media" tab will get you the dataset used (https://paperswithcode.com/dataset/ucf101)
Re:Lumiere: A Space-Time Diffusion Model for Realistic Video...
by sjwhevvvvvsj on Wednesday January 24, 2024 @01:35PM
(#39120964)
Well in the Ai/ML era maybe “models or gtfo” is better. Training data is just common crawl for half these LMs.
Re:Lumiere: A Space-Time Diffusion Model for Realistic Video...
by gs17 on Thursday January 25, 2024 @01:39PM
(#39133034)
That's not the dataset used for training. From the paper:
>We train our T2V model on a dataset containing 30M videos along with their text caption. [...] We evaluate our model on a collection of 113 text prompts describing diverse objects and scenes. The prompt list consists of 18 prompts assembled by us and 95 prompts used by prior works (Singer et al., 2022; Ho et al., 2022a; Blattmann et al., 2023b) (see App. B). Additionally, we employ a zero-shot evaluation protocol on the UCF101 dataset >