Re:fMRI-to-Image with Contrastive Learning and Diffusion Priors
by satvikpendem on Tuesday July 18, 2023 @01:33AM
(#36768224)
If it's still retrieving an image and not reconstructing it, if the dataset is large enough that's decently fine, but this is generally not how diffusion models work in general and I'd have expected the model to map the fMRI data to a wholly new image.
[ Parent
| on HN ]
Re:fMRI-to-Image with Contrastive Learning and Diffusion Priors
by jph00 on Tuesday July 18, 2023 @01:40AM
(#36768267)
Please read the paper. Or at least the blog post. It's really quite readable.
They explain that they've done both retrieval and reconstruction, and have lots of pictures showing examples of each.