News for hackers. Stuff that matters.
Re:fMRI-to-Image with Contrastive Learning and Diffusion Priors by satvikpendem on Tuesday July 18, 2023 @01:33AM (#36768224)
If it's still retrieving an image and not reconstructing it, if the dataset is large enough that's decently fine, but this is generally not how diffusion models work in general and I'd have expected the model to map the fMRI data to a wholly new image.
Re:fMRI-to-Image with Contrastive Learning and Diffusion Priors by jph00 on Tuesday July 18, 2023 @01:40AM (#36768267)
Please read the paper. Or at least the blog post. It's really quite readable.

They explain that they've done both retrieval and reconstruction, and have lots of pictures showing examples of each.

https://medarc-ai.github.io/mindeye/

Re:fMRI-to-Image with Contrastive Learning and Diffusion Priors by RC_ITR on Tuesday July 18, 2023 @01:42AM (#36768287)
If you can retrieve an image using a latent vector, it’s trivial to reconstruct it (decently well) with a diffusion model.
Re:fMRI-to-Image with Contrastive Learning and Diffusion Priors by rocqua on Tuesday July 18, 2023 @03:23AM (#36769010)
They tested themselves both on retrieval and reconstruction.