News for hackers. Stuff that matters.
Re:Real-Time Brain-to-Image Reconstructions by sillysaurusx on Friday February 10, 2023 @08:37AM (#34739436)
I don’t know. Now that you explain how it works, it’s starting to freak me out. Imagine being hooked up to an ML model designed to classify whether you’re thinking about porn or not, and emits a beep whenever it detects it. The implications of that are astonishing, if it’s accurate.

It hinges on accuracy. If it can detect a topic, the image reconstruction is almost moot, because you can start interrogating people about what they know.

I wish I knew more about biology to know whether this is at all feasible, or if it’s just smoke and mirrors. (A distressing number of projects like this are to secure further funding for a lab, not really to advance science.)

Since you seem to know about this, do you have any details about the classification process? I assume it requires the cooperation of the user, but it’s easy to imagine that a “primal brainwave” pattern might be common to all humans.

Re:Real-Time Brain-to-Image Reconstructions by ad404b8a372f2b9 on Friday February 10, 2023 @09:21AM (#34739910)
lol yes, the social implications are horrible for this kind of work but I'd say more so for dissidents, journalists, and so on rather than porn.

Projects that are at the intersection of life sciences and machine learning are rarely interesting along both axes, it's always novel on one side and the other side is just there to make it seem cool. For example you'll find a lot of ML scientists investigating medical issues but lacking the basic medical knowledge to actually make an impact, similarly you'll see doctors using neural networks where a linear regression would do. In both cases the paper seems novel to the people in the field it's being published in.

The classifier I was talking about is implicit, if you look at their proposed diagram they want to use fMRI embeddings, they serve as a continuous equivalent. You put a sufficiently large model on top of any embeddings and it will learn to reconstruct their modes. The embeddings are trained across subjects so it's not specific to a single patient but they hope to fine-tune it per patient using latent space alignment.

If you look at the papers in their recommended reading list, it's apparent that only low-frequency signals are learned, for example for face reconstruction the model can learn hair color, sex and beard/no-beard, but the actual face doesn't look anything like that of the person being looked at. Similarly for other benchmarks, the model can tell it's looking at a plane, but not much beyond that. This is cool from a technological standpoint but I recall papers doing the same thing at least 7 years ago. The novelty of their approach will be the architecture that comes after the embeddings, which can be interesting but won't add any more information to the fMRI scans.

Re:Real-Time Brain-to-Image Reconstructions by r3trohack3r on Friday February 10, 2023 @09:23AM (#34739936)
I’m struggling to find a reference, but I’ve already seen this used in the reverse during interrogations.

You use something like an EEG and show someone a series of images to establish a baseline of “familiar” and “unfamiliar.” Then you show them photographs of the crime scene that haven’t been made public to test for familiarity.

I question its accuracy but your scenario already seems possible.

Edit: for siblings comments about journalists - “identifying” a source could probably be “accomplished” using the above technique already, no need for AI. Show photos of random people mixed in with the photo of the suspected leak in your gov. department.

Re:Real-Time Brain-to-Image Reconstructions by retrac on Friday February 10, 2023 @10:05AM (#34740554)
> classify whether you’re thinking about porn or not, and emits a beep whenever it detects it

Already gone down this road with lower tech. In the 50s - 70s it was in vogue to monitor blood flow to the genitals while subjecting the subject to erotic imagery of various kinds to see what turned them on. [1]

It was then realized that arousal is also correlated with pupil dilation, which meant that a much less invasive test was possible. Which of course led to the Canadian government (and probably other governments) using it in the 1960s to detect possible homosexuals in the public service. [2]

The scientific flaws and human rights violations of such a test are too many to even begin to list in a short post like this. Still, the inconvenient and disturbing thing is: it does work. Sort of. Kind of. Not good enough odds to be confident about the result, but a properly run protocol is much better than chance odds at determining if a man is gay or straight, for example, in terms of aligning with their self-reports about what arouses them.

Whether someone is actually erotically aroused by something based on a physical response is obviously controversial. For example, a repeatable finding is that self-reported-heterosexual men with intensely homophobic views are more aroused by homosexual male imagery than the average heterosexual male. Commonly reported in the news and media as: homophobic men are secretly gay. And I guess that's one possible interpretation. But someone about to to fly into a fit of rage is also aroused. Sometimes literally -- sexual arousal during flight-or-fight and disgust responses is a thing. So it's tricky to interpret what that result means, if anything.

No doubt we will fall into similar traps again, with the brain scanning version of it.

[1] https://en.wikipedia.org/wiki/Penile_plethysmography

[2] https://en.wikipedia.org/wiki/Fruit_machine_(homosexuality_t...

Re:Real-Time Brain-to-Image Reconstructions by thedorkknight on Friday February 10, 2023 @11:06AM (#34741515)
I'm actually struggling to find the usefulness of this. The person needs to be in an fMRI machine, so we're not talking about some sort of unobtrusive scanner in a public area. On top of that, in cases like what you're describing which basically just classify thoughts to a binary level, then it's pretty much useless because if someone knows that they're being scanned to see if they're actively thinking about pink bunny slippers, then they're going to think about pink bunny slippers.
Re:Real-Time Brain-to-Image Reconstructions by cabalamat on Friday February 10, 2023 @12:38PM (#34742928)
> Imagine being hooked up to an ML model designed to classify whether you’re thinking about porn or not

Or whether you're thinking thoughts the government doesn't like.

Re:Real-Time Brain-to-Image Reconstructions by lostmsu on Friday February 10, 2023 @03:57PM (#34745732)
> it’s starting to worry me

Not any time soon: https://duckduckgo.com/?q=fMRI+device&ia=images&iax=images