News for hackers. Stuff that matters.
Re:Monkey MindPong by elil17 on Friday April 09, 2021 @03:50AM (#26747773)
For those who don’t know much about this field, this seems incredible. The reality is that this a tech demo that Neuralink is using to practice the basics. For other research groups in this field, this is tech from 20 years ago.

The current state of the art is humans, mostly quadriplegic people, with chips which let them control robot arms with enough accuracy to pick up small delicate objects, play games, and type by thinking words. Current state of the art implants let people get tactile feedback too - they can intuitively know the position of the arm they’re controlling and feel the amount of pressure on each finger tip.

I had the pleasure of meeting a man with an implant in 2016 and the technology he was using was incredible. He could pick up a grape with his arm without crushing it and then eat it. If the arm was in another room, he could feel around with it to find objects. He described how the arm just felt like a part of his body when it’s turned on.

To use SpaceX as an analogy: this isn’t a first flight. This is more like a static test fire. If Neuralink follows the SpaceX trajectory of driving down cost/increasing innovation, it results will be really out of this world. Stuff that would just sound bonkers right now.

Re:Monkey MindPong by codeulike on Friday April 09, 2021 @09:21AM (#26750204)
One of the neuralink innovations is having the electrodes installed very precisely via a robot surgeon, which supposedly allows them to make things easier/better/more precise -

https://www.dezeen.com/2020/09/02/neuralink-elon-musk-brain-...

Previous discussion of surgical robot https://news.ycombinator.com/item?id=24311152

Re:Monkey MindPong by elil17 on Friday April 09, 2021 @10:30AM (#26751012)
That's really cool! I think one of the things that will hold them back is that there are still a lot of issues on even knowing where to place the electrodes - but as those issues are solved this will have such amazing potential!
Re:Monkey MindPong by lolthishuman on Saturday April 10, 2021 @12:26AM (#26758919)
It sounds like they know exactly where to put it based on their white paper. The problem is more materials engineering for longevity and economics.
Re:Monkey MindPong by elil17 on Saturday April 10, 2021 @08:30PM (#26766586)
They know where to put them for the tasks they are targeting right now - tasks which have already been performed in the lab. Beyond that is a open question
Re:Monkey MindPong by lolthishuman on Wednesday April 14, 2021 @12:18AM (#26802888)
It seems that the ideal way would be trhz gap if it can be done. That way no implant needed but maybe a dome.
Re:Monkey MindPong by graderjs on Friday April 09, 2021 @07:45AM (#26749265)
I think that's a little unfair. I guess what they are doing is achieving the basics, but with a different interface. This is an important proof of concept.

Remember, Musk is all about scalable manufacturing and products. If this was other's tech from 20 years ago, where's the massive commercialization? They failed. Musk is focused on this aspect, and he will (given his past achievements) succeed.

Re:Monkey MindPong by trombonechamp on Friday April 09, 2021 @08:22AM (#26749608)
This is really basic. Here is a harder task from 2015 in monkeys with only 96 implanted electrodes (Utah array): https://youtu.be/lVFWIv5lupo?t=1673

Here is a video from 2014 of someone controlling a quadcopter with their mind with zero implanted electrodes: https://www.youtube.com/watch?v=lsraC04Mm8w

Re:Monkey MindPong by antattack on Friday April 09, 2021 @10:20AM (#26750884)
That's akin to saying that phones are basic since we already had desktops in the 1990s.

Having 10x more electrodes that stay active for a long time, attached to self powered unit under skin with low latency wireless comm link is a major step forward.

Re:Monkey MindPong by elil17 on Friday April 09, 2021 @12:23PM (#26752530)
It’s not that it’s nothing new - it’s obviously not identical to previous BMIs. But the thing people are reacting too is mostly the MindPong part (genuinely basic) and not the 10x electrode part (novel). It’s not like a paradigm shift, it’s a practice run for them to see if they can replicate previous successes with some changes to the tech.
Re:Monkey MindPong by graderjs on Friday April 09, 2021 @10:48AM (#26751221)
That's what I'm saying. Exactly. I don't think it's "easier" to use 2000 electrodes in a microneural mesh.

Besides that, why the pushback? Is it coming from field experts who are like, "bah, old hat as shiny new. humbug!"; disappointed futurists who expected more ("we were promised flying cars and intelligent robotic spouses, and all we got was 2000 electrodes in our brains, and 140 characters"); misMuskists; people who sense unfairness in praises lauded upon this, in their mind, mediocre achievement, echoing to them a theme that the already-anointed and, in their view, undeserving, accrue all praise, while the genuinely meritful, themselves, for example, are overlooked, yet again?

Re:Monkey MindPong by dekhn on Friday April 09, 2021 @07:47PM (#26757542)
I'm going to echo that this is not really as impressive as neuralink is saying. It's a good incremental improvement, but no breakthrough, and enough people have shown similar results. It's still quite far from achieving Musk's dream of uploading his brain into a robot body to fight the AI Singularity.
Re:Monkey MindPong by mlindner on Monday April 12, 2021 @09:39PM (#26787274)
The professor in that first video is a consultant of Neuralink as well now, FYI.
Re:Monkey MindPong by elil17 on Friday April 09, 2021 @12:34PM (#26752651)
Also! Forgot to put this in my comment but here is an interview (a couple years old) with the man I met talking about what he thinks of NeuraLink: https://www.technologyreview.com/2019/07/19/238809/nathan-co...
Re:Monkey MindPong by ggambetta on Friday April 09, 2021 @04:49AM (#26748168)
Would it be possible to control an extra arm somehow? Or brain plasticity doesn't go that far?
Re:Monkey MindPong by RobertoG on Friday April 09, 2021 @08:50AM (#26749872)
The brain is very plastic, it probably would adapt at any consistent input. A most interesting question is, what would you sacrifice?

Because the part that you would use to control your extra tentacle or whatever is probably currently used for something. If you are missing an arm is obvious what part of your brain you would use, otherwise, some sacrifice probably have to happen.

Even reading, it seems, take the space that is used in people that can't read for some detailed visual processing (1).

Maybe you could add some extra processing in the extra arm, so it's more "cheap" to use.

(1) - I learnt that in "Reading in the brain" by Stanislas Dehaene.

Re:Monkey MindPong by vsareto on Friday April 09, 2021 @10:37AM (#26751106)
I don't think we necessarily have to sacrifice something. We learn new skills and knowledge all the time. Using the new limb could be a skill. Maybe it's not as dexterous as the motor cortex and real hands at first, but there might be some benefits over natural hands.
Re:Monkey MindPong by RobertoG on Friday April 09, 2021 @12:06PM (#26752315)
I think that you sacrifice something when you learn a new skill. The brain have a finite capacity and it just forget not used facts or skills, and the reason it's forgetting is because it's always learning.

For instance, I'm learning German and I can feel how is messing with my English, specially with the spelling (English is not my first language).

Re:Monkey MindPong by HKH2 on Friday April 09, 2021 @07:09PM (#26757298)
I think memory retention has more to do with simplicity / emotional consistency.

The new skill you learn may reinforce existing areas if its components are transferrable. Also, I see schemas as compression in the brain; eidetic memory shows how much some brains are capable of.

Forgetting is very good for clarification. I think your example suggests that your spelling in English hasn't been established deeply enough; I understand why you might have an adverse reaction to learning it though (German spelling is far more reasonable).

Re:Monkey MindPong by vsareto on Friday April 09, 2021 @12:22PM (#26752505)
But if it has a finite capacity, when does it fill completely and with what? I guess it's entirely possible that only kids who are growing up can learn to use the extra limb and adults won't be able to.
Re:Monkey MindPong by RobertoG on Friday April 09, 2021 @01:35PM (#26753487)
I don't think it never fills completely, it just empties the older entries to make place for the new ones.
Re:Monkey MindPong by codr7 on Friday April 09, 2021 @12:14PM (#26752399)
Also part of why voice interfaces didn't take off for complex tasks, talking about performing the task interferes too much with the mental process.
Re:Monkey MindPong by londons_explore on Friday April 09, 2021 @05:07AM (#26748298)
The real innovation is when you can find a method to control the physical hand and the virtual hand independently.

I suspect it would be possible if you can do some kind of real-time feedback/tuning of the ML model. Reinforcement learning stuff.

By slowly adjusting the model to reward hitting the ball back in pong, but also to penalize moving the real physical hand, you might achieve it.

Re:Monkey MindPong by harperlee on Friday April 09, 2021 @06:57AM (#26748915)
Can't the brain alone use visual feedback to close the loop, separating both hands? If thinking in a particular way activates the only the robot hand (trembling), I'd guess that with sufficient plasticity you should be able to start enhancing control of it.

Obviously tactile and proprioceptive feedback through the chip would enable better / quicker control, given the sufficient plasticity hypothesis.

Re:Monkey MindPong by elil17 on Friday April 09, 2021 @09:54AM (#26750610)
Absolutely. The first test subjects of this technology were chimps who weren't paraplegic, just controlling extra arms.
Re:Monkey MindPong by _Microft on Friday April 09, 2021 @07:51AM (#26749300)
I bet it is possible but that does not mean that it is going to be easy. Try training yourself to wiggle an ear or to lift a single eyebrow if you cannot do that yet. It's possible but it takes quite some time.
Re:Monkey MindPong by childintime on Friday April 09, 2021 @06:29AM (#26748753)
Many monkeys use their tail as an extra arm, so, should not be a problem.
Re:Monkey MindPong by m463 on Friday April 09, 2021 @11:16AM (#26751579)
I thought the ctrl-labs guys did that.
Re:Monkey MindPong by riccardomc on Friday April 09, 2021 @06:20AM (#26748692)
this is why we can't have nice things... :)
Re:Monkey MindPong by alcover on Friday April 09, 2021 @04:31AM (#26748050)
If the arm was in another room, he could feel around with it

This uncanny sentence is giving me dystopian vertigo. I picture a mob of derelicts home-invading a 130 years-old tech boomer, fighting his remote-controlled spare limbs from room to room..

Re:Monkey MindPong by m463 on Friday April 09, 2021 @11:20AM (#26751635)
Re:Monkey MindPong by brians on Friday April 09, 2021 @07:36AM (#26749204)
Heinlein’s Waldo might be a good thing to read, then. It’s the origin of the word “Waldo” in English.
Re:Monkey MindPong by ZeikJT on Friday April 09, 2021 @11:16PM (#26758629)
It is a cool story, but I had no idea that remote control arms were called waldoes when I read it haha.
Re:Monkey MindPong by GrumpyNl on Friday April 09, 2021 @06:39AM (#26748798)
Thats a nice idea for a movie.
Re:Monkey MindPong by jonplackett on Friday April 09, 2021 @05:03AM (#26748271)
I had no idea these things were possible. Are they currently insanely expensive / only experimental? How available are they?
Re:Monkey MindPong by elil17 on Friday April 09, 2021 @10:12AM (#26750800)
Very much insanely expensive and only experimental. The man I met had a team of like five people needed just to set the thing up and calibrate it for his "brain waves" that day (they had to constantly fine tune the neural net he used to control it because the human brain is so plastic it would change every day and become unusable after a couple days) - plus more researchers running the experiments he was doing. The team had a portable supercomputer running the neural net (this thing was maybe a two or three server cabinets on wheels) that they brought around with them. They had a safety managers to make sure the arm didn't hurt anyone and make sure he was medically okay. This was not a device he used around the house, he was an employee of the research lab and using it for experiments was his full time job.

The risks of these devices are also significant: you have to get risky brain surgery to install them and then you might still reject the implants and have to get them removed.

A very limited number of people have these - the lab this guy worked at had I think about a dozen people, all with BMIs installed using different surgery techniques (some had the implants on the areas where the brain met the nerves going to the muscles so the output to the neural net was a more "direct" representation of movement whereas others had implants on motion planning areas on the brain giving a more "high level" output to the neural net). There are several such labs in the world. My best guess is there are less than one hundred BMIs installed on people today, as well as quite a few more on animals.

Re:Monkey MindPong by tomcam on Friday April 09, 2021 @11:11AM (#26751514)
Not trying to be funny here: lunch with those guys must’ve been absolutely fascinating. When I worked at Microsoft a couple of decades ago we all loved the job and we talked about work even on breaks. To see the staff of the place you’re describing just hanging out must have been extraordinary.
Re:Monkey MindPong by elil17 on Friday April 09, 2021 @12:32PM (#26752628)
It was! The guy with the implant did his undergrad in nanotechnology and had pretty much became an expert in BMI stuff so they were a very cohesive team. They had a lot of funny stories too - like when they accidentally put the mind control monkeys in the cage with the cocaine addiction research monkeys and got to see how cocaine affected the brain interface (it didn’t).
Re:Monkey MindPong by PetitPrince on Friday April 09, 2021 @05:59AM (#26748595)
IIRC this is only experimental. The most reliable/interesting stuff are relying on ECoG (== put electrodes on the surface of the brain), and this means you have to perform a surgery.

For human applications, most of the time the researchers are using patients that requires several brains surgery (e.g severe epilepsy) so that they can do some sort of fly-by experiments (several surgery are needed so that they can also remove the electrodes).

I studied this at uni; my knowledge is probably not up to date.

Re:Monkey MindPong by jonplackett on Friday April 09, 2021 @06:15AM (#26748674)
Thanks - so it seems like it's actually the ease-of-implant part that Neuralink is really doing most interesting development on then, rather than the actual abilities it gives (so far at least)
Re:Monkey MindPong by ianai on Saturday April 10, 2021 @10:12AM (#26761604)
Out of my range here, but I bet they have a deeper and wider base to draw on for the AI interface with the brain than most other organizations through their CEO.
Re:Monkey MindPong by m463 on Friday April 09, 2021 @11:05AM (#26751433)
I would agree, with the further caveat that musk is the guy who builds the machine that makes the machine.
Re:Monkey MindPong by ianai on Saturday April 10, 2021 @10:16AM (#26761627)
You really shot this down with your comment until the end. I’m curious what you could see happening with this tech in 5/10/20/30 years? Particularly the “bonkers” stuff.

I’m asking in part because Elon’s suggested this could eventually lead to whole brain uploads and downloads. Partly asking because it’s pretty easy to be very destructive with a comment like yours and offering a glimpse of where this stands out from the crowd balances the attack.

Re:Monkey MindPong by icoder on Friday April 09, 2021 @06:36AM (#26748786)
The chips you describe, are they responding to brain activity, or are they connected to something outside it, and if so, is that remnant muscle tissue or remnant (peripheral) neural tissue? And if so, do you agree that if that's missing, this is an unprecedented (possible) solution?
Re:Monkey MindPong by elil17 on Friday April 09, 2021 @10:19AM (#26750875)
Both techniques have been used! Some are connected to the top of the spinal cord where as others are on different areas of the brain. Both techniques work and it's not clear which is superior right now.
Re:Monkey MindPong by mlindner on Monday April 12, 2021 @09:37PM (#26787259)
You're confusing apples and oranges here. Those implants you're referring to are at the injury site (arm stump for example), not in the brain. Completely different technology.
Re:Monkey MindPong by swiley on Friday April 09, 2021 @09:14AM (#26750120)
If they handle the software anything like they do for the tesla this will b a massive net negative.
Re:Monkey MindPong by jdsalaro on Friday April 09, 2021 @05:28AM (#26748418)
I'm really interested in learning more about the process of putting existing research into practice as a process from an economics and innovation point of view.

Does anyone have book, talks and other material you'd suggest looking at?

Re:Monkey MindPong by elil17 on Friday April 09, 2021 @10:17AM (#26750858)
Some great places to look:

The Annual BCI Research Award highlights interesting advances each year

"Search for Paradise: A Patient's Account of the Artificial Vision Experiment" is an older book (2012) about a research subject's personal experience with an attempted vision-restoring implant

The research put out by the University of Pittsburgh Human Neural Prosthetics Program and Braingate at Brown University

Re:Monkey MindPong by overdrivetg on Friday April 09, 2021 @02:25PM (#26754108)
Sounds like you are asking about tech transfer capabilities?

As a starting point, here is a good intro article from WIRED that you might find useful:

https://www.wired.com/brandlab/2017/02/tech-transfer-lab-mai...

Re:Monkey MindPong by Zecc on Friday April 09, 2021 @04:16AM (#26747942)
Now imagine if someone could control an implant installed on a Mars probe.

Stupid speed of light, making it lag so much.