News for hackers. Stuff that matters.
Re:Researchers Move Closer to Completely Optical Artificial ... by EchoAce on Friday August 10, 2018 @04:25AM (#17731582)
It may be my lack of knowledge about optics, but from an ML perspective this seems rather mundane if not useless. Model training involves high levels of parallelism on a large scale for difficult tasks, something I can’t see these optical chips doing. Does anyone have any further information that might enlighten me to otherwise?
Re:Researchers Move Closer to Completely Optical Artificial ... by stochastic_monk on Friday August 10, 2018 @04:43AM (#17731661)
By performing these transformations optically, they primarily get data parallelism (like [GTV]PUs). I expect this to happen. NVIDIA’s ACDC paper provides an FFT-accelerated neural network layer (similar to deep-fried convnets), with an offhand remark that the transformations could be performed optically. I wonder what kind of information bandwidth they can get, though.
Re:Researchers Move Closer to Completely Optical Artificial ... by dekhn on Friday August 10, 2018 @07:23AM (#17732321)
Physicists were using optical lenses to do approximate FFTs over a hundred years ago.
Re:Researchers Move Closer to Completely Optical Artificial ... by drumttocs8 on Friday August 10, 2018 @09:54AM (#17733240)
Can you use something like wavelength division multiplexing to get different data streams and achieve parallelism there?
Re:Researchers Move Closer to Completely Optical Artificial ... by d--b on Friday August 10, 2018 @04:39AM (#17731639)
I can't read the article as it's behind a paywall, but if you can make a chip that's 100% optical, then it means that when you beam your input data at the input end of the chip, you _instantly_ get the output at the end. No need for cycles for multiplying, adding and so on. Plus it wouldn't heat up like silicon does.
Re:Researchers Move Closer to Completely Optical Artificial ... by p1esk on Friday August 10, 2018 @12:06PM (#17734567)
you _instantly_ get the output

That's not how physics works, unfortunately.