News for hackers. Stuff that matters.
Re:Design of CMOS-memristor Circuits for LSTM architecture by tw1010 on Friday June 08, 2018 @10:30AM (#17265743)
This is cool stuff. But you guys, the perception that there are no low-hanging fruits anymore is false, and the reason it is perpetuated is because people oddly obsess over frontier techniques and their combinations, instead of innovating at first principles.

Just trying to be the voice of psychological health in this community.

Re:Design of CMOS-memristor Circuits for LSTM architecture by bcheung on Friday June 08, 2018 @08:44PM (#17270863)
AI is largely a research dominated field, and as such, it emphasizes novelty. Once the average developer starts using it I think things will change towards more practical concerns. We're starting to see this already with existing libraries and porting to non-python environments.
Re:Design of CMOS-memristor Circuits for LSTM architecture by bcheung on Friday June 08, 2018 @02:04PM (#17268099)
I'm not that familiar with CMOS-memristors. The paper is a bit scarce on background.

Is this just for inference or training time as well?

Is it digital or do the inputs have analog voltage rates and only then trigger like a neuron?

Can the network topology and weights be modified or is this fixed like an ASIC?

Re:Design of CMOS-memristor Circuits for LSTM architecture by londons_explore on Friday June 08, 2018 @12:17PM (#17266895)
Interesting concept, but note this can't be used for training an LSTM network.

it's the training that involves far more computation and memory, because rather than just storing the latest state of the LSTM cells, one needs to store all past states and activations of the cells.

For forward inference, this logic looks good, although I'm unclear what use cases it would apply to.

Re:Design of CMOS-memristor Circuits for LSTM architecture by amirhirsch on Friday June 08, 2018 @12:26PM (#17267007)
It makes much more sense to design ASICs for inference than for training. Any useful inference network will be executed many millions of times more than its training and so will require much more computation in aggregate. Inference may also be run in embedded environments, running on battery power with no network connectivity while training can probably run in the cloud.
Re:Design of CMOS-memristor Circuits for LSTM architecture by senatorobama on Friday June 08, 2018 @08:22AM (#17264591)
Are there any Master's degrees in AI + chip design?
Re:Design of CMOS-memristor Circuits for LSTM architecture by soravux on Friday June 08, 2018 @09:41AM (#17265215)
In my university, both machine (and deep) learning and FPGA + chip design are specialties of the electrical engineering department. We just launched earlier this year an industry-oriented AI masters degree. Taking your extra classes in chip design would give you a solid foundation to perform this.
Re:Design of CMOS-memristor Circuits for LSTM architecture by godelmachine on Friday June 08, 2018 @10:18AM (#17265616)
Would you kindly provide the link to the particular course of your university? Thanks :)
Re:Design of CMOS-memristor Circuits for LSTM architecture by soravux on Friday June 08, 2018 @01:52PM (#17267961)
The master's program in AI I was referring to is only available in French (Laval University, Québec City).

The chip design expertise is provided by most electrical engineering departments, with courses usually named VLSI design, FPGA/ASIC development or microelectronics.

If you apply for a master's degree (in AI, for example), you can often mix-and-match speciality classes and ask for those chip design courses to be added to your cursus.

If you are a hands-on person curious about the matter, you can buy an FPGA (~50$ for entry-level) and follow a Verilog or VHDL tutorial online. Quickly put, an FPGA is a chip that can be "rewired" at will, very useful to learn or prototype before building a production chip.

Re:Design of CMOS-memristor Circuits for LSTM architecture by godelmachine on Saturday June 09, 2018 @02:54AM (#17271884)
Thanks for the info :)

Hope it will be available in English soon enough.

Re:Design of CMOS-memristor Circuits for LSTM architecture by godelmachine on Friday June 08, 2018 @08:28AM (#17264630)
Never heard of one, if you ask me. You have to customize the course so as to suit your expectations. Basically, take up courses on Machine Learning and Advanced Digital Electronics.
Re:Design of CMOS-memristor Circuits for LSTM architecture by deepnotderp on Friday June 08, 2018 @12:01PM (#17266737)
MIT has a course I think.
Re:Design of CMOS-memristor Circuits for LSTM architecture by godelmachine on Saturday June 09, 2018 @02:55AM (#17271887)
Would you kindly post the relevant link?
Re:Design of CMOS-memristor Circuits for LSTM architecture by deepnotderp on Saturday June 09, 2018 @03:38AM (#17271984)
I think it's an MIT only course, but this is a good starting link: http://eyeriss.mit.edu/
Re:Design of CMOS-memristor Circuits for LSTM architecture by monk_e_boy on Friday June 08, 2018 @09:20AM (#17264979)
Any interesting algorithm eventually finds its way down into silicon.