News for hackers. Stuff that matters.
Re:Show HN: A perceptron with stochastic gradient descent in Go by nurettin on Monday July 31, 2017 @05:56AM (#14890636)
This is what I like. When I start such projects, I am criticised by my peers, told that it is a waste of time and effort, that the best methods and most optimized libraries already exist and that I will never make anything better.

Well, not always the case. Of course I understand the merit of standing on the shoulders of giant(corporation)s, but sometimes you just want to try out something new (to you) just to test your intuition and improve your own perception of existing knowledge.

Re:Show HN: A perceptron with stochastic gradient descent in Go by qeternity on Monday July 31, 2017 @08:24AM (#14891248)
This is like saying "I will never open a restaurant so it's pointless to learn how to cook". At the very least it gives you an appreciation and understanding for the domain that you wouldn't otherwise have.
Re:Show HN: A perceptron with stochastic gradient descent in Go by made2591 on Monday July 31, 2017 @08:29AM (#14891270)
+1 +1 +1 +1
[dead]
Re:Show HN: A perceptron with stochastic gradient descent in Go by mayank on Monday July 31, 2017 @10:14AM (#14892141)
Please read the site guidelines; empty comments like this are not encouraged and will generally be downvoted to oblivion.
Re:Show HN: A perceptron with stochastic gradient descent in Go by nabla9 on Monday July 31, 2017 @08:08AM (#14891160)
"Look, I wrote a simple neural network" is the new "Look, I wrote a simple Lisp interpreter".
Re:Show HN: A perceptron with stochastic gradient descent in Go by trendia on Monday July 31, 2017 @11:12AM (#14892720)
"Look, I wrote a neural network to write a simple Lisp interpreter."
Re:Show HN: A perceptron with stochastic gradient descent in Go by doktrin on Monday July 31, 2017 @02:10PM (#14894512)
> Show HN : my weekend project, a single layer convolutional neural perceptron implementation in Haskell
Re:Show HN: A perceptron with stochastic gradient descent in Go by halflings on Monday July 31, 2017 @03:39PM (#14895221)
Cool project! Makes me want to recommend to my brother to start something like this.

Would definitely recommend trying vectorised calculus (instead of calculating the output with loops [0]) I'd also advise you to steer from some apparently neurology-inspired terms (stimulus) and use terms more common in machine learning (vector, features, etc.).

If you want to go further with this, you could try to implement back propagation with different activation functions and any depth. Check CS231n [1], the reference course for this.

[0] https://github.com/made2591/go-perceptron-go/blob/master/uti... [1] http://cs231n.stanford.edu/

Re:Show HN: A perceptron with stochastic gradient descent in Go by made2591 on Monday July 31, 2017 @03:48PM (#14895304)
Hi! I'm just doing it right now, I'm in the middle of sigmoid testing :D I'm agree with you about terms, for my master thesis I wrote a neuro-computational model to analyze taxonomic responses in early childhood, so I think in term of stimulus because of my background in AN (if interested, you can find the work in my Github page https://made2591.github.com in About section)...I will port my private repo on Github soon :) (but is written in MATLAB)
Re:Show HN: A perceptron with stochastic gradient descent in Go by Waterluvian on Monday July 31, 2017 @08:55AM (#14891442)
I'm sorry that this isn't really adding to the conversation, but I have to say just how awesome that whole title sounds to someone who only knows a few of the words.
Re:Show HN: A perceptron with stochastic gradient descent in Go by made2591 on Monday July 31, 2017 @08:58AM (#14891464)
Haha you're damn right!
Re:Show HN: A perceptron with stochastic gradient descent in Go by made2591 on Tuesday August 08, 2017 @06:30AM (#14956314)
Hi All, I dev the multi layer perceptron with back propagation algorithm. If you want to have a look, please go to: https://github.com/made2591/go-perceptron-go Have a nice day!
Re:Show HN: A perceptron with stochastic gradient descent in Go by cr0sh on Monday July 31, 2017 @03:55PM (#14895362)
This is interesting; I once tried to create my own ANN library for Go, but didn't get far with it (one of those half-baked projects). I even had a branding and naming of things, but somewhere along the line moved on to something else.

This is nice to see.

I do wonder where the activation function is in the code, though? I looked it over, and maybe I missed it? If it's in there, it's gotta be something very simple (binary or relu?) - enough to overlook it easily...

Or maybe I'm looking at the code wrong - is this really "a perceptron" - that is, an implementation of the McColloch-Pitts model (basically a single neuron, and basic activation)?

https://en.wikipedia.org/wiki/Artificial_neuron

Hmm - what I recall of the code, this does look probable...

Interesting.

Re:Show HN: A perceptron with stochastic gradient descent in Go by made2591 on Tuesday August 08, 2017 @06:31AM (#14956319)
I just pushed multi layer perceptron with back propagation algorithm: https://github.com/made2591/go-perceptron-go
Re:Show HN: A perceptron with stochastic gradient descent in Go by made2591 on Monday July 31, 2017 @04:04PM (#14895427)
Yes, is exactly as simple as you imagined. I'm working on multilayer + backprop, while re-studying theory XD I used som and gsom in recent years. I think the idea of an ML library in Go is a good idea: I shared my repo just to, you know...share the idea, find co-workers, open to some source in Go. I'm honest, I'm really happy in finding such an interest from web... and other coders ^^
Re:Show HN: A perceptron with stochastic gradient descent in Go by made2591 on Thursday August 03, 2017 @03:33AM (#14917650)
I'm still looking for help ^^ if you're interested please join: https://join.slack.com/t/go-johnny-go-go/shared_invite/MjIxN...

NOTE: this invite link will expire in 7 days (from 8/3/2017)

Re:Show HN: A perceptron with stochastic gradient descent in Go by ejholmes on Monday July 31, 2017 @06:39AM (#14890799)
> A single level perceptron classifier with weights estimated from sonar training data set using stochastic gradient descent.

I don't have a clue what any of those words mean. Neat!

Re:Show HN: A perceptron with stochastic gradient descent in Go by deadprogram on Monday July 31, 2017 @06:24AM (#14890750)
This looks neat. Please continue!
Re:Show HN: A perceptron with stochastic gradient descent in Go by made2591 on Monday July 31, 2017 @07:07AM (#14890886)
Thank you for your supports guys!!! I hope I will attract some others Go guru to work with!! I truly appreciate your interest, it's a little step, but I promise I will Go (haha) through it!