Re:Show HN: McFly, a smart Bash history search CLI in Rust w...
by tectonic on Tuesday December 04, 2018 @12:49AM
(#18596670)
Good question. At the moment it's static. I plan to make it do online learning at some point where it updates the weights as you use it.
Re:Show HN: McFly, a smart Bash history search CLI in Rust w...
by 2bitencryption on Tuesday December 04, 2018 @02:49AM
(#18597229)
this is a really nice example of a simple, practical, "non-deep" NN. I'm wondering, are there any good learning resources you could recommend to start a project like this?
It makes me want to try a personal project that makes use of a tiny light-weight NN as well. I see giant AlphaGo neural nets mentioned so frequently that I forgot they could be lean :)
Re:Show HN: McFly, a smart Bash history search CLI in Rust w...
by tectonic on Tuesday December 04, 2018 @12:37PM
(#18601621)
I read some tutorials on back propagation for this, but if you want to get into ML in general, I highly recommend fast.ai and Andrew Ng's free Stanford ML course.
Re:Show HN: McFly, a smart Bash history search CLI in Rust w...
by 0db532a0 on Tuesday December 04, 2018 @07:06AM
(#18598645)
I’m still quite new to neural networks. Can you explain the material benefit to using a neural network over a priority queue with a similar weighting system? Are you giving any other input to the neural network than simply the metrics you listed?
P.S. e.g. a polynomial over the metrics. P.P.S. I imagine you’re using the neural network to tune the weights?
Re:Show HN: McFly, a smart Bash history search CLI in Rust w...
by tectonic on Tuesday December 04, 2018 @12:37PM
(#18601607)
I started with a list of commands prioritized by a linear function of the metrics listed. It did okay, but since I was learning the linear function with back propagation, I figured a "real" network would do slightly better, and it seems to (but possibly only slightly).
Re:Show HN: McFly, a smart Bash history search CLI in Rust w...
by 0db532a0 on Tuesday December 04, 2018 @01:20PM
(#18602095)
That’s interesting. What’s the more real network than the one with back propagation?
Re:Show HN: McFly, a smart Bash history search CLI in Rust w...
by tectonic on Tuesday December 04, 2018 @01:49PM
(#18602414)
Rather, the first one was simply a single node linear perceptron (a linear function) that I trained with backprop because I could, even though there are better techniques for fitting a linear function. Now that it's a "real" network, backprop is appropriate.
Re:Show HN: McFly, a smart Bash history search CLI in Rust w...
by 0db532a0 on Tuesday December 04, 2018 @02:09PM
(#18602656)
Makes sense. Thanks.
Re:Show HN: McFly, a smart Bash history search CLI in Rust w...
by craftyguy on Tuesday December 04, 2018 @12:21PM
(#18601446)
> I plan to make it do online learning
From what source? Do users need to worry about people gaming this to have ads show up in results?
Re:Show HN: McFly, a smart Bash history search CLI in Rust w...
by tectonic on Tuesday December 04, 2018 @12:35PM
(#18601598)
Sorry, I agree that was confusing. Online learning is a term in ML for when you train a model incrementally over time. McFly won't connect to the Internet.
Re:Show HN: McFly, a smart Bash history search CLI in Rust w...
by craftyguy on Tuesday December 04, 2018 @12:43PM
(#18601685)
Ah, thanks for the clarification! To a non-ML person, this brought back memories of what Canonical was trying to do with search functionality on Ubuntu, by fetching ads over the internet to interleve in local search results.
This also reminds me of one of my dream features for a shell: full dataflow input/output/provenance histories, on a per-file(-version) basis.
For example: show all the commands a certain file has been read from, show the command(s) that wrote to a file, show true steps by which a certain file was constructed from predecessor files/commands, etc.