News for hackers. Stuff that matters.
Re:A Google Brain engineer’s guide to entering AI by yters on Saturday November 10, 2018 @12:39PM (#18422379)
What is the big job market for AI/ML? I see some Kaggle competitions, and a few high wage jobs working for the big tech companies, but it still seems pretty niche.

Makes sense from a theoretical viewpoint, b/c all AI/ML models are not Turing complete in order to be optimizable, whereas your average programmer easily churns out "models" in a Turing complete language. So, joe blow programmer is universally more powerful than any AI/ML algorithm. He can program an AI in his TC language, but AI cannot replicate his work in a non TC language.

Re:A Google Brain engineer’s guide to entering AI by Ftuuky on Saturday November 10, 2018 @02:46PM (#18423109)
The bank where I work needs so many data scientists and AI/ML/DL engineers and they can't find enough of them to the point they're paying master degrees and MOOCs to all employees that want to study it, as long as they already have some experience with Python/R or a background in math/stats/engineering.
Re:A Google Brain engineer’s guide to entering AI by leesec on Saturday November 10, 2018 @03:05PM (#18423206)
Cough. What company is this? I was looking into getting my Masters but would be much nicer if somebody was paying for it.
Re:A Google Brain engineer’s guide to entering AI by Ftuuky on Saturday November 10, 2018 @03:54PM (#18423445)
One of the top 20 investment banks.
Re:A Google Brain engineer’s guide to entering AI by throwawaymath on Saturday November 10, 2018 @06:11PM (#18424025)
I know you probably mean well and maybe want to stay anonymous, but it seems pretty clear to me that commenter was looking for a specific firm in response to their question. Is it the case that all of the top 20 IBs are offering tuition reimbursement for data science?
Re:A Google Brain engineer’s guide to entering AI by Ftuuky on Saturday November 10, 2018 @07:33PM (#18424340)
I understand the commenter wanted a clear answer but I don't know if I should be specific since I can't find a public source to go along. Maybe this is internal and I fd up?
Re:A Google Brain engineer’s guide to entering AI by softawre on Tuesday November 13, 2018 @12:02PM (#18442545)
Just so you know its very easy to find out where you work. I can get your name from your keybase links, easily find your linkedin page, and verify your location to be sure from other links on keybase.
Re:A Google Brain engineer’s guide to entering AI by leesec on Saturday November 10, 2018 @11:09PM (#18424990)
I understood your answer and thought it was fine.
Re:A Google Brain engineer’s guide to entering AI by yters on Saturday November 10, 2018 @03:08PM (#18423221)
PhD in Computer Engineering with MSc in AI/ML here. Happy to do remote work for your bank :)
Re:A Google Brain engineer’s guide to entering AI by Ftuuky on Saturday November 10, 2018 @03:52PM (#18423434)
Working remote is not allowed due to certain regulations. That's why it's so hard to hire good data scientists!
Re:A Google Brain engineer’s guide to entering AI by irregular-john on Saturday November 10, 2018 @05:21PM (#18423844)
And you're in top-20 I-banking? So most likely in a huge city, with a huge swath of data science talent. The issue isn't folks not being able to work remotely.
Re:A Google Brain engineer’s guide to entering AI by Ftuuky on Saturday November 10, 2018 @07:31PM (#18424333)
The thing is that data scientists are wanted by so many companies that besides salary you have to compete with perks and other things. IBs can't provide some of the perks, like remote work and makes it less attractive to potential candidates. This is my opinion, not my employer.
Re:A Google Brain engineer’s guide to entering AI by bitL on Saturday November 10, 2018 @03:42PM (#18423390)
A very recent M.S. from a top 10 school in ML/DL here. Can chime in remotely as well. Need a new Lamborghini; Murcielago is getting old you know ;-)
Re:A Google Brain engineer’s guide to entering AI by ben_w on Saturday November 10, 2018 @01:53PM (#18422830)
Once an AI gets that good, good enough to reproduce even a junior developer, nobody can ever get paid to work again. Before that point, it’s still useful to know the basics of AI in the same way knowing about arrays or higher order functions is useful.
Re:A Google Brain engineer’s guide to entering AI by yters on Saturday November 10, 2018 @02:24PM (#18422997)
Do you know of a Turing complete AI/ML model?
Re:A Google Brain engineer’s guide to entering AI by currymj on Saturday November 10, 2018 @05:57PM (#18423971)
many of them are Turing-complete almost by accident, if you are willing to add enough parameters. E.g. a shallow neural network with one layer is Turing-complete.

It's actually Turing-complete for rational-valued weights (countable). If you are willing to grant real valued weights (uncountable) then it is actually more powerful than a Turing machine, able to compute things in P/poly, a very weird complexity class that includes some encodings of the halting problem. But this is just because you're "cheating" by allowing infinite precision which is not possible in the real world.

Re:A Google Brain engineer’s guide to entering AI by yters on Saturday November 10, 2018 @06:27PM (#18424076)
That doesn't sound like TC for real world usage...unlike a regular programmer.
Re:A Google Brain engineer’s guide to entering AI by ben_w on Sunday November 11, 2018 @01:53PM (#18427874)
One layer is a surprise to me, I thought xor needed two?
Re:A Google Brain engineer’s guide to entering AI by chillee on Sunday November 11, 2018 @08:51PM (#18430022)
One hidden layer. Commonly known as the "Universal approximation theorem"
Re:A Google Brain engineer’s guide to entering AI by ben_w on Tuesday November 13, 2018 @08:33AM (#18440778)
Ah, I misunderstood GP saying one layer.
Re:A Google Brain engineer’s guide to entering AI by solomatov on Saturday November 10, 2018 @02:37PM (#18423066)
- Neural turing machines: https://arxiv.org/abs/1410.5401

- Universal transformers: https://arxiv.org/abs/1807.03819

These are just 2 of most well known.

Re:A Google Brain engineer’s guide to entering AI by yters on Saturday November 10, 2018 @03:06PM (#18423207)
Definitely interesting stuff. Do you know of real world tasks where these sorts of models have proven more useful than non TC models?
Re:A Google Brain engineer’s guide to entering AI by solomatov on Saturday November 10, 2018 @03:30PM (#18423321)
I am not aware of any real world usage of these models. They are hard to train, and most of the papers consider toy examples.