News for hackers. Stuff that matters.
Re:Microsoft lays off an ethical AI team as it doubles down ... by Xcelerate on Tuesday March 14, 2023 @08:19AM (#35150287)
> The symbolists place a heavier emphasis on model interpretability and believe learning emerges from a logical substrate, albeit at a much higher level of abstraction.

These people still exist?

Personally, I don’t think gradient descent is the way to AGI either (I think it’s efficient algorithmic search over the space of all computable programs), but I haven’t heard anything from the symbols crowd since the early 2010s.

Re:Microsoft lays off an ethical AI team as it doubles down ... by fnordpiglet on Tuesday March 14, 2023 @10:14AM (#35151855)
They can’t speak over all the cooling noise coming from the GPU farm.
Re:Microsoft lays off an ethical AI team as it doubles down ... by YeGoblynQueenne on Tuesday March 14, 2023 @04:42PM (#35158199)
You sir/ma'am, win the internets today.
Re:Microsoft lays off an ethical AI team as it doubles down ... by YeGoblynQueenne on Tuesday March 14, 2023 @04:36PM (#35158096)
>> These people still exist?

Of course, I just finished reviewing a few papers from ICLP (the International Conference of Logic Programming) 2023. This year there was a substantial machine learning element, most of it in the form of Inductive Logic Programming (i.e. logic programming for learning; ordinary logic programming is for reasoning).

This September I was in the second IJCLR (International Joint Conference of Learning and Reasoning) where I helped run the Neuro-Symbolic part of the conference. Like the first year we had people from IBM, MIT, Stanford, etc etc (to clarify, my work is not in NeuroSymbolic AI, but I was asked to help).

Then in January there was the IBM Neuro-Symoblic workshop, again getting together people from academia and industry.

And this year someone I know very well almost got poached by a big university in a certain country I'll be very vague about where there was what I would describe as a sudden explosion in interest in neuro-symbolic machine learning. They're trying to find an edge, you see.

Yeah, there's interest in combining symbolic and statistical machine learning.

Just two data points about why (well because, why not, but):

a) Machine Learning really started out as symbolic machine learning, back in the '90s when people realised Expert Systems need too many rules to write by hand. A textbook to read about that era of Machine Learning is Tom Mitchell's "Machine Learning" (1997). The work the public at large knows as "machine learning" today was at the time mostly being published under the "Pattern Recognition" rubrik.

b) To the early pioneers in AI having two camps, of "statistical" and "symbolic" AI, or for "connectionist" and "logic-based" AI, just wouldn't make any sense at all.

Consider Claude Shannon. Shannon was at the Dartmouth workshop were "Artificial Intelligence" was coined, in 1956. Shannon invented both logic gates (in his Master's thesis... what the fuck did I do in my Master's thesis?) and statistical language processing ("A Mathematical Theory of Communication"; where he also invented Information Theory, just as an aside).

Or, take the first artificial neuron: the Pitts and McCulloch neuron, first described in 1942, by er, by Pitts and McCulloch, as luck would have it. The Pitts & McCulloch neuron was a self-programming logic gate, a propositional logic circuit.

Or, of course, take Turing. Turing described Turing Machines in the language of the first order predicate calculus, a.k.a. First Order Logic (mainly because he was following from Gödel's work) and also described "the child machine", a computer that would learn, like a child.

To be honest, I don't really understand when or why the split happened, between "statistical" and "logical". Anyone who knows how to fill in the blanks, you're welcome.

Anyway those are silly distinctions that are only amplified by the cluelessness of social media today. The truth is that, as it was always, a good scientist uses the tools of science. No exceptions.

Re:Microsoft lays off an ethical AI team as it doubles down ... by marcosdumay on Tuesday March 14, 2023 @08:13PM (#35161668)
Except for classifiers and LLMs, every single thing that is successful seems to be mixed. So, yes, it exists. It's only out there solving problems, instead of buying hype because there is no use-case.