News for hackers. Stuff that matters.
Re:How close are computers to automating mathematical reason... by bigyikes on Saturday August 29, 2020 @11:33AM (#24316792)
As someone unfamiliar with the results you describe, why can’t a machine do better than a human? A smart human is better at writing proofs than a dumb one. If we had a highly advanced general artificial intelligence, why couldn’t it generate better results than the smart humans?
Re:How close are computers to automating mathematical reason... by ShinTakuya on Saturday August 29, 2020 @11:43AM (#24316856)
I don't know what result they were referring to, but I've often heard it said that AI of current types so never be capable of the same types of cognition that we can do. That's not to say we can't create a different type of AI, but at the moment that's just science fiction and will need some major advances in technology.
Re:How close are computers to automating mathematical reason... by westurner on Saturday August 29, 2020 @11:40AM (#24316839)
Or is automated proof search impossible for humans as well?

Arguably, humans require more energy per operation. So, presumably such an argument hinges upon what types of operations are performed in conducting automated proof search?

Re:How close are computers to automating mathematical reason... by qayxc on Saturday August 29, 2020 @12:21PM (#24317188)
What would "automated proof search" even mean in the context of being performed by a human being?

The context here is that certain problems cannot be solved by an algorithm, which doesn't necessarily translate into "cannot be performed by a machine".

It only means that there cannot be any Turing machine capable of solving them, no matter what "operations" it represents.

Re:How close are computers to automating mathematical reason... by kd0amg on Saturday August 29, 2020 @12:36PM (#24317294)
The idea that humans are physical systems with Turing-computable behavior would mean that any problem not solvable by Turing machines is also not solvable by humans. That is, there are programs whose halting behavior no human will ever determine, theorems of Peano arithmetic whose proof no human will ever find, etc., no matter how much humans work at it.
Re:How close are computers to automating mathematical reason... by qayxc on Saturday August 29, 2020 @01:23PM (#24317708)
> The idea that humans are physical systems with Turing-computable behavior would mean that any problem not solvable by Turing machines is also not solvable by humans.

But there are real-world instances that contradict this hypothesis already. Humans don't exhibit Turing-computable behaviour because they did indeed solve problems that aren't solvable by Turing Machines.

I can give a very concrete example as well. Consider the following program (in Python for simplicity's sake):

  def nat(x):
    yield x
    yield from nat(x+1)

  for a in nat(2):
    for b in nat(2):
      for c in nat(2):
        if a*a*a + b*b*b == c*c*c:
          print(f"{a}^3 * {b}^3 = {c}^3")
          exit()
There is no Turing Machine capable of proving that this program won't halt (technically it will, due to practical limitations).

Yet it has has been proven centuries ago that the above program won't halt.

The mathematicians couldn't have used a Turing Machine-compliant computation, so something else must be involved.

Now this of course doesn't mean that humans are generally capable of solving every problem that's not solvable by an algorithm, but it means that they can solve problems that algorithms can't solve.

Re:How close are computers to automating mathematical reason... by kd0amg on Saturday August 29, 2020 @01:25PM (#24317737)
> There is no Turing Machine capable of proving that this program won't halt

Yes, there is. There's a machine which does nothing but print that exact proof.

You seem to have conflated solving an instance of a problem with solving the entire problem. Turing's theorem states that no one Turing machine will get the answer right for every instance of the halting problem, but for any instance that one specific machine gets wrong, there's another machine that also gets that instance right (in addition to everything else the original machine gets right).

Re:How close are computers to automating mathematical reason... by westurner on Saturday August 29, 2020 @12:31PM (#24317262)
The task (in terms of constructor theory) is: Find the functions that sufficiently approximate the observations and record their reproducible derivations.

Either the (unreferenced) study was actually arguing that "automated proof search" can't be done at all, or that human neural computation is categorically non-algorothmic.

Grid search of all combinations of bits that correspond to [symbolic] classical or quantum models.

Or better: evolutionary algorithms and/or neural nets.

Re:How close are computers to automating mathematical reason... by qayxc on Saturday August 29, 2020 @12:54PM (#24317453)
Roger Penrose argues that human neural computation is indeed non-algorithmic in nature (see his book "The Emperor's New Mind"; 1989) and speculates that quantum processes are involved.

I don't quite understand the role of neural nets in that context, though. Those just classical computations in the end and should be bound by the same limits that every other algorithms are, shouldn't they?

Re:How close are computers to automating mathematical reason... by westurner on Saturday August 29, 2020 @01:11PM (#24317606)
That human cognition is quantum in nature - that e.g. entanglement is necessary - may be unfalsifiable.

Neuromorphic engineering has expanded since the 1980s. https://en.wikipedia.org/wiki/Neuromorphic_engineering

Quantum computing is the best known method for simulating chemical reactions and thereby possibly also neurochemical reactions. But, Is quantum computing necessary to functionally emulate human cognition?

It may be that a different computation medium can accomplish the same tasks without emulating all of the complexity of the brain.

If the brain is only classical and some people are using their brains to perform quantum computations, there may be something there.

Quantum cognition: https://en.wikipedia.org/wiki/Quantum_cognition

Re:How close are computers to automating mathematical reason... by westurner on Saturday August 29, 2020 @01:28PM (#24317768)
Quantum memristors are still elusive.

From "Quantum Memristors in Frequency-Entangled Optical Fields" (2020) https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7079656/ :

> Apart from the advantages of using these devices for computation [12] (such as energy efficiency [13], compared to transistor-based computers), memristors can be also used in machine learning schemes [14,15]. The relevance of the memristor lies in its ubiquitous presence in models which describe natural processes, especially those involving biological systems. For example, memristors inherently describe voltage-dependent ion-channel conductances in the axon membrane in neurons, present in the Hodgkin–Huxley model [16,17].

> Due to the inherent linearity of quantum mechanics, it is not straightforward to describe a dissipative non-linear memory element, such as the memristor, in the quantum realm, since nonlinearities usually lead to the violation of fundamental quantum principles, such as no-cloning theorem. Nonetheless, the challenge was already constructively addressed in Ref. [18]. This consists of a harmonic oscillator coupled to a dissipative environment, where the coupling is changed based on the results of a weak measurement scheme with classical feedback. As a result of the development of quantum platforms in recent years, and their improvement in controllability and scalability, different constructions of a quantum memristor in such platforms have been presented. There is a proposal for implementing it in superconducting circuits [7], exploiting memory effects that naturally arise in Josephson junctions. The second proposal is based on integrated photonics [19]: a Mach–Zehnder interferometer can behave as a beam splitter with a tunable reflectivity by introducing a phase in one of the beams, which can be manipulated to study the system as a quantum memristor subject to different quantum state inputs.

Quantum harmonic oscillators have also found application in modeling financial markets. Quantum harmonic oscillator: https://en.wikipedia.org/wiki/Quantum_harmonic_oscillator

Re:How close are computers to automating mathematical reason... by qayxc on Saturday August 29, 2020 @12:10PM (#24317097)
It has been shown numerous times that there are limits to automated proof generation.

One such result was that certain problems are undecidable, which means that any automated approach would be prone to become "stuck" and never terminate.

Another results showed that the complexity of general automated proof generation is exponential in nature.

Both these results mean, that it's impossible to tell whether a computation just takes a very long time (say years) or whether the problem is indeed undecidable (in which case the program would never halt.)

A human on the hand, is very well capable of solving the Halting Problem and can discern whether a problem is undecidable [1].

This is of course a corner case, but it goes to show that there are indeed limits to automated theorem proving.

A human would therefore - in principle - always need to proof that a problem is decidable in the first place before passing it to an ATP.

[1] https://en.wikipedia.org/wiki/List_of_undecidable_problems

Re:How close are computers to automating mathematical reason... by sudosysgen on Saturday August 29, 2020 @12:27PM (#24317231)
Humans are not able to solve the halting problem. The halting problem isn't a question of if you can decide that some programs will not halt, but that you can decide if all programs would halt.

Which humans can not do.

Re:How close are computers to automating mathematical reason... by qayxc on Saturday August 29, 2020 @12:37PM (#24317312)
No - that's simply not true. The Halting Problem states that there is no Turing Machine (i.e. program) capable of deciding whether a given program will halt.

And yes, humans are very well capable of solving that, because humans can in fact proof whether any program halts.

This doesn't mean every human can or that it has been done for every program, but it means that humans are - in general - able capable of deciding this, while algorithms (programs) can't.

Re:How close are computers to automating mathematical reason... by tsimionescu on Saturday August 29, 2020 @12:51PM (#24317425)
The Church-Turing thesis claims (and is believed to be right) that a Turing machine can solve (compute) any problem that can be solved (is computable).

For now at least, we don't know of any counter-example to the Church-Turing thesis. Humans are certainly not able to tell whether a program in general will halt for any input it recieves. If you believe otherwise, please tell me whether the following program halts:

    Foo():
        if P = NP:
            return true
        else:
            Foo()
Re:How close are computers to automating mathematical reason... by qayxc on Saturday August 29, 2020 @01:32PM (#24317800)
> If you believe otherwise, please tell me whether the following program halts

That's a logical fallacy - just because I can't show whether P=NP doesn't mean nobody can!

Turing-Church is a conjecture, not a theorem. There have been arguments made against it [1].

[1] https://arxiv.org/ftp/cs/papers/0207/0207055.pdf

Re:How close are computers to automating mathematical reason... by sudosysgen on Saturday August 29, 2020 @03:11PM (#24318666)
There is no reason to believe that the human mind can solve a superset of the problems solvable by a Turing machine, and a lot of evidence to the contrary.

Also, the link you replied provides an argument of efficiency, not an argument of possibility. It is arguing that we might use things that are not Turing machines because they can solve the problem more efficiently, not because they can solve problems Turing machines could never hope to solve.

Re:How close are computers to automating mathematical reason... by tsimionescu on Sunday August 30, 2020 @10:20AM (#24323166)
Solving the halting problem means being able to tell, for ANY Turing machine and ANY input, whether it will halt. I know of absolutely nothing that would make us believe humanity or any individual human can do this.

If there is a single Turing machine for which there is no human that can tell whether it will halt, the conjecture that human reasoning is not more powerful than Turing machines is still not disproven.

Also, if you were right that humans can do things that Turing machines can't, it would be an interesting excersise to try to find that example of super-Turing human reasoning and try to see why it can't be encoded as a Turing machine. No one has successfully done this yet, so there is no reason to believe that it is possible.

Re:How close are computers to automating mathematical reason... by yongjik on Saturday August 29, 2020 @01:30PM (#24317786)
No, the correct statement is that there is no Turing Machine that can, given any program, decide whether it will halt.

The "given any program" part is crucial.

Re:How close are computers to automating mathematical reason... by steve_musk on Saturday August 29, 2020 @12:31PM (#24317263)
A human is no more capable of solving the halting problem than a computer.

And we aren’t doing some kind of magical logic when we humans create proofs. Sure naively general automated proof generation could be exponential in nature, but that hasn’t stopped us from mathematics research. There’s no reason it should stop computers either.

Re:How close are computers to automating mathematical reason... by qayxc on Saturday August 29, 2020 @12:43PM (#24317363)
But we are (in general).

Humans can solve problems that aren't solvable by algorithms and that's why humans can - in general - decide whether a given program will halt. That doesn't mean every human can or that it has been done for every program (which would be impossible, since there are infinitely many instances anyway).

But the difference between humans and Turing Machines (computers) is, that humans can and did proof undecidable problems, while algorithms provably can't.

This is a fundamental difference and there's no way around it. So whatever might be done in ATP, it can't be algorithmic in nature or based on a Turing Machine in order to be applied universally.

Unless of course, you know of a way to disprove Gödel and Turing...

Re:How close are computers to automating mathematical reason... by tsimionescu on Saturday August 29, 2020 @12:52PM (#24317437)
I don't know what made you believe this, but humans are not magical. We absolutely can't solve the halting problem, and by definition nothing can decide an undecidable problem. As far as we know so far, the human mind is a (limited) Turing machine. In fact, as far as we know, there is no computing system more powerful than a Turing machine.
Re:How close are computers to automating mathematical reason... by pdehaan on Saturday August 29, 2020 @03:42PM (#24318869)
Are there any problems we have a proof for, and a corresponding proof that no algorithm can exist to provide said proof?

Basically, why can't I write an algorithm that can be given input for "is the halting problem decidable?" and return "no"?

Re:How close are computers to automating mathematical reason... by roywiggins on Saturday August 29, 2020 @12:59PM (#24317503)
Which undecidable theorems have humans proven?
Re:How close are computers to automating mathematical reason... by dnautics on Saturday August 29, 2020 @01:19PM (#24317671)
yeah that's not a thing. Humans do regularly "solve" undecidable theorems, if by solve you mean "come up with heuristics that are good enough". Possibly even "provably good enough", as in "if there's a flaw in the algorithm, the lower bound on the badness of the input to make it unreachable in the lifetime of the universe".