Say someone set up a business selling coconuts on an island. Over time in order to avoid labor they automated the growing/picking and selling of the coconuts. Then they automated the security of the island.
At what point does "ownership" of the process stop having meaning if you effectively have to go to war and destroy the machine/island in order to collect its "wealth"?
There are potentially variations of this where a non human CFO basically says, no more dividends, all further profits will be invested in physical security to avoid theft, until it effectively becomes an enormous self protecting war machine selling phone (or whatever) service.
What prevents a machine from hiring a living person in the same fashion?
Legal claims are only ever as strong as your ability to enforce it. I can envision machine-run enterprises that are so well automated and encrypted, that any efforts by the government to interfere, would work about as well as governments trying to outlaw the common cold.
This is just not correct. There is the concept of a "trust" where property is not fully owned by any group of individuals, but rather is owned by a legal entity for the benefit of some person or some other legal entity. It is not uncommon for a wealthy person to create a trust to which they give their assets, which will be managed in perpetuity for the benefit of that person's heirs. Just as a trust can own stocks and give the dividends to the beneficiaries of the trust, a trust could wholly-own a company, which in turn owns machines and other property.
The trustee is legally responsible for employing the trust's assets in accordance with the terms of the trust. The relevance of this is that the actions of a machine owned by a trust would be the legal responsibility of the trustee.
You can't really say that a machine truly owns something until the machine, and not its owners or operators, can be held legally responsible for what it does with it.
I consider it doubtful that a court would rule that an AI was a person. Natural persons are persons because they are. Legal persons are persons because it benefits society for groups of persons to act together and not be held individually responsible for what they do - with the proviso that the corporate veil may be pierced if the persons protected by it act with malfeasance.
Allowing a person who can determine the behaviour of an AI in every situation to be protected from the consequences of the AI's behaviour would likely not benefit society.
You might say that an AI whose behaviour is so complex as to preclude a mere human being able to control it is a different matter, but even now if I own a machine that I cannot control and it injures somebody, I would still be held liable despite lacking intent to harm.
And even though a sufficiently sophisticated AI will react to deterrents, so does a dog, and dogs are not legal persons.
You also claim that some legal persons are persons simply because society benefits from allowing groups of persons to act as one. If this is the threshold for personhood - society benefits - then I am confused why this threshold would not also extend personhood to machines.
I guess I'm looking for a clear bright line for defining personhood that includes humans, rivers, and corporations while excluding machines, and I'm not seeing it.
It would be a machine operated business, but not machine ownership. That would require a change in law.
How can a machine break the law?
EDIT: If there is a positive answer, it might be similar to how money and other assets can be sued in asset forfeiture cases.
Guns and cars aren't prosecuted for murder. I'm assuming autonomous cars won't be either.
Whilst there's no reason a machine couldn't be a legal person, in the sense that the sentence describes a possible future, that future is not near, and it will take more than a competent robolawyer to bring it about.
I personally think the line between that of so-called "meatspace" and "machine" is tenuous at best. In a very real sense, so-called biological organisms are machines. To say a machine can't own property is to ignore this truth.
You could shift the goal-post to say "only sentient, and self-aware machines can own property" - and it would get you closer. But that would pre-suppose that large organizations of people and machines (what we call "corporations" and other terms) aren't in some manner sentient and self-aware (and we the individual components, being at a lower level within the network, are unable to see this emergent property and/or understand it).
In effect, your statements pre-suppose that machines can only be slaves, without ownership of property, to us "superior" meat-machines. If that is truly your real position, you had better hope that something like that depicted in the Animatrix "Second Renaissance" does not come to pass.
Because it probably won't go well for humanity, if our own history is any guide.
Aren't companies in the US people in the eyes of the law (I imagine due to some shameful lobbying on behalf of some large companies).
Could a "company" own a machine that controls the company in some way?
This has nothing to do with the legislature or lobbying. It is a legal principle largely established by strict constitutionalists in the judiciary (aka conservative activist judges). Short of a sweeping Constitutional amendment, corporate personhood is entirely up to them.
It can be sued, taxed, bankrupted, etc. separately from the people who own it. Could such a thing happen to a machine? Maybe. But it's really no different than a corporation.
Correction: Only legal entities can.
Ultimate blame when something illegal happens in a machine-owned enterprise is likely to remain just as difficult to pin down as it was with the 2008 Great Recession, if not manifestly more difficult.
These same vehicles can be used by machines that own enterprises. They might not be on the masthead/letterhead of the enterprise, but that hardly matters unless a currently-unknown prerequisite to AGI or AI sufficient to run an an enterprise is the machine equivalent of a childish human ego.
For officers of the company it is a different matter, but even there punishment beyond being fired is very rare.
More data on this subject than you can absorb in a few days:
http://lib.law.virginia.edu/Garrett/plea_agreements/home.php...
An enterprise can be autonomous, for instance with a blockchain. But to be legally recognizable, it would still need someone to interface with meatspace. Even a corporation has an Agent for Service of Process, a real person to interact with the real world of living persons.