"Free choice" is the first step towards the solution to this paradox: free will is what a deterministic choice feels like from the inside. The popular notion of free will is that our decisions are undetermined, which must imply that there is a random element to them.

But though that is the colloquial meaning, it doesn't line up with what people say they want: you want to make your choice according to your own reasons. You want free choice. But unless your own reasoning includes a literal throw of the dice, your justifications deterministically decide the outcome.

"Free will" is the ability to make your own choices, and for most people most of the time, those choices are deterministic given the options and knowledge available. Free will and determinism are not only compatible, but necessarily so. If your choices weren't deterministic, it wouldn't be free will.

This is the position that is literally called compatibilist.

But when you probe people, while a lot of people will argue in ways that a philosopher might call compatibilist, my experience is that people will also strongly resist the notion that the only options are randomness and determinism. A lot of people have what boils down to a religious belief in a third category that is not merely a combination of those two, but infuses some mysterious third options where they "choose" that they can't explain.

Most of the time, people who believe there is no free will (and can't be), like me, take positions similar to what you described, that - again - a proponent of free will might describe as compatibilist, but sometimes we oppose the term for the reason above: A lot of people genuinely believe in a "third option" for choices are made.

And so there are really two separate debates on free will: Does the "third option" exist or not, and does "compatibilist free will" exist or not. I don't think I've ever met anyone who seriously disagrees that "free will" the way compatibilists define it exists, so when compatibilists get into arguments over this, it's almost always a misunderstanding...

But I have met plenty of people who disagree with the notion that things are deterministic "from the outside".

It is stronger than compatibilism. Compatibilism argues that free will and determinism are orthogonal. The argument I summarized is that free will is and must necessarily imply determinism..

I think that is a distinction without difference in as much as it's an excuse not to deal with it. But compatibilist "free will" must imply determinism unless some "magic" third alternative exists, because there isn't another option, and there is no evidence to suggest such a third alternative exists, so in practice every compatibilist I've had this discussion with have fallen back on arguing free will is compatible with determinism.

Definition doesn't tell all implications. In practice compatibilists do deeper analysis that reveals that determinism is required for free will.

Opposing the term gives a wrong result too, as people jump to hard determinism.

However "hard" your determinism, there is no support for the notion of agency, and that is all that matters. Without agency, free will is nothing but an illusion, with same moral consequences.

And agency as inner motivation exists and is determined by your character, otherwise it would be not yours.

This isn’t true. The position I argued for above is that agency derives from determinism because it is necessarily causal: you have agency because you make decisions in line with your goals. If you didn’t make decisions that were deterministically selected from your goals, you’d actually lack agency!

I'm a regular practitioner of magic, have written essays about it on Quora, and I can identify this mysterious third option as "the universe responding to your needs." You can use any number of religious terms to refer it to, like serendipity and the like, but none of them can capture the full texture of precisely how free will operates.

Approaching this subject from a rational perspective divorces you from subject and makes it impossible to perceive. You have to immerse yourself in it and one way to do that is magical practice. Having direct experience of the universe responding to your actions and mindset eventually makes it absurdly clear that the universe bears intelligence and it's in this intelligence that free will operates.

I'd never thought before now to connect magic this directly to free will. Thanks for the opportunity to think this through! If you're interested in a deeper discussion, happy to jump on a call.

lmao, magic? seriously?

You betcha.

I think a reasonable interpretation of the colloquial sense of incompatibilist free will is that people want to be (or have the experience that they are) their own causal origins or prime movers. That they originate an action that is not (purely) the effect of all other actions that have occurred, but in such a way that they decided what that action was.

From the outside, this is indistinguishable from randomness. But from the inside, the difference is that the individual had a say in what the action would be.

Where this tends to get tangled up with notions of a soul, I think, is that one could argue that such a free choice needs some kind of internal state. If not, then the grounds by which the person makes the choice is a combination of something that is fixed and their environment, which then intuitively seems to reduce the free-will process to a combination of determined and random. So the natural thing to do is then to assign the required "being-ness" (or internal state if you will) to a soul.

But there may exist subtle philosophical arguments that sidestep this dilemma. I am not a philosopher: this is just my impression of what commonsense notions of free will mean.

My point is that from the outside this doesn’t look like randomness at all, unless you are mistaking ignorance of their motives as a random oracle. If you can infer what set of goals drives their decision making, and the decision making process itself (e.g. ADHD brain vs careful considered action) you can very much predict their decisions. Marketing and PR people do this every single day. People don’t behave like random oracles, they behave like deterministic decision makers with complex, partly unknown goals so our predictions of their behavior are not always correct. That’s not the same thing as random.