To be clear, I am with you in believing that there is, indeed, an absolute right/wrong, and the examples you brought up are obviously wrong. But humans cannot absolutely determine right/wrong, as is exemplified by the many paradoxes, and again as it appears in Genesis. And that is precisely a sort of soft-proof of God: if we accept there is an absolute right/wrong, but unreachable from the human realm, then where does that absolute emanate from? I haven't worded that very well, but it's an argument you can find in literature.
And, to be clear, Claude is full of BS.
I'm not arguing that it would make the edge-cases easier to define, but I do think the general outcomes for society would be better over the long-run if we all held ourselves to a greater moral authority than that of our opinions, the will of those in power and the cultural norms of the time.
If we could get alignment on the shared belief that there are at least some obvious moral absolutes, then I would be happy to join in on the discussion as to how to implement the - no doubt - difficult task of aligning an LLM towards those absolutes.
What do you do with the case where you have a choice between a train staying on track and killing one person, or going off track and killing everybody else?
Like others have said, you are oversimplifying things. It sounds like you just discovered philosophy or religion, or both.
Since you have referenced the Bible: the story of the tree of good and evil, specifically Genesis 2:17, is often interpreted to mean that man died the moment he ate from the tree and tried to pursue its own righteousness. That is, discerning good from evil is God's department, not man's. So whether there is an objective good/evil is a different question from whether that knowledge is available to the human brain. And, pulling from the many examples in philosophy, it doesn't appear to be. This is also part of the reason why people argue that a law perfectly enforced by an AI would be absolutely terrible for societies; the (human) law must inherently allow ambiguity and the grace of a judge because any attempt at an "objective" human law inevitably results in tyranny/hell.