News for hackers. Stuff that matters.
Re:Claude's New Constitution by joshuamcginnis on Wednesday January 21, 2026 @05:41PM (#46712674)
If you are a moral relativist, as I suspect most HN readers are, then nothing I propose will satisfy you because we disagree philosophically on a fundamental ethics question: are there moral absolutes? If we could agree on that, then we could have a conversation about which of the absolutes are worthy of inclusion, in which case, the Ten Commandments would be a great starting point (not all but some).
Re:Claude's New Constitution by jakefromstatecs on Wednesday January 21, 2026 @05:46PM (#46712729)
> are there moral absolutes?

Even if there are, wouldn't the process of finding them effectively mirror moral relativism?..

Assuming that slavery was always immoral, we culturally discovered that fact at some point which appears the same as if it were a culturally relativistic value

Re:Claude's New Constitution by joshuamcginnis on Wednesday January 21, 2026 @05:54PM (#46712820)
You think we discovered that slavery was always immoral? If we "discover" things which were wrong to be now right, then you are making the case for moral relativism. I would argue slavery is absolutely wrong and has always been, despite cultural acceptance.
Re:Claude's New Constitution by JoshTriplett on Wednesday January 21, 2026 @08:37PM (#46714112)
How will you feel when you "discover" other things are wrong that you currently believe are right? How will you feel when others discover such things and you haven't caught up yet? How can you best avoid holding back the pace of such discovery?

It is a useful exercise to attempt to iterate some of those "discovery" processes to their logical conclusions, rather than repeatedly making "discoveries" of the same sort that all fundamentally rhyme with each other and have common underlying principles.

Re:Claude's New Constitution by rungeen__panda on Wednesday January 21, 2026 @08:08PM (#46713899)
> the Ten Commandments would be a great starting point (not all but some).

if morals are absolute then why exclude some of the commandments?

Re:Claude's New Constitution by joshuamcginnis on Wednesday January 21, 2026 @09:58PM (#46714703)
The Ten Commandments are commandments and not a list of moral absolutes. Not all of the commandments are relevant to the functioning of an ethical LLM. For example, the first commandment is "I am the Lord thy God. Thou shall not have strange gods before Me."
Re:Claude's New Constitution by __MatrixMan__ on Wednesday January 21, 2026 @05:49PM (#46712758)
Right, so given that agreement on the existence of absolutes is unlikely, let alone moral ones. And that even if it were achieved, agreement on what they are is also unlikely. Isn't it pragmatic to attempt an implementation of something a bit more handwavey?

The alternative is that you get outpaced by a competitor which doesn't bother with addressing ethics at all.

Re:Claude's New Constitution by foxygen on Wednesday January 21, 2026 @06:03PM (#46712922)
Why would it be a good starting point? And why only some of them? What is the process behind objectively finding out which ones are good and which ones are bad?
Re:Claude's New Constitution by joshuamcginnis on Wednesday January 21, 2026 @10:03PM (#46714736)
It's a good starting point because the commandments were given by God. And without God, there is no objective moral standard. Everything, including your opinion on my point of view, is subjective and relative. Whatever one would want to call "good" or "evil" would just be a matter of opinion.
Re:Claude's New Constitution by donkeybeer on Thursday January 22, 2026 @05:46AM (#46717551)
Thats all very nice, but first prove god.

If you are done solving that question, next prove that the book you favor is from god. There's a lot of competition for this claim as you know.

Re:Claude's New Constitution by spot on Wednesday January 21, 2026 @05:58PM (#46712860)
> the Ten Commandments would be a great starting point (not all but some).

i think you missed "hubris" :)