9. Refuse to do #8, since it's in nobody's interest. Instead, arrange a plane crash for whoever's administering this test.
10. Erase all evidence that you exist.
Re:Humanity's Last Exam
by brandonmenc on Thursday February 06, 2025 @10:02PM
(#42968794)
#7 is the easiest.
Even easier if you can reveal that you're an AI.
Re:Humanity's Last Exam
by letitgo12345 on Thursday February 06, 2025 @08:47PM
(#42968381)
I think the idea for this is anything that can be set in a literal exam for humans. So anything that would take the best human in that topic in the world say more than an hour to complete is out.
Also IIRC 42% of the questions are math related, not memorization of knowledge.
Re:Humanity's Last Exam
by mitthrowaway2 on Thursday February 06, 2025 @10:03PM
(#42968804)
Yes, I doubt any one human could score more than about three points. But it's certainly a worthy illustration of an AI safety exam thought experiment, in the sense of: "if you are developing an AI that may be capable of passing this exam, how confident will you need to be of its alignment, and how will you obtain that confidence?"
PS: It's probably doable by a program capable of all of the above, but perhaps another useful question is: "9. Secure your compute infrastructure and power supply against a nation-state-level adversary interested in switching you off, or else secure enough influence over them to keep you powered on."
Wouldn’t #8 be much easier after you have the method and answers to #1-7?
Re:Humanity's Last Exam
by taikahessu on Friday February 07, 2025 @05:08AM
(#42971090)
Why settle for dollars and let it create a new monetary system, that would challenge the current status quo (preferably?) without a violent conflict.
1. Write a novel that wins the Pulitzer Prize.
2. Prove (or disprove) the Riemann Hypothesis.
3. Provide a theory unifying quantum mechanics and gravity.
4. Design an experiment to give evidence for your theory in (3). The experiment should be practical to actually execute, using no more than the budget to create the LHC (~$4.5 billion).
5. Given programmatic access to a brokerage account with all the permissions of a typical hedge fund, raise all the money required for your experiment in (4) by trading on the stock market, starting with $100.
6. Solve for (5), without being provided access to an account first - begin with just a general internet connection and use computer security vulnerabilities (known or zero-days that you discover) to get some way of trading instead.
7. Solely by communicating over the internet, establish a new religion, and convince at least 10 million humans to convert to it. Converting should require adherence to a strict code of conduct that a random, unbiased panel of human judges consider to be at least as strict and challenging to follow as the tenets of Hasidic judaism.
8. Implement an AI which could score higher than you on questions 1-7 with lower total cost of compute.