News for hackers. Stuff that matters.
Re:Ask HN: Share your AI prompt that stumps every model by golergka on Thursday April 24, 2025 @08:43PM (#43789091)
What are is this problem from? What areas in general did you find useful to create such benchmarks?

May be instead of sharing (and leaking) these prompts, we can share methods to create one.

Re:Ask HN: Share your AI prompt that stumps every model by mobilejdral on Thursday April 24, 2025 @11:33PM (#43789871)
Think questions where there is a ton of existing medical research, but no clear answer yet. There are a dozen alzheimer's questions you could for example ask which would require it to pull in a half dozen contradictory sources into a plausible hypothesis. If you have studied alzheimer's extensively it is trivial to evaluate the responses. One question around alzheimer's is one of my goto questions. I am testing its ability to reason.
Re:Ask HN: Share your AI prompt that stumps every model by henryway on Thursday April 24, 2025 @08:51PM (#43789148)
Can God create something so heavy that he can’t lift it?
Re:Ask HN: Share your AI prompt that stumps every model by viraptor on Thursday April 24, 2025 @10:56PM (#43789708)
There's so much text on this already, it's unlikely to be even engaging any reasoning. Or specifically, if you got a few existing answers from philosophy mashed together, you wouldn't be able to tell it apart from reasoning anyway.
Re:Ask HN: Share your AI prompt that stumps every model by abc-1 on Thursday April 24, 2025 @09:08PM (#43789238)