News for hackers. Stuff that matters.

A comment on Show HN: Trailmarks – Huge, browser-based, Carmen Sandiego-style travel game.

Re:Show HN: Trailmarks – Huge, browser-based, Carmen Sandieg... by ArthurGallery on Tuesday April 22, 2025 @11:07PM (#43768311)
How did you create the questions? I get that they are AI generated but how do you avoid halluciniations? They seem solid enough.
[ Parent | on HN ]
Re:Show HN: Trailmarks – Huge, browser-based, Carmen Sandieg... by matsxmats on Tuesday April 22, 2025 @11:25PM (#43768378)
Thanks for asking! A few different things, and it's probably not perfect yet. But a few things:

+ I've worked on a quiz app for a year so I have a bit of a polished prompt + writing good example questions + letting the AI choose the quiz topics + double checking with a different LLM. So GPT 4.5 reviewed questions from Claude and so on.

I think the percentage of hallucinations are at the same level as something written entirely by humans now.

[ Parent | on HN ]